By type
[2021-06-04T01:20:06+00:00] INFO: Started chef-zero at chefzero://localhost:1 with repository at /app/jetty/chef-solo
One version per cookbook
[2021-06-04T01:20:06+00:00] INFO: Started chef-zero at chefzero://localhost:1 with repository at /app/jetty/chef-solo
One version per cookbook
[2021-06-04T01:20:06+00:00] INFO: Forking chef instance to converge...
[2021-06-04T01:20:06+00:00] INFO: Forking chef instance to converge...
Starting Chef Client, version 13.8.5[0m
[2021-06-04T01:20:06+00:00] INFO: *** Chef 13.8.5 ***
[2021-06-04T01:20:06+00:00] INFO: *** Chef 13.8.5 ***
[2021-06-04T01:20:06+00:00] INFO: Platform: x86_64-linux-musl
[2021-06-04T01:20:06+00:00] INFO: Platform: x86_64-linux-musl
[2021-06-04T01:20:06+00:00] INFO: Chef-client pid: 18
[2021-06-04T01:20:06+00:00] INFO: Chef-client pid: 18
[2021-06-04T01:20:06+00:00] INFO: The plugin path /etc/chef/ohai/plugins does not exist. Skipping...
[2021-06-04T01:20:06+00:00] INFO: The plugin path /etc/chef/ohai/plugins does not exist. Skipping...
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
[2021-06-04T01:20:08+00:00] INFO: Setting the run_list to ["role[catalog-be]"] from CLI options
[2021-06-04T01:20:08+00:00] INFO: Setting the run_list to ["role[catalog-be]"] from CLI options
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
[2021-06-04T01:20:08+00:00] INFO: Run List is [role[catalog-be]]
[2021-06-04T01:20:08+00:00] INFO: Run List is [role[catalog-be]]
[2021-06-04T01:20:08+00:00] INFO: Run List expands to [sdc-catalog-be::BE_1_cleanup_jettydir, sdc-catalog-be::BE_2_setup_configuration, sdc-catalog-be::BE_3_locate_keystore, sdc-catalog-be::BE_4_jetty_Modules, sdc-catalog-be::BE_6_setup_portal_and_key_properties, sdc-catalog-be::BE_7_logback, sdc-catalog-be::BE_8_errors_config, sdc-catalog-be::BE_9_prepareProbeFile, sdc-catalog-be::BE_10_setup_cadi]
[2021-06-04T01:20:08+00:00] INFO: Run List expands to [sdc-catalog-be::BE_1_cleanup_jettydir, sdc-catalog-be::BE_2_setup_configuration, sdc-catalog-be::BE_3_locate_keystore, sdc-catalog-be::BE_4_jetty_Modules, sdc-catalog-be::BE_6_setup_portal_and_key_properties, sdc-catalog-be::BE_7_logback, sdc-catalog-be::BE_8_errors_config, sdc-catalog-be::BE_9_prepareProbeFile, sdc-catalog-be::BE_10_setup_cadi]
[2021-06-04T01:20:08+00:00] INFO: Starting Chef Run for dev-sdc-be-5ddb77679c-fjvdd
[2021-06-04T01:20:08+00:00] INFO: Starting Chef Run for dev-sdc-be-5ddb77679c-fjvdd
[2021-06-04T01:20:08+00:00] INFO: Running start handlers
[2021-06-04T01:20:08+00:00] INFO: Running start handlers
[2021-06-04T01:20:08+00:00] INFO: Start handlers complete.
[2021-06-04T01:20:08+00:00] INFO: Start handlers complete.
resolving cookbooks for run list: ["sdc-catalog-be::BE_1_cleanup_jettydir", "sdc-catalog-be::BE_2_setup_configuration", "sdc-catalog-be::BE_3_locate_keystore", "sdc-catalog-be::BE_4_jetty_Modules", "sdc-catalog-be::BE_6_setup_portal_and_key_properties", "sdc-catalog-be::BE_7_logback", "sdc-catalog-be::BE_8_errors_config", "sdc-catalog-be::BE_9_prepareProbeFile", "sdc-catalog-be::BE_10_setup_cadi"][0m
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:287: warning: URI.escape is obsolete
[2021-06-04T01:20:08+00:00] INFO: Loading cookbooks [sdc-catalog-be@0.0.0]
[2021-06-04T01:20:08+00:00] INFO: Loading cookbooks [sdc-catalog-be@0.0.0]
Synchronizing Cookbooks:[0m
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/templates/default/BE-distribution-engine-configuration.yaml.erb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/attributes/default.rb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/attributes/default.rb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/templates/default/BE-distribution-engine-configuration.yaml.erb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/templates/default/BE-configuration.yaml.erb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/templates/default/BE-configuration.yaml.erb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/templates/default/BE-janusgraph.properties.erb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/templates/default/BE-janusgraph.properties.erb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/templates/default/cadi.properties.erb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/templates/default/cadi.properties.erb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/templates/default/BE-onboarding-configuration.yaml.erb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/templates/default/BE-onboarding-configuration.yaml.erb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/templates/default/https-ini.erb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/templates/default/https-ini.erb in the cache.
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/templates/default/http-ini.erb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/templates/default/http-ini.erb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/templates/default/BE-key.properties.erb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/templates/default/BE-key.properties.erb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/templates/default/BE-portal.properties.erb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/templates/default/BE-portal.properties.erb in the cache.
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/templates/default/ready-probe.sh.erb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/templates/default/ready-probe.sh.erb in the cache.
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/files/default/Artifact-Generator.properties in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/files/default/Artifact-Generator.properties in the cache.
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/files/default/ecomp-error-configuration.yaml in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/files/default/ecomp-error-configuration.yaml in the cache.
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/files/default/cadi.properties in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/files/default/cadi.properties in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/templates/default/ssl-ini.erb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/files/default/error-configuration.yaml in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/files/default/error-configuration.yaml in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/files/default/cadi_truststore.jks in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/files/default/cadi_truststore.jks in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/templates/default/ssl-ini.erb in the cache.
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/files/default/keyfile in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/files/default/keyfile in the cache.
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/files/default/logback.xml in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/files/default/org.onap.sdc.trust.jks in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/files/default/logback.xml in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/recipes/BE_10_setup_cadi.rb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/recipes/BE_10_setup_cadi.rb in the cache.
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/files/default/org.onap.sdc.trust.jks in the cache.
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/recipes/BE_2_setup_configuration.rb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/recipes/BE_2_setup_configuration.rb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/recipes/BE_1_cleanup_jettydir.rb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/recipes/BE_1_cleanup_jettydir.rb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/recipes/BE_4_jetty_Modules.rb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/recipes/BE_4_jetty_Modules.rb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/files/default/org.onap.sdc.p12 in the cache.
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/recipes/BE_3_locate_keystore.rb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/recipes/BE_3_locate_keystore.rb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/files/default/org.onap.sdc.p12 in the cache.
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/recipes/BE_5_setup_elasticsearch.rb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/recipes/BE_5_setup_elasticsearch.rb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/recipes/BE_6_setup_portal_and_key_properties.rb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/recipes/BE_6_setup_portal_and_key_properties.rb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/recipes/BE_7_logback.rb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/recipes/BE_7_logback.rb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/recipes/BE_8_errors_config.rb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/recipes/BE_9_prepareProbeFile.rb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/recipes/BE_8_errors_config.rb in the cache.
[2021-06-04T01:20:08+00:00] INFO: Storing updated cookbooks/sdc-catalog-be/recipes/BE_9_prepareProbeFile.rb in the cache.
- sdc-catalog-be (0.0.0)[0m
Installing Cookbook Gems:[0m
Compiling Cookbooks...[0m
Converging 23 resources[0m
Recipe: sdc-catalog-be::BE_1_cleanup_jettydir[0m
* directory[BE_tempdir_creation] action create[2021-06-04T01:20:08+00:00] INFO: directory[BE_tempdir_creation] created directory /app/jetty/temp
[2021-06-04T01:20:08+00:00] INFO: directory[BE_tempdir_creation] created directory /app/jetty/temp
[32m- create new directory /app/jetty/temp[0m[2021-06-04T01:20:08+00:00] INFO: directory[BE_tempdir_creation] owner changed to 1000
[2021-06-04T01:20:08+00:00] INFO: directory[BE_tempdir_creation] owner changed to 1000
[2021-06-04T01:20:08+00:00] INFO: directory[BE_tempdir_creation] mode changed to 755
[2021-06-04T01:20:08+00:00] INFO: directory[BE_tempdir_creation] mode changed to 755
[32m- change mode from '' to '0755'[0m
[32m- change owner from '' to 'onap'[0m
[0m * directory[BE_create_config_dir] action create[2021-06-04T01:20:08+00:00] INFO: directory[BE_create_config_dir] created directory /app/jetty/config
[2021-06-04T01:20:08+00:00] INFO: directory[BE_create_config_dir] created directory /app/jetty/config
[32m- create new directory /app/jetty/config[0m[2021-06-04T01:20:08+00:00] INFO: directory[BE_create_config_dir] owner changed to 1000
[2021-06-04T01:20:08+00:00] INFO: directory[BE_create_config_dir] owner changed to 1000
[2021-06-04T01:20:08+00:00] INFO: directory[BE_create_config_dir] mode changed to 755
[2021-06-04T01:20:08+00:00] INFO: directory[BE_create_config_dir] mode changed to 755
[32m- change mode from '' to '0755'[0m
[32m- change owner from '' to 'onap'[0m
[0m * directory[BE_create_catalog-be] action create[2021-06-04T01:20:08+00:00] INFO: directory[BE_create_catalog-be] created directory /app/jetty/config/catalog-be
[2021-06-04T01:20:08+00:00] INFO: directory[BE_create_catalog-be] created directory /app/jetty/config/catalog-be
[32m- create new directory /app/jetty/config/catalog-be[0m[2021-06-04T01:20:08+00:00] INFO: directory[BE_create_catalog-be] owner changed to 1000
[2021-06-04T01:20:08+00:00] INFO: directory[BE_create_catalog-be] owner changed to 1000
[2021-06-04T01:20:08+00:00] INFO: directory[BE_create_catalog-be] mode changed to 755
[2021-06-04T01:20:08+00:00] INFO: directory[BE_create_catalog-be] mode changed to 755
[32m- change mode from '' to '0755'[0m
[32m- change owner from '' to 'onap'[0m
[0mRecipe: sdc-catalog-be::BE_2_setup_configuration[0m
* template[janusgraph.properties] action create_if_missing[2021-06-04T01:20:08+00:00] INFO: template[janusgraph.properties] created file /app/jetty/config/catalog-be/janusgraph.properties
[2021-06-04T01:20:08+00:00] INFO: template[janusgraph.properties] created file /app/jetty/config/catalog-be/janusgraph.properties
[32m- create new file /app/jetty/config/catalog-be/janusgraph.properties[0m[2021-06-04T01:20:08+00:00] INFO: template[janusgraph.properties] updated file contents /app/jetty/config/catalog-be/janusgraph.properties
[2021-06-04T01:20:08+00:00] INFO: template[janusgraph.properties] updated file contents /app/jetty/config/catalog-be/janusgraph.properties
[32m- update content in file /app/jetty/config/catalog-be/janusgraph.properties from none to 18f7e5[0m
[37m--- /app/jetty/config/catalog-be/janusgraph.properties 2021-06-04 01:20:08.373604070 +0000[0m
[37m+++ /app/jetty/config/catalog-be/.chef-janusgraph20210604-18-m16vkg.properties 2021-06-04 01:20:08.373604070 +0000[0m
[37m@@ -1,27 +1,54 @@[0m
[37m+storage.backend=cql[0m
[37m+storage.hostname=cassandra.onap[0m
[37m+storage.port=9042[0m
[37m+storage.username=asdc_user[0m
[37m+storage.password=Aa1234%^![0m
[37m+storage.connection-timeout=10000[0m
[37m+storage.cql.keyspace=sdctitan[0m
[37m+[0m
[37m+storage.cql.ssl.enabled=false[0m
[37m+storage.cql.ssl.truststore.location=[0m
[37m+storage.cql.ssl.truststore.password=Aa123456[0m
[37m+[0m
[37m+storage.cql.read-consistency-level=LOCAL_QUORUM[0m
[37m+storage.cql.write-consistency-level=LOCAL_QUORUM[0m
[37m+storage.cql.replication-strategy-class=NetworkTopologyStrategy[0m
[37m+storage.cql.replication-strategy-options=Pod,3[0m
[37m+storage.cql.local-datacenter=Pod[0m
[37m+[0m
[37m+[0m
[37m+cache.db-cache = false[0m
[37m+cache.db-cache-clean-wait = 20[0m
[37m+cache.db-cache-time = 180000[0m
[37m+cache.db-cache-size = 0.5[0m
[37m+[0m
[37m+cache.tx-cache-size = 1000000[0m
[37m+[0m
[37m+storage.lock.retries=5[0m[2021-06-04T01:20:08+00:00] INFO: template[janusgraph.properties] owner changed to 1000
[2021-06-04T01:20:08+00:00] INFO: template[janusgraph.properties] owner changed to 1000
[2021-06-04T01:20:08+00:00] INFO: template[janusgraph.properties] group changed to 101
[2021-06-04T01:20:08+00:00] INFO: template[janusgraph.properties] group changed to 101
[2021-06-04T01:20:08+00:00] INFO: template[janusgraph.properties] mode changed to 644
[2021-06-04T01:20:08+00:00] INFO: template[janusgraph.properties] mode changed to 644
[32m- change mode from '' to '0644'[0m
[32m- change owner from '' to 'onap'[0m
[32m- change group from '' to 'onap'[0m
[0m * template[catalog-be-config] action create_if_missing[2021-06-04T01:20:08+00:00] INFO: template[catalog-be-config] created file /app/jetty/config/catalog-be/configuration.yaml
[2021-06-04T01:20:08+00:00] INFO: template[catalog-be-config] created file /app/jetty/config/catalog-be/configuration.yaml
[32m- create new file /app/jetty/config/catalog-be/configuration.yaml[0m[2021-06-04T01:20:08+00:00] INFO: template[catalog-be-config] updated file contents /app/jetty/config/catalog-be/configuration.yaml
[2021-06-04T01:20:08+00:00] INFO: template[catalog-be-config] updated file contents /app/jetty/config/catalog-be/configuration.yaml
[32m- update content in file /app/jetty/config/catalog-be/configuration.yaml from none to 282ea0[0m
[37m--- /app/jetty/config/catalog-be/configuration.yaml 2021-06-04 01:20:08.389604146 +0000[0m
[37m+++ /app/jetty/config/catalog-be/.chef-configuration20210604-18-1bct76m.yaml 2021-06-04 01:20:08.389604146 +0000[0m
[37m@@ -1,1243 +1,2486 @@[0m
[37m+identificationHeaderFields:[0m
[37m+ - HTTP_IV_USER[0m
[37m+ - HTTP_CSP_FIRSTNAME[0m
[37m+ - HTTP_CSP_LASTNAME[0m
[37m+ - HTTP_IV_REMOTE_ADDRESS[0m
[37m+ - HTTP_CSP_WSTYPE[0m
[37m+[0m
[37m+# catalog backend hostname[0m
[37m+beFqdn: sdc-be.onap[0m
[37m+[0m
[37m+# catalog backend http port[0m
[37m+beHttpPort: 8080[0m
[37m+[0m
[37m+# catalog backend http context[0m
[37m+beContext: /sdc/rest/config/get[0m
[37m+[0m
[37m+# catalog backend protocol[0m
[37m+beProtocol: https[0m
[37m+[0m
[37m+# catalog backend ssl port[0m
[37m+beSslPort: 8443[0m
[37m+version: 1.1.0[0m
[37m+released: 2012-11-30[0m
[37m+toscaConformanceLevel: 11.0[0m
[37m+minToscaConformanceLevel: 3.0[0m
[37m+[0m
[37m+janusGraphCfgFile: /app/jetty/config/catalog-be/janusgraph.properties[0m
[37m+janusGraphInMemoryGraph: false[0m
[37m+janusGraphLockTimeout: 1800[0m
[37m+# The interval to try and reconnect to JanusGraph DB when it is down during ASDC startup:[0m
[37m+janusGraphReconnectIntervalInSeconds: 3[0m
[37m+[0m
[37m+# The read timeout towards JanusGraph DB when health check is invoked:[0m
[37m+janusGraphHealthCheckReadTimeout: 1[0m
[37m+[0m
[37m+# The interval to try and reconnect to Elasticsearch when it is down during ASDC startup:[0m
[37m+[0m
[37m+uebHealthCheckReconnectIntervalInSeconds: 15[0m
[37m+uebHealthCheckReadTimeout: 4[0m
[37m+[0m
[37m+# Protocols[0m
[37m+protocols:[0m
[37m+ - http[0m
[37m+ - https[0m
[37m+[0m
[37m+# Default imports[0m
[37m+defaultImports:[0m
[37m+ - nodes:[0m
[37m+ file: nodes.yml[0m
[37m+ - datatypes:[0m
[37m+ file: data.yml[0m
[37m+ - capabilities:[0m
[37m+ file: capabilities.yml[0m
[37m+ - relationships:[0m
[37m+ file: relationships.yml[0m
[37m+ - groups:[0m
[37m+ file: groups.yml[0m
[37m+ - policies:[0m
[37m+ file: policies.yml[0m
[37m+ - annotations:[0m
[37m+ file: annotations.yml[0m
[37m+[0m
[37m+# Global CSAR Import Files[0m
[37m+globalCsarImports:[0m
[37m+ - annotations.yml[0m
[37m+ - artifacts.yml[0m
[37m+ - capabilities.yml[0m
[37m+ - data.yml[0m
[37m+ - groups.yml[0m
[37m+ - interfaces.yml[0m
[37m+ - nodes.yml[0m
[37m+ - policies.yml[0m
[37m+ - relationships.yml[0m
[37m+[0m
[37m+# Users[0m
[37m+users:[0m
[37m+ tom: passwd[0m
[37m+ bob: passwd[0m
[37m+[0m
[37m+# access restriction[0m
[37m+authCookie:[0m
[37m+ securityKey: "sdcaccessrestrictionsecureykey"[0m
[37m+ maxSessionTimeOut: 86400000[0m
[37m+ sessionIdleTimeOut: 3600000[0m
[37m+ cookieName: "AuthenticationCookie"[0m
[37m+ path: /[0m
[37m+ domain: ""[0m
[37m+ isHttpOnly: true[0m
[37m+ # redirect variable name from portal.properties file[0m
[37m+ redirectURL: ""[0m
[37m+ excludedUrls: ['/.*'][0m
[37m+ onboardingExcludedUrls: ['/.*'][0m
[37m+[0m
[37m+basicAuth:[0m
[37m+ enabled: false[0m
[37m+ userName: testName[0m
[37m+ userPass: testPass[0m
[37m+ excludedUrls: "/sdc2/rest/healthCheck"[0m
[37m+[0m
[37m+cassandraConfig:[0m
[37m+ cassandraHosts: [cassandra.onap][0m
[37m+ cassandraPort: 9042[0m
[37m+ localDataCenter: Pod[0m
[37m+ reconnectTimeout : 30000[0m
[37m+ socketReadTimeout: 20000[0m
[37m+ socketConnectTimeout: 20000[0m
[37m+ authenticate: true[0m
[37m+ username: asdc_user[0m
[37m+ password: Aa1234%^![0m
[37m+ ssl: false[0m
[37m+ truststorePath : /app/jetty/etc/truststore[0m
[37m+ truststorePassword : Aa123456[0m
[37m+ keySpaces:[0m
[37m+ - { name: dox, replicationStrategy: NetworkTopologyStrategy, replicationInfo: ['Pod','3']}[0m
[37m+ - { name: sdcaudit, replicationStrategy: NetworkTopologyStrategy, replicationInfo: ['Pod','3']}[0m
[37m+ - { name: sdcartifact, replicationStrategy: NetworkTopologyStrategy, replicationInfo: ['Pod','3']}[0m
[37m+ - { name: sdccomponent, replicationStrategy: NetworkTopologyStrategy, replicationInfo: ['Pod','3']}[0m
[37m+ - { name: sdcrepository, replicationStrategy: NetworkTopologyStrategy, replicationInfo: ['Pod','3']}[0m
[37m+[0m
[37m+[0m
[37m+licenseTypes:[0m
[37m+ - User[0m
[37m+ - Installation[0m
[37m+ - CPU[0m
[37m+[0m
[37m+#Deployment artifacts placeHolder[0m
[37m+resourceTypes: &allResourceTypes[0m
[37m+ - VFC[0m
[37m+ - CP[0m
[37m+ - VL[0m
[37m+ - VF[0m
[37m+ - CR[0m
[37m+ - VFCMT[0m
[37m+ - Abstract[0m
[37m+ - CVFC[0m
[37m+ - Configuration[0m
[37m+ - ServiceProxy[0m
[37m+ - PNF[0m
[37m+[0m
[37m+componentAllowedInstanceTypes:[0m
[37m+ Resource:[0m
[37m+ VF:[0m
[37m+ - VFC[0m
[37m+ - VF[0m
[37m+ - CR[0m
[37m+ - CP[0m
[37m+ - PNF[0m
[37m+ - CVFC[0m
[37m+ - VL[0m
[37m+ - Configuration[0m
[37m+ - ServiceProxy[0m
[37m+ - Abstract[0m
[37m+ CVFC:[0m
[37m+ - VFC[0m
[37m+ - VF[0m
[37m+ - CR[0m
[37m+ - CP[0m
[37m+ - PNF[0m
[37m+ - CVFC[0m
[37m+ - VL[0m
[37m+ - ServiceProxy[0m
[37m+ - Abstract[0m
[37m+ PNF:[0m
[37m+ - VF[0m
[37m+ - CR[0m
[37m+ - CP[0m
[37m+ - PNF[0m
[37m+ - CVFC[0m
[37m+ - VL[0m
[37m+ - Configuration[0m
[37m+ - ServiceProxy[0m
[37m+ - Abstract[0m
[37m+ CR:[0m
[37m+ - VF[0m
[37m+ - CR[0m
[37m+ - CP[0m
[37m+ - PNF[0m
[37m+ - CVFC[0m
[37m+ - VL[0m
[37m+ - Configuration[0m
[37m+ - ServiceProxy[0m
[37m+ - Abstract[0m
[37m+ VL:[0m
[37m+ - VL[0m
[37m+ Service:[0m
[37m+ "*":[0m
[37m+ - VF[0m
[37m+ - CR[0m
[37m+ - CP[0m
[37m+ - PNF[0m
[37m+ - CVFC[0m
[37m+ - VL[0m
[37m+ - Configuration[0m
[37m+ - ServiceProxy[0m
[37m+ - Abstract[0m
[37m+[0m
[37m+artifacts:[0m
[37m+ - type: CONTROLLER_BLUEPRINT_ARCHIVE[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - SERVICE[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes:[0m
[37m+ - VF[0m
[37m+ - PNF[0m
[37m+ acceptedTypes:[0m
[37m+ - zip[0m
[37m+ - type: HELM[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - SERVICE[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes: *allResourceTypes[0m
[37m+ acceptedTypes:[0m
[37m+ - tgz[0m
[37m+ - type: YANG_XML[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ - INFORMATIONAL[0m
[37m+ componentTypes:[0m
[37m+ - SERVICE[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes: *allResourceTypes[0m
[37m+ acceptedTypes:[0m
[37m+ - xml[0m
[37m+ - type: VNF_CATALOG[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - SERVICE[0m
[37m+ resourceTypes:[0m
[37m+ acceptedTypes:[0m
[37m+ - xml[0m
[37m+ - type: MODEL_INVENTORY_PROFILE[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - SERVICE[0m
[37m+ resourceTypes:[0m
[37m+ acceptedTypes:[0m
[37m+ - xml[0m
[37m+ - type: MODEL_QUERY_SPEC[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - SERVICE[0m
[37m+ resourceTypes:[0m
[37m+ acceptedTypes:[0m
[37m+ - xml[0m
[37m+ - type: UCPE_LAYER_2_CONFIGURATION[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - SERVICE[0m
[37m+ resourceTypes:[0m
[37m+ acceptedTypes:[0m
[37m+ - xml[0m
[37m+ #AAI Artifacts[0m
[37m+ - type: AAI_SERVICE_MODEL[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - SERVICE[0m
[37m+ resourceTypes:[0m
[37m+ acceptedTypes:[0m
[37m+ - xml[0m
[37m+ - type: AAI_VF_MODULE_MODEL[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - SERVICE[0m
[37m+ resourceTypes:[0m
[37m+ acceptedTypes:[0m
[37m+ - xml[0m
[37m+ - type: AAI_VF_INSTANCE_MODEL[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - SERVICE[0m
[37m+ resourceTypes:[0m
[37m+ acceptedTypes:[0m
[37m+ - xml[0m
[37m+ #Plan[0m
[37m+ - type: PLAN[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - SERVICE[0m
[37m+ - RESOURCE[0m
[37m+ - RESOURCE_INSTANCE[0m
[37m+ resourceTypes:[0m
[37m+ - VF[0m
[37m+ - VFC[0m
[37m+ acceptedTypes:[0m
[37m+ - xml[0m
[37m+ - type: WORKFLOW[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - SERVICE[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes:[0m
[37m+ - VFC[0m
[37m+ - CP[0m
[37m+ - VL[0m
[37m+ - VF[0m
[37m+ - CR[0m
[37m+ - VFCMT[0m
[37m+ - Abstract[0m
[37m+ - CVFC[0m
[37m+ - PNF[0m
[37m+ acceptedTypes:[0m
[37m+ - type: HEAT[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ - INFORMATIONAL[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes: *allResourceTypes[0m
[37m+ acceptedTypes:[0m
[37m+ - yaml[0m
[37m+ - yml[0m
[37m+ - type: HEAT_VOL[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes: *allResourceTypes[0m
[37m+ acceptedTypes:[0m
[37m+ - yaml[0m
[37m+ - yml[0m
[37m+ - type: HEAT_NET[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes: *allResourceTypes[0m
[37m+ acceptedTypes:[0m
[37m+ - yaml[0m
[37m+ - yml[0m
[37m+ - type: HEAT_NESTED[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes: *allResourceTypes[0m
[37m+ acceptedTypes:[0m
[37m+ - yaml[0m
[37m+ - yml[0m
[37m+ - type: HEAT_ARTIFACT[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes: *allResourceTypes[0m
[37m+ acceptedTypes:[0m
[37m+ - type: CLOUD_TECHNOLOGY_SPECIFIC_ARTIFACT[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes: *allResourceTypes[0m
[37m+ acceptedTypes:[0m
[37m+ - zip[0m
[37m+ - tgz[0m
[37m+ - csar[0m
[37m+ - type: VNF_CATALOG[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes: *allResourceTypes[0m
[37m+ acceptedTypes:[0m
[37m+ - xml[0m
[37m+ - type: VF_LICENSE[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes: *allResourceTypes[0m
[37m+ acceptedTypes:[0m
[37m+ - xml[0m
[37m+ - type: VENDOR_LICENSE[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes: *allResourceTypes[0m
[37m+ acceptedTypes:[0m
[37m+ - xml[0m
[37m+ - type: MODEL_INVENTORY_PROFILE[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes: *allResourceTypes[0m
[37m+ acceptedTypes:[0m
[37m+ - xml[0m
[37m+ - type: MODEL_QUERY_SPEC[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes: *allResourceTypes[0m
[37m+ acceptedTypes:[0m
[37m+ - xml[0m
[37m+ - type: LIFECYCLE_OPERATIONS[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes:[0m
[37m+ - VF[0m
[37m+ - VFC[0m
[37m+ acceptedTypes:[0m
[37m+ - yaml[0m
[37m+ - yml[0m
[37m+ - type: VES_EVENTS[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ - RESOURCE_INSTANCE[0m
[37m+ resourceTypes:[0m
[37m+ - VFC[0m
[37m+ - CP[0m
[37m+ - VL[0m
[37m+ - VF[0m
[37m+ - CR[0m
[37m+ - VFCMT[0m
[37m+ - Abstract[0m
[37m+ - CVFC[0m
[37m+ - PNF[0m
[37m+ acceptedTypes:[0m
[37m+ - yaml[0m
[37m+ - yml[0m
[37m+ - type: PERFORMANCE_COUNTER[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ - RESOURCE_INSTANCE[0m
[37m+ resourceTypes: *allResourceTypes[0m
[37m+ acceptedTypes:[0m
[37m+ - csv[0m
[37m+ - type: APPC_CONFIG[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes:[0m
[37m+ - VF[0m
[37m+ acceptedTypes:[0m
[37m+ - type: DCAE_TOSCA[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes:[0m
[37m+ - VF[0m
[37m+ - VFCMT[0m
[37m+ acceptedTypes:[0m
[37m+ - yml[0m
[37m+ - yaml[0m
[37m+ - type: DCAE_JSON[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes:[0m
[37m+ - VF[0m
[37m+ - VFCMT[0m
[37m+ acceptedTypes:[0m
[37m+ - json[0m
[37m+ - type: DCAE_POLICY[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes:[0m
[37m+ - VF[0m
[37m+ - VFCMT[0m
[37m+ acceptedTypes:[0m
[37m+ - emf[0m
[37m+ - type: DCAE_DOC[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes:[0m
[37m+ - VF[0m
[37m+ - VFCMT[0m
[37m+ acceptedTypes:[0m
[37m+ - type: DCAE_EVENT[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes:[0m
[37m+ - VF[0m
[37m+ - VFCMT[0m
[37m+ acceptedTypes:[0m
[37m+ - type: AAI_VF_MODEL[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes:[0m
[37m+ - VF[0m
[37m+ acceptedTypes:[0m
[37m+ - xml[0m
[37m+ - type: AAI_VF_MODULE_MODEL[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes:[0m
[37m+ - VF[0m
[37m+ acceptedTypes:[0m
[37m+ - xml[0m
[37m+ - type: OTHER[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ - INFORMATIONAL[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes:[0m
[37m+ - VFC[0m
[37m+ - CVFC[0m
[37m+ - CP[0m
[37m+ - VL[0m
[37m+ - VF[0m
[37m+ - VFCMT[0m
[37m+ - Abstract[0m
[37m+ - PNF[0m
[37m+ acceptedTypes:[0m
[37m+ - type: SNMP_POLL[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ - INFORMATIONAL[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ - RESOURCE_INSTANCE[0m
[37m+ resourceTypes: *allResourceTypes[0m
[37m+ acceptedTypes:[0m
[37m+ - type: SNMP_TRAP[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ - INFORMATIONAL[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ - RESOURCE_INSTANCE[0m
[37m+ resourceTypes: *allResourceTypes[0m
[37m+ acceptedTypes:[0m
[37m+ - type: PM_DICTIONARY[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes:[0m
[37m+ - VF[0m
[37m+ - PNF[0m
[37m+ acceptedTypes:[0m
[37m+ - yaml[0m
[37m+ - yml[0m
[37m+ - type: YANG_MODULE[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes:[0m
[37m+ - VF[0m
[37m+ - PNF[0m
[37m+ acceptedTypes:[0m
[37m+ - yang[0m
[37m+ - type: ANSIBLE_PLAYBOOK[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes:[0m
[37m+ - VF[0m
[37m+ - PNF[0m
[37m+ acceptedTypes:[0m
[37m+ - yaml[0m
[37m+ - yml[0m
[37m+ - type: ONBOARDED_PACKAGE[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes:[0m
[37m+ - VF[0m
[37m+ - PNF[0m
[37m+ acceptedTypes:[0m
[37m+ - csar[0m
[37m+ - zip[0m
[37m+ - type: ETSI_PACKAGE[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes:[0m
[37m+ - VF[0m
[37m+ - PNF[0m
[37m+ acceptedTypes:[0m
[37m+ - csar[0m
[37m+ - zip[0m
[37m+ - type: HEAT_ENV[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE_INSTANCE[0m
[37m+ resourceTypes:[0m
[37m+ acceptedTypes:[0m
[37m+ - env[0m
[37m+ - type: VF_MODULES_METADATA[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE_INSTANCE[0m
[37m+ resourceTypes:[0m
[37m+ acceptedTypes:[0m
[37m+ - json[0m
[37m+ - type: DCAE_INVENTORY_TOSCA[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE_INSTANCE[0m
[37m+ resourceTypes:[0m
[37m+ acceptedTypes:[0m
[37m+ - yml[0m
[37m+ - yaml[0m
[37m+ - type: DCAE_INVENTORY_JSON[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE_INSTANCE[0m
[37m+ resourceTypes:[0m
[37m+ acceptedTypes:[0m
[37m+ - json[0m
[37m+ - type: DCAE_INVENTORY_POLICY[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE_INSTANCE[0m
[37m+ resourceTypes:[0m
[37m+ acceptedTypes:[0m
[37m+ - emf[0m
[37m+ - type: DCAE_INVENTORY_DOC[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE_INSTANCE[0m
[37m+ resourceTypes:[0m
[37m+ acceptedTypes:[0m
[37m+ - type: DCAE_INVENTORY_BLUEPRINT[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE_INSTANCE[0m
[37m+ resourceTypes:[0m
[37m+ acceptedTypes:[0m
[37m+ - type: DCAE_INVENTORY_EVENT[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE_INSTANCE[0m
[37m+ resourceTypes:[0m
[37m+ acceptedTypes:[0m
[37m+ - type: CHEF[0m
[37m+ categories:[0m
[37m+ - INFORMATIONAL[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes: *allResourceTypes[0m
[37m+ acceptedTypes:[0m
[37m+ - type: PUPPET[0m
[37m+ categories:[0m
[37m+ - INFORMATIONAL[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes: *allResourceTypes[0m
[37m+ acceptedTypes:[0m
[37m+ - type: SHELL[0m
[37m+ categories:[0m
[37m+ - INFORMATIONAL[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes: *allResourceTypes[0m
[37m+ acceptedTypes:[0m
[37m+ - type: YANG[0m
[37m+ categories:[0m
[37m+ - INFORMATIONAL[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes: *allResourceTypes[0m
[37m+ acceptedTypes:[0m
[37m+ - type: BPEL[0m
[37m+ categories:[0m
[37m+ - INFORMATIONAL[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes: *allResourceTypes[0m
[37m+ acceptedTypes:[0m
[37m+ - type: DG_XML[0m
[37m+ categories:[0m
[37m+ - INFORMATIONAL[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes: *allResourceTypes[0m
[37m+ acceptedTypes:[0m
[37m+ - type: MURANO_PKG[0m
[37m+ categories:[0m
[37m+ - INFORMATIONAL[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes: *allResourceTypes[0m
[37m+ acceptedTypes:[0m
[37m+ - type: PNF_SW_INFORMATION[0m
[37m+ categories:[0m
[37m+ - INFORMATIONAL[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes:[0m
[37m+ - PNF[0m
[37m+ acceptedTypes:[0m
[37m+ - yaml[0m
[37m+ - yml[0m
[37m+ - type: GUIDE[0m
[37m+ categories:[0m
[37m+ - INFORMATIONAL[0m
[37m+ componentTypes:[0m
[37m+ - RESOURCE[0m
[37m+ resourceTypes:[0m
[37m+ - VF[0m
[37m+ - VFC[0m
[37m+ - CVFC[0m
[37m+ - PNF[0m
[37m+ acceptedTypes:[0m
[37m+ - yaml[0m
[37m+ - yml[0m
[37m+ - type: FLOW[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - SERVICE[0m
[37m+ resourceTypes: *allResourceTypes[0m
[37m+ acceptedTypes:[0m
[37m+ - type: SHELL_SCRIPT[0m
[37m+ categories:[0m
[37m+ - DEPLOYMENT[0m
[37m+ componentTypes:[0m
[37m+ - SERVICE[0m
[37m+ - SERVICE_INSTANCE[0m
[37m+ - RESOURCE[0m
[37m+ - RESOURCE_INSTANCE[0m
[37m+ resourceTypes: *allResourceTypes[0m
[37m+ acceptedTypes:[0m
[37m+ - sh[0m
[37m+ - type: TOSCA_CSAR[0m
[37m+ categories:[0m
[37m+ - TOSCA[0m
[37m+ componentTypes:[0m
[37m+ resourceTypes:[0m
[37m+ acceptedTypes:[0m
[37m+ - csar[0m
[37m+ - type: TOSCA_TEMPLATE[0m
[37m+ categories:[0m
[37m+ - TOSCA[0m
[37m+ componentTypes:[0m
[37m+ resourceTypes:[0m
[37m+ acceptedTypes:[0m
[37m+ - yml[0m
[37m+ - yaml[0m
[37m+ - type: NETWORK_CALL_FLOW[0m
[37m+ categories:[0m
[37m+ componentTypes:[0m
[37m+ resourceTypes:[0m
[37m+ acceptedTypes:[0m
[37m+ - type: ICON[0m
[37m+ categories:[0m
[37m+ componentTypes:[0m
[37m+ resourceTypes:[0m
[37m+ acceptedTypes:[0m
[37m+[0m
[37m+deploymentResourceArtifacts:[0m
[37m+[0m
[37m+deploymentResourceInstanceArtifacts:[0m
[37m+ heatEnv:[0m
[37m+ displayName: "HEAT ENV"[0m
[37m+ type: HEAT_ENV[0m
[37m+ description: "Auto-generated HEAT Environment deployment artifact"[0m
[37m+ fileExtension: "env"[0m
[37m+ VfHeatEnv:[0m
[37m+ displayName: "VF HEAT ENV"[0m
[37m+ type: HEAT_ENV[0m
[37m+ description: "VF Auto-generated HEAT Environment deployment artifact"[0m
[37m+ fileExtension: "env"[0m
[37m+[0m
[37m+#tosca artifacts placeholders[0m
[37m+toscaArtifacts:[0m
[37m+ assetToscaTemplate:[0m
[37m+ artifactName: -template.yml[0m
[37m+ displayName: Tosca Template[0m
[37m+ type: TOSCA_TEMPLATE[0m
[37m+ description: TOSCA representation of the asset[0m
[37m+ assetToscaCsar:[0m
[37m+ artifactName: -csar.csar[0m
[37m+ displayName: Tosca Model[0m
[37m+ type: TOSCA_CSAR[0m
[37m+ description: TOSCA definition package of the asset[0m
[37m+[0m
[37m+#Informational artifacts placeHolder[0m
[37m+excludeResourceCategory:[0m
[37m+ - Generic[0m
[37m+excludeResourceType:[0m
[37m+ - PNF[0m
[37m+ - CR[0m
[37m+informationalResourceArtifacts:[0m
[37m+ features:[0m
[37m+ displayName: Features[0m
[37m+ type: OTHER[0m
[37m+ capacity:[0m
[37m+ displayName: Capacity[0m
[37m+ type: OTHER[0m
[37m+ vendorTestResult:[0m
[37m+ displayName: Vendor Test Result[0m
[37m+ type: OTHER[0m
[37m+ testScripts:[0m
[37m+ displayName: Test Scripts[0m
[37m+ type: OTHER[0m
[37m+ CloudQuestionnaire:[0m
[37m+ displayName: Cloud Questionnaire (completed)[0m
[37m+ type: OTHER[0m
[37m+ HEATTemplateFromVendor:[0m
[37m+ displayName: HEAT Template from Vendor[0m
[37m+ type: HEAT[0m
[37m+ resourceSecurityTemplate:[0m
[37m+ displayName: Resource Security Template[0m
[37m+ type: OTHER[0m
[37m+[0m
[37m+excludeServiceCategory:[0m
[37m+[0m
[37m+informationalServiceArtifacts:[0m
[37m+ serviceArtifactPlan:[0m
[37m+ displayName: Service Artifact Plan[0m
[37m+ type: OTHER[0m
[37m+ summaryOfImpactsToECOMPElements:[0m
[37m+ displayName: Summary of impacts to ECOMP elements,OSSs, BSSs[0m
[37m+ type: OTHER[0m
[37m+ controlLoopFunctions:[0m
[37m+ displayName: Control Loop Functions[0m
[37m+ type: OTHER[0m
[37m+ dimensioningInfo:[0m
[37m+ displayName: Dimensioning Info[0m
[37m+ type: OTHER[0m
[37m+ affinityRules:[0m
[37m+ displayName: Affinity Rules[0m
[37m+ type: OTHER[0m
[37m+ operationalPolicies:[0m
[37m+ displayName: Operational Policies[0m
[37m+ type: OTHER[0m
[37m+ serviceSpecificPolicies:[0m
[37m+ displayName: Service-specific Policies[0m
[37m+ type: OTHER[0m
[37m+ engineeringRules:[0m
[37m+ displayName: Engineering Rules (ERD)[0m
[37m+ type: OTHER[0m
[37m+ distributionInstructions:[0m
[37m+ displayName: Distribution Instructions[0m
[37m+ type: OTHER[0m
[37m+ certificationTestResults:[0m
[37m+ displayName: TD Certification Test Results[0m
[37m+ type: OTHER[0m
[37m+ deploymentVotingRecord:[0m
[37m+ displayName: Deployment Voting Record[0m
[37m+ type: OTHER[0m
[37m+ serviceQuestionnaire:[0m
[37m+ displayName: Service Questionnaire[0m
[37m+ type: OTHER[0m
[37m+ serviceSecurityTemplate:[0m
[37m+ displayName: Service Security Template[0m
[37m+ type: OTHER[0m
[37m+[0m
[37m+serviceApiArtifacts:[0m
[37m+ configuration:[0m
[37m+ displayName: Configuration[0m
[37m+ type: OTHER[0m
[37m+ instantiation:[0m
[37m+ displayName: Instantiation[0m
[37m+ type: OTHER[0m
[37m+ monitoring:[0m
[37m+ displayName: Monitoring[0m
[37m+ type: OTHER[0m
[37m+ reporting:[0m
[37m+ displayName: Reporting[0m
[37m+ type: OTHER[0m
[37m+ logging:[0m
[37m+ displayName: Logging[0m
[37m+ type: OTHER[0m
[37m+ testing:[0m
[37m+ displayName: Testing[0m
[37m+ type: OTHER[0m
[37m+[0m
[37m+[0m
[37m+additionalInformationMaxNumberOfKeys: 50[0m
[37m+[0m
[37m+systemMonitoring:[0m
[37m+ enabled: false[0m
[37m+ isProxy: false[0m
[37m+ probeIntervalInSeconds: 15[0m
[37m+heatArtifactDeploymentTimeout:[0m
[37m+ defaultMinutes: 30[0m
[37m+ minMinutes: 1[0m
[37m+ maxMinutes: 120[0m
[37m+[0m
[37m+unLoggedUrls:[0m
[37m+ - /sdc2/rest/monitoring[0m
[37m+ - /sdc2/rest/healthCheck[0m
[37m+[0m
[37m+cleanComponentsConfiguration:[0m
[37m+ cleanIntervalInMinutes: 1440[0m
[37m+ componentsToClean:[0m
[37m+ - Resource[0m
[37m+ - Service[0m
[37m+[0m
[37m+artifactsIndex: resources[0m
[37m+[0m
[37m+heatEnvArtifactHeader: ""[0m
[37m+heatEnvArtifactFooter: ""[0m
[37m+[0m
[37m+onboarding:[0m
[37m+ host: sdc-onboarding-be.onap[0m
[37m+ protocol: https[0m
[37m+ port: 8445[0m
[37m+ downloadCsarUri: "/onboarding-api/v1.0/vendor-software-products/packages"[0m
[37m+ healthCheckUri: "/onboarding-api/v1.0/healthcheck"[0m
[37m+[0m
[37m+# #GSS IDNS[0m
[37m+switchoverDetector:[0m
[37m+ gBeFqdn:[0m
[37m+ gFeFqdn:[0m
[37m+ beVip: 1.2.3.4[0m
[37m+ feVip: 1.2.3.4[0m
[37m+ beResolveAttempts: 3[0m
[37m+ feResolveAttempts: 3[0m
[37m+ enabled: false[0m
[37m+ interval: 60[0m
[37m+ changePriorityUser: ecompasdc[0m
[37m+ changePriorityPassword: ecompasdc123[0m
[37m+ publishNetworkUrl:[0m
[37m+ publishNetworkBody: '{"note":"comment"}'[0m
[37m+ groups:[0m
[37m+ beSet: { changePriorityUrl: "", changePriorityBody: '{"name":"","uri":"","no_ad_redirection":false,"v4groups":{"failover_groups":["","","failover_policy":["FAILALL"]},"comment":"","intended_app_proto":"DNS"}'}[0m
[37m+ feSet: { changePriorityUrl: "", changePriorityBody: '{"name":"","uri":"","no_ad_redirection":false,"v4groups":{"failover_groups":["",""],"failover_policy":["FAILALL"]},"comment":"","intended_app_proto":"DNS"}'}[0m
[37m+[0m
[37m+applicationL1Cache:[0m
[37m+ datatypes:[0m
[37m+ enabled: true[0m
[37m+ firstRunDelay: 10[0m
[37m+ pollIntervalInSec: 60[0m
[37m+[0m
[37m+applicationL2Cache:[0m
[37m+ enabled: false[0m
[37m+ catalogL1Cache:[0m
[37m+ enabled: false[0m
[37m+ resourcesSizeInCache: 300[0m
[37m+ servicesSizeInCache: 200[0m
[37m+ productsSizeInCache: 100[0m
[37m+ queue:[0m
[37m+ syncIntervalInSecondes: 43200[0m
[37m+ waitOnShutDownInMinutes: 10[0m
[37m+ numberOfCacheWorkers: 4[0m
[37m+[0m
[37m+toscaValidators:[0m
[37m+ stringMaxLength: 2500[0m
[37m+[0m
[37m+disableAudit: false[0m
[37m+[0m
[37m+consumerBusinessLogic: true[0m
[37m+[0m
[37m+vfModuleProperties:[0m
[37m+ min_vf_module_instances:[0m
[37m+ forBaseModule: 1[0m
[37m+ forNonBaseModule: 0[0m
[37m+ max_vf_module_instances:[0m
[37m+ forBaseModule: 1[0m
[37m+ forNonBaseModule:[0m
[37m+ initial_count:[0m
[37m+ forBaseModule: 1[0m
[37m+ forNonBaseModule: 0[0m
[37m+ vf_module_type:[0m
[37m+ forBaseModule: Base[0m
[37m+ forNonBaseModule: Expansion[0m
[37m+[0m
[37m+genericAssetNodeTypes:[0m
[37m+ VFC: org.openecomp.resource.abstract.nodes.VFC[0m
[37m+ CVFC: org.openecomp.resource.abstract.nodes.VFC[0m
[37m+ VF : org.openecomp.resource.abstract.nodes.VF[0m
[37m+ CR : org.openecomp.resource.abstract.nodes.CR[0m
[37m+ PNF: org.openecomp.resource.abstract.nodes.PNF[0m
[37m+ Service: org.openecomp.resource.abstract.nodes.service[0m
[37m+ ETSI NFV Network Service: tosca.nodes.nfv.NS[0m
[37m+[0m
[37m+serviceNodeTypes:[0m
[37m+ ETSI NFV Network Service: tosca.nodes.nfv.NS[0m
[37m+[0m
[37m+workloadContext: Production[0m
[37m+[0m
[37m+environmentContext:[0m
[37m+ defaultValue: General_Revenue-Bearing[0m
[37m+ validValues:[0m
[37m+ - Critical_Revenue-Bearing[0m
[37m+ - Vital_Revenue-Bearing[0m
[37m+ - Essential_Revenue-Bearing[0m
[37m+ - Important_Revenue-Bearing[0m
[37m+ - Needed_Revenue-Bearing[0m
[37m+ - Useful_Revenue-Bearing[0m
[37m+ - General_Revenue-Bearing[0m
[37m+ - Critical_Non-Revenue[0m
[37m+ - Vital_Non-Revenue[0m
[37m+ - Essential_Non-Revenue[0m
[37m+ - Important_Non-Revenue[0m
[37m+ - Needed_Non-Revenue[0m
[37m+ - Useful_Non-Revenue[0m
[37m+ - General_Non-Revenue[0m
[37m+[0m
[37m+gabConfig:[0m
[37m+ - artifactType: 'VES_EVENTS'[0m
[37m+ pathsAndNamesDefinitions:[0m
[37m+ -[0m
[37m+ friendlyName: "Action"[0m
[37m+ path: "event.action[2]"[0m
[37m+ searchable: true[0m
[37m+ -[0m
[37m+ friendlyName: "Comment"[0m
[37m+ path: "event.comment"[0m
[37m+ searchable: true[0m
[37m+ -[0m
[37m+ friendlyName: "Alarm Additional Information"[0m
[37m+ path: "event.structure.faultFields.structure.alarmAdditionalInformation.comment"[0m
[37m+ searchable: true[0m
[37m+ - artifactType: 'PM_DICTIONARY'[0m
[37m+ pathsAndNamesDefinitions:[0m
[37m+ -[0m
[37m+ friendlyName: "measType"[0m
[37m+ path: "pmMetaData.pmFields.measType"[0m
[37m+ searchable: true[0m
[37m+ -[0m
[37m+ friendlyName: "measDescription"[0m
[37m+ path: "pmMetaData.pmFields.measDescription"[0m
[37m+ searchable: true[0m
[37m+ -[0m
[37m+ friendlyName: "measCondition"[0m
[37m+ path: "pmMetaData.pmFields.measCondition"[0m
[37m+ searchable: false[0m
[37m+ -[0m
[37m+ friendlyName: "measResultUnits"[0m
[37m+ path: "pmMetaData.pmFields.measResultUnits"[0m
[37m+ searchable: false[0m
[37m+ -[0m
[37m+ friendlyName: "measResultRange"[0m
[37m+ path: "pmMetaData.pmFields.measResultRange"[0m
[37m+ searchable: false[0m
[37m+ -[0m
[37m+ friendlyName: "measObjClass"[0m
[37m+ path: "pmMetaData.pmFields.measObjClass"[0m
[37m+ searchable: true[0m
[37m+ -[0m
[37m+ friendlyName: "measCollectionMethod"[0m
[37m+ path: "pmMetaData.pmFields.measCollectionMethod"[0m
[37m+ searchable: false[0m
[37m+ -[0m
[37m+ friendlyName: "measInfoId"[0m
[37m+ path: "pmMetaData.pmFields.measInfoId"[0m
[37m+ searchable: true[0m
[37m+ -[0m
[37m+ friendlyName: "iMeasInfoId"[0m
[37m+ path: "pmMetaData.pmFields.iMeasInfoId"[0m
[37m+ searchable: false[0m
[37m+[0m
[37m+dmaapConsumerConfiguration:[0m
[37m+ active: false[0m
[37m+ hosts: localhost:3905[0m
[37m+ consumerGroup: sdc[0m
[37m+ consumerId: mama[0m
[37m+ timeoutMs: 15000[0m
[37m+ limit: 1[0m
[37m+ pollingInterval: 2[0m
[37m+ topic: topic[0m
[37m+ latitude: 32.109333[0m
[37m+ longitude: 34.855499[0m
[37m+ version: 1.0[0m
[37m+ serviceName: localhost/events[0m
[37m+ environment: TEST[0m
[37m+ partner: BOT_R[0m
[37m+ routeOffer: MR1[0m
[37m+ protocol: https[0m
[37m+ contenttype: application/json[0m
[37m+ dme2TraceOn: true[0m
[37m+ aftEnvironment: AFTUAT[0m
[37m+ aftDme2ConnectionTimeoutMs: 15000[0m
[37m+ aftDme2RoundtripTimeoutMs: 240000[0m
[37m+ aftDme2ReadTimeoutMs: 50000[0m
[37m+ dme2preferredRouterFilePath: DME2preferredRouter.txt[0m
[37m+ timeLimitForNotificationHandleMs: 120000[0m
[37m+ credential:[0m
[37m+ username: user[0m
[37m+ password:[0m
[37m+ aftDme2SslEnable: true[0m
[37m+ aftDme2ClientKeystore: /app/jetty/etc/truststore[0m
[37m+ aftDme2ClientKeystorePassword: ""[0m
[37m+ aftDme2ClientSslCertAlias: certman[0m
[37m+[0m
[37m+dmaapProducerConfiguration:[0m
[37m+ active: true[0m
[37m+ hosts: olsd004.com:3905[0m
[37m+ consumerGroup: sdc-AUTO-1622769608[0m
[37m+ consumerId: sdc-AUTO1-1622769608[0m
[37m+ timeoutMs: 15000[0m
[37m+ limit: 1[0m
[37m+ pollingInterval: 2[0m
[37m+ topic: SDC-FACADE-NOTIF-v1 [0m
[37m+ latitude: 32.109333[0m
[37m+ longitude: 34.855499[0m
[37m+ version: 1.0[0m
[37m+ serviceName: dmaap.com:3905/events[0m
[37m+ environment: TEST[0m
[37m+ partner: BOT_R[0m
[37m+ routeOffer: MR1[0m
[37m+ protocol: [0m
[37m+ contenttype: application/json[0m
[37m+ dme2TraceOn: true[0m
[37m+ aftEnvironment: [0m
[37m+ aftDme2ConnectionTimeoutMs: 15000[0m
[37m+ aftDme2RoundtripTimeoutMs: 240000[0m
[37m+ aftDme2ReadTimeoutMs: 50000[0m
[37m+ dme2preferredRouterFilePath: [0m
[37m+ timeLimitForNotificationHandleMs: 120000[0m
[37m+ credential:[0m
[37m+ username: user1@sdc.com[0m
[37m+ password: password==[0m
[37m+ aftDme2SslEnable: true[0m
[37m+ aftDme2ClientKeystore: /app/jetty/etc/truststore[0m
[37m+ aftDme2ClientKeystorePassword: dmaap_truststore_pwd[0m
[37m+ aftDme2ClientSslCertAlias: certman[0m
[37m+[0m
[37m+[0m
[37m+# ToDo: AF - had to remove due to configuration laod class failure[0m
[37m+#dmeConfiguration:[0m
[37m+# lookupUriFormat: "http://DME2RESOLVE/service=%s/version=1.0.0/envContext=%s/routeOffer=DEFAULT"[0m
[37m+# dme2Search: DME2SEARCH[0m
[37m+# dme2Resolve: DME2RESOLVE[0m
[37m+[0m
[37m+excludedPolicyTypesMapping:[0m
[37m+ # VF:[0m
[37m+ # - a.b.c[0m
[37m+ # - c.d.e[0m
[37m+ #CR:[0m
[37m+ # - x.y.z[0m
[37m+[0m
[37m+excludedGroupTypesMapping:[0m
[37m+ CR:[0m
[37m+ - org.openecomp.groups.VfModule[0m
[37m+ - org.openecomp.groups.heat.HeatStack[0m
[37m+ - org.openecomp.groups.Group[0m
[37m+ - tosca.groups.Root[0m
[37m+ PNF:[0m
[37m+ - org.openecomp.groups.VfModule[0m
[37m+ - org.openecomp.groups.heat.HeatStack[0m
[37m+ - org.openecomp.groups.Group[0m
[37m+ - tosca.groups.Root[0m
[37m+ VF:[0m
[37m+ - org.openecomp.groups.VfModule[0m
[37m+ - org.openecomp.groups.heat.HeatStack[0m
[37m+ - org.openecomp.groups.Group[0m
[37m+ - tosca.groups.Root[0m
[37m+ Service:[0m
[37m+ - org.openecomp.groups.VfModule[0m
[37m+ - org.openecomp.groups.heat.HeatStack[0m
[37m+ - org.openecomp.groups.Group[0m
[37m+ - tosca.groups.Root[0m
[37m+[0m
[37m+healthStatusExclude:[0m
[37m+ - DE[0m
[37m+ - DMAAP[0m
[37m+ - DMAAP_PRODUCER[0m
[37m+ - ON_BOARDING[0m
[37m+ - DCAE[0m
[37m+ - PORTAL[0m
[37m+ - External API[0m
[37m+[0m
[37m+#Auto Healing[0m
[37m+enableAutoHealing: false[0m
[37m+appVersion: [0m
[37m+[0m
[37m+artifactGeneratorConfig: Artifact-Generator.properties[0m
[37m+resourcesForUpgrade:[0m
[37m+ 8.0:[0m
[37m+ - org.openecomp.resource.cp.extCP[0m
[37m+ - tosca.nodes.network.Network[0m
[37m+ - tosca.nodes.network.Port[0m
[37m+ - org.openecomp.resource.cp.nodes.network.SubInterface[0m
[37m+skipUpgradeFailedVfs: true[0m
[37m+skipUpgradeVSPs: true[0m
[37m+autoHealingOwner: jh0003[0m
[37m+supportAllottedResourcesAndProxy: true[0m
[37m+deleteLockTimeoutInSeconds: 60[0m
[37m+maxDeleteComponents: 10[0m
[37m+[0m
[37m+# Cadi filter (access restriction) Parameters[0m
[37m+aafNamespace: com.onap.sdc[0m
[37m+aafAuthNeeded: false[0m
[37m+[0m
[37m+cadiFilterParams:[0m
[37m+ AFT_LATITUDE: "32.780140"[0m
[37m+ AFT_LONGITUDE: "-96.800451"[0m
[37m+ hostname: sdc-be.onap[0m
[37m+ aaf_id: user[0m
[37m+ aaf_env: TEST[0m
[37m+ aaf_url: [0m
[37m+ csp_domain: PROD[0m
[37m+ cadi_keyfile: /app/jetty/etc/org.onap.sdc.p12[0m
[37m+ aaf_password: enc:AafEncriptedPassword[0m
[37m+ cadi_loglevel: DEBUG[0m
[37m+ AFT_ENVIRONMENT: AFTUAT[0m
[37m+ cadiX509Issuers: CN=intermediateCA_1, OU=OSAAF, O=ONAP, C=US[0m
[37m+ cadi_truststore: /app/jetty/etc/org.onap.sdc.trust.jks[0m
[37m+ cadi_truststore_password: changeit[0m
[37m+[0m
[37m+# This configuration entry lists all node type names prefix that shall be allowed on SDC.[0m
[37m+definedResourceNamespace:[0m
[37m+ - org.openecomp.resource.[0m
[37m+[0m
[37m+# This configuration entry lists all Directives values that shall be allowed on SDC.[0m
[37m+directives:[0m
[37m+ - select[0m
[37m+ - selectable[0m
[37m+ - substitute[0m
[37m+ - substitutable[0m[2021-06-04T01:20:08+00:00] INFO: template[catalog-be-config] owner changed to 1000
[2021-06-04T01:20:08+00:00] INFO: template[catalog-be-config] owner changed to 1000
[2021-06-04T01:20:08+00:00] INFO: template[catalog-be-config] group changed to 101
[2021-06-04T01:20:08+00:00] INFO: template[catalog-be-config] group changed to 101
[2021-06-04T01:20:08+00:00] INFO: template[catalog-be-config] mode changed to 644
[2021-06-04T01:20:08+00:00] INFO: template[catalog-be-config] mode changed to 644
[32m- change mode from '' to '0644'[0m
[32m- change owner from '' to 'onap'[0m
[32m- change group from '' to 'onap'[0m
[0m * template[distribution-engine-configuration] action create_if_missing[2021-06-04T01:20:08+00:00] INFO: template[distribution-engine-configuration] created file /app/jetty/config/catalog-be/distribution-engine-configuration.yaml
[2021-06-04T01:20:08+00:00] INFO: template[distribution-engine-configuration] created file /app/jetty/config/catalog-be/distribution-engine-configuration.yaml
[32m- create new file /app/jetty/config/catalog-be/distribution-engine-configuration.yaml[0m[2021-06-04T01:20:08+00:00] INFO: template[distribution-engine-configuration] updated file contents /app/jetty/config/catalog-be/distribution-engine-configuration.yaml
[2021-06-04T01:20:08+00:00] INFO: template[distribution-engine-configuration] updated file contents /app/jetty/config/catalog-be/distribution-engine-configuration.yaml
[32m- update content in file /app/jetty/config/catalog-be/distribution-engine-configuration.yaml from none to 17f7e1[0m
[37m--- /app/jetty/config/catalog-be/distribution-engine-configuration.yaml 2021-06-04 01:20:08.441604395 +0000[0m
[37m+++ /app/jetty/config/catalog-be/.chef-distribution-engine-configuration20210604-18-nbt8sw.yaml 2021-06-04 01:20:08.441604395 +0000[0m
[37m@@ -1,81 +1,162 @@[0m
[37m+uebServers:[0m
[37m+ - message-router.onap[0m
[37m+ - message-router.onap[0m
[37m+[0m
[37m+uebPublicKey: iPIxkpAMI8qTcQj8[0m
[37m+uebSecretKey: Ehq3WyT4bkif4zwgEbvshGal[0m
[37m+[0m
[37m+distributionNotifTopicName: SDC-DISTR-NOTIF-TOPIC[0m
[37m+distributionStatusTopicName: SDC-DISTR-STATUS-TOPIC[0m
[37m+[0m
[37m+initRetryIntervalSec: 5[0m
[37m+initMaxIntervalSec: 60[0m
[37m+[0m
[37m+distribNotifServiceArtifactTypes:[0m
[37m+ info:[0m
[37m+ - MURANO-PKG[0m
[37m+[0m
[37m+distribNotifResourceArtifactTypes:[0m
[37m+ lifecycle:[0m
[37m+ - HEAT[0m
[37m+ - DG-XML[0m
[37m+[0m
[37m+environments:[0m
[37m+ - AUTO[0m
[37m+[0m
[37m+distributionStatusTopic:[0m
[37m+ pollingIntervalSec: 60[0m
[37m+ fetchTimeSec: 15[0m
[37m+ consumerGroup: sdc-AUTO[0m
[37m+ consumerId: sdc-AUTO1[0m
[37m+[0m
[37m+[0m
[37m+distributionNotificationTopic:[0m
[37m+ minThreadPoolSize: 0[0m
[37m+ maxThreadPoolSize: 10[0m
[37m+ maxWaitingAfterSendingSeconds: 5[0m
[37m+[0m
[37m+createTopic:[0m
[37m+ partitionCount: 1[0m
[37m+ replicationCount: 1[0m
[37m+[0m
[37m+startDistributionEngine: true[0m
[37m+[0m
[37m+#This is false by default, since ONAP Dmaap currently doesn't support https[0m
[37m+useHttpsWithDmaap: false[0m
[37m+opEnvRecoveryIntervalSec: 180[0m
[37m+allowedTimeBeforeStaleSec: 300[0m
[37m+[0m
[37m+aaiConfig:[0m
[37m+ httpRequestConfig:[0m
[37m+ serverRootUrl: https://localhost:8443[0m
[37m+ resourceNamespaces:[0m
[37m+ operationalEnvironments: /aai/v12/cloud-infrastructure/operational-environments[0m
[37m+[0m
[37m+ httpClientConfig:[0m
[37m+ timeouts:[0m
[37m+ readTimeoutMs: 5000[0m
[37m+ connectTimeoutMs: 1000[0m
[37m+ clientCertificate:[0m
[37m+ keyStore: /app/jetty/base/be/etc/non-prod.jks[0m
[37m+ keyStorePassword: hmXYcznAljMSisdy8zgcag==[0m
[37m+ headers:[0m
[37m+ X-FromAppId: asdc[0m
[37m+ numOfRetries: 3[0m
[37m+[0m
[37m+msoConfig:[0m
[37m+ httpRequestConfig:[0m
[37m+ serverRootUrl: http://127.0.0.1:8080/onap/mso/infra/modelDistributions/v1[0m
[37m+ resourceNamespaces:[0m
[37m+ distributions: /distributions[0m
[37m+[0m
[37m+ httpClientConfig:[0m
[37m+ timeouts:[0m
[37m+ readTimeoutMs: 2000[0m
[37m+ connectTimeoutMs: 500[0m
[37m+ basicAuthorization:[0m
[37m+ userName: asdc[0m
[37m+ password: OTLEp5lfVhYdyw5EAtTUBQ==[0m
[37m+ numOfRetries: 3[0m
[37m+ [0m
[37m+currentArtifactInstallationTimeout: 120[0m[2021-06-04T01:20:08+00:00] INFO: template[distribution-engine-configuration] owner changed to 1000
[2021-06-04T01:20:08+00:00] INFO: template[distribution-engine-configuration] owner changed to 1000
[2021-06-04T01:20:08+00:00] INFO: template[distribution-engine-configuration] group changed to 101
[2021-06-04T01:20:08+00:00] INFO: template[distribution-engine-configuration] group changed to 101
[2021-06-04T01:20:08+00:00] INFO: template[distribution-engine-configuration] mode changed to 644
[2021-06-04T01:20:08+00:00] INFO: template[distribution-engine-configuration] mode changed to 644
[32m- change mode from '' to '0644'[0m
[32m- change owner from '' to 'onap'[0m
[32m- change group from '' to 'onap'[0m
[0mRecipe: sdc-catalog-be::BE_3_locate_keystore[0m
* directory[Jetty_etcdir_creation] action create (up to date)
* cookbook_file[/app/jetty/etc/org.onap.sdc.p12] action create[2021-06-04T01:20:08+00:00] INFO: cookbook_file[/app/jetty/etc/org.onap.sdc.p12] created file /app/jetty/etc/org.onap.sdc.p12
[2021-06-04T01:20:08+00:00] INFO: cookbook_file[/app/jetty/etc/org.onap.sdc.p12] created file /app/jetty/etc/org.onap.sdc.p12
[32m- create new file /app/jetty/etc/org.onap.sdc.p12[0m[2021-06-04T01:20:08+00:00] INFO: cookbook_file[/app/jetty/etc/org.onap.sdc.p12] updated file contents /app/jetty/etc/org.onap.sdc.p12
[2021-06-04T01:20:08+00:00] INFO: cookbook_file[/app/jetty/etc/org.onap.sdc.p12] updated file contents /app/jetty/etc/org.onap.sdc.p12
[32m- update content in file /app/jetty/etc/org.onap.sdc.p12 from none to 6418f9[0m
[37m(new content is binary, diff output suppressed)[0m[2021-06-04T01:20:08+00:00] INFO: cookbook_file[/app/jetty/etc/org.onap.sdc.p12] owner changed to 1000
[2021-06-04T01:20:08+00:00] INFO: cookbook_file[/app/jetty/etc/org.onap.sdc.p12] owner changed to 1000
[2021-06-04T01:20:08+00:00] INFO: cookbook_file[/app/jetty/etc/org.onap.sdc.p12] mode changed to 755
[2021-06-04T01:20:08+00:00] INFO: cookbook_file[/app/jetty/etc/org.onap.sdc.p12] mode changed to 755
[32m- change mode from '' to '0755'[0m
[32m- change owner from '' to 'onap'[0m
[0m * cookbook_file[/app/jetty/etc/org.onap.sdc.trust.jks] action create[2021-06-04T01:20:08+00:00] INFO: cookbook_file[/app/jetty/etc/org.onap.sdc.trust.jks] created file /app/jetty/etc/org.onap.sdc.trust.jks
[2021-06-04T01:20:08+00:00] INFO: cookbook_file[/app/jetty/etc/org.onap.sdc.trust.jks] created file /app/jetty/etc/org.onap.sdc.trust.jks
[32m- create new file /app/jetty/etc/org.onap.sdc.trust.jks[0m[2021-06-04T01:20:08+00:00] INFO: cookbook_file[/app/jetty/etc/org.onap.sdc.trust.jks] updated file contents /app/jetty/etc/org.onap.sdc.trust.jks
[2021-06-04T01:20:08+00:00] INFO: cookbook_file[/app/jetty/etc/org.onap.sdc.trust.jks] updated file contents /app/jetty/etc/org.onap.sdc.trust.jks
[32m- update content in file /app/jetty/etc/org.onap.sdc.trust.jks from none to afa753[0m
[37m(new content is binary, diff output suppressed)[0m[2021-06-04T01:20:08+00:00] INFO: cookbook_file[/app/jetty/etc/org.onap.sdc.trust.jks] owner changed to 1000
[2021-06-04T01:20:08+00:00] INFO: cookbook_file[/app/jetty/etc/org.onap.sdc.trust.jks] owner changed to 1000
[2021-06-04T01:20:08+00:00] INFO: cookbook_file[/app/jetty/etc/org.onap.sdc.trust.jks] mode changed to 755
[2021-06-04T01:20:08+00:00] INFO: cookbook_file[/app/jetty/etc/org.onap.sdc.trust.jks] mode changed to 755
[32m- change mode from '' to '0755'[0m
[32m- change owner from '' to 'onap'[0m
[0mRecipe: sdc-catalog-be::BE_4_jetty_Modules[0m
* execute[create-jetty-modules] action run
[execute] INFO : deploy already enabled by [${jetty.base}/start.ini]
INFO : Base directory was not modified
INFO : http already enabled by [${jetty.base}/start.ini]
MKDIR : ${jetty.base}/start.d
INFO : console-capture initialized in ${jetty.base}/start.d/console-capture.ini
INFO : https initialized in ${jetty.base}/start.d/https.ini
INFO : ssl transitively enabled, ini template available with --add-to-start=ssl
INFO : setuid initialized in ${jetty.base}/start.d/setuid.ini
COPY : ${jetty.base}/modules/ssl/keystore to ${jetty.base}/etc/keystore
INFO : Base directory was modified
[2021-06-04T01:20:09+00:00] INFO: execute[create-jetty-modules] ran successfully
[2021-06-04T01:20:09+00:00] INFO: execute[create-jetty-modules] ran successfully
[32m- execute java -jar /app/jetty/start.jar --add-to-start=deploy && java -jar /app/jetty/start.jar --create-startd --add-to-start=http,https,console-capture,setuid[0m
[0m * template[http-ini] action create[2021-06-04T01:20:09+00:00] INFO: template[http-ini] created file /app/jetty/start.d/http.ini
[2021-06-04T01:20:09+00:00] INFO: template[http-ini] created file /app/jetty/start.d/http.ini
[32m- create new file /app/jetty/start.d/http.ini[0m[2021-06-04T01:20:09+00:00] INFO: template[http-ini] updated file contents /app/jetty/start.d/http.ini
[2021-06-04T01:20:09+00:00] INFO: template[http-ini] updated file contents /app/jetty/start.d/http.ini
[32m- update content in file /app/jetty/start.d/http.ini from none to 600ef1[0m
[37m--- /app/jetty/start.d/http.ini 2021-06-04 01:20:09.553609713 +0000[0m
[37m+++ /app/jetty/start.d/.chef-http20210604-18-1iv1nc9.ini 2021-06-04 01:20:09.553609713 +0000[0m
[37m@@ -1,29 +1,58 @@[0m
[37m+# ---------------------------------------[0m
[37m+# Module: http[0m
[37m+#--module=http[0m
[37m+[0m
[37m+### HTTP Connector Configuration[0m
[37m+[0m
[37m+## Connector host/address to bind to[0m
[37m+# jetty.http.host=0.0.0.0[0m
[37m+[0m
[37m+## Connector port to listen on[0m
[37m+jetty.http.port=8080[0m
[37m+[0m
[37m+## Connector idle timeout in milliseconds[0m
[37m+jetty.http.idleTimeout=30000[0m
[37m+[0m
[37m+## Connector socket linger time in seconds (-1 to disable)[0m
[37m+# jetty.http.soLingerTime=-1[0m
[37m+[0m
[37m+## Number of acceptors (-1 picks default based on number of cores)[0m
[37m+# jetty.http.acceptors=-1[0m
[37m+[0m
[37m+## Number of selectors (-1 picks default based on number of cores)[0m
[37m+# jetty.http.selectors=-1[0m
[37m+[0m
[37m+## ServerSocketChannel backlog (0 picks platform default)[0m
[37m+# jetty.http.acceptorQueueSize=0[0m
[37m+[0m
[37m+## Thread priority delta to give to acceptor threads[0m
[37m+# jetty.http.acceptorPriorityDelta=0[0m[2021-06-04T01:20:09+00:00] INFO: template[http-ini] owner changed to 1000
[2021-06-04T01:20:09+00:00] INFO: template[http-ini] owner changed to 1000
[2021-06-04T01:20:09+00:00] INFO: template[http-ini] group changed to 101
[2021-06-04T01:20:09+00:00] INFO: template[http-ini] group changed to 101
[2021-06-04T01:20:09+00:00] INFO: template[http-ini] mode changed to 755
[2021-06-04T01:20:09+00:00] INFO: template[http-ini] mode changed to 755
[32m- change mode from '' to '0755'[0m
[32m- change owner from '' to 'onap'[0m
[32m- change group from '' to 'onap'[0m
[0m * template[https-ini] action create[2021-06-04T01:20:09+00:00] INFO: template[https-ini] backed up to /app/jetty/chef-solo/backup/app/jetty/start.d/https.ini.chef-20210604012009.573090
[2021-06-04T01:20:09+00:00] INFO: template[https-ini] backed up to /app/jetty/chef-solo/backup/app/jetty/start.d/https.ini.chef-20210604012009.573090
[2021-06-04T01:20:09+00:00] INFO: template[https-ini] updated file contents /app/jetty/start.d/https.ini
[2021-06-04T01:20:09+00:00] INFO: template[https-ini] updated file contents /app/jetty/start.d/https.ini
[32m- update content in file /app/jetty/start.d/https.ini from 1167e5 to e03583[0m
[37m--- /app/jetty/start.d/https.ini 2021-06-04 01:20:09.501609464 +0000[0m
[37m+++ /app/jetty/start.d/.chef-https20210604-18-1w5ofz0.ini 2021-06-04 01:20:09.565609770 +0000[0m
[37m@@ -1,8 +1,30 @@[0m
[37m-# --------------------------------------- [0m
[37m+# ---------------------------------------[0m
[37m # Module: https[0m
[37m-# Adds HTTPS protocol support to the TLS(SSL) Connector[0m
[37m-# --------------------------------------- [0m
[37m --module=https[0m
[37m [0m
[37m+### HTTPS Connector Configuration[0m
[37m [0m
[37m+## Connector host/address to bind to[0m
[37m+# jetty.https.host=0.0.0.0[0m
[37m+[0m
[37m+## Connector port to listen on[0m
[37m+jetty.https.port=8443[0m
[37m+[0m
[37m+## Connector idle timeout in milliseconds[0m
[37m+jetty.https.idleTimeout=30000[0m
[37m+[0m
[37m+## Connector socket linger time in seconds (-1 to disable)[0m
[37m+# jetty.https.soLingerTime=-1[0m
[37m+[0m
[37m+## Number of acceptors (-1 picks default based on number of cores)[0m
[37m+# jetty.https.acceptors=-1[0m
[37m+[0m
[37m+## Number of selectors (-1 picks default based on number of cores)[0m
[37m+# jetty.https.selectors=-1[0m
[37m+[0m
[37m+## ServerSocketChannel backlog (0 picks platform default)[0m
[37m+# jetty.https.acceptorQueueSize=0[0m
[37m+[0m
[37m+## Thread priority delta to give to acceptor threads[0m
[37m+# jetty.https.acceptorPriorityDelta=0[0m[2021-06-04T01:20:09+00:00] INFO: template[https-ini] mode changed to 755
[2021-06-04T01:20:09+00:00] INFO: template[https-ini] mode changed to 755
[32m- change mode from '0644' to '0755'[0m
[0m * template[ssl-ini] action create[2021-06-04T01:20:09+00:00] INFO: template[ssl-ini] created file /app/jetty/start.d/ssl.ini
[2021-06-04T01:20:09+00:00] INFO: template[ssl-ini] created file /app/jetty/start.d/ssl.ini
[32m- create new file /app/jetty/start.d/ssl.ini[0m[2021-06-04T01:20:09+00:00] INFO: template[ssl-ini] updated file contents /app/jetty/start.d/ssl.ini
[2021-06-04T01:20:09+00:00] INFO: template[ssl-ini] updated file contents /app/jetty/start.d/ssl.ini
[32m- update content in file /app/jetty/start.d/ssl.ini from none to 01e25d[0m
[37m--- /app/jetty/start.d/ssl.ini 2021-06-04 01:20:09.577609828 +0000[0m
[37m+++ /app/jetty/start.d/.chef-ssl20210604-18-cyv11r.ini 2021-06-04 01:20:09.577609828 +0000[0m
[37m@@ -1,90 +1,180 @@[0m
[37m+# ---------------------------------------[0m
[37m+# Module: ssl[0m
[37m+--module=ssl[0m
[37m+[0m
[37m+### TLS(SSL) Connector Configuration[0m
[37m+[0m
[37m+## Connector host/address to bind to[0m
[37m+# jetty.ssl.host=0.0.0.0[0m
[37m+[0m
[37m+## Connector port to listen on[0m
[37m+jetty.ssl.port=8443[0m
[37m+[0m
[37m+## Connector idle timeout in milliseconds[0m
[37m+# jetty.ssl.idleTimeout=30000[0m
[37m+[0m
[37m+## Connector socket linger time in seconds (-1 to disable)[0m
[37m+# jetty.ssl.soLingerTime=-1[0m
[37m+[0m
[37m+## Number of acceptors (-1 picks default based on number of cores)[0m
[37m+# jetty.ssl.acceptors=-1[0m
[37m+[0m
[37m+## Number of selectors (-1 picks default based on number of cores)[0m
[37m+# jetty.ssl.selectors=-1[0m
[37m+[0m
[37m+## ServerSocketChannel backlog (0 picks platform default)[0m
[37m+# jetty.ssl.acceptorQueueSize=0[0m
[37m+[0m
[37m+## Thread priority delta to give to acceptor threads[0m
[37m+# jetty.ssl.acceptorPriorityDelta=0[0m
[37m+[0m
[37m+## Whether request host names are checked to match any SNI names[0m
[37m+# jetty.ssl.sniHostCheck=true[0m
[37m+[0m
[37m+## max age in seconds for a Strict-Transport-Security response header (default -1)[0m
[37m+# jetty.ssl.stsMaxAgeSeconds=31536000[0m
[37m+[0m
[37m+## include subdomain property in any Strict-Transport-Security header (default false)[0m
[37m+# jetty.ssl.stsIncludeSubdomains=true[0m
[37m+[0m
[37m+### SslContextFactory Configuration[0m
[37m+## Note that OBF passwords are not secure, just protected from casual observation[0m
[37m+## See http://www.eclipse.org/jetty/documentation/current/configuring-security-secure-passwords.html[0m
[37m+[0m
[37m+## Keystore file path (relative to $jetty.base)[0m
[37m+jetty.sslContext.keyStorePath=etc/org.onap.sdc.p12[0m
[37m+[0m
[37m+## Truststore file path (relative to $jetty.base)[0m
[37m+jetty.sslContext.trustStorePath=etc/org.onap.sdc.trust.jks[0m
[37m+[0m
[37m+## Keystore password[0m
[37m+# jetty.sslContext.keyStorePassword=OBF:1vny1zlo1x8e1vnw1vn61x8g1zlu1vn4[0m
[37m+jetty.sslContext.keyStorePassword=AmuAKP@NgSBi2.cg7KWjs^gK[0m
[37m+[0m
[37m+## Keystore type and provider[0m
[37m+# jetty.sslContext.keyStoreType=JKS[0m
[37m+# jetty.sslContext.keyStoreProvider=[0m
[37m+[0m
[37m+## KeyManager password[0m
[37m+# jetty.sslContext.keyManagerPassword=OBF:1u2u1wml1z7s1z7a1wnl1u2g[0m
[37m+jetty.sslContext.keyManagerPassword=AmuAKP@NgSBi2.cg7KWjs^gK[0m
[37m+[0m
[37m+## Truststore password[0m
[37m+# jetty.sslContext.trustStorePassword=OBF:1vny1zlo1x8e1vnw1vn61x8g1zlu1vn4[0m
[37m+jetty.sslContext.trustStorePassword=)mfMBb:hA51Z2bFHY{lNDBgG[0m
[37m+[0m
[37m+## Truststore type and provider[0m
[37m+# jetty.sslContext.trustStoreType=JKS[0m
[37m+# jetty.sslContext.trustStoreProvider=[0m
[37m+[0m
[37m+## whether client certificate authentication is required[0m
[37m+# jetty.sslContext.needClientAuth=false[0m
[37m+[0m
[37m+## Whether client certificate authentication is desired[0m
[37m+# jetty.sslContext.wantClientAuth=false[0m
[37m+[0m
[37m+## Whether cipher order is significant (since java 8 only)[0m
[37m+# jetty.sslContext.useCipherSuitesOrder=true[0m
[37m+[0m
[37m+## To configure Includes / Excludes for Cipher Suites or Protocols see tweak-ssl.xml example at[0m
[37m+## https://www.eclipse.org/jetty/documentation/current/configuring-ssl.html#configuring-sslcontextfactory-cipherSuites[0m
[37m+[0m
[37m+## Set the size of the SslSession cache[0m
[37m+# jetty.sslContext.sslSessionCacheSize=-1[0m
[37m+[0m
[37m+## Set the timeout (in seconds) of the SslSession cache timeout[0m
[37m+# jetty.sslContext.sslSessionTimeout=-1[0m
[37m+[0m
[37m+## Allow SSL renegotiation[0m
[37m+# jetty.sslContext.renegotiationAllowed=true[0m
[37m+# jetty.sslContext.renegotiationLimit=5[0m[2021-06-04T01:20:09+00:00] INFO: template[ssl-ini] owner changed to 1000
[2021-06-04T01:20:09+00:00] INFO: template[ssl-ini] owner changed to 1000
[2021-06-04T01:20:09+00:00] INFO: template[ssl-ini] group changed to 101
[2021-06-04T01:20:09+00:00] INFO: template[ssl-ini] group changed to 101
[2021-06-04T01:20:09+00:00] INFO: template[ssl-ini] mode changed to 755
[2021-06-04T01:20:09+00:00] INFO: template[ssl-ini] mode changed to 755
[32m- change mode from '' to '0755'[0m
[32m- change owner from '' to 'onap'[0m
[32m- change group from '' to 'onap'[0m
[0mRecipe: sdc-catalog-be::BE_6_setup_portal_and_key_properties[0m
* template[template portal.properties] action create[2021-06-04T01:20:09+00:00] INFO: template[template portal.properties] created file /app/jetty/resources/portal.properties
[2021-06-04T01:20:09+00:00] INFO: template[template portal.properties] created file /app/jetty/resources/portal.properties
[32m- create new file /app/jetty/resources/portal.properties[0m[2021-06-04T01:20:09+00:00] INFO: template[template portal.properties] updated file contents /app/jetty/resources/portal.properties
[2021-06-04T01:20:09+00:00] INFO: template[template portal.properties] updated file contents /app/jetty/resources/portal.properties
[32m- update content in file /app/jetty/resources/portal.properties from none to 62974b[0m
[37m--- /app/jetty/resources/portal.properties 2021-06-04 01:20:09.589609885 +0000[0m
[37m+++ /app/jetty/resources/.chef-portal20210604-18-1nsoy7t.properties 2021-06-04 01:20:09.589609885 +0000[0m
[37m@@ -1,89 +1,178 @@[0m
[37m+###[0m
[37m+# ============LICENSE_START==========================================[0m
[37m+# ONAP Portal SDK[0m
[37m+# ===================================================================[0m
[37m+# Copyright © 2017 AT&T Intellectual Property. All rights reserved.[0m
[37m+# ===================================================================[0m
[37m+#[0m
[37m+# Unless otherwise specified, all software contained herein is licensed[0m
[37m+# under the Apache License, Version 2.0 (the “License”);[0m
[37m+# you may not use this software except in compliance with the License.[0m
[37m+# You may obtain a copy of the License at[0m
[37m+#[0m
[37m+# http://www.apache.org/licenses/LICENSE-2.0[0m
[37m+#[0m
[37m+# Unless required by applicable law or agreed to in writing, software[0m
[37m+# distributed under the License is distributed on an "AS IS" BASIS,[0m
[37m+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.[0m
[37m+# See the License for the specific language governing permissions and[0m
[37m+# limitations under the License.[0m
[37m+#[0m
[37m+# Unless otherwise specified, all documentation contained herein is licensed[0m
[37m+# under the Creative Commons License, Attribution 4.0 Intl. (the “License”);[0m
[37m+# you may not use this documentation except in compliance with the License.[0m
[37m+# You may obtain a copy of the License at[0m
[37m+#[0m
[37m+# https://creativecommons.org/licenses/by/4.0/[0m
[37m+#[0m
[37m+# Unless required by applicable law or agreed to in writing, documentation[0m
[37m+# distributed under the License is distributed on an "AS IS" BASIS,[0m
[37m+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.[0m
[37m+# See the License for the specific language governing permissions and[0m
[37m+# limitations under the License.[0m
[37m+#[0m
[37m+# ============LICENSE_END============================================[0m
[37m+#[0m
[37m+#[0m
[37m+###[0m
[37m+# Properties read by ECOMP Framework library, ecompFW.jar[0m
[37m+[0m
[37m+##########################################################################[0m
[37m+# The following properties should NOT be changed by partner applications.[0m
[37m+##########################################################################[0m
[37m+[0m
[37m+portal.api.prefix = /api[0m
[37m+max.idle.time = 5[0m
[37m+user.attribute.name = user_attribute[0m
[37m+[0m
[37m+#Use REST API instead of UEB to fetch the functional menu data[0m
[37m+use_rest_for_functional_menu=true[0m
[37m+[0m
[37m+[0m
[37m+##########################################################################[0m
[37m+# The following properties MUST be changed by partner applications.[0m
[37m+##########################################################################[0m
[37m+[0m
[37m+# Name of java class that implements the OnBoardingApiService interface.[0m
[37m+portal.api.impl.class = org.openecomp.sdc.be.ecomp.PortalRestApiCentralServiceImpl[0m
[37m+role_access_centralized = remote[0m
[37m+[0m
[37m+# Cookie set by CSP-SSO[0m
[37m+#csp_cookie_name = onapCsp[0m
[37m+[0m
[37m+# CSP setting, most use PROD; DEV also recognized[0m
[37m+csp_gate_keeper_prod_key = PROD[0m
[37m+[0m
[37m+# URL of the Portal where this app is onboarded[0m
[37m+ecomp_redirect_url = https://portal-app.onap:30225/ONAPPORTAL/login.htm[0m
[37m+[0m
[37m+# URL of the ECOMP Portal REST API[0m
[37m+ecomp_rest_url = https://portal-app.onap:8443/ONAPPORTAL/auxapi[0m
[37m+[0m
[37m+# Connection and Read timeout values[0m
[37m+ext_req_connection_timeout = 15000[0m
[37m+ext_req_read_timeout = 20000[0m
[37m+[0m
[37m+# Name of java class that implements the OnBoardingApiService interface.[0m
[37m+portal.api.impl.class = org.openecomp.sdc.be.ecomp.PortalRestApiCentralServiceImpl[0m
[37m+[0m
[37m+#Portal user & key[0m
[37m+portal_app_name = Ipwxi2oLvDxctMA1royaRw1W0jhucLx+grHzci3ePIA=[0m
[37m+portal_pass = j85yNhyIs7zKYbR1VlwEfNhS6b7Om4l0Gx5O8931sCI=[0m
[37m+portal_user = Ipwxi2oLvDxctMA1royaRw1W0jhucLx+grHzci3ePIA=[0m
[37m+[0m
[37m+[0m
[37m+# UEB key generated while on-boarding[0m
[37m+ueb_app_key = ""[0m
[37m+[0m
[37m+# Applications do not need to run a UEB listener after 1607.[0m
[37m+ueb_listeners_enable = false[0m[2021-06-04T01:20:09+00:00] INFO: template[template portal.properties] owner changed to 1000
[2021-06-04T01:20:09+00:00] INFO: template[template portal.properties] owner changed to 1000
[2021-06-04T01:20:09+00:00] INFO: template[template portal.properties] group changed to 101
[2021-06-04T01:20:09+00:00] INFO: template[template portal.properties] group changed to 101
[2021-06-04T01:20:09+00:00] INFO: template[template portal.properties] mode changed to 755
[2021-06-04T01:20:09+00:00] INFO: template[template portal.properties] mode changed to 755
[32m- change mode from '' to '0755'[0m
[32m- change owner from '' to 'onap'[0m
[32m- change group from '' to 'onap'[0m
[0m * template[template key.properties] action create[2021-06-04T01:20:09+00:00] INFO: template[template key.properties] created file /app/jetty/resources/key.properties
[2021-06-04T01:20:09+00:00] INFO: template[template key.properties] created file /app/jetty/resources/key.properties
[32m- create new file /app/jetty/resources/key.properties[0m[2021-06-04T01:20:09+00:00] INFO: template[template key.properties] updated file contents /app/jetty/resources/key.properties
[2021-06-04T01:20:09+00:00] INFO: template[template key.properties] updated file contents /app/jetty/resources/key.properties
[32m- update content in file /app/jetty/resources/key.properties from none to f2c564[0m
[37m--- /app/jetty/resources/key.properties 2021-06-04 01:20:09.597609923 +0000[0m
[37m+++ /app/jetty/resources/.chef-key20210604-18-1s2swwd.properties 2021-06-04 01:20:09.597609923 +0000[0m
[37m@@ -1,41 +1,82 @@[0m
[37m+###[0m
[37m+# ============LICENSE_START==========================================[0m
[37m+# ONAP Portal SDK[0m
[37m+# ===================================================================[0m
[37m+# Copyright © 2017 AT&T Intellectual Property. All rights reserved.[0m
[37m+# ===================================================================[0m
[37m+#[0m
[37m+# Unless otherwise specified, all software contained herein is licensed[0m
[37m+# under the Apache License, Version 2.0 (the “License”);[0m
[37m+# you may not use this software except in compliance with the License.[0m
[37m+# You may obtain a copy of the License at[0m
[37m+#[0m
[37m+# http://www.apache.org/licenses/LICENSE-2.0[0m
[37m+#[0m
[37m+# Unless required by applicable law or agreed to in writing, software[0m
[37m+# distributed under the License is distributed on an "AS IS" BASIS,[0m
[37m+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.[0m
[37m+# See the License for the specific language governing permissions and[0m
[37m+# limitations under the License.[0m
[37m+#[0m
[37m+# Unless otherwise specified, all documentation contained herein is licensed[0m
[37m+# under the Creative Commons License, Attribution 4.0 Intl. (the “License”);[0m
[37m+# you may not use this documentation except in compliance with the License.[0m
[37m+# You may obtain a copy of the License at[0m
[37m+#[0m
[37m+# https://creativecommons.org/licenses/by/4.0/[0m
[37m+#[0m
[37m+# Unless required by applicable law or agreed to in writing, documentation[0m
[37m+# distributed under the License is distributed on an "AS IS" BASIS,[0m
[37m+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.[0m
[37m+# See the License for the specific language governing permissions and[0m
[37m+# limitations under the License.[0m
[37m+#[0m
[37m+# ============LICENSE_END============================================[0m
[37m+#[0m
[37m+# [0m
[37m+###[0m
[37m+[0m
[37m+# Properties read by the ECOMP Framework library (epsdk-fw)[0m
[37m+[0m
[37m+cipher.enc.key = AGLDdG4D04BKm2IxIWEr8o==[0m[2021-06-04T01:20:09+00:00] INFO: template[template key.properties] owner changed to 1000
[2021-06-04T01:20:09+00:00] INFO: template[template key.properties] owner changed to 1000
[2021-06-04T01:20:09+00:00] INFO: template[template key.properties] group changed to 101
[2021-06-04T01:20:09+00:00] INFO: template[template key.properties] group changed to 101
[2021-06-04T01:20:09+00:00] INFO: template[template key.properties] mode changed to 755
[2021-06-04T01:20:09+00:00] INFO: template[template key.properties] mode changed to 755
[32m- change mode from '' to '0755'[0m
[32m- change owner from '' to 'onap'[0m
[32m- change group from '' to 'onap'[0m
[0mRecipe: sdc-catalog-be::BE_7_logback[0m
* cookbook_file[/app/jetty/config/catalog-be/logback.xml] action create_if_missing[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/logback.xml] created file /app/jetty/config/catalog-be/logback.xml
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/logback.xml] created file /app/jetty/config/catalog-be/logback.xml
[32m- create new file /app/jetty/config/catalog-be/logback.xml[0m[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/logback.xml] updated file contents /app/jetty/config/catalog-be/logback.xml
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/logback.xml] updated file contents /app/jetty/config/catalog-be/logback.xml
[32m- update content in file /app/jetty/config/catalog-be/logback.xml from none to 03b6e7[0m
[37m--- /app/jetty/config/catalog-be/logback.xml 2021-06-04 01:20:09.605609961 +0000[0m
[37m+++ /app/jetty/config/catalog-be/.chef-logback20210604-18-1qutwdz.xml 2021-06-04 01:20:09.605609961 +0000[0m
[37m@@ -1,253 +1,506 @@[0m
[37m+[0m
[37m+[0m
[37m+[0m
[37m+ [0m
[37m+ [0m
[37m+ [0m
[37m+ ${log.home}/${ECOMP-component-name}/${ECOMP-subcomponent-name}/all.log [0m
[37m+[0m
[37m+ [0m
[37m+ ${log.home}/${ECOMP-component-name}/${ECOMP-subcomponent-name}/all.log.%i[0m
[37m+ [0m
[37m+ 1 [0m
[37m+ 10 [0m
[37m+ [0m
[37m+[0m
[37m+ [0m
[37m+ 20MB [0m
[37m+ [0m
[37m+[0m
[37m+ [0m
[37m+ ${all-log-pattern} [0m
[37m+ [0m
[37m+ [0m
[37m+ [0m
[37m+ [0m
[37m+[0m
[37m+[0m
[37m+ [0m
[37m+ [0m
[37m+ ${log.home}/${ECOMP-component-name}/${ECOMP-subcomponent-name}/debug.log [0m
[37m+[0m
[37m+ [0m
[37m+ [0m
[37m+ [0m
[37m+ ENTRY [0m
[37m+ EXIT [0m
[37m+ INVOKE [0m
[37m+ INVOKE-RETURN [0m
[37m+ INVOKE-SYNCHRONOUS [0m
[37m+ [0m
[37m+ NEUTRAL [0m
[37m+ DENY [0m
[37m+ [0m
[37m+[0m
[37m+ [0m
[37m+ [0m
[37m+ [0m
[37m+ [0m
[37m+ e.level.toInt() <= INFO.toInt()[0m
[37m+ [0m
[37m+ [0m
[37m+ DENY [0m
[37m+ ACCEPT [0m
[37m+ [0m
[37m+[0m
[37m+ [0m
[37m+ ${log.home}/${ECOMP-component-name}/${ECOMP-subcomponent-name}/debug.log.%i[0m
[37m+ [0m
[37m+ 1 [0m
[37m+ 10 [0m
[37m+ [0m
[37m+[0m
[37m+ [0m
[37m+ 20MB [0m
[37m+ [0m
[37m+[0m
[37m+ [0m
[37m+ ${debug-log-pattern} [0m
[37m+ [0m
[37m+ [0m
[37m+[0m
[37m+[0m
[37m+ [0m
[37m+ [0m
[37m+ ${log.home}/${ECOMP-component-name}/${ECOMP-subcomponent-name}/error.log [0m
[37m+[0m
[37m+ [0m
[37m+ [0m
[37m+ WARN [0m
[37m+ [0m
[37m+[0m
[37m+ [0m
[37m+ ${log.home}/${ECOMP-component-name}/${ECOMP-subcomponent-name}/error.log.%i[0m
[37m+ [0m
[37m+ 1 [0m
[37m+ 10 [0m
[37m+ [0m
[37m+[0m
[37m+ [0m
[37m+ 20MB [0m
[37m+ [0m
[37m+[0m
[37m+ [0m
[37m+ ${error-log-pattern} [0m
[37m+ [0m
[37m+ [0m
[37m+[0m
[37m+[0m
[37m+ [0m
[37m+ [0m
[37m+ ${log.home}/${ECOMP-component-name}/${ECOMP-subcomponent-name}/audit.log [0m
[37m+[0m
[37m+ [0m
[37m+ [0m
[37m+ [0m
[37m+ ENTRY [0m
[37m+ EXIT [0m
[37m+ [0m
[37m+ DENY [0m
[37m+ ACCEPT [0m
[37m+ [0m
[37m+[0m
[37m+ [0m
[37m+ ${log.home}/${ECOMP-component-name}/${ECOMP-subcomponent-name}/audit.log.%i[0m
[37m+ [0m
[37m+ 1 [0m
[37m+ 10 [0m
[37m+ [0m
[37m+[0m
[37m+ [0m
[37m+ 20MB [0m
[37m+ [0m
[37m+[0m
[37m+ [0m
[37m+ ${audit-log-pattern} [0m
[37m+ [0m
[37m+ [0m
[37m+[0m
[37m+[0m
[37m+ [0m
[37m+ [0m
[37m+[0m
[37m+ ${log.home}/${ECOMP-component-name}/${ECOMP-subcomponent-name}/metrics.log[0m
[37m+ [0m
[37m+[0m
[37m+ [0m
[37m+ [0m
[37m+ [0m
[37m+ INVOKE [0m
[37m+ INVOKE-RETURN [0m
[37m+ INVOKE-SYNCHRONOUS [0m
[37m+ [0m
[37m+ DENY [0m
[37m+ ACCEPT [0m
[37m+ [0m
[37m+[0m
[37m+ [0m
[37m+ ${log.home}/${ECOMP-component-name}/${ECOMP-subcomponent-name}/metrics.log.%i[0m
[37m+ [0m
[37m+ 1 [0m
[37m+ 10 [0m
[37m+ [0m
[37m+[0m
[37m+ [0m
[37m+ 20MB [0m
[37m+ [0m
[37m+[0m
[37m+ [0m
[37m+ ${metric-log-pattern} [0m
[37m+ [0m
[37m+ [0m
[37m+[0m
[37m+[0m
[37m+ [0m
[37m+ [0m
[37m+[0m
[37m+ ${log.home}/${ECOMP-component-name}/${ECOMP-subcomponent-name}/supportability.log [0m
[37m+[0m
[37m+ [0m
[37m+ [0m
[37m+ [0m
[37m+ SUPPORTABILITY_MARKER [0m
[37m+ [0m
[37m+ DENY [0m
[37m+ ACCEPT [0m
[37m+ [0m
[37m+[0m
[37m+ [0m
[37m+ ${log.home}/${ECOMP-component-name}/${ECOMP-subcomponent-name}/supportability.log.%i[0m
[37m+ [0m
[37m+ 1 [0m
[37m+ 10 [0m
[37m+ [0m
[37m+[0m
[37m+ [0m
[37m+ 20MB [0m
[37m+ [0m
[37m+[0m
[37m+ [0m
[37m+ ${supportability-log-pattern} [0m
[37m+ [0m
[37m+ [0m
[37m+[0m
[37m+[0m
[37m+ [0m
[37m+ [0m
[37m+ [0m
[37m+[0m
[37m+ [0m
[37m+ [0m
[37m+[0m
[37m+ [0m
[37m+ [0m
[37m+[0m
[37m+[0m
[37m+ [0m
[37m+ [0m
[37m+ [0m
[37m+ [0m
[37m+ [0m
[37m+ [0m
[37m+[0m
[37m+ [0m[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/logback.xml] owner changed to 1000
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/logback.xml] owner changed to 1000
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/logback.xml] group changed to 101
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/logback.xml] group changed to 101
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/logback.xml] mode changed to 644
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/logback.xml] mode changed to 644
[32m- change mode from '' to '0644'[0m
[32m- change owner from '' to 'onap'[0m
[32m- change group from '' to 'onap'[0m
[0mRecipe: sdc-catalog-be::BE_8_errors_config[0m
* cookbook_file[/app/jetty/config/catalog-be/ecomp-error-configuration.yaml] action create_if_missing[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/ecomp-error-configuration.yaml] created file /app/jetty/config/catalog-be/ecomp-error-configuration.yaml
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/ecomp-error-configuration.yaml] created file /app/jetty/config/catalog-be/ecomp-error-configuration.yaml
[32m- create new file /app/jetty/config/catalog-be/ecomp-error-configuration.yaml[0m[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/ecomp-error-configuration.yaml] updated file contents /app/jetty/config/catalog-be/ecomp-error-configuration.yaml
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/ecomp-error-configuration.yaml] updated file contents /app/jetty/config/catalog-be/ecomp-error-configuration.yaml
[32m- update content in file /app/jetty/config/catalog-be/ecomp-error-configuration.yaml from none to fc2c33[0m
[37m--- /app/jetty/config/catalog-be/ecomp-error-configuration.yaml 2021-06-04 01:20:09.621610038 +0000[0m
[37m+++ /app/jetty/config/catalog-be/.chef-ecomp-error-configuration20210604-18-1l277q2.yaml 2021-06-04 01:20:09.621610038 +0000[0m
[37m@@ -1,383 +1,766 @@[0m
[37m+###########################################[0m
[37m+# Note the conventions of the field values:[0m
[37m+# type can be one of: CONFIG_ERROR, SYSTEM_ERROR, DATA_ERROR, CONNECTION_PROBLEM, AUTHENTICATION_PROBLEM[0m
[37m+# severity can be one of: WARN, ERROR, FATAL[0m
[37m+# alarmSeverity can be one of: CRITICAL,MAJOR,MINOR,INFORMATIONAL,NONE[0m
[37m+# code is a unique integer in range of 3003-9999 (3000-3002 are occupied for internal usage)[0m
[37m+# The above enumeration values are out-of-the-box and can be changed in code. [0m
[37m+# In case of config and code mismatch, the appropriate error will be printed to log[0m
[37m+#[0m
[37m+## Range of BE codes - 3010-7999[0m
[37m+[0m
[37m+errors:[0m
[37m+[0m
[37m+ BeRestApiGeneralError: {[0m
[37m+ type: SYSTEM_ERROR,[0m
[37m+ code: ASDC_4000,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Unexpected error during BE REST API execution",[0m
[37m+ alarmSeverity: CRITICAL[0m
[37m+ }[0m
[37m+[0m
[37m+ BeHealthCheckError: {[0m
[37m+ type: SYSTEM_ERROR,[0m
[37m+ code: ASDC_3010,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Error during BE Health Check",[0m
[37m+ alarmSeverity: CRITICAL[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeInitializationError: {[0m
[37m+ type: SYSTEM_ERROR,[0m
[37m+ code: ASDC_4019,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Catalog-BE was not initialized properly",[0m
[37m+ alarmSeverity: CRITICAL[0m
[37m+ }[0m
[37m+[0m
[37m+ BeResourceMissingError: {[0m
[37m+ type: SYSTEM_ERROR,[0m
[37m+ code: ASDC_3011,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Mandatory resource %s cannot be found in repository",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeServiceMissingError: {[0m
[37m+ type: SYSTEM_ERROR,[0m
[37m+ code: ASDC_3012,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Mandatory service %s cannot be found in repository",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeFailedAddingResourceInstanceError: {[0m
[37m+ type: SYSTEM_ERROR,[0m
[37m+ code: ASDC_3013,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Failed to add resource instance of resource %s to service %s",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeIncorrectServiceError: {[0m
[37m+ type: SYSTEM_ERROR,[0m
[37m+ code: ASDC_3014,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Service %s is not valid",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeRepositoryDeleteError: {[0m
[37m+ type: SYSTEM_ERROR,[0m
[37m+ code: ASDC_3015,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Failed to delete object %s from repository",[0m
[37m+ alarmSeverity: CRITICAL[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeRepositoryQueryError: {[0m
[37m+ type: SYSTEM_ERROR,[0m
[37m+ code: ASDC_3016,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Failed to fetch from repository %s",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeInvalidConfigurationError: {[0m
[37m+ type: CONFIG_ERROR,[0m
[37m+ code: ASDC_3017,[0m
[37m+ severity: FATAL,[0m
[37m+ description: "Configuration parameter %s is invalid. Value configured is %s",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeUebConnectionError: {[0m
[37m+ type: CONNECTION_PROBLEM,[0m
[37m+ code: ASDC_4001,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Connection problem towards U-EB server. Reason: %s",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeUebSystemError: {[0m
[37m+ type: SYSTEM_ERROR,[0m
[37m+ code: ASDC_3019,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Error occured during access to U-EB Server. Operation: %s",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeUebObjectNotFoundError: {[0m
[37m+ type: DATA_ERROR,[0m
[37m+ code: ASDC_4005,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Error occured during access to U-EB Server. Data not found: %s",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+[0m
[37m+ BeDistributionEngineSystemError: {[0m
[37m+ type: SYSTEM_ERROR,[0m
[37m+ code: ASDC_3021,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Error occured in Distribution Engine. Failed operation: %s",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeUebAuthenticationError: {[0m
[37m+ type: AUTHENTICATION_PROBLEM,[0m
[37m+ code: ASDC_4003,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Authentication problem towards U-EB server. Reason: %s",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeUebUnkownHostError: {[0m
[37m+ type: CONNECTION_PROBLEM,[0m
[37m+ code: ASDC_4002,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Connection problem towards U-EB server. Cannot reach host %s",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeDistributionEngineInvalidArtifactType: {[0m
[37m+ type: DATA_ERROR,[0m
[37m+ code: ASDC_4006,[0m
[37m+ severity: WARN,[0m
[37m+ description: "The artifact type %s does not appear in the list of valid artifacts %s",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ BeInvalidTypeError: {[0m
[37m+ type: DATA_ERROR,[0m
[37m+ code: ASDC_4008,[0m
[37m+ severity: WARN,[0m
[37m+ description: "The type %s of %s is invalid",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ BeInvalidValueError: {[0m
[37m+ type: DATA_ERROR,[0m
[37m+ code: ASDC_3028,[0m
[37m+ severity: WARN,[0m
[37m+ description: "The value %s of %s from type %s is invalid",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ } [0m
[37m+ [0m
[37m+ BeFailedDeletingResourceInstanceError: {[0m
[37m+ type: SYSTEM_ERROR,[0m
[37m+ code: ASDC_3029,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Failed to delete resource instance %s from service %s",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeMissingConfigurationError: {[0m
[37m+ type: CONFIG_ERROR,[0m
[37m+ code: ASDC_3030,[0m
[37m+ severity: FATAL,[0m
[37m+ description: "Configuration parameter %s is missing",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeConfigurationInvalidListSizeError: {[0m
[37m+ type: CONFIG_ERROR,[0m
[37m+ code: ASDC_3031,[0m
[37m+ severity: FATAL,[0m
[37m+ description: "Configuration parameter %s is invalid. At least %s values shall be configured",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ ErrorConfigFileFormat: {[0m
[37m+ type: CONFIG_ERROR,[0m
[37m+ code: ASDC_3032,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Error element not found in YAML name: %s",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeMissingArtifactInformationError: {[0m
[37m+ type: DATA_ERROR,[0m
[37m+ code: ASDC_4010,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Artifact uploaded has missing information. Missing %s",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeArtifactMissingError: {[0m
[37m+ type: DATA_ERROR,[0m
[37m+ code: ASDC_4011,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Artifact %s requested is not found",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeArtifactPayloadInvalid: {[0m
[37m+ type: DATA_ERROR,[0m
[37m+ code: ASDC_4012,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Payload of artifact uploaded is invalid (invalid MD5 or encryption)",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeUserMissingError: {[0m
[37m+ type: DATA_ERROR,[0m
[37m+ code: ASDC_4009,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "User %s requested is not found",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeArtifactInformationInvalidError: {[0m
[37m+ type: DATA_ERROR,[0m
[37m+ code: ASDC_4013,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Input for artifact metadata is invalid",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ BeFailedAddingCapabilityTypeError: {[0m
[37m+ type: DATA_ERROR,[0m
[37m+ code: ASDC_4015,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Failed adding capability type",[0m
[37m+ alarmSeverity: CRITICAL[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeCapabilityTypeMissingError: {[0m
[37m+ type: DATA_ERROR,[0m
[37m+ code: ASDC_4016,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Capability Type %s not found",[0m
[37m+ alarmSeverity: CRITICAL[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeInterfaceMissingError: {[0m
[37m+ type: DATA_ERROR,[0m
[37m+ code: ASDC_4020,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Interface %s required is missing",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeDaoSystemError: {[0m
[37m+ type: SYSTEM_ERROR,[0m
[37m+ code: ASDC_4014,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Operation towards database failed",[0m
[37m+ alarmSeverity: CRITICAL[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeSystemError: {[0m
[37m+ type: SYSTEM_ERROR,[0m
[37m+ code: ASDC_4017,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Unexpected error during operation",[0m
[37m+ alarmSeverity: CRITICAL[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeFailedLockObjectError: {[0m
[37m+ type: SYSTEM_ERROR,[0m
[37m+ code: ASDC_4007,[0m
[37m+ severity: WARN,[0m
[37m+ description: "Failed to lock object for update",[0m
[37m+ alarmSeverity: CRITICAL[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeInvalidJsonInput: {[0m
[37m+ type: SYSTEM_ERROR,[0m
[37m+ code: ASDC_4018,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Failed to convert json input to object",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeDistributionMissingError: {[0m
[37m+ type: DATA_ERROR,[0m
[37m+ code: ASDC_4021,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Distribution %s required is missing",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeHealthCheckRecovery: {[0m
[37m+ type: RECOVERY,[0m
[37m+ code: ASDC_4022,[0m
[37m+ severity: INFO,[0m
[37m+ description: "BE Health Check Recovery",[0m
[37m+ alarmSeverity: INFORMATIONAL[0m
[37m+ }[0m
[37m+ BeFailedCreateNodeError: {[0m
[37m+ type: DATA_ERROR,[0m
[37m+ code: ASDC_6000,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Failed to create node %s on graph. status is %s",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ BeFailedUpdateNodeError: {[0m
[37m+ type: DATA_ERROR,[0m
[37m+ code: ASDC_6001,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Failed to update node %s on graph. Status is %s",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeFailedDeleteNodeError: {[0m
[37m+ type: DATA_ERROR,[0m
[37m+ code: ASDC_6002,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Failed to delete node %s on graph. Status is %s",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeFailedRetrieveNodeError: {[0m
[37m+ type: DATA_ERROR,[0m
[37m+ code: ASDC_6003,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Failed to retrieve node %s from graph. Status is %s",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeExecuteRollbackError: {[0m
[37m+ type: DATA_ERROR,[0m
[37m+ code: ASDC_6004,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Going to execute rollback on graph.",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeFailedFindParentError: {[0m
[37m+ type: DATA_ERROR,[0m
[37m+ code: ASDC_6005,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Failed to find parent node %s on graph. Status is %s",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeFailedFindAllNodesError: {[0m
[37m+ type: DATA_ERROR,[0m
[37m+ code: ASDC_6006,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Failed to fetch all nodes with type %s of parent node %s . Status is %s",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeFailedFindAssociationError: {[0m
[37m+ type: DATA_ERROR,[0m
[37m+ code: ASDC_6007,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Cannot find node with type %s associated with node %s . Status is %s",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m
[37m+ BeFailedFindAssociationError: {[0m
[37m+ type: DATA_ERROR,[0m
[37m+ code: ASDC_6008,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Cannot find node with type %s associated with node %s . Status is %s",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ BeComponentCleanerSystemError: {[0m
[37m+ type: SYSTEM_ERROR,[0m
[37m+ code: ASDC_6009,[0m
[37m+ severity: ERROR,[0m
[37m+ description: "Error occured in Component Cleaner Task. Failed operation: %s",[0m
[37m+ alarmSeverity: MAJOR[0m
[37m+ }[0m
[37m+ [0m[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/ecomp-error-configuration.yaml] owner changed to 1000
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/ecomp-error-configuration.yaml] owner changed to 1000
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/ecomp-error-configuration.yaml] group changed to 101
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/ecomp-error-configuration.yaml] group changed to 101
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/ecomp-error-configuration.yaml] mode changed to 644
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/ecomp-error-configuration.yaml] mode changed to 644
[32m- change mode from '' to '0644'[0m
[32m- change owner from '' to 'onap'[0m
[32m- change group from '' to 'onap'[0m
[0m * cookbook_file[/app/jetty/config/catalog-be/error-configuration.yaml] action create_if_missing[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/error-configuration.yaml] created file /app/jetty/config/catalog-be/error-configuration.yaml
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/error-configuration.yaml] created file /app/jetty/config/catalog-be/error-configuration.yaml
[32m- create new file /app/jetty/config/catalog-be/error-configuration.yaml[0m[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/error-configuration.yaml] updated file contents /app/jetty/config/catalog-be/error-configuration.yaml
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/error-configuration.yaml] updated file contents /app/jetty/config/catalog-be/error-configuration.yaml
[32m- update content in file /app/jetty/config/catalog-be/error-configuration.yaml from none to 734414[0m
[37m--- /app/jetty/config/catalog-be/error-configuration.yaml 2021-06-04 01:20:09.641610133 +0000[0m
[37m+++ /app/jetty/config/catalog-be/.chef-error-configuration20210604-18-z40zym.yaml 2021-06-04 01:20:09.641610133 +0000[0m
[37m@@ -1,2467 +1,4934 @@[0m
[37m+# Errors[0m
[37m+errors:[0m
[37m+ OK: {[0m
[37m+ code: 200,[0m
[37m+ message: "OK"[0m
[37m+ }[0m
[37m+ CREATED: {[0m
[37m+ code: 201,[0m
[37m+ message: "OK"[0m
[37m+ }[0m
[37m+ ACCEPTED: {[0m
[37m+ code: 202,[0m
[37m+ message: "Accepted"[0m
[37m+ }[0m
[37m+ NO_CONTENT: {[0m
[37m+ code: 204,[0m
[37m+ message: "No Content"[0m
[37m+ }[0m
[37m+ #--------POL4050-----------------------------[0m
[37m+ NOT_ALLOWED: {[0m
[37m+ code: 405,[0m
[37m+ message: "Error: Method not allowed.",[0m
[37m+ messageId: "POL4050"[0m
[37m+ }[0m
[37m+ #--------POL5000-----------------------------[0m
[37m+ GENERAL_ERROR: {[0m
[37m+ code: 500,[0m
[37m+ message: "Error: Internal Server Error. Please try again later.",[0m
[37m+ messageId: "POL5000"[0m
[37m+ }[0m
[37m+ #---------POL5001------------------------------[0m
[37m+ MISSING_X_ECOMP_INSTANCE_ID: {[0m
[37m+ code: 400 ,[0m
[37m+ message: "Error: Missing 'X-ECOMP-InstanceID' HTTP header.",[0m
[37m+ messageId: "POL5001"[0m
[37m+ }[0m
[37m+ #---------POL5002------------------------------[0m
[37m+ AUTH_REQUIRED: {[0m
[37m+ code: 401 ,[0m
[37m+ message: "Error: Authentication is required to use the API.",[0m
[37m+ messageId: "POL5002"[0m
[37m+ }[0m
[37m+ #---------POL5003------------------------------[0m
[37m+ AUTH_FAILED: {[0m
[37m+ code: 403 ,[0m
[37m+ message: "Error: Not authorized to use the API.",[0m
[37m+ messageId: "POL5003"[0m
[37m+ }[0m
[37m+ #---------POL5004------------------------------[0m
[37m+ MISSING_USER_ID: {[0m
[37m+ code: 400 ,[0m
[37m+ message: "Error: Missing 'USER_ID' HTTP header.",[0m
[37m+ messageId: "POL5004"[0m
[37m+ }[0m
[37m+ #---------POL5005------------------------------[0m
[37m+ SESSION_EXPIRED: {[0m
[37m+ code: 403 ,[0m
[37m+ message: "Your session has expired. Please close the SDC tab and re-enter the SDC application.",[0m
[37m+ messageId: "POL5005"[0m
[37m+ }[0m
[37m+ #---------SVC4000-----------------------------[0m
[37m+ INVALID_CONTENT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid content.",[0m
[37m+ messageId: "SVC4000"[0m
[37m+ }[0m
[37m+ #---------SVC4002-----------------------------[0m
[37m+ MISSING_INFORMATION: {[0m
[37m+ code: 403,[0m
[37m+ message: "Error: Missing information.",[0m
[37m+ messageId: "SVC4002"[0m
[37m+ }[0m
[37m+ #---------SVC4003------------------------------[0m
[37m+ # %1 - Users's ID[0m
[37m+ USER_NOT_FOUND: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: User '%1' was not found.",[0m
[37m+ messageId: "SVC4003"[0m
[37m+ }[0m
[37m+ #---------SVC4004-----------------------------[0m
[37m+ # %1 - Users's email address[0m
[37m+ INVALID_EMAIL_ADDRESS: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid email address '%1'.",[0m
[37m+ messageId: "SVC4004"[0m
[37m+ }[0m
[37m+ #---------SVC4005------------------------------[0m
[37m+ # %1 - role[0m
[37m+ INVALID_ROLE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid role '%1'.",[0m
[37m+ messageId: "SVC4005"[0m
[37m+ }[0m
[37m+ #---------SVC4006------------------------------[0m
[37m+ # %1 - Users's USER_ID[0m
[37m+ USER_ALREADY_EXIST: {[0m
[37m+ code: 409,[0m
[37m+ message: "Error: User with '%1' ID already exists.",[0m
[37m+ messageId: "SVC4006"[0m
[37m+ }[0m
[37m+ #---------SVC4007------------------------------[0m
[37m+ DELETE_USER_ADMIN_CONFLICT: {[0m
[37m+ code: 409,[0m
[37m+ message: "Error: An administrator can only be deleted by another administrator.",[0m
[37m+ messageId: "SVC4007"[0m
[37m+ }[0m
[37m+ #---------SVC4008-----------------------------[0m
[37m+ # %1 - Users's userId[0m
[37m+ INVALID_USER_ID: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid userId '%1'.",[0m
[37m+ messageId: "SVC4008"[0m
[37m+ }[0m
[37m+#---------SVC4009-----------------------------[0m
[37m+ USER_DEFINED: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: User Defined '%1'.",[0m
[37m+ messageId: "SVC4009"[0m
[37m+ }[0m
[37m+ #---------SVC4049------------------------------[0m
[37m+ # %1 - service/resource[0m
[37m+ COMPONENT_MISSING_CONTACT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Missing %1 contact.",[0m
[37m+ messageId: "SVC4049"[0m
[37m+ }[0m
[37m+ #---------SVC4050-----------------------------[0m
[37m+ # %1 - Service/Resource/Additional parameter[0m
[37m+ # %2 - service/resource/label name[0m
[37m+ COMPONENT_NAME_ALREADY_EXIST: {[0m
[37m+ code: 409,[0m
[37m+ message: "Error: %1 with name '%2' already exists.",[0m
[37m+ messageId: "SVC4050"[0m
[37m+ }[0m
[37m+ #---------SVC4051------------------------------[0m
[37m+ # %1 - resource/service[0m
[37m+ COMPONENT_MISSING_CATEGORY: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Missing %1 category.",[0m
[37m+ messageId: "SVC4051"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4052------------------------------[0m
[37m+ COMPONENT_MISSING_TAGS: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. At least one tag has to be specified.",[0m
[37m+ messageId: "SVC4052"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4053------------------------------[0m
[37m+ # %1 - service/resource[0m
[37m+ COMPONENT_MISSING_DESCRIPTION: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Missing %1 description.",[0m
[37m+ messageId: "SVC4053"[0m
[37m+ }[0m
[37m+ #---------SVC4054------------------------------[0m
[37m+ # %1 - resource/service[0m
[37m+ COMPONENT_INVALID_CATEGORY: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Value %1 for the field Category is invalid.",[0m
[37m+ messageId: "SVC4054"[0m
[37m+ }[0m
[37m+ #---------SVC4055------------------------------[0m
[37m+ MISSING_VENDOR_NAME: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Missing vendor name.",[0m
[37m+ messageId: "SVC4055"[0m
[37m+ }[0m
[37m+ #---------SVC4056------------------------------[0m
[37m+ MISSING_VENDOR_RELEASE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Missing vendor release.",[0m
[37m+ messageId: "SVC4056"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4057------------------------------[0m
[37m+ MISSING_DERIVED_FROM_TEMPLATE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Missing derived from template specification.",[0m
[37m+ messageId: "SVC4057"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4058------------------------------[0m
[37m+ # %1 - service/resource[0m
[37m+ COMPONENT_MISSING_ICON: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Missing %1 icon.",[0m
[37m+ messageId: "SVC4058"[0m
[37m+ }[0m
[37m+ #---------SVC4059------------------------------[0m
[37m+ # %1 - service/resource[0m
[37m+ COMPONENT_INVALID_ICON: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Invalid %1 icon.",[0m
[37m+ messageId: "SVC4059"[0m
[37m+ }[0m
[37m+ #---------SVC4060------------------------------[0m
[37m+ PARENT_RESOURCE_NOT_FOUND: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Derived from resource template was not found.",[0m
[37m+ messageId: "SVC4060"[0m
[37m+ }[0m
[37m+ #---------SVC4061------------------------------[0m
[37m+ MULTIPLE_PARENT_RESOURCE_FOUND: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Multiple derived from resource template is not allowed.",[0m
[37m+ messageId: "SVC4061"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4062------------------------------[0m
[37m+ # %1 - service/resource[0m
[37m+ MISSING_COMPONENT_NAME: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Missing %1 name.",[0m
[37m+ messageId: "SVC4062"[0m
[37m+ }[0m
[37m+ #---------SVC4063------------------------------[0m
[37m+ #%1 - resource/service name[0m
[37m+ RESOURCE_NOT_FOUND: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: Requested '%1' resource was not found.",[0m
[37m+ messageId: "SVC4063"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4064------------------------------[0m
[37m+ # %1 - Service/Resource/Property[0m
[37m+ COMPONENT_INVALID_DESCRIPTION: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. %1 description contains non-english characters.",[0m
[37m+ messageId: "SVC4064"[0m
[37m+ }[0m
[37m+ #---------SVC4065------------------------------[0m
[37m+ # %1 - Service/Resource/Property[0m
[37m+ # %2 - max resource/service name length[0m
[37m+ COMPONENT_DESCRIPTION_EXCEEDS_LIMIT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. %1 description exceeds limit of %2 characters.",[0m
[37m+ messageId: "SVC4065"[0m
[37m+ }[0m
[37m+ #---------SVC4066------------------------------[0m
[37m+ # %1 - max length[0m
[37m+ COMPONENT_TAGS_EXCEED_LIMIT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Tags overall length exceeds limit of %1 characters.",[0m
[37m+ messageId: "SVC4066"[0m
[37m+ }[0m
[37m+ #---------SVC4067------------------------------[0m
[37m+ # %1 - max length[0m
[37m+ VENDOR_NAME_EXCEEDS_LIMIT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Vendor name exceeds limit of %1 characters.",[0m
[37m+ messageId: "SVC4067"[0m
[37m+ }[0m
[37m+ #---------SVC4068------------------------------[0m
[37m+ # %1 - max length[0m
[37m+ VENDOR_RELEASE_EXCEEDS_LIMIT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Vendor release exceeds limit of %1 characters.",[0m
[37m+ messageId: "SVC4068"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4069------------------------------[0m
[37m+ # %1 - Service/Resource/Product[0m
[37m+ COMPONENT_INVALID_CONTACT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. %1 Contact Id should be in format 'mnnnnnn' or 'aannna' or 'aannnn', where m=m ,a=a-zA-Z and n=0-9. Max length: 50",[0m
[37m+ messageId: "SVC4069"[0m
[37m+ }[0m
[37m+ #---------SVC4070------------------------------[0m
[37m+ # %1 - Service/Resource[0m
[37m+ INVALID_COMPONENT_NAME: {[0m
[37m+ code: 400,[0m
[37m+ message: 'Error: Invalid Content. Value %1 for Component name is invalid. Only alphanumeric characters and regular spaces are allowed.',[0m
[37m+ messageId: "SVC4070"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4071------------------------------[0m
[37m+ INVALID_VENDOR_NAME: {[0m
[37m+ code: 400,[0m
[37m+ message: 'Error: Invalid Content. Value %1 for the field Vendor name is invalid. Only alphanumeric characters and regular spaces are allowed.',[0m
[37m+ messageId: "SVC4071"[0m
[37m+ }[0m
[37m+ #---------SVC4072------------------------------[0m
[37m+ INVALID_VENDOR_RELEASE: {[0m
[37m+ code: 400,[0m
[37m+ message: 'Error: Invalid Content. Value %1 for the field Vendor release is invalid. Only alphanumeric characters and regular spaces are allowed.',[0m
[37m+ messageId: "SVC4072"[0m
[37m+ }[0m
[37m+ #---------SVC4073------------------------------[0m
[37m+ # %1 - Service/Resource[0m
[37m+ # %2 - max resource/service name[0m
[37m+ COMPONENT_NAME_EXCEEDS_LIMIT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. %1 name exceeds limit of %2 characters.",[0m
[37m+ messageId: "SVC4073"[0m
[37m+ }[0m
[37m+ #---------SVC4080------------------------------[0m
[37m+ # %1 - resource/service name[0m
[37m+ # %2 - resource/service[0m
[37m+ # %3 - First name of last modifier[0m
[37m+ # %4 - Last name of last modifier[0m
[37m+ # %5 - USER_ID of last modifier[0m
[37m+ COMPONENT_IN_CHECKOUT_STATE: {[0m
[37m+ code: 403,[0m
[37m+ message: "Error: Requested '%1' %2 is locked for modification by %3 %4(%5).",[0m
[37m+ messageId: "SVC4080"[0m
[37m+ }[0m
[37m+ #---------SVC4081-----------------------------[0m
[37m+ # %1 - resource/service name[0m
[37m+ # %2 - resource/service[0m
[37m+ # %3 - First name of last modifier[0m
[37m+ # %4 - Last name of last modifier[0m
[37m+ # %5 - USER_ID of last modifier[0m
[37m+ COMPONENT_IN_CERT_IN_PROGRESS_STATE: {[0m
[37m+ code: 403,[0m
[37m+ message: "Error: Requested '%1' %2 is locked for certification by %3 %4(%5).",[0m
[37m+ messageId: "SVC4081"[0m
[37m+ }[0m
[37m+[0m
[37m+ #-----------SVC4082---------------------------[0m
[37m+ # %1 - resource/service name[0m
[37m+ # %2 - resource/service[0m
[37m+ # %3 - First name of last modifier[0m
[37m+ # %4 - Last name of last modifier[0m
[37m+ # %5 - USER_ID of last modifier[0m
[37m+ COMPONENT_SENT_FOR_CERTIFICATION: {[0m
[37m+ code: 403,[0m
[37m+ message: "Error: Requested '%1' %2 is sent for certification by %3 %4(%5).",[0m
[37m+ messageId: "SVC4082"[0m
[37m+ }[0m
[37m+ #-----------SVC4083---------------------------[0m
[37m+ COMPONENT_VERSION_ALREADY_EXIST: {[0m
[37m+ code: 409,[0m
[37m+ message: "Error: Version of this %1 was already promoted.",[0m
[37m+ messageId: "SVC4083"[0m
[37m+ }[0m
[37m+ #-----------SVC4084---------------------------[0m
[37m+ # %1 - resource/service/product name[0m
[37m+ # %2 - resource/service/product[0m
[37m+ # %3 - First name of last modifier[0m
[37m+ # %4 - Last name of last modifier[0m
[37m+ # %5 - USER_ID of last modifier[0m
[37m+ COMPONENT_ALREADY_CHECKED_IN: {[0m
[37m+ code: 409,[0m
[37m+ message: "Error: The current version of '%1' %2 was already checked-in by %3 %4(%5).",[0m
[37m+ messageId: "SVC4084"[0m
[37m+ }[0m
[37m+ #-----------SVC4085---------------------------[0m
[37m+ # %1 - resource/service/product name[0m
[37m+ # %2 - resource/service/product[0m
[37m+ # %3 - First name of last modifier[0m
[37m+ # %4 - Last name of last modifier[0m
[37m+ # %5 - USER_ID of last modifier[0m
[37m+ COMPONENT_CHECKOUT_BY_ANOTHER_USER: {[0m
[37m+ code: 403,[0m
[37m+ message: "Error: %1 %2 has already been checked out by %3 %4(%5).",[0m
[37m+ messageId: "SVC4085"[0m
[37m+ }[0m
[37m+ #-----------SVC4086---------------------------[0m
[37m+ # %1 - resource/service name[0m
[37m+ # %2 - resource/service[0m
[37m+ COMPONENT_IN_USE: {[0m
[37m+ code: 403,[0m
[37m+ message: "Error: '%1' %2 is still held by previous action. Please try again later.",[0m
[37m+ messageId: "SVC4086"[0m
[37m+ }[0m
[37m+ #-----------SVC4087---------------------------[0m
[37m+ # %1 - component name[0m
[37m+ # %2 - resource/service/product[0m
[37m+ COMPONENT_HAS_NEWER_VERSION: {[0m
[37m+ code: 409,[0m
[37m+ message: "Error: Checking out of the requested version of the '%1' %2 is not allowed as a newer version exists.",[0m
[37m+ messageId: "SVC4087"[0m
[37m+ }[0m
[37m+ #-----------SVC4088---------------------------[0m
[37m+ # %1 - resource/service name[0m
[37m+ # %2 - resource/service[0m
[37m+ # %3 - First name of last modifier[0m
[37m+ # %4 - Last name of last modifier[0m
[37m+ # %5 - USER_ID of last modifier[0m
[37m+ COMPONENT_ALREADY_CERTIFIED: {[0m
[37m+ code: 403,[0m
[37m+ message: "Error: Requested %1 %2 has already been certified by %3 %4(%5).",[0m
[37m+ messageId: "SVC4088"[0m
[37m+ }[0m
[37m+ #-----------SVC4089---------------------------[0m
[37m+ # %1 - resource/service name[0m
[37m+ # %2 - resource/service[0m
[37m+ COMPONENT_NOT_READY_FOR_CERTIFICATION: {[0m
[37m+ code: 403,[0m
[37m+ message: "Error: Requested '%1' %2 is not ready for certification.",[0m
[37m+ messageId: "SVC4089"[0m
[37m+ }[0m
[37m+ #-----------SVC4100---------------------------[0m
[37m+ #%1 - property name[0m
[37m+ PROPERTY_NOT_FOUND: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: Requested '%1' property was not found.",[0m
[37m+ messageId: "SVC4100"[0m
[37m+ }[0m
[37m+ #-----------SVC4101---------------------------[0m
[37m+ #%1 - property name[0m
[37m+ PROPERTY_ALREADY_EXIST: {[0m
[37m+ code: 409,[0m
[37m+ message: "Error: Property with '%1' name already exists.",[0m
[37m+ messageId: "SVC4101"[0m
[37m+ }[0m
[37m+[0m
[37m+ #-----------SVC4102---------------------------[0m
[37m+ # %1 - capability type name[0m
[37m+ CAPABILITY_TYPE_ALREADY_EXIST: {[0m
[37m+ code: 409,[0m
[37m+ message: "Error: Capability Type with name '%1' already exists.",[0m
[37m+ messageId: "SVC4102"[0m
[37m+ }[0m
[37m+ #-----------SVC4114---------------------------[0m
[37m+ AUTH_FAILED_INVALIDE_HEADER: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Authorization header.",[0m
[37m+ messageId: "SVC4114"[0m
[37m+ }[0m
[37m+ #-----------SVC4115---------------------------[0m
[37m+ # %1 - capability type name[0m
[37m+ MISSING_CAPABILITY_TYPE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Missing Capability Type '%1'.",[0m
[37m+ messageId: "SVC4115"[0m
[37m+ }[0m
[37m+ RESOURCE_INSTANCE_BAD_REQUEST: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content.",[0m
[37m+ messageId: "SVC4116"[0m
[37m+ }[0m
[37m+ #-----------SVC4117---------------------------[0m
[37m+ # %1 - resource instance name[0m
[37m+ # %2 - resource instance name[0m
[37m+ # %3 - requirement name[0m
[37m+ RESOURCE_INSTANCE_MATCH_NOT_FOUND: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: Match not found between resource instance '%1' and resource instance '%2' for requirement '%3'.",[0m
[37m+ messageId: "SVC4117"[0m
[37m+ }[0m
[37m+ #-----------SVC4118---------------------------[0m
[37m+ # %1 - resource instance name[0m
[37m+ # %2 - resource instance name[0m
[37m+ # %3 - requirement name[0m
[37m+ RESOURCE_INSTANCE_ALREADY_EXIST: {[0m
[37m+ code: 409,[0m
[37m+ message: "Error: Resource instances '%1' and '%2' are already associated with requirement '%3'.",[0m
[37m+ messageId: "SVC4118"[0m
[37m+ }[0m
[37m+ #-----------SVC4119---------------------------[0m
[37m+ # %1 - resource instance name[0m
[37m+ # %2 - resource instance name[0m
[37m+ # %3 - requirement name[0m
[37m+ RESOURCE_INSTANCE_RELATION_NOT_FOUND: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: No relation found between resource instances '%1' and '%2' for requirement '%3'.",[0m
[37m+ messageId: "SVC4119"[0m
[37m+ }[0m
[37m+ #-----------SVC4120---------------------------[0m
[37m+ # %1 - User's USER_ID[0m
[37m+ USER_INACTIVE: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: User %1 inactive.",[0m
[37m+ messageId: "SVC4120"[0m
[37m+ }[0m
[37m+ #-----------SVC4121---------------------------[0m
[37m+ # %1 - User's USER_ID[0m
[37m+ USER_HAS_ACTIVE_ELEMENTS: {[0m
[37m+ code: 403,[0m
[37m+ message: "Error: User with %1 ID can not be deleted since it has active elements(resources/services/artifacts).",[0m
[37m+ messageId: "SVC4121"[0m
[37m+ }[0m
[37m+ #-----------SVC4122---------------------------[0m
[37m+ # %1 - artifact type[0m
[37m+ ARTIFACT_TYPE_NOT_SUPPORTED: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid artifact type '%1'.",[0m
[37m+ messageId: "SVC4122"[0m
[37m+ }[0m
[37m+ #-----------SVC4123---------------------------[0m
[37m+ ARTIFACT_LOGICAL_NAME_CANNOT_BE_CHANGED: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Artifact logical name cannot be changed.",[0m
[37m+ messageId: "SVC4123"[0m
[37m+ }[0m
[37m+ #-----------SVC4124---------------------------[0m
[37m+ MISSING_ARTIFACT_TYPE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Missing artifact type.",[0m
[37m+ messageId: "SVC4124"[0m
[37m+ }[0m
[37m+ #-----------SVC4125---------------------------[0m
[37m+ # %1-artifact name[0m
[37m+ ARTIFACT_EXIST: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Artifact '%1' already exists.",[0m
[37m+ messageId: "SVC4125"[0m
[37m+ }[0m
[37m+ #---------SVC4126------------------------------[0m
[37m+ # %1 - resource/service/product/...[0m
[37m+ # %2 - field (tag, vendor name...)[0m
[37m+ INVALID_FIELD_FORMAT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid %1 %2 format.",[0m
[37m+ messageId: "SVC4126"[0m
[37m+ }[0m
[37m+ #-----------SVC4127---------------------------[0m
[37m+ ARTIFACT_INVALID_MD5: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid artifact checksum.",[0m
[37m+ messageId: "SVC4127"[0m
[37m+ }[0m
[37m+ #-----------SVC4128---------------------------[0m
[37m+ MISSING_ARTIFACT_NAME: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid content. Missing artifact name.",[0m
[37m+ messageId: "SVC4128"[0m
[37m+ }[0m
[37m+ #-----------SVC4129---------------------------[0m
[37m+ MISSING_PROJECT_CODE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Missing PROJECT_CODE number.",[0m
[37m+ messageId: "SVC4129"[0m
[37m+ }[0m
[37m+ #-----------SVC4130---------------------------[0m
[37m+ INVALID_PROJECT_CODE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. PROJECT_CODE must be from 5 up to 50 characters.",[0m
[37m+ messageId: "SVC4130"[0m
[37m+ }[0m
[37m+ #-----------SVC4131---------------------------[0m
[37m+ # %1-resource/service[0m
[37m+ # %2-srtifact/artifacts[0m
[37m+ # %3-semicolomn separated list of artifact[0m
[37m+ COMPONENT_MISSING_MANDATORY_ARTIFACTS: {[0m
[37m+ code: 403,[0m
[37m+ message: "Error: Missing mandatory informational %1 %2: [%3].",[0m
[37m+ messageId: "SVC4131"[0m
[37m+ }[0m
[37m+ #-----------SVC4132---------------------------[0m
[37m+ # %1 - lifecycle type name[0m
[37m+ LIFECYCLE_TYPE_ALREADY_EXIST: {[0m
[37m+ code: 409,[0m
[37m+ message: "Error: Lifecycle Type with name '%1' already exists.",[0m
[37m+ messageId: "SVC4132"[0m
[37m+ }[0m
[37m+ #-----------SVC4133---------------------------[0m
[37m+ # %1 - service version[0m
[37m+ # %2 - service name[0m
[37m+ SERVICE_NOT_AVAILABLE_FOR_DISTRIBUTION: {[0m
[37m+ code: 403,[0m
[37m+ message: "Error: Version %1 of '%2' service is not available for distribution.",[0m
[37m+ messageId: "SVC4133"[0m
[37m+ }[0m
[37m+ #-----------SVC4134---------------------------[0m
[37m+ MISSING_LIFECYCLE_TYPE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Missing interface life-cycle type.",[0m
[37m+ messageId: "SVC4134"[0m
[37m+ }[0m
[37m+ #---------SVC4135------------------------------[0m
[37m+ SERVICE_CATEGORY_CANNOT_BE_CHANGED: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Service category cannot be changed once the service is certified.",[0m
[37m+ messageId: "SVC4135"[0m
[37m+ }[0m
[37m+ #---------SVC4136------------------------------[0m
[37m+ # %1 - distribution environment name[0m
[37m+ DISTRIBUTION_ENVIRONMENT_NOT_AVAILABLE: {[0m
[37m+ code: 500,[0m
[37m+ message: "Error: Requested distribution environment '%1' is not available.",[0m
[37m+ messageId: "SVC4136"[0m
[37m+ }[0m
[37m+ #---------SVC4137------------------------------[0m
[37m+ # %1 - distribution environment name[0m
[37m+ DISTRIBUTION_ENVIRONMENT_NOT_FOUND: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Requested distribution environment '%1' was not found.",[0m
[37m+ messageId: "SVC4137"[0m
[37m+ }[0m
[37m+ #---------SVC4138------------------------------[0m
[37m+ DISTRIBUTION_ENVIRONMENT_INVALID: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid distribution environment.",[0m
[37m+ messageId: "SVC4138"[0m
[37m+ }[0m
[37m+ #---------SVC4200------------------------------[0m
[37m+ # %1 - Service/Resource[0m
[37m+ # %2 - max icon name length[0m
[37m+ COMPONENT_ICON_EXCEEDS_LIMIT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. %1 icon name exceeds limit of %2 characters.",[0m
[37m+ messageId: "SVC4200"[0m
[37m+ }[0m
[37m+ #---------SVC4300------------------------------[0m
[37m+ RESTRICTED_ACCESS: {[0m
[37m+ code: 403,[0m
[37m+ message: "Error: Restricted access.",[0m
[37m+ messageId: "SVC4300"[0m
[37m+ }[0m
[37m+ #---------SVC4301------------------------------[0m
[37m+ RESTRICTED_OPERATION: {[0m
[37m+ code: 403,[0m
[37m+ message: "Error: Restricted operation.",[0m
[37m+ messageId: "SVC4301"[0m
[37m+ }[0m
[37m+ #---------SVC4500------------------------------[0m
[37m+ MISSING_BODY: {[0m
[37m+ code: 400 ,[0m
[37m+ message: "Error: Missing request body.",[0m
[37m+ messageId: "SVC4500"[0m
[37m+ }[0m
[37m+ #---------SVC4501------------------------------[0m
[37m+ MISSING_PUBLIC_KEY: {[0m
[37m+ code: 400 ,[0m
[37m+ message: "Error: Invalid Content. Missing mandatory parameter 'apiPublicKey'." ,[0m
[37m+ messageId: "SVC4501"[0m
[37m+ }[0m
[37m+ #---------SVC4502------------------------------[0m
[37m+ DISTRIBUTION_ENV_DOES_NOT_EXIST: {[0m
[37m+ code: 400 ,[0m
[37m+ message: "Error: Invalid Body : Missing mandatory parameter 'distrEnvName'." ,[0m
[37m+ messageId: "SVC4502"[0m
[37m+ }[0m
[37m+ #-----------SVC4503---------------------------[0m
[37m+ # %1 - service name[0m
[37m+ SERVICE_NOT_FOUND: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: Requested '%1' service was not found.",[0m
[37m+ messageId: "SVC4503"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4504------------------------------[0m
[37m+ # %1 - Service/Resource[0m
[37m+ # %2 - service/resource version[0m
[37m+ COMPONENT_VERSION_NOT_FOUND: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: %1 version %2 was not found.",[0m
[37m+ messageId: "SVC4504"[0m
[37m+ }[0m
[37m+ #-----------SVC4505---------------------------[0m
[37m+ #%1-artifact name[0m
[37m+[0m
[37m+ ARTIFACT_NOT_FOUND: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: Artifact '%1' was not found.",[0m
[37m+ messageId: "SVC4505"[0m
[37m+ }[0m
[37m+ #---------SVC4506------------------------------[0m
[37m+ MISSING_ENV_NAME: {[0m
[37m+ code: 400 ,[0m
[37m+ message: "Error: Invalid Content. Missing mandatory parameter 'distrEnvName'.",[0m
[37m+ messageId: "SVC4506"[0m
[37m+ }[0m
[37m+ #---------SVC4507------------------------------[0m
[37m+ COMPONENT_INVALID_TAGS_NO_COMP_NAME: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. One of the tags should be the component name.",[0m
[37m+ messageId: "SVC4507"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4508------------------------------[0m
[37m+ SERVICE_NAME_CANNOT_BE_CHANGED: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Service name cannot be changed once the service is certified.",[0m
[37m+ messageId: "SVC4508"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4509------------------------------[0m
[37m+ SERVICE_ICON_CANNOT_BE_CHANGED: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Icon cannot be changed once the service is certified.",[0m
[37m+ messageId: "SVC4509"[0m
[37m+ }[0m
[37m+ #---------SVC4510------------------------------[0m
[37m+ # %1 - icon name max length[0m
[37m+ SERVICE_ICON_EXCEEDS_LIMIT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Icon name exceeds limit of %1 characters.",[0m
[37m+ messageId: "SVC4510"[0m
[37m+ }[0m
[37m+ #---------SVC4511------------------------------[0m
[37m+ DISTRIBUTION_REQUESTED_NOT_FOUND: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: Requested distribution was not found.",[0m
[37m+ messageId: "SVC4511"[0m
[37m+ }[0m
[37m+ #---------SVC4512------------------------------[0m
[37m+ # %1 - Distribution ID[0m
[37m+ DISTRIBUTION_REQUESTED_FAILED: {[0m
[37m+ code: 403,[0m
[37m+ message: "Error: Requested distribution '%1' failed.",[0m
[37m+ messageId: "SVC4512"[0m
[37m+ }[0m
[37m+ #---------SVC4513------------------------------[0m
[37m+ RESOURCE_CATEGORY_CANNOT_BE_CHANGED: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Resource category cannot be changed once the resource is certified.",[0m
[37m+ messageId: "SVC4513"[0m
[37m+ }[0m
[37m+ #---------SVC4514------------------------------[0m
[37m+ RESOURCE_NAME_CANNOT_BE_CHANGED: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Resource name cannot be changed once the resource is certified.",[0m
[37m+ messageId: "SVC4514"[0m
[37m+ }[0m
[37m+ #---------SVC4515------------------------------[0m
[37m+ RESOURCE_ICON_CANNOT_BE_CHANGED: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Icon cannot be changed once the resource is certified.",[0m
[37m+ messageId: "SVC4515"[0m
[37m+ }[0m
[37m+ #---------SVC4516------------------------------[0m
[37m+ RESOURCE_VENDOR_NAME_CANNOT_BE_CHANGED: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Vendor name cannot be changed once the resource is certified.",[0m
[37m+ messageId: "SVC4516"[0m
[37m+ }[0m
[37m+ #---------SVC4517------------------------------[0m
[37m+ RESOURCE_DERIVED_FROM_CANNOT_BE_CHANGED: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Derived from resource template cannot be changed once the resource is certified.",[0m
[37m+ messageId: "SVC4517"[0m
[37m+ }[0m
[37m+ #---------SVC4518------------------------------[0m
[37m+ # %1 - max length[0m
[37m+ COMPONENT_SINGLE_TAG_EXCEED_LIMIT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Single tag exceeds limit of %1 characters.",[0m
[37m+ messageId: "SVC4518"[0m
[37m+ }[0m
[37m+ #---------SVC4519------------------------------[0m
[37m+ INVALID_DEFAULT_VALUE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: mismatch in data-type occurred for property %1. data type is %2 and default value found is %3.",[0m
[37m+ messageId: "SVC4519"[0m
[37m+ }[0m
[37m+ #---------SVC4520------------------------------[0m
[37m+ # %1 - service or resource[0m
[37m+ ADDITIONAL_INFORMATION_MAX_NUMBER_REACHED: {[0m
[37m+ code: 409,[0m
[37m+ message: "Error: Maximal number of additional %1 parameters was reached.",[0m
[37m+ messageId: "SVC4520"[0m
[37m+ }[0m
[37m+ #---------SVC4521------------------------------[0m
[37m+ ADDITIONAL_INFORMATION_EMPTY_STRING_NOT_ALLOWED: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. The Additional information label and value cannot be empty.",[0m
[37m+ messageId: "SVC4521"[0m
[37m+ }[0m
[37m+ #---------SVC4522------------------------------[0m
[37m+ # %1 - label/value[0m
[37m+ # %2 - Maximal length of %1[0m
[37m+ ADDITIONAL_INFORMATION_EXCEEDS_LIMIT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Additional information %1 exceeds limit of %2 characters.",[0m
[37m+ messageId: "SVC4522"[0m
[37m+ }[0m
[37m+ #---------SVC4523------------------------------[0m
[37m+ ADDITIONAL_INFORMATION_KEY_NOT_ALLOWED_CHARACTERS: {[0m
[37m+ code: 400,[0m
[37m+ message: 'Error: Invalid Content. Additional information label is not allowed to contain characters like <>:"\/|?* and space characters other than regular space.',[0m
[37m+ messageId: "SVC4523"[0m
[37m+ }[0m
[37m+ #---------SVC4524------------------------------[0m
[37m+ ADDITIONAL_INFORMATION_NOT_FOUND: {[0m
[37m+ code: 409,[0m
[37m+ message: "Error: Requested additional information was not found.",[0m
[37m+ messageId: "SVC4524"[0m
[37m+ }[0m
[37m+ #---------SVC4525------------------------------[0m
[37m+ ADDITIONAL_INFORMATION_VALUE_NOT_ALLOWED_CHARACTERS: {[0m
[37m+ code: 400,[0m
[37m+ message: 'Error: Invalid Content. Additional information contains non-english characters.',[0m
[37m+ messageId: "SVC4525"[0m
[37m+ }[0m
[37m+ #---------SVC4526------------------------------[0m
[37m+ RESOURCE_INSTANCE_NOT_FOUND: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: Requested '%1' resource instance was not found.",[0m
[37m+ messageId: "SVC4526"[0m
[37m+ }[0m
[37m+ #---------SVC4527------------------------------[0m
[37m+ ASDC_VERSION_NOT_FOUND: {[0m
[37m+ code: 500,[0m
[37m+ message: 'Error: ASDC version cannot be displayed.',[0m
[37m+ messageId: "SVC4527"[0m
[37m+ }[0m
[37m+ #---------SVC4528------------------------------[0m
[37m+ # %1-artifact url/artifact label/artifact description/VNF Service Indicator[0m
[37m+ MISSING_DATA: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid content. Missing %1.",[0m
[37m+ messageId: "SVC4528"[0m
[37m+ }[0m
[37m+ #---------SVC4529------------------------------[0m
[37m+ # %1-artifact url/artifact label/artifact description/artifact name[0m
[37m+ # %2 - Maximal length of %1[0m
[37m+ EXCEEDS_LIMIT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. %1 exceeds limit of %2 characters.",[0m
[37m+ messageId: "SVC4529"[0m
[37m+ }[0m
[37m+ #---------SVC4530------------------------------[0m
[37m+ ARTIFACT_INVALID_TIMEOUT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Artifact Timeout should be set to valid positive non-zero number of minutes.",[0m
[37m+ messageId: "SVC4530"[0m
[37m+ }[0m
[37m+ #---------SVC4531------------------------------[0m
[37m+ SERVICE_IS_VNF_CANNOT_BE_CHANGED: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: VNF Indicator cannot be updated for certified service.",[0m
[37m+ messageId: "SVC4531"[0m
[37m+ }[0m
[37m+ #---------SVC4532------------------------------[0m
[37m+ RESOURCE_INSTANCE_NOT_FOUND_ON_SERVICE: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: Requested '%1' resource instance was not found on the service '%2.",[0m
[37m+ messageId: "SVC4532"[0m
[37m+ }[0m
[37m+ #---------SVC4533------------------------------[0m
[37m+ # %1 - "HEAT"/"HEAT_ENV"/"MURANO_PKG"/"YANG_XML"[0m
[37m+ WRONG_ARTIFACT_FILE_EXTENSION: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid file extension for %1 artifact type.",[0m
[37m+ messageId: "SVC4533"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4534------------------------------[0m
[37m+ # %1 - "HEAT"/"HEAT_ENV"[0m
[37m+ INVALID_YAML: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Uploaded YAML file for %1 artifact is invalid.",[0m
[37m+ messageId: "SVC4534"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4535------------------------------[0m
[37m+ # %1 - "HEAT"[0m
[37m+ INVALID_DEPLOYMENT_ARTIFACT_HEAT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid %1 artifact.",[0m
[37m+ messageId: "SVC4535"[0m
[37m+ }[0m
[37m+ #---------SVC4536------------------------------[0m
[37m+ # %1 - "Resource"/"Service"[0m
[37m+ # %2 - resource/service name[0m
[37m+ # %3 - "HEAT"/"HEAT_ENV"/"MURANO_PKG"[0m
[37m+ # %4 - "HEAT"/"HEAT_ENV"/"MURANO_PKG[0m
[37m+ DEPLOYMENT_ARTIFACT_OF_TYPE_ALREADY_EXISTS: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: %1 '%2' already has a deployment artifact of %3 type .Please delete or update an existing %4 artifact.",[0m
[37m+ messageId: "SVC4536"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4537------------------------------[0m
[37m+ MISSING_HEAT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Missing HEAT artifact. HEAT_ENV artifact cannot be uploaded without corresponding HEAT template.",[0m
[37m+ messageId: "SVC4537"[0m
[37m+ }[0m
[37m+ #---------SVC4538------------------------------[0m
[37m+ MISMATCH_HEAT_VS_HEAT_ENV: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid artifact content. Parameter's set in HEAT_ENV '%1' artifact doesn't match the parameters in HEAT '%2' artifact.",[0m
[37m+ messageId: "SVC4538"[0m
[37m+ }[0m
[37m+ #---------SVC4539------------------------------[0m
[37m+ INVALID_RESOURCE_PAYLOAD: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid resource payload.",[0m
[37m+ messageId: "SVC4539"[0m
[37m+ }[0m
[37m+ #---------SVC4540------------------------------[0m
[37m+ INVALID_TOSCA_FILE_EXTENSION: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid file extension for TOSCA template.",[0m
[37m+ messageId: "SVC4540"[0m
[37m+ }[0m
[37m+ #---------SVC4541------------------------------[0m
[37m+ INVALID_YAML_FILE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid YAML file.",[0m
[37m+ messageId: "SVC4541"[0m
[37m+ }[0m
[37m+ #---------SVC4542------------------------------[0m
[37m+ INVALID_TOSCA_TEMPLATE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid TOSCA template.",[0m
[37m+ messageId: "SVC4542"[0m
[37m+ }[0m
[37m+ #---------SVC4543------------------------------[0m
[37m+ NOT_RESOURCE_TOSCA_TEMPLATE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Imported Service TOSCA template.",[0m
[37m+ messageId: "SVC4543"[0m
[37m+ }[0m
[37m+ #---------SVC4544------------------------------[0m
[37m+ NOT_SINGLE_RESOURCE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Imported TOSCA template should contain one resource definition.",[0m
[37m+ messageId: "SVC4544"[0m
[37m+ }[0m
[37m+ #---------SVC4545------------------------------[0m
[37m+ INVALID_RESOURCE_NAMESPACE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid resource namespace.",[0m
[37m+ messageId: "SVC4545"[0m
[37m+ }[0m
[37m+ #---------SVC4546------------------------------[0m
[37m+ RESOURCE_ALREADY_EXISTS: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Imported resource already exists in ASDC Catalog.",[0m
[37m+ messageId: "SVC4546"[0m
[37m+ }[0m
[37m+ #---------SVC4549------------------------------[0m
[37m+ INVALID_RESOURCE_CHECKSUM: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid resource checksum.",[0m
[37m+ messageId: "SVC4549"[0m
[37m+ }[0m
[37m+ #---------SVC4551------------------------------[0m
[37m+ # %1 - ECOMP User name[0m
[37m+ ECOMP_USER_NOT_FOUND: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: ECOMP User '%1' was not found.",[0m
[37m+ messageId: "SVC4551"[0m
[37m+ }[0m
[37m+ #---------SVC4554------------------------------[0m
[37m+ # %1 - Artifact Id[0m
[37m+ # %2 - "Resource"/"Service"[0m
[37m+ COMPONENT_ARTIFACT_NOT_FOUND: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: Requested artifact %1 doesn't belong to specified %2.",[0m
[37m+ messageId: "SVC4554"[0m
[37m+ }[0m
[37m+ #---------SVC4554------------------------------[0m
[37m+ # %1 - "Service name"[0m
[37m+ SERVICE_DEPLOYMENT_ARTIFACT_NOT_FOUND: {[0m
[37m+ code: 403,[0m
[37m+ message: "Error: Requested '%1' service is not ready for certification. Service has to have at least one deployment artifact.",[0m
[37m+ messageId: "SVC4554"[0m
[37m+ }[0m
[37m+ #---------SVC4555------------------------------[0m
[37m+ # %1 - "Resource"/"Service"/"Product"[0m
[37m+ # %2 - "category"[0m
[37m+ COMPONENT_ELEMENT_INVALID_NAME_LENGTH: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid %1 %2 name length.",[0m
[37m+ messageId: "SVC4555"[0m
[37m+ }[0m
[37m+ #---------SVC4556------------------------------[0m
[37m+ # %1 - "Resource"/"Service"/"Product"[0m
[37m+ # %2 - "category"[0m
[37m+ COMPONENT_ELEMENT_INVALID_NAME_FORMAT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid %1 %2 name format.",[0m
[37m+ messageId: "SVC4556"[0m
[37m+ }[0m
[37m+ #---------SVC4557------------------------------[0m
[37m+ # %1 - "Resource"/"Service"/"Product"[0m
[37m+ # %2 - "category name"[0m
[37m+ COMPONENT_CATEGORY_ALREADY_EXISTS: {[0m
[37m+ code: 409,[0m
[37m+ message: "Error: %1 category name '%2' already exists.",[0m
[37m+ messageId: "SVC4557"[0m
[37m+ }[0m
[37m+ #---------SVC4558------------------------------[0m
[37m+ # %1 - "service"/"VF"[0m
[37m+ # %2 - "Resource name"[0m
[37m+ VALIDATED_RESOURCE_NOT_FOUND: {[0m
[37m+ code: 403,[0m
[37m+ message: "Error: Submit for Testing is not permitted as your '%1' includes non-validated '%2' resource.",[0m
[37m+ messageId: "SVC4558"[0m
[37m+ }[0m
[37m+ #---------SVC4559------------------------------[0m
[37m+ # %1 - "service"/"VF"[0m
[37m+ # %2 - "Resource name"[0m
[37m+ FOUND_ALREADY_VALIDATED_RESOURCE: {[0m
[37m+ code: 403,[0m
[37m+ message: "Error: Submit for Testing is not permitted as your '%1' includes non-validated '%2' resource. Please use already available validated resource version.",[0m
[37m+ messageId: "SVC4559"[0m
[37m+ }[0m
[37m+ #---------SVC4560------------------------------[0m
[37m+ # %1 - "service"/"VF"[0m
[37m+ # %2 - "Resource name"[0m
[37m+ FOUND_LIST_VALIDATED_RESOURCES: {[0m
[37m+ code: 403,[0m
[37m+ message: "Error: Submit for Testing is not permitted as your '%1' includes non-validated '%2' resource. Please use one of available validated resource versions.",[0m
[37m+ messageId: "SVC4560"[0m
[37m+ }[0m
[37m+ #---------SVC4561------------------------------[0m
[37m+ # %1 - "resource"/"product"[0m
[37m+ # %2 - "category"[0m
[37m+ # %3 - "category name"[0m
[37m+ COMPONENT_CATEGORY_NOT_FOUND: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: Requested %1 %2 '%3' was not found.",[0m
[37m+ messageId: "SVC4561"[0m
[37m+ }[0m
[37m+ #---------SVC4562------------------------------[0m
[37m+ # %1 - "Resource"/"Product"[0m
[37m+ # %2 - "sub-category name"[0m
[37m+ # %3 - "category name"[0m
[37m+ COMPONENT_SUB_CATEGORY_EXISTS_FOR_CATEGORY: {[0m
[37m+ code: 409,[0m
[37m+ message: "Error: %1 sub-category '%2' already exists under '%3' category.",[0m
[37m+ messageId: "SVC4562"[0m
[37m+ }[0m
[37m+ #---------SVC4563------------------------------[0m
[37m+ # %1 - "Product"[0m
[37m+ # %2 - "grouping name"[0m
[37m+ # %3 - "sub-category name"[0m
[37m+ COMPONENT_GROUPING_EXISTS_FOR_SUB_CATEGORY: {[0m
[37m+ code: 409,[0m
[37m+ message: "Error: %1 grouping '%2' already exists under '%3' sub-category.",[0m
[37m+ messageId: "SVC4563"[0m
[37m+ }[0m
[37m+ #---------SVC4564------------------------------[0m
[37m+ # %1 - product name[0m
[37m+ PRODUCT_NOT_FOUND: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: Requested '%1' product was not found.",[0m
[37m+ messageId: "SVC4564"[0m
[37m+ }[0m
[37m+ #---------SVC4565------------------------------[0m
[37m+ # %1 - "HEAT"[0m
[37m+ # %2 - parameter type ("string" , "boolean" , "number")[0m
[37m+ # %3 - parameter name[0m
[37m+ INVALID_HEAT_PARAMETER_VALUE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid %1 artifact. Invalid %2 value set for '%3' parameter.",[0m
[37m+ messageId: "SVC4565"[0m
[37m+ }[0m
[37m+ #---------SVC4566------------------------------[0m
[37m+ # %1 - "HEAT"[0m
[37m+ # %2 - parameter type ("string" , "boolean" , "number")[0m
[37m+ INVALID_HEAT_PARAMETER_TYPE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid %1 artifact. Unsupported '%2' parameter type.",[0m
[37m+ messageId: "SVC4566"[0m
[37m+ }[0m
[37m+ #---------SVC4567------------------------------[0m
[37m+ # %1 - "YANG_XML"[0m
[37m+ INVALID_XML: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Uploaded XML file for %1 artifact is invalid.",[0m
[37m+ messageId: "SVC4567"[0m
[37m+ }[0m
[37m+ #---------SVC4569------------------------------[0m
[37m+ # %1 - "User Name and UserId"[0m
[37m+ # %2 -"component names ot IDs"[0m
[37m+ CANNOT_DELETE_USER_WITH_ACTIVE_ELEMENTS: {[0m
[37m+ code: 412,[0m
[37m+ message: "Error: User cannot be deleted. User '%1' has projects that cannot be committed: %2.",[0m
[37m+ messageId: "SVC4569"[0m
[37m+ }[0m
[37m+ #---------SVC4568------------------------------[0m
[37m+ # %1 - "User Name and UserId"[0m
[37m+ # %2 -"checked-out"/"in-certification"[0m
[37m+ CANNOT_UPDATE_USER_WITH_ACTIVE_ELEMENTS: {[0m
[37m+ code: 409,[0m
[37m+ message: "Error: Role cannot be changed. User '%1' has %2 projects.",[0m
[37m+ messageId: "SVC4568"[0m
[37m+ }[0m
[37m+ #---------SVC4570------------------------------[0m
[37m+ UPDATE_USER_ADMIN_CONFLICT: {[0m
[37m+ code: 409,[0m
[37m+ message: "Error: An administrator is not allowed to change his/her role.",[0m
[37m+ messageId: "SVC4570"[0m
[37m+ }[0m
[37m+ #---------SVC4571------------------------------[0m
[37m+ SERVICE_CANNOT_CONTAIN_SUBCATEGORY: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Sub category cannot be defined for service",[0m
[37m+ messageId: "SVC4571"[0m
[37m+ }[0m
[37m+ #---------SVC4572------------------------------[0m
[37m+ # %1 - "Resource"/"Service"[0m
[37m+ COMPONENT_TOO_MUCH_CATEGORIES: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: %1 must have only 1 category",[0m
[37m+ messageId: "SVC4572"[0m
[37m+ }[0m
[37m+ #---------SVC4574------------------------------[0m
[37m+ RESOURCE_TOO_MUCH_SUBCATEGORIES: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Resource must have only 1 sub category",[0m
[37m+ messageId: "SVC4574"[0m
[37m+ }[0m
[37m+ #---------SVC4575------------------------------[0m
[37m+ COMPONENT_MISSING_SUBCATEGORY: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Missing sub category",[0m
[37m+ messageId: "SVC4575"[0m
[37m+ }[0m
[37m+ #---------SVC4576------------------------------[0m
[37m+ # %1 - "component type"[0m
[37m+ UNSUPPORTED_ERROR: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error : Requested component type %1 is unsupported.",[0m
[37m+ messageId: "SVC4576"[0m
[37m+ }[0m
[37m+ #---------SVC4577------------------------------[0m
[37m+ # %1 - "resource type"[0m
[37m+ RESOURCE_CANNOT_CONTAIN_RESOURCE_INSTANCES: {[0m
[37m+ code: 409,[0m
[37m+ message: "Error : Resource of type %1 cannot contain resource instances.",[0m
[37m+ messageId: "SVC4577"[0m
[37m+ }[0m
[37m+ #---------SVC4578------------------------------[0m
[37m+ # %1 - "Resource"/"Service"[0m
[37m+ # %2 - resource/service name[0m
[37m+ # %3 - "artifact name"[0m
[37m+ DEPLOYMENT_ARTIFACT_NAME_ALREADY_EXISTS: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: %1 '%2' already has a deployment artifact named '%3'.",[0m
[37m+ messageId: "SVC4578"[0m
[37m+ }[0m
[37m+ #---------SVC4579------------------------------[0m
[37m+ # %1 - "Category"/"Sub-Category"/"Group"[0m
[37m+ # %2 - category/sub-category/grouping name.[0m
[37m+ INVALID_GROUP_ASSOCIATION: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid group association. %1 '%2' was not found.",[0m
[37m+ messageId: "SVC4579"[0m
[37m+ }[0m
[37m+ #---------SVC4580------------------------------[0m
[37m+ EMPTY_PRODUCT_CONTACTS_LIST: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid content. At least one Product Contact has to be specified.",[0m
[37m+ messageId: "SVC4580"[0m
[37m+ }[0m
[37m+ #---------SVC4581------------------------------[0m
[37m+ # %1 - UserId[0m
[37m+ INVALID_PRODUCT_CONTACT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid content. User '%1' cannot be set as Product Contact.",[0m
[37m+ messageId: "SVC4581"[0m
[37m+ }[0m
[37m+ #---------SVC4582------------------------------[0m
[37m+ # %1 - Product[0m
[37m+ # %2 - "abbreviated"/"full"[0m
[37m+ MISSING_ONE_OF_COMPONENT_NAMES: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid content. Missing %1 %2 name.",[0m
[37m+ messageId: "SVC4582"[0m
[37m+ }[0m
[37m+ #---------SVC4583------------------------------[0m
[37m+ # %1 - "Icon"[0m
[37m+ # %2 - "resource"/"service"/"product"[0m
[37m+ COMPONENT_PARAMETER_CANNOT_BE_CHANGED: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: %1 cannot be changed once the %2 is certified.",[0m
[37m+ messageId: "SVC4583"[0m
[37m+ }[0m
[37m+ #---------SVC4584------------------------------[0m
[37m+ # %1 - service/VF name[0m
[37m+ # %2 - "service" /"VF"[0m
[37m+ # %3 - resource instance origin type[0m
[37m+ # %4 - resource instance name[0m
[37m+ # %5 - requirement/capability[0m
[37m+ # %6 - requirement/capability name[0m
[37m+ # %7 - "fulfilled" (for req)/"consumed (for cap)"[0m
[37m+ REQ_CAP_NOT_SATISFIED_BEFORE_CERTIFICATION: {[0m
[37m+ code: 403,[0m
[37m+ message: "Error: Requested '%1' %2 is not ready for certification. %3 '%4' has to have %5 '%6' %7.",[0m
[37m+ messageId: "SVC4584"[0m
[37m+ }[0m
[37m+ #---------SVC4585------------------------------[0m
[37m+ INVALID_OCCURRENCES: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid occurrences format.",[0m
[37m+ messageId: "SVC4585"[0m
[37m+ }[0m
[37m+ #---------SVC4586------------------------------[0m
[37m+ #---------SVC4586------------------------------[0m
[37m+ INVALID_SERVICE_API_URL: {[0m
[37m+ code: 400,[0m
[37m+ message: 'Error: Invalid Service API URL. Please check whether your URL has a valid domain extension and does not contain the following characters - #?&@%+;,=$<>~^`\[]{}|"*!',[0m
[37m+ messageId: "SVC4586"[0m
[37m+ }[0m
[37m+ #---------SVC4587------------------------------[0m
[37m+ # %1 - Data type name[0m
[37m+ DATA_TYPE_ALREADY_EXIST: {[0m
[37m+ code: 409,[0m
[37m+ message: 'Error: Data type %1 already exists.',[0m
[37m+ messageId: "SVC4587"[0m
[37m+ }[0m
[37m+ #---------SVC4588------------------------------[0m
[37m+ # %1 - Data type name[0m
[37m+ DATA_TYPE_NOR_PROPERTIES_NEITHER_DERIVED_FROM: {[0m
[37m+ code: 400,[0m
[37m+ message: 'Error: Invalid Data type %1. Data type must have either a valid derived from declaration or at least one valid property',[0m
[37m+ messageId: "SVC4588"[0m
[37m+ }[0m
[37m+ #---------SVC4589------------------------------[0m
[37m+ # %1 - Data type name[0m
[37m+ DATA_TYPE_PROPERTIES_CANNOT_BE_EMPTY: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Data type %1. 'properties' parameter cannot be empty if provided.",[0m
[37m+ messageId: "SVC4589"[0m
[37m+ }[0m
[37m+ #---------SVC4590------------------------------[0m
[37m+ # %1 - Property type name[0m
[37m+ # %2 - Property name[0m
[37m+ INVALID_PROPERTY_TYPE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Property type %1 in property %2.",[0m
[37m+ messageId: "SVC4590"[0m
[37m+ }[0m
[37m+ #---------SVC4591------------------------------[0m
[37m+ # %1 - Property inner type[0m
[37m+ # %2 - Property name[0m
[37m+ INVALID_PROPERTY_INNER_TYPE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid property inner type %1, in property %2",[0m
[37m+ messageId: "SVC4591"[0m
[37m+ }[0m
[37m+ #---------SVC4592------------------------------[0m
[37m+ # %1 - component instance name[0m
[37m+ # %2 - "resource instance"/"service instance"[0m
[37m+ COMPONENT_INSTANCE_NOT_FOUND: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: Requested '%1' %2 was not found.",[0m
[37m+ messageId: "SVC4592"[0m
[37m+ }[0m
[37m+ #---------SVC4593------------------------------[0m
[37m+ # %1 - component instance name[0m
[37m+ # %2 - "resource instance"/"service instance"[0m
[37m+ # %3 - "resource/"service"/"product"[0m
[37m+ # %4 - container name[0m
[37m+ COMPONENT_INSTANCE_NOT_FOUND_ON_CONTAINER: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: Requested '%1' %2 was not found on the %3 '%4'.",[0m
[37m+ messageId: "SVC4593"[0m
[37m+ }[0m
[37m+ #---------SVC4594------------------------------[0m
[37m+ #%1 - requirement / capability[0m
[37m+ #%2 - requirement name[0m
[37m+ IMPORT_DUPLICATE_REQ_CAP_NAME: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Imported TOSCA template contains more than one %1 named '%2'.",[0m
[37m+ messageId: "SVC4594"[0m
[37m+ }[0m
[37m+ #---------SVC4595------------------------------[0m
[37m+ #%1 - requirement / capability[0m
[37m+ #%2 - requirement name[0m
[37m+ #%3 - parent containing the requirement[0m
[37m+ IMPORT_REQ_CAP_NAME_EXISTS_IN_DERIVED: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Imported TOSCA template contains %1 '%2' that is already defined by derived template %3.",[0m
[37m+ messageId: "SVC4595"[0m
[37m+ }[0m
[37m+ #---------SVC4596------------------------------[0m
[37m+ # %1 - Data type name[0m
[37m+ DATA_TYPE_DERIVED_IS_MISSING: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. The ancestor data type %1 cannot be found in the system.",[0m
[37m+ messageId: "SVC4596"[0m
[37m+ }[0m
[37m+ #---------SVC4597------------------------------[0m
[37m+ # %1 - Data type name[0m
[37m+ # %2 - Property names[0m
[37m+ DATA_TYPE_PROPERTY_ALREADY_DEFINED_IN_ANCESTOR: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. The data type %1 contains properties named %2 which are already defined in one of its ancestors.",[0m
[37m+ messageId: "SVC4597"[0m
[37m+ }[0m
[37m+ #---------SVC4598------------------------------[0m
[37m+ # %1 - Data type name[0m
[37m+ DATA_TYPE_DUPLICATE_PROPERTY: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. The data type %1 contains duplicate property.",[0m
[37m+ messageId: "SVC4598"[0m
[37m+ }[0m
[37m+ #---------SVC4599------------------------------[0m
[37m+ # %1 - Data type name[0m
[37m+ # %2 - Property names[0m
[37m+ DATA_TYPE_PROEPRTY_CANNOT_HAVE_SAME_TYPE_OF_DATA_TYPE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. The data type %1 contains properties %2 which their type is this data type.",[0m
[37m+ messageId: "SVC4599"[0m
[37m+ }[0m
[37m+ #---------SVC4600------------------------------[0m
[37m+ # %1 - Data type name[0m
[37m+ DATA_TYPE_CANNOT_HAVE_PROPERTIES: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. The data type %1 cannot have properties since it is of type scalar",[0m
[37m+ messageId: "SVC4600"[0m
[37m+ }[0m
[37m+ #---------SVC4601------------------------------[0m
[37m+ NOT_TOPOLOGY_TOSCA_TEMPLATE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: TOSCA yaml file %1 cannot be modeled to VF as it does not contain 'topology_template.",[0m
[37m+ messageId: "SVC4601"[0m
[37m+ }[0m
[37m+ #---------SVC4602--------------------------------[0m
[37m+ # %1 - yaml file name[0m
[37m+ # %2 - node_template label[0m
[37m+ # %3 - node_template type[0m
[37m+ INVALID_NODE_TEMPLATE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: TOSCA yaml file '%1' contains node_template '%2' of type '%3' that does not represent existing VFC/CP/VL",[0m
[37m+ messageId: "SVC4602"[0m
[37m+ }[0m
[37m+ #---------SVC4603------------------------------[0m
[37m+ # %1 - component type[0m
[37m+ # %2 - component name[0m
[37m+ # %3 - state[0m
[37m+ ILLEGAL_COMPONENT_STATE: {[0m
[37m+ code: 403,[0m
[37m+ message: "Error: Action is not allowed on %1 '%2' because it is in an illegal state %3.",[0m
[37m+ messageId: "SVC4603"[0m
[37m+ }[0m
[37m+ #---------SVC4604------------------------------[0m
[37m+ # %1 - csar file name[0m
[37m+ CSAR_INVALID: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: TOSCA CSAR '%1' is invalid. 'TOSCA-Metadata/Tosca.meta' file must be provided.",[0m
[37m+ messageId: "SVC4604"[0m
[37m+ }[0m
[37m+ #---------SVC4605------------------------------[0m
[37m+ # %1 - csar file name[0m
[37m+ CSAR_INVALID_FORMAT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: TOSCA CSAR '%1' is invalid. Invalid 'TOSCA-Metadata/Tosca.meta' file format.",[0m
[37m+ messageId: "SVC4605"[0m
[37m+ }[0m
[37m+ #---------SVC4606------------------------------[0m
[37m+ # %1 - property name[0m
[37m+ # %2 - property type[0m
[37m+ # %3 - property innerType[0m
[37m+ # %4 - default value is[0m
[37m+ INVALID_COMPLEX_DEFAULT_VALUE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid default value of property %1. Data type is %2 with inner type %3 and default value found is %4.",[0m
[37m+ messageId: "SVC4606"[0m
[37m+ }[0m
[37m+ #---------SVC4607------------------------------[0m
[37m+ # %1 - csar file name[0m
[37m+ CSAR_NOT_FOUND: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: TOSCA CSAR '%1' is not found.",[0m
[37m+ messageId: "SVC4607"[0m
[37m+ }[0m
[37m+ #---------SVC4608------------------------------[0m
[37m+ # %1 - artifact name[0m
[37m+ # %2 - component type[0m
[37m+ # %3 - actual component type[0m
[37m+ MISMATCH_BETWEEN_ARTIFACT_TYPE_AND_COMPONENT_TYPE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Artifact %1 is only compatible with component of type %2, but component type is %3.",[0m
[37m+ messageId: "SVC4608"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4609------------------------------[0m
[37m+ # %1 - "INVALID_JSON"[0m
[37m+ INVALID_JSON: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Uploaded JSON file for %1 artifact is invalid.",[0m
[37m+ messageId: "SVC4609"[0m
[37m+ }[0m
[37m+ #---------SVC4610------------------------------[0m
[37m+ # %1 - csar file name[0m
[37m+ # %2 - missing file name[0m
[37m+ YAML_NOT_FOUND_IN_CSAR: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error - TOSCA CSAR %1 is invalid. TOSCA-Metadata/Tosca.meta refers to file %2 that is not provided.",[0m
[37m+ messageId: "SVC4610"[0m
[37m+ }[0m
[37m+ #---------SVC4611------------------------------[0m
[37m+ # %1 - group name[0m
[37m+ GROUP_MEMBER_EMPTY: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Group %1 member list was provided but does not have values",[0m
[37m+ messageId: "SVC4611"[0m
[37m+ }[0m
[37m+ #---------SVC4612------------------------------[0m
[37m+ # %1 - group name[0m
[37m+ GROUP_TYPE_ALREADY_EXIST: {[0m
[37m+ code: 409,[0m
[37m+ message: 'Error: Group type %1 already exists.',[0m
[37m+ messageId: "SVC4612"[0m
[37m+ }[0m
[37m+ #---------SVC4613------------------------------[0m
[37m+ # %1 - group name[0m
[37m+ # %2 - VF name(component name)[0m
[37m+ # %3 - actual component type [VF][0m
[37m+ GROUP_ALREADY_EXIST: {[0m
[37m+ code: 409,[0m
[37m+ message: "Error: Group with name '%1' already exists in %2 %3.",[0m
[37m+ messageId: "SVC4613"[0m
[37m+ }[0m
[37m+ #---------SVC4614------------------------------[0m
[37m+ # %1 - group type[0m
[37m+ GROUP_TYPE_IS_INVALID: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid content. Group type %1 does not exist",[0m
[37m+ messageId: "SVC4614"[0m
[37m+ }[0m
[37m+ #---------SVC4615------------------------------[0m
[37m+ # %1 - group name[0m
[37m+ GROUP_MISSING_GROUP_TYPE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Missing Group Type for group '%1'",[0m
[37m+ messageId: "SVC4615"[0m
[37m+ }[0m
[37m+ #---------SVC4616------------------------------[0m
[37m+ # %1 - member name[0m
[37m+ # %2 - group name[0m
[37m+ # %3 - VF name[0m
[37m+ # %4 - component type [VF ][0m
[37m+ GROUP_INVALID_COMPONENT_INSTANCE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Member '%1' listed in group '%2' is not part of '%3' %4.",[0m
[37m+ messageId: "SVC4616"[0m
[37m+ }[0m
[37m+ #---------SVC4617------------------------------[0m
[37m+ # %1 - member name[0m
[37m+ # %2 - group name[0m
[37m+ # %3 - group type[0m
[37m+ GROUP_INVALID_TOSCA_NAME_OF_COMPONENT_INSTANCE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: member %1 listed in group %2 is not part of allowed members of group type %3.",[0m
[37m+ messageId: "SVC4617"[0m
[37m+ }[0m
[37m+ #---------SVC4618------------------------------[0m
[37m+ # %1 - missing file name[0m
[37m+ # %2 - csar file name[0m
[37m+ ARTIFACT_NOT_FOUND_IN_CSAR: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: artifact %1 is defined in CSAR %2 manifest but is not provided",[0m
[37m+ messageId: "SVC4618"[0m
[37m+ }[0m
[37m+#---------SVC4619------------------------------[0m
[37m+# %1 - artifact name[0m
[37m+# %2 - artifact type[0m
[37m+# %3 - existing artifact type[0m
[37m+ ARTIFACT_ALREADY_EXIST_IN_DIFFERENT_TYPE_IN_CSAR: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: artifact %1 in type %2 already exists in type %3.",[0m
[37m+ messageId: "SVC4619"[0m
[37m+ }[0m
[37m+ #---------SVC4620------------------------------[0m
[37m+ FAILED_RETRIVE_ARTIFACTS_TYPES: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Failed to retrieve list of suported artifact types.",[0m
[37m+ messageId: "SVC4620"[0m
[37m+ }[0m
[37m+ #---------SVC4621------------------------------[0m
[37m+ # %1 - artifact name[0m
[37m+ # %2 - master[0m
[37m+ ARTIFACT_ALRADY_EXIST_IN_MASTER_IN_CSAR: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: artifact %1 already exists in master %2 .",[0m
[37m+ messageId: "SVC4621"[0m
[37m+ }[0m
[37m+ #---------SVC4622------------------------------[0m
[37m+ # %1 - artifact name[0m
[37m+ # %2 - artifact type[0m
[37m+ # %3 - master name[0m
[37m+ # %4 - master type[0m
[37m+ ARTIFACT_NOT_VALID_IN_MASTER: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: artifact %1 in type %2 can not be exists under master %3 in type %4.",[0m
[37m+ messageId: "SVC4622"[0m
[37m+ }[0m
[37m+ #---------SVC4623------------------------------[0m
[37m+ # %1 - artifact name[0m
[37m+ # %2 - artifact type[0m
[37m+ # %3 - env name[0m
[37m+ # %4 - existing env[0m
[37m+ ARTIFACT_NOT_VALID_ENV: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Artifact %1 in type %2 with env %3 already exists with another env %4",[0m
[37m+ messageId: "SVC4623"[0m
[37m+ }[0m
[37m+ #---------SVC4624------------------------------[0m
[37m+ # %1 - groups names[0m
[37m+ # %2 - VF name[0m
[37m+ # %3 - component type [VF ][0m
[37m+ GROUP_IS_MISSING: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. The groups '%1' cannot be found under %2 %3.",[0m
[37m+ messageId: "SVC4624"[0m
[37m+ }[0m
[37m+ #---------SVC4625------------------------------[0m
[37m+ # %1 - groups name[0m
[37m+ GROUP_ARTIFACT_ALREADY_ASSOCIATED: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Artifact already associated to group '%1'.",[0m
[37m+ messageId: "SVC4625"[0m
[37m+ }[0m
[37m+ #---------SVC4626------------------------------[0m
[37m+ # %1 - groups name[0m
[37m+ GROUP_ARTIFACT_ALREADY_DISSOCIATED: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Artifact already dissociated from group '%1'.",[0m
[37m+ messageId: "SVC4626"[0m
[37m+ }[0m
[37m+ #---------SVC4627------------------------------[0m
[37m+ # %1 - property name[0m
[37m+ # %2 - group name[0m
[37m+ # %3 - group type name[0m
[37m+ GROUP_PROPERTY_NOT_FOUND: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: property %1 listed in group %2 is not exist in group type %3.",[0m
[37m+ messageId: "SVC4627"[0m
[37m+ }[0m
[37m+ #---------SVC4628------------------------------[0m
[37m+ # %1 - csarUUID[0m
[37m+ # %2 - VF name[0m
[37m+ VSP_ALREADY_EXISTS: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: The VSP with UUID %1 was already imported for VF %2. Please select another or update the existing VF.",[0m
[37m+ messageId: "SVC4628"[0m
[37m+ }[0m
[37m+ #---------SVC4629------------------------------[0m
[37m+ # %1 - VF name[0m
[37m+ MISSING_CSAR_UUID: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: The Csar UUID or payload name is missing for VF %1.",[0m
[37m+ messageId: "SVC4629"[0m
[37m+ }[0m
[37m+ #---------SVC4630------------------------------[0m
[37m+ # %1 - VF name[0m
[37m+ # %2 - new csarUUID[0m
[37m+ # %3 - old csarUUID[0m
[37m+ RESOURCE_LINKED_TO_DIFFERENT_VSP: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Resource %1 cannot be updated using CsarUUID %2 since the resource is linked to a different VSP with csarUUID %3.",[0m
[37m+ messageId: "SVC4630"[0m
[37m+ }[0m
[37m+ #---------SVC4631------------------------------[0m
[37m+ # %1 - policy name[0m
[37m+ POLICY_TYPE_ALREADY_EXIST: {[0m
[37m+ code: 409,[0m
[37m+ message: "Error: Policy type %1 already exists.",[0m
[37m+ messageId: "SVC4631"[0m
[37m+ }[0m
[37m+ #---------SVC4632------------------------------[0m
[37m+ # %1 - target name[0m
[37m+ # %2 - policy type name[0m
[37m+ TARGETS_NON_VALID: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: target %1 listed in policy type %2 is not a group or resource.",[0m
[37m+ messageId: "SVC4632"[0m
[37m+ }[0m
[37m+ #---------SVC4633------------------------------[0m
[37m+ # %1 - policy name[0m
[37m+ TARGETS_EMPTY: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Policy %1 target list was provided but does not have values",[0m
[37m+ messageId: "SVC4633"[0m
[37m+ }[0m
[37m+ #---------SVC4634------------------------------[0m
[37m+ DATA_TYPE_CANNOT_BE_EMPTY: {[0m
[37m+ code: 500,[0m
[37m+ message: "Error: Data types are empty. Please import the data types.",[0m
[37m+ messageId: "SVC4634"[0m
[37m+ }[0m
[37m+ #---------SVC4635------------------------------[0m
[37m+ # %1 - csar uuid[0m
[37m+ RESOURCE_FROM_CSAR_NOT_FOUND: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: resource from csar uuid %1 not found",[0m
[37m+ messageId: "SVC4635"[0m
[37m+ }[0m
[37m+ #---------SVC4636------------------------------[0m
[37m+ # %1 - Data type name[0m
[37m+ DATA_TYPE_CANNOT_BE_UPDATED_BAD_REQUEST: {[0m
[37m+ code: 400,[0m
[37m+ message: 'Error: Data type %1 cannot be upgraded. The new data type does not contain old properties or the type of one of the properties has been changed.',[0m
[37m+ messageId: "SVC4636"[0m
[37m+ }[0m
[37m+ #-----------SVC4637---------------------------[0m
[37m+ #%1 - attribute name[0m
[37m+ ATTRIBUTE_NOT_FOUND: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: Requested '%1' attribute was not found.",[0m
[37m+ messageId: "SVC4637"[0m
[37m+ }[0m
[37m+ #-----------SVC4638---------------------------[0m
[37m+ #%1 - attribute name[0m
[37m+ ATTRIBUTE_ALREADY_EXIST: {[0m
[37m+ code: 409,[0m
[37m+ message: "Error: Attribute with '%1' name already exists.",[0m
[37m+ messageId: "SVC4638"[0m
[37m+ }[0m
[37m+ #-----------SVC4639---------------------------[0m
[37m+ #%1 - property name[0m
[37m+ PROPERTY_NAME_ALREADY_EXISTS: {[0m
[37m+ code: 409,[0m
[37m+ message: "Error: Property with '%1' name and different type already exists.",[0m
[37m+ messageId: "SVC4639"[0m
[37m+ }[0m
[37m+ #-----------SVC4640---------------------------[0m
[37m+ #%1 - property name[0m
[37m+ INVALID_PROPERTY: {[0m
[37m+ code: 409,[0m
[37m+ message: "Error: Invalid property received.",[0m
[37m+ messageId: "SVC4640"[0m
[37m+ }[0m
[37m+ #---------SVC4641-----------------------------[0m
[37m+ #%1 - invalid filter[0m
[37m+ #%2 - valid filters[0m
[37m+ INVALID_FILTER_KEY: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: The filter %1 is not applicable. Please use one of the following filters: %2",[0m
[37m+ messageId: "SVC4641"[0m
[37m+ }[0m
[37m+ #---------SVC4642-----------------------------[0m
[37m+ #%1 - asset type[0m
[37m+ #%2 - filter[0m
[37m+ NO_ASSETS_FOUND: {[0m
[37m+ code: 404,[0m
[37m+ message: "No %1 were found to match criteria %2",[0m
[37m+ messageId: "SVC4642"[0m
[37m+ }[0m
[37m+ #---------SVC4643------------------------------[0m
[37m+ # %1 - "Resource"/"Product"[0m
[37m+ # %2 - "sub-category name"[0m
[37m+ # %3 - "category name"[0m
[37m+ COMPONENT_SUB_CATEGORY_NOT_FOUND_FOR_CATEGORY: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: %1 sub-category '%2' not found under category '%3'.",[0m
[37m+ messageId: "SVC4643"[0m
[37m+ }[0m
[37m+ #---------SVC4644------------------------------[0m
[37m+ # %1 - Format[0m
[37m+ CORRUPTED_FORMAT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: %1 format is corrupted.",[0m
[37m+ messageId: "SVC4644"[0m
[37m+ }[0m
[37m+ #---------SVC4645------------------------------[0m
[37m+ # %1 - "groupType"[0m
[37m+ INVALID_VF_MODULE_TYPE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid group type '%1' (should be VfModule).",[0m
[37m+ messageId: "SVC4645"[0m
[37m+ }[0m
[37m+ #---------SVC4646------------------------------[0m
[37m+ # %1 - "groupName"[0m
[37m+ INVALID_VF_MODULE_NAME: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Group name '%1' contains invalid characters",[0m
[37m+ messageId: "SVC4646"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4647------------------------------[0m
[37m+ # %1 - "modifiedName"[0m
[37m+ INVALID_VF_MODULE_NAME_MODIFICATION: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid VF Module name modification, can not modify '%1'",[0m
[37m+ messageId: "SVC4647"[0m
[37m+ }[0m
[37m+ #---------SVC4648------------------------------[0m
[37m+ # %1 - "inputId"[0m
[37m+ # %2 - "componentId"[0m
[37m+ INPUT_IS_NOT_CHILD_OF_COMPONENT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Input id: '%1' is not child of component id: '%2'",[0m
[37m+ messageId: "SVC4648"[0m
[37m+ }[0m
[37m+ #---------SVC4649------------------------------[0m
[37m+ # %1 - "groupName"[0m
[37m+ GROUP_HAS_CYCLIC_DEPENDENCY: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: The group '%1' has cyclic dependency",[0m
[37m+ messageId: "SVC4649"[0m
[37m+ }[0m
[37m+ #---------SVC4650------------------------------[0m
[37m+ # %1 - "Component Type"[0m
[37m+ # %2 - [0m
[37m+ # %3 - error description[0m
[37m+ AAI_ARTIFACT_GENERATION_FAILED: {[0m
[37m+ code: 500,[0m
[37m+ message: "Error: %1 %2 automatic generation of artifacts failed. Description: %3",[0m
[37m+ messageId: "SVC4650"[0m
[37m+ }[0m
[37m+ #---------SVC4651------------------------------[0m
[37m+ PARENT_RESOURCE_DOES_NOT_EXTEND: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Once resource is certified, derived_from can be changed only to a sibling",[0m
[37m+ messageId: "SVC4651"[0m
[37m+ }[0m
[37m+ #---------SVC4652------------------------------[0m
[37m+ # %1 - resource/service[0m
[37m+ COMPONENT_INVALID_SUBCATEGORY: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Invalid %1 sub category.",[0m
[37m+ messageId: "SVC4652"[0m
[37m+ }[0m
[37m+ #---------SVC4653------------------------------[0m
[37m+ # %1 - group instance uniqueId[0m
[37m+ # %2 - service uniqueId[0m
[37m+ GROUP_INSTANCE_NOT_FOUND_ON_COMPONENT_INSTANCE: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: Requested group instance %1 was not found on component %2.",[0m
[37m+ messageId: "SVC4653"[0m
[37m+ }[0m
[37m+ #---------SVC4654------------------------------[0m
[37m+ # %1 - group property name[0m
[37m+ # %2 - valid min limit value[0m
[37m+ # %3 - valid max limit value[0m
[37m+ INVALID_GROUP_MIN_MAX_INSTANCES_PROPERTY_VALUE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Value of %1 must be not higher than %2, and not lower than %3.",[0m
[37m+ messageId: "SVC4654"[0m
[37m+ }[0m
[37m+ #---------SVC4655------------------------------[0m
[37m+ # %1 - group property name[0m
[37m+ # %2 - valid min limit value[0m
[37m+ # %3 - valid max limit value[0m
[37m+ INVALID_GROUP_INITIAL_COUNT_PROPERTY_VALUE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Value of %1 must be between %2 and %3.",[0m
[37m+ messageId: "SVC4655"[0m
[37m+ }[0m
[37m+ #---------SVC4656------------------------------[0m
[37m+ # %1 - group property name[0m
[37m+ # %2 - lower/higher[0m
[37m+ # %3 - valid max/min value[0m
[37m+ INVALID_GROUP_PROPERTY_VALUE_LOWER_HIGHER: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Value of %1 must be %2 or equals to %3.",[0m
[37m+ messageId: "SVC4656"[0m
[37m+ }[0m
[37m+ #---------SVC4657------------------------------[0m
[37m+ # %1 - certificationRequest / startTesting[0m
[37m+ RESOURCE_VFCMT_LIFECYCLE_STATE_NOT_VALID: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error - Lifecycle state %1 is not valid for resource of type VFCMT",[0m
[37m+ messageId: "SVC4657"[0m
[37m+ }[0m
[37m+ #---------SVC4658------------------------------[0m
[37m+ # %1 – asset type [service / resource ][0m
[37m+ # %2 – main asset uuid[0m
[37m+ # %3 – not found asset type [service / resource][0m
[37m+ # %4 – not found asset name[0m
[37m+ ASSET_NOT_FOUND_DURING_CSAR_CREATION: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: CSAR packaging failed for %1 %2. %3 %4 was not found",[0m
[37m+ messageId: "SVC4658"[0m
[37m+ }[0m
[37m+ #---------SVC4659------------------------------[0m
[37m+ # %1 – asset type [service / resource ][0m
[37m+ # %2 – main asset uuid[0m
[37m+ # %3 – Artifact name[0m
[37m+ # %4 – Artifact uuid[0m
[37m+ ARTIFACT_PAYLOAD_NOT_FOUND_DURING_CSAR_CREATION: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: CSAR packaging failed for %1 %2. Artifact %3 [%4] was not found",[0m
[37m+ messageId: "SVC4659"[0m
[37m+ }[0m
[37m+ #---------SVC4660------------------------------[0m
[37m+ # %1 - assetType[0m
[37m+ # %2 - matching generic node type name[0m
[37m+ GENERIC_TYPE_NOT_FOUND: {[0m
[37m+ code: 404,[0m
[37m+ message: "Creation of %1 failed. Generic type %2 was not found",[0m
[37m+ messageId: "SVC4660"[0m
[37m+ }[0m
[37m+ #---------SVC4661------------------------------[0m
[37m+ # %1 - assetType[0m
[37m+ # %2 - matching generic node type name[0m
[37m+ TOSCA_SCHEMA_FILES_NOT_FOUND: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: CSAR packaging failed. TOSCA schema files for SDC-Version: %1 and Conformance-Level %2 were not found",[0m
[37m+ messageId: "SVC4661"[0m
[37m+ }[0m
[37m+ #---------SVC4662------------------------------[0m
[37m+ # %1 - file name[0m
[37m+ # %2 - parser error[0m
[37m+ TOSCA_PARSE_ERROR: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid TOSCA template in file %1. %2",[0m
[37m+ messageId: "SVC4662"[0m
[37m+ }[0m
[37m+ #---------SVC4663------------------------------[0m
[37m+ # %1 - max length[0m
[37m+ RESOURCE_VENDOR_MODEL_NUMBER_EXCEEDS_LIMIT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Resource vendor model number exceeds limit of %1 characters.",[0m
[37m+ messageId: "SVC4663"[0m
[37m+ }[0m
[37m+ #---------SVC4664------------------------------[0m
[37m+ INVALID_RESOURCE_VENDOR_MODEL_NUMBER: {[0m
[37m+ code: 400,[0m
[37m+ message: 'Error: Invalid Content. Resource vendor model number is not allowed to contain characters like <>:"\/|?* and space characters other than regular space.',[0m
[37m+ messageId: "SVC4664"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4669-----------------------------[0m
[37m+ INVALID_RESOURCE_TYPE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid resource type.",[0m
[37m+ messageId: "SVC4669"[0m
[37m+ }[0m
[37m+ #---------SVC4670------------------------------[0m
[37m+ ARTIFACT_NAME_INVALID: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Artifact name is invalid.",[0m
[37m+ messageId: "SVC4670"[0m
[37m+ }[0m
[37m+ #---------SVC4671------------------------------[0m
[37m+ # %1 - VSP name[0m
[37m+ # %2 - VFC name[0m
[37m+ CFVC_LOOP_DETECTED: {[0m
[37m+ code: 400,[0m
[37m+ message: 'Error: VSP %1 cannot be imported. The VSP contains internal loop in VFC %2',[0m
[37m+ messageId: "SVC4671"[0m
[37m+ }[0m
[37m+ #---------SVC4672------------------------------[0m
[37m+ # %1 - capability uniqueId[0m
[37m+ # %2 - instance uniqueId[0m
[37m+ # %3 - container uniqueId[0m
[37m+ CAPABILITY_OF_INSTANCE_NOT_FOUND_ON_CONTAINER: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: Requested capability %1 of instance %2 was not found on the container %3.",[0m
[37m+ messageId: "SVC4672"[0m
[37m+ }[0m
[37m+ #---------SVC4673------------------------------[0m
[37m+ # %1 - requirement uniqueId[0m
[37m+ # %2 - instance uniqueId[0m
[37m+ # %3 - container uniqueId[0m
[37m+ REQUIREMENT_OF_INSTANCE_NOT_FOUND_ON_CONTAINER: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: Requested requirement %1 of instance %2 was not found on the container %3.",[0m
[37m+ messageId: "SVC4673"[0m
[37m+ }[0m
[37m+ #---------SVC4674-----------------------------[0m
[37m+ # %1 - relation Id[0m
[37m+ # %2 - container uniqueId[0m
[37m+ RELATION_NOT_FOUND: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: Requested relation %1 was not found on the container %2.",[0m
[37m+ messageId: "SVC4674"[0m
[37m+ }[0m
[37m+[0m
[37m+[0m
[37m+ #---------SVC4675------------------------------[0m
[37m+ INVALID_SERVICE_STATE: {[0m
[37m+ code: 409,[0m
[37m+ message: "Service state is invalid for this action",[0m
[37m+ messageId: "SVC4675"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4676------------------------------[0m
[37m+ INVALID_RESPONSE_FROM_PROXY: {[0m
[37m+ code: 502,[0m
[37m+ message: "Error: The server was acting as a gateway or proxy and received an invalid response from the upstream server",[0m
[37m+ messageId: "SVC4676"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4677------------------------------[0m
[37m+ API_RESOURCE_NOT_FOUND: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: Requested '%1' was not found.",[0m
[37m+ messageId: "SVC4677"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4678------------------------------[0m
[37m+ BAD_REQUEST_MISSING_RESOURCE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: The required resource name/id is missing in the request",[0m
[37m+ messageId: "SVC4678"[0m
[37m+ }[0m
[37m+ #---------SVC4679------------------------------[0m
[37m+ # %1 forwarding path name maximum length[0m
[37m+ FORWARDING_PATH_NAME_MAXIMUM_LENGTH: {[0m
[37m+ code: 400,[0m
[37m+ message: "Forwarding path name too long, , maximum allowed 200 characters : '%1'.",[0m
[37m+ messageId: "SVC4679"[0m
[37m+ }[0m
[37m+ #---------SVC4680------------------------------[0m
[37m+ # %1 Forwarding path name already in use[0m
[37m+ FORWARDING_PATH_NAME_ALREADY_IN_USE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Forwarding path name already in use : '%1'.",[0m
[37m+ messageId: "SVC4680"[0m
[37m+ }[0m
[37m+ #---------SVC4681------------------------------[0m
[37m+ # %1 Forwarding path name empty[0m
[37m+ FORWARDING_PATH_NAME_EMPTY: {[0m
[37m+ code: 400,[0m
[37m+ message: "Forwarding Path Name can't be empty .",[0m
[37m+ messageId: "SVC4681"[0m
[37m+ }[0m
[37m+ #---------SVC4682------------------------------[0m
[37m+ # %1 - resource uniqueId[0m
[37m+ # %2 - resource component type[0m
[37m+ RESOURCE_CANNOT_CONTAIN_POLICIES: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: The resource %1 type of %2 cannot contain policies.",[0m
[37m+ messageId: "SVC4682"[0m
[37m+ }[0m
[37m+ #---------SVC4683------------------------------[0m
[37m+ # %1 - policy uniqueId[0m
[37m+ # %2 - component uniqueId[0m
[37m+ POLICY_NOT_FOUND_ON_CONTAINER: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: Requested policy %1 was not found on the container %2.",[0m
[37m+ messageId: "SVC4683"[0m
[37m+ }[0m
[37m+ #---------SVC4684------------------------------[0m
[37m+ # %1 - policy name[0m
[37m+ INVALID_POLICY_NAME: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid policy name %1 received.",[0m
[37m+ messageId: "SVC4684"[0m
[37m+ }[0m
[37m+ #---------SVC4801------------------------------[0m
[37m+ # %1 - policy type[0m
[37m+ POLICY_TYPE_IS_INVALID: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid content. Policy type %1 does not exist",[0m
[37m+ messageId: "SVC4801"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4802------------------------------[0m
[37m+ # %1 - policy name[0m
[37m+ POLICY_MISSING_POLICY_TYPE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid content. Type name is not defined for policy %1",[0m
[37m+ messageId: "SVC4802"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4685------------------------------[0m
[37m+ # %1 - policy name[0m
[37m+ POLICY_NAME_ALREADY_EXIST: {[0m
[37m+ code: 409,[0m
[37m+ message: "Error: The policy with the name %1 already exists.",[0m
[37m+ messageId: "SVC4685"[0m
[37m+ }[0m
[37m+ #---------SVC4686------------------------------[0m
[37m+ # %1 - policy name[0m
[37m+ POLICY_TARGET_DOES_NOT_EXIST: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: The targets %1 are not valid, all targets have to be on the topologyTemplate.",[0m
[37m+ messageId: "SVC4686"[0m
[37m+ }[0m
[37m+ #---------SVC4687------------------------------[0m
[37m+ # %1 - policy type[0m
[37m+ # %2 - component type[0m
[37m+ EXCLUDED_POLICY_TYPE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: The policy of the type %1 excluded to add to a component of the type %2.",[0m
[37m+ messageId: "SVC4687"[0m
[37m+ }[0m
[37m+ #---------SVC4688------------------------------[0m
[37m+ # %1 - group type[0m
[37m+ # %2 - component type[0m
[37m+ GROUP_TYPE_ILLEGAL_PER_COMPONENT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: group type %1 not permitted in component of type %2",[0m
[37m+ messageId: "SVC4688"[0m
[37m+ }[0m
[37m+ #---------SVC4689------------------------------[0m
[37m+ # %1 - group type[0m
[37m+ # %2 - component type[0m
[37m+ POLICY_TARGET_TYPE_DOES_NOT_EXIST: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: The target types %1 are not valid.",[0m
[37m+ messageId: "SVC4689"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4690------------------------------[0m
[37m+ # %1 forwarding path protocol maximum length[0m
[37m+ FORWARDING_PATH_PROTOCOL_MAXIMUM_LENGTH: {[0m
[37m+ code: 400,[0m
[37m+ message: "Forwarding path protocol too long, , maximum allowed 200 characters : '%1'.",[0m
[37m+ messageId: "SVC4690"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4691------------------------------[0m
[37m+ # %1 forwarding path destination port maximum length[0m
[37m+ FORWARDING_PATH_DESTINATION_PORT_MAXIMUM_LENGTH: {[0m
[37m+ code: 400,[0m
[37m+ message: "Forwarding path destination port too long, , maximum allowed 200 characters : '%1'.",[0m
[37m+ messageId: "SVC4691"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------POL4692------------------------------[0m
[37m+ MISSING_OLD_COMPONENT_INSTANCE: {[0m
[37m+ code: 400 ,[0m
[37m+ message: "Error: Missing 'componentInstanceId' HTTP param.",[0m
[37m+ messageId: "POL4692"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------POL4693------------------------------[0m
[37m+ MISSING_NEW_COMPONENT_INSTANCE: {[0m
[37m+ code: 400 ,[0m
[37m+ message: "Error: Missing 'newComponentInstanceId' HTTP param.",[0m
[37m+ messageId: "POL4693"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4694------------------------------[0m
[37m+ # %1 External Reference Value[0m
[37m+ EXT_REF_NOT_FOUND: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: External Reference '%1' was not found.",[0m
[37m+ messageId: "SVC4694"[0m
[37m+ }[0m
[37m+ #---------SVC4695-----------------------------[0m
[37m+ # %1 - Interface Operation Name[0m
[37m+ INTERFACE_OPERATION_NAME_ALREADY_IN_USE: {[0m
[37m+ code: 409,[0m
[37m+ message: "Error: Interface Operation name '%1' already in use, Your current changes will not be saved.",[0m
[37m+ messageId: "SVC4695"[0m
[37m+ }[0m
[37m+ #---------SVC4696-----------------------------[0m
[37m+ # %1 - Interface Operation Name[0m
[37m+ INTERFACE_OPERATION_NAME_INVALID: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Interface Operation name '%1' is Invalid, Operation name should not contain special character, space and should not be greater than 200 characters.",[0m
[37m+ messageId: "SVC4696"[0m
[37m+ }[0m
[37m+ #---------SVC4697-----------------------------[0m
[37m+ INTERFACE_OPERATION_NAME_MANDATORY: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Interface Operation name is mandatory, Operation name can't be empty.",[0m
[37m+ messageId: "SVC4697"[0m
[37m+ }[0m
[37m+#---------SVC4698-----------------------------[0m
[37m+# %1 - Interface type[0m
[37m+ INTERFACE_OPERATION_INVALID_FOR_LOCAL_TYPE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid input, only one operation is allowed in local interface type '%1'.",[0m
[37m+ messageId: "SVC4698"[0m
[37m+ }[0m
[37m+ #---------SVC4699-----------------------------[0m
[37m+ # %1 - Interface Operation input parameter name[0m
[37m+ INTERFACE_OPERATION_INPUT_NAME_ALREADY_IN_USE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Interface Operation input parameter name '%1' already in use, Your current changes will not be saved.",[0m
[37m+ messageId: "SVC4699"[0m
[37m+ }[0m
[37m+ #---------SVC4700-----------------------------[0m
[37m+ INTERFACE_OPERATION_INPUT_NAME_MANDATORY: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Interface operation input parameter name should not be empty.",[0m
[37m+ messageId: "SVC4700"[0m
[37m+ }[0m
[37m+#---------SVC4701-----------------------------[0m
[37m+# %1 - component Id[0m
[37m+ INTERFACE_OPERATION_NOT_FOUND: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: Interface operation not found in the component '%1'.",[0m
[37m+ messageId: "SVC4701"[0m
[37m+ }[0m
[37m+ #---------SVC4702-----------------------------[0m
[37m+ INTERFACE_OPERATION_NOT_DELETED: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Failed to delete interface operation.",[0m
[37m+ messageId: "SVC4702"[0m
[37m+ }[0m
[37m+ #SVC4732[0m
[37m+ INTERFACE_UNKNOWN: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: The interface '%1' does not exists in the database.",[0m
[37m+ messageId: "SVC4732"[0m
[37m+ }[0m
[37m+ #SVC4733[0m
[37m+ INTERFACE_OPERATION_NOT_DEFINED: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: The operation '%1' does not exists in the interface '%2'.",[0m
[37m+ messageId: "SVC4733"[0m
[37m+ }[0m
[37m+ #-----------SVC4692---------------------------[0m
[37m+ RESOURCE_LIFECYCLE_STATE_NOT_VALID: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Lifecycle state %1 is not valid for resource",[0m
[37m+ messageId: "SVC4692"[0m
[37m+ }[0m
[37m+ #-----------SVC4693---------------------------[0m
[37m+ #%1 - component name[0m
[37m+ COMPONENT_IS_ARCHIVED: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Component %1 is archived",[0m
[37m+ messageId: "SVC4693"[0m
[37m+ }[0m
[37m+ #-----------SVC4703---------------------------[0m
[37m+ #%1 - component name[0m
[37m+ COMPONENT_IS_NOT_HIHGEST_CERTIFIED: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Component %1 is not highest certified",[0m
[37m+ messageId: "SVC4703"[0m
[37m+ }[0m
[37m+ #---------SVC4704------------------------------[0m
[37m+ # %1 - "service"/"VF"[0m
[37m+ # %2 - "Resource name"[0m
[37m+ ARCHIVED_ORIGINS_FOUND: {[0m
[37m+ code: 403,[0m
[37m+ message: "Error: Action is not permitted as your '%1' '%2' includes archived resources",[0m
[37m+ messageId: "SVC4704"[0m
[37m+ }[0m
[37m+ #---------SVC4705------------------------------[0m
[37m+ # %1-artifact name[0m
[37m+ ARTIFACT_PAYLOAD_EMPTY: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid content. Uploaded file %1 is empty. Please retry with the correct file.",[0m
[37m+ messageId: "SVC4705"[0m
[37m+ }[0m
[37m+ #---------SVC4800------------------------------[0m
[37m+ # %1 - "component id"[0m
[37m+ UPDATE_CATALOG_FAILED: {[0m
[37m+ code: 403,[0m
[37m+ message: "Error: update catalog for component '%1' failed.",[0m
[37m+ messageId: "SVC4800"[0m
[37m+ }[0m
[37m+ #---------SVC4706------------------------------[0m
[37m+ # %1-input(s) name(s) string[0m
[37m+ INPUTS_NOT_FOUND: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: missing input value(s) %1.",[0m
[37m+ messageId: "SVC4706"[0m
[37m+ }[0m
[37m+ #---------SVC4707-----------------------------[0m
[37m+ # %1 – asset type [service / resource ][0m
[37m+ # %2 – main asset uuid[0m
[37m+ ERROR_DURING_CSAR_CREATION: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: CSAR packaging failed for %1 %2.",[0m
[37m+ messageId: "SVC4706"[0m
[37m+ }[0m
[37m+#---------SVC4708-----------------------------[0m
[37m+# %1 - Interface Operation input property name, component type[0m
[37m+ INTERFACE_OPERATION_INPUT_PROPERTY_NOT_FOUND_IN_COMPONENT: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: Interface operation input parameter property '%1' not found in '%2' input properties, capability properties or outputs of other operations.",[0m
[37m+ messageId: "SVC4708"[0m
[37m+ }[0m
[37m+#---------SVC4709-----------------------------[0m
[37m+# %1 - Interface Operation output parameter name[0m
[37m+ INTERFACE_OPERATION_OUTPUT_NAME_ALREADY_IN_USE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Interface Operation output parameter name '%1' already in use, Your current changes will not be saved.",[0m
[37m+ messageId: "SVC4708"[0m
[37m+ }[0m
[37m+#---------SVC4710-----------------------------[0m
[37m+ INTERFACE_OPERATION_OUTPUT_NAME_MANDATORY: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Interface operation output parameter name should not be empty.",[0m
[37m+ messageId: "SVC4710"[0m
[37m+ }[0m
[37m+#---------SVC4711-----------------------------[0m
[37m+# %1 - interface Id[0m
[37m+ INTERFACE_NOT_FOUND_IN_COMPONENT: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: Interface not found in the component '%1'.",[0m
[37m+ messageId: "SVC4711"[0m
[37m+ }[0m
[37m+ #---------SVC4709-----------------------------[0m
[37m+ INVALID_PROPERTY_CONSTRAINTS: {[0m
[37m+ # %1 – property constraints type[0m
[37m+ # %2 – received property constraints value[0m
[37m+ # %3 – property type[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid %1 %2 for the type %3 have been received.",[0m
[37m+ messageId: "SVC4709"[0m
[37m+ }[0m
[37m+ #---------SVC4710-----------------------------[0m
[37m+ INVALID_PROPERTY_CONSTRAINTS_FORMAT: {[0m
[37m+ # %1 – received property constraints json section[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid format of the received property constraints section: %1. The property constraints section should be a list.",[0m
[37m+ messageId: "SVC4710"[0m
[37m+ }[0m
[37m+ #---------SVC4711-----------------------------[0m
[37m+ CANNOT_DELETE_VALID_VALUES: {[0m
[37m+ # %1 – property constraints type[0m
[37m+ # %2 – missing valid values[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Deletion of existing %1 is not permitted on an update. Missing values: %2",[0m
[37m+ messageId: "SVC4711"[0m
[37m+ }[0m
[37m+ #---------SVC4712------------------------------[0m
[37m+ MISSING_PROPERTY_NAME: {[0m
[37m+ code: 400 ,[0m
[37m+ message: "Error: Invalid Content. Missing mandatory parameter 'name'." ,[0m
[37m+ messageId: "SVC4712"[0m
[37m+ }[0m
[37m+ #---------SVC4713------------------------------[0m
[37m+ MISSING_PROPERTY_VALUE: {[0m
[37m+ code: 400 ,[0m
[37m+ message: "Error: Invalid Content. Missing mandatory parameter 'value'." ,[0m
[37m+ messageId: "SVC4713"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4712---------------------------[0m
[37m+ INVALID_INSTANTIATION_TYPE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Invalid instantiationType: %1",[0m
[37m+ messageId: "SVC4712"[0m
[37m+ }[0m
[37m+[0m
[37m+ #----------SVC4713---------------------------[0m
[37m+ MISSING_ECOMP_GENERATED_NAMING: {[0m
[37m+ code: 400,[0m
[37m+ message: "Missing ecompGeneratedNaming property",[0m
[37m+ messageId: "SVC4713"[0m
[37m+ }[0m
[37m+[0m
[37m+ #-----------SVC4714--------------------------[0m
[37m+ NAMING_POLICY_EXCEEDS_LIMIT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. Naming policy exceeds limit of %1 characters.",[0m
[37m+ messageId: "SVC4714"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4715------------------------------[0m
[37m+ INVALID_NAMING_POLICY: {[0m
[37m+ code: 400,[0m
[37m+ message: 'Error: Invalid Content. Naming policy is not allowed to contain characters like <>:"\/|?* and space characters other than regular space.',[0m
[37m+ messageId: "SVC4715"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4716------------------------------[0m
[37m+ INVALID_ENVIRONMENT_CONTEXT: {[0m
[37m+ code: 400,[0m
[37m+ message: 'Error: Invalid Environment context: %1',[0m
[37m+ messageId: "SVC4716"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4717------------------------------[0m
[37m+ UNSUPPORTED_DISTRIBUTION_STATUS: {[0m
[37m+ code: 400,[0m
[37m+ message: 'Error: Unsupported distribution action: %1',[0m
[37m+ messageId: "SVC4717"[0m
[37m+ }[0m
[37m+ #---------SVC4718------------------------------[0m
[37m+ CONTAINER_CANNOT_CONTAIN_INSTANCE: {[0m
[37m+ # %1 - "container type"[0m
[37m+ # %2- “component type”[0m
[37m+ code: 400 ,[0m
[37m+ message: "Error : %1 can’t contain component instance %2" ,[0m
[37m+ messageId: "SVC4718"[0m
[37m+ }[0m
[37m+ #---------SVC4719------------------------------[0m
[37m+ CONTAINER_CANNOT_CONTAIN_COMPONENT_IN_STATE: {[0m
[37m+ # %1 - "container type"[0m
[37m+ # %2- "lifecycle state"[0m
[37m+ code: 400 ,[0m
[37m+ message: "Error: Container %1 can’t contain component in state %2" ,[0m
[37m+ messageId: "SVC4719"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4720------------------------------[0m
[37m+ MISSING_MANDATORY_PROPERTY: {[0m
[37m+ # %1 - "property name"[0m
[37m+ code: 400 ,[0m
[37m+ message: "Error: Missing mandatory %1 property" ,[0m
[37m+ messageId: "SVC4720"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4721------------------------------[0m
[37m+ MANDATORY_PROPERTY_MISSING_VALUE: {[0m
[37m+ # %1 - "property name"[0m
[37m+ code: 400 ,[0m
[37m+ message: "Error: Missing value for the mandatory %1 property" ,[0m
[37m+ messageId: "SVC4721"[0m
[37m+ }[0m
[37m+#---------SVC4712-----------------------------[0m
[37m+ INTERFACE_LIFECYCLE_TYPES_NOT_FOUND: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: Interface Lifecycle types not found.",[0m
[37m+ messageId: "SVC4712"[0m
[37m+ }[0m
[37m+#---------SVC4713-----------------------------[0m
[37m+# %1 - Interface Operation Name[0m
[37m+ INTERFACE_OPERATION_INVALID_FOR_GLOBAL_TYPE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid input, only pre-defined operation names are allowed in global interface type '%1'",[0m
[37m+ messageId: "SVC4713"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4714-----------------------------[0m
[37m+ NODE_FILTER_NOT_FOUND: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Node Filter was not found",[0m
[37m+ messageId: "SVC4714"[0m
[37m+ }[0m
[37m+ #---------SVC4715----------------------------[0m
[37m+ UNSUPPORTED_VALUE_PROVIDED: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Supported value type is %1 for %2 property. Provided Value: %3",[0m
[37m+ messageId: "SVC4715"[0m
[37m+ }[0m
[37m+ #---------SVC4716----------------------------[0m
[37m+ # %1 - Property Name[0m
[37m+ SELECTED_PROPERTY_NOT_PRESENT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: %1 property does not exists in Service anymore.",[0m
[37m+ messageId: "SVC4716"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4717----------------------------[0m
[37m+ # %1 - Property Name[0m
[37m+ MAPPED_PROPERTY_NOT_FOUND: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: %1 property does not exist.",[0m
[37m+ messageId: "SVC4717"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4718----------------------------[0m
[37m+ # %1 - Property Name[0m
[37m+ # %2 - Operator Name[0m
[37m+ UNSUPPORTED_OPERATOR_PROVIDED: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: %1 property does not support %2 operator.",[0m
[37m+ messageId: "SVC4718"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4719----------------------------[0m
[37m+ CONSTRAINT_FORMAT_INCORRECT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Constraint provided does not contains expected values.",[0m
[37m+ messageId: "SVC4719"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4720----------------------------[0m
[37m+ # %1 - Property Name[0m
[37m+ # %2 - Operator Type[0m
[37m+ SOURCE_TARGET_PROPERTY_TYPE_MISMATCH: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: %1 property and %2 property type is not same.",[0m
[37m+ messageId: "SVC4720"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4721----------------------------[0m
[37m+ # %1 - Property Type[0m
[37m+ # %2 - Operator Type[0m
[37m+ UNSUPPORTED_PROPERTY_TYPE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Property type %1 provided against %2 is not supported for static value.",[0m
[37m+ messageId: "SVC4721"[0m
[37m+ }[0m
[37m+[0m
[37m+ #---------SVC4722------------------------------[0m
[37m+ # %1 Directive value set[0m
[37m+ DIRECTIVES_INVALID_VALUE: {[0m
[37m+ code: 404,[0m
[37m+ message: "Error: Invalid directive value : '%1' .",[0m
[37m+ messageId: "SVC4722"[0m
[37m+ }[0m
[37m+#---------SVC4723-----------------------------[0m
[37m+# %1 - Interface Operation output name[0m
[37m+ INTERFACE_OPERATION_MAPPED_OUTPUT_MODIFIED: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Cannot update or delete interface operation output(s) '%1' mapped to an operation input",[0m
[37m+ messageId: "SVC4723"[0m
[37m+ }[0m
[37m+#---------SVC4724-----------------------------[0m
[37m+# %1 - Interface Operation output name[0m
[37m+ INTERFACE_OPERATION_DELETE_WITH_MAPPED_OUTPUT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Cannot delete interface operation with output(s) '%1' mapped to another operation input",[0m
[37m+ messageId: "SVC4724"[0m
[37m+ }[0m
[37m+#---------SVC4725-----------------------------[0m
[37m+ INVALID_CONSUMPTION_TYPE: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Given value is different than input type. Needs to be %1",[0m
[37m+ messageId: "SVC4725"[0m
[37m+ }[0m
[37m+#---------SVC4726-----------------------------[0m
[37m+ INVALID_PROPERTY_VALUES: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid property values provided:\n %1",[0m
[37m+ messageId: "SVC4726"[0m
[37m+ }[0m
[37m+#---------SVC4727------------------------------[0m
[37m+ INVALID_PROPERTY_NAME: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Property name contains invalid characters. It should have only letters, numbers and underscores.",[0m
[37m+ messageId: "SVC4727"[0m
[37m+ }[0m
[37m+[0m
[37m+#---------SVC4728------------------------------[0m
[37m+ FAILED_TO_CREATE_OR_UPDATE_CAPABILITY_PROPERTIES: {[0m
[37m+ code: 500,[0m
[37m+ message: "Error: Failed to create or update capabilities properties",[0m
[37m+ messageId: "SVC4728"[0m
[37m+ }[0m
[37m+[0m
[37m+#---------SVC4729------------------------------[0m
[37m+ # %1 - resource Id[0m
[37m+ CAPABILITY_PROPERTIES_NOT_FOUND: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Capability properties not found in the resource '%1'.",[0m
[37m+ messageId: "SVC4729"[0m
[37m+ }[0m
[37m+#---------SVC4730------------------------------[0m
[37m+ # %1 - property name[0m
[37m+ PROPERTY_EXCEEDS_LIMIT: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Invalid Content. %1 exceeds limit.",[0m
[37m+ messageId: "SVC4722"[0m
[37m+ }[0m
[37m+#---------SVC4731------------------------------[0m
[37m+ INVALID_PROPERY: {[0m
[37m+ # %1 - property name[0m
[37m+ code: 400,[0m
[37m+ message: 'Error: Invalid Content. %1 has invalid format.',[0m
[37m+ messageId: "SVC4723"[0m
[37m+ }[0m
[37m+#---------SVC4734------------------------------[0m
[37m+ # %1 - list of validation errors[0m
[37m+ INVALID_PM_DICTIONARY_FILE: {[0m
[37m+ code: 400,[0m
[37m+ message: 'Error: Invalid PM Dictionary File. %1',[0m
[37m+ messageId: "SVC4734"[0m
[37m+ }[0m
[37m+#-----------SVC4735---------------------------[0m
[37m+ #%1 - input name[0m
[37m+ INPUT_ALREADY_EXIST: {[0m
[37m+ code: 409,[0m
[37m+ message: "Error: Input with '%1' name already exists.",[0m
[37m+ messageId: "SVC4735"[0m
[37m+ }[0m
[37m+#---------SVC4736------------------------------[0m
[37m+ INVALID_INPUT_NAME: {[0m
[37m+ code: 400,[0m
[37m+ message: "Error: Input name contains invalid characters. It should have only letters, numbers and underscores.",[0m
[37m+ messageId: "SVC4736"[0m
[37m+ }[0m
[37m+ #---------SVC4139------------------------------[0m
[37m+ # %1 - The action that is not supported[0m
[37m+ NOT_SUPPORTED: {[0m
[37m+ code: 400,[0m
[37m+ message: '%1 is not yet supported',[0m
[37m+ messageId: "SVC4139"[0m
[37m+ }[0m
[37m+ #---------SVC4140------------------------------[0m
[37m+ # %1 - Component uid[0m
[37m+ COMPONENT_FIND_ERROR: {[0m
[37m+ code: 500,[0m
[37m+ message: "An unexpected error occurred while retrieving the component '%1'.",[0m
[37m+ messageId: "SVC4140"[0m
[37m+ }[0m
[37m+ #---------SVC4141------------------------------[0m
[37m+ # %1 - Component uid[0m
[37m+ COMPONENT_CAPABILITIES_FIND_ERROR: {[0m
[37m+ code: 500,[0m
[37m+ message: "An unexpected error occurred while retrieving the component '%1' capabilities.",[0m
[37m+ messageId: "SVC4141"[0m
[37m+ }[0m
[37m+ #---------SVC4142------------------------------[0m
[37m+ # %1 - Component uid or name[0m
[37m+ COMPONENT_NOT_FOUND: {[0m
[37m+ code: 404,[0m
[37m+ message: "Component '%1' was not found.",[0m
[37m+ messageId: "SVC4142"[0m
[37m+ }[0m
[37m+ #---------SVC4143------------------------------[0m
[37m+ # %1 - Capability name[0m
[37m+ COMPONENT_INSTANCE_CAPABILITY_UPDATE_ERROR: {[0m
[37m+ code: 500,[0m
[37m+ message: "An unexpected error occurred while updating the capability '%1'.",[0m
[37m+ messageId: "SVC4143"[0m
[37m+ }[0m[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/error-configuration.yaml] owner changed to 1000
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/error-configuration.yaml] owner changed to 1000
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/error-configuration.yaml] group changed to 101
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/error-configuration.yaml] group changed to 101
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/error-configuration.yaml] mode changed to 644
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/config/catalog-be/error-configuration.yaml] mode changed to 644
[32m- change mode from '' to '0644'[0m
[32m- change owner from '' to 'onap'[0m
[32m- change group from '' to 'onap'[0m
[0mRecipe: sdc-catalog-be::BE_9_prepareProbeFile[0m
* template[/app/jetty/ready-probe.sh] action create[2021-06-04T01:20:09+00:00] INFO: template[/app/jetty/ready-probe.sh] created file /app/jetty/ready-probe.sh
[2021-06-04T01:20:09+00:00] INFO: template[/app/jetty/ready-probe.sh] created file /app/jetty/ready-probe.sh
[32m- create new file /app/jetty/ready-probe.sh[0m[2021-06-04T01:20:09+00:00] INFO: template[/app/jetty/ready-probe.sh] updated file contents /app/jetty/ready-probe.sh
[2021-06-04T01:20:09+00:00] INFO: template[/app/jetty/ready-probe.sh] updated file contents /app/jetty/ready-probe.sh
[32m- update content in file /app/jetty/ready-probe.sh from none to 7f2787[0m
[32m- suppressed sensitive resource[0m[2021-06-04T01:20:09+00:00] INFO: template[/app/jetty/ready-probe.sh] mode changed to 755
[2021-06-04T01:20:09+00:00] INFO: template[/app/jetty/ready-probe.sh] mode changed to 755
[32m- change mode from '' to '0755'[0m
[0mRecipe: sdc-catalog-be::BE_10_setup_cadi[0m
* directory[Jetty_etc_dir_creation] action create (skipped due to not_if)
* cookbook_file[/app/jetty/etc/keyfile] action create[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/etc/keyfile] created file /app/jetty/etc/keyfile
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/etc/keyfile] created file /app/jetty/etc/keyfile
[32m- create new file /app/jetty/etc/keyfile[0m[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/etc/keyfile] updated file contents /app/jetty/etc/keyfile
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/etc/keyfile] updated file contents /app/jetty/etc/keyfile
[32m- update content in file /app/jetty/etc/keyfile from none to 699bb0[0m
[37m--- /app/jetty/etc/keyfile 2021-06-04 01:20:09.733610573 +0000[0m
[37m+++ /app/jetty/etc/.chef-keyfile20210604-18-1jod4np 2021-06-04 01:20:09.733610573 +0000[0m
[37m@@ -1,4 +1,8 @@[0m
[37m+#############################################################[0m
[37m+# This file should be replaced with jetty keyfile: #[0m
[37m+# /var/lib/jetty/base/be/etc/keyfile #[0m
[37m+#############################################################[0m[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/etc/keyfile] owner changed to 1000
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/etc/keyfile] owner changed to 1000
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/etc/keyfile] mode changed to 755
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/etc/keyfile] mode changed to 755
[32m- change mode from '' to '0755'[0m
[32m- change owner from '' to 'onap'[0m
[0m * cookbook_file[/app/jetty/etc/cadi_truststore.jks] action create[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/etc/cadi_truststore.jks] created file /app/jetty/etc/cadi_truststore.jks
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/etc/cadi_truststore.jks] created file /app/jetty/etc/cadi_truststore.jks
[32m- create new file /app/jetty/etc/cadi_truststore.jks[0m[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/etc/cadi_truststore.jks] updated file contents /app/jetty/etc/cadi_truststore.jks
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/etc/cadi_truststore.jks] updated file contents /app/jetty/etc/cadi_truststore.jks
[32m- update content in file /app/jetty/etc/cadi_truststore.jks from none to 9eae24[0m
[37m--- /app/jetty/etc/cadi_truststore.jks 2021-06-04 01:20:09.741610612 +0000[0m
[37m+++ /app/jetty/etc/.chef-cadi_truststore20210604-18-spmi1g.jks 2021-06-04 01:20:09.741610612 +0000[0m
[37m@@ -1,4 +1,8 @@[0m
[37m+##################################################################[0m
[37m+## This file should be replaced with jetty cadi_truststore.jks: #[0m
[37m+## /var/lib/jetty/base/be/etc/cadi_truststore.jks #[0m
[37m+##################################################################[0m[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/etc/cadi_truststore.jks] owner changed to 1000
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/etc/cadi_truststore.jks] owner changed to 1000
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/etc/cadi_truststore.jks] mode changed to 755
[2021-06-04T01:20:09+00:00] INFO: cookbook_file[/app/jetty/etc/cadi_truststore.jks] mode changed to 755
[32m- change mode from '' to '0755'[0m
[32m- change owner from '' to 'onap'[0m
[0m * template[/app/jetty/etc/cadi.properties] action create[2021-06-04T01:20:09+00:00] INFO: template[/app/jetty/etc/cadi.properties] created file /app/jetty/etc/cadi.properties
[2021-06-04T01:20:09+00:00] INFO: template[/app/jetty/etc/cadi.properties] created file /app/jetty/etc/cadi.properties
[32m- create new file /app/jetty/etc/cadi.properties[0m[2021-06-04T01:20:09+00:00] INFO: template[/app/jetty/etc/cadi.properties] updated file contents /app/jetty/etc/cadi.properties
[2021-06-04T01:20:09+00:00] INFO: template[/app/jetty/etc/cadi.properties] updated file contents /app/jetty/etc/cadi.properties
[32m- update content in file /app/jetty/etc/cadi.properties from none to 98baf9[0m
[37m--- /app/jetty/etc/cadi.properties 2021-06-04 01:20:09.745610630 +0000[0m
[37m+++ /app/jetty/etc/.chef-cadi20210604-18-1ynrzn5.properties 2021-06-04 01:20:09.745610630 +0000[0m
[37m@@ -1,54 +1,108 @@[0m
[37m+# Configure AAF[0m
[37m+aaf_locate_url=[0m
[37m+[0m
[37m+aaf_url=[0m
[37m+[0m
[37m+#if you are running aaf service from a docker image you have to use aaf service IP and port number[0m
[37m+aaf_id=user[0m
[37m+#Encrypt the password using AAF Jar[0m
[37m+aaf_password=enc:AafEncriptedPassword[0m
[37m+# Sample CADI Properties, from CADI 1.4.2[0m
[37m+hostname=sdc-be.onap[0m
[37m+csp_domain=PROD[0m
[37m+[0m
[37m+# Add Absolute path to Keyfile[0m
[37m+cadi_keyfile=/app/jetty/etc/org.onap.sdc.p12[0m
[37m+[0m
[37m+[0m
[37m+# This is required to accept Certificate Authentication from Certman certificates.[0m
[37m+# can be TEST, IST or PROD[0m
[37m+aaf_env=TEST[0m
[37m+[0m
[37m+# DEBUG prints off all the properties. Use to get started.[0m
[37m+cadi_loglevel=DEBUG[0m
[37m+[0m
[37m+[0m
[37m+# Become CSO Poodle Compliant by only allowing sanctioned TLS versions[0m
[37m+# The following is the default[0m
[37m+# cadi_protocols=TLSv1.1,TLSv1.2[0m
[37m+[0m
[37m+# Default TrustStore - REQUIRED for changing PROTOCOL Defaults for DME2[0m
[37m+# Read https://wiki.web.att.com/pages/viewpage.action?pageId=574623569#URGENT:SolvingSSL2-3/TLSv1removalissues-Up-to-dateTruststore[0m
[37m+# Add Absolute path to truststore2020.jks[0m
[37m+cadi_truststore=/app/jetty/etc/org.onap.sdc.trust.jks[0m
[37m+# Note: This is the ONLY password that doesn't have to be encrypted. All Java's TrustStores are this passcode by default, because they are public certs[0m
[37m+cadi_truststore_password=changeit[0m
[37m+[0m
[37m+# how to turn on SSL Logging[0m
[37m+#javax.net.debug=ssl[0m
[37m+[0m
[37m+##[0m
[37m+# Hint[0m
[37m+# Use "maps.bing.com" to get Lat and Long for an Address[0m
[37m+AFT_LATITUDE=32.780140[0m
[37m+AFT_LONGITUDE=-96.800451[0m
[37m+AFT_ENVIRONMENT=AFTUAT[0m
[37m+AFT_DME2_CLIENT_IGNORE_SSL_CONFIG=true[0m
[37m+DME2.DEBUG=true[0m
[37m+AFT_DME2_HTTP_EXCHANGE_TRACE_ON=true[0m
[37m+[0m
[37m+cadi_latitude=32.780140[0m
[37m+cadi_longitude=-96.800451[0m
[37m+[0m
[37m+aaf_root_ns=com.onap.sdc[0m
[37m+aaf_api_version=2.0[0m[2021-06-04T01:20:09+00:00] INFO: template[/app/jetty/etc/cadi.properties] owner changed to 1000
[2021-06-04T01:20:09+00:00] INFO: template[/app/jetty/etc/cadi.properties] owner changed to 1000
[2021-06-04T01:20:09+00:00] INFO: template[/app/jetty/etc/cadi.properties] mode changed to 755
[2021-06-04T01:20:09+00:00] INFO: template[/app/jetty/etc/cadi.properties] mode changed to 755
[32m- change mode from '' to '0755'[0m
[32m- change owner from '' to 'onap'[0m
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
/usr/lib/ruby/gems/2.7.0/gems/chef-zero-13.1.0/lib/chef_zero/rest_base.rb:80: warning: URI.unescape is obsolete
[0m[2021-06-04T01:20:09+00:00] INFO: Chef Run complete in 1.696143962 seconds
[2021-06-04T01:20:09+00:00] INFO: Chef Run complete in 1.696143962 seconds
[0m
Running handlers:[0m
[2021-06-04T01:20:09+00:00] INFO: Running report handlers
[2021-06-04T01:20:09+00:00] INFO: Running report handlers
Running handlers complete
[0m[2021-06-04T01:20:09+00:00] INFO: Report handlers complete
[2021-06-04T01:20:09+00:00] INFO: Report handlers complete
Chef Client finished, 21/23 resources updated in 03 seconds[0m
[2021-06-04T01:20:09+00:00] WARN: *****************************************
[2021-06-04T01:20:09+00:00] WARN: *****************************************
[2021-06-04T01:20:09+00:00] WARN: Did not find config file: /solo.rb, using command line options.
[2021-06-04T01:20:09+00:00] WARN: Did not find config file: /solo.rb, using command line options.
[2021-06-04T01:20:09+00:00] WARN: *****************************************
[2021-06-04T01:20:09+00:00] WARN: *****************************************
2021-06-04 01:20:10.397:INFO::main: Logging initialized @557ms to org.eclipse.jetty.util.log.StdErrLog
2021-06-04 01:20:10.715:INFO::main: Console stderr/stdout captured to /app/jetty/logs/2021_06_04.jetty.log
2021-06-04T00:00:01.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca48256e-3de5-467e-90b2-b9a116b76903 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:00:01.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca48256e-3de5-467e-90b2-b9a116b76903 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d3c2373
2021-06-04T00:00:01.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca48256e-3de5-467e-90b2-b9a116b76903 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:00:01.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca48256e-3de5-467e-90b2-b9a116b76903 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:00:05.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d5cb85f-a963-4316-a3b3-56df0826a692 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:00:05.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d5cb85f-a963-4316-a3b3-56df0826a692 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34083b49
2021-06-04T00:00:05.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d5cb85f-a963-4316-a3b3-56df0826a692 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:00:05.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d5cb85f-a963-4316-a3b3-56df0826a692 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:00:07.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6ade246-42f9-4210-b475-cad294e6a536 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:00:07.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6ade246-42f9-4210-b475-cad294e6a536 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2781e929
2021-06-04T00:00:07.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6ade246-42f9-4210-b475-cad294e6a536 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:00:07.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6ade246-42f9-4210-b475-cad294e6a536 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:00:08.410Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T00:00:08.411Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:00:08.412Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:00:08.412Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:00:08.412Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:00:08.413Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:00:08.413Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:00:10.894Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7dceedf-6315-4ebe-9710-0941e0ffb95c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:00:10.894Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7dceedf-6315-4ebe-9710-0941e0ffb95c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e6d241
2021-06-04T00:00:10.894Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7dceedf-6315-4ebe-9710-0941e0ffb95c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:00:10.895Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7dceedf-6315-4ebe-9710-0941e0ffb95c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:00:13.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d00b51a9-ab93-495d-b159-7c73842a64f6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:00:13.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d00b51a9-ab93-495d-b159-7c73842a64f6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7fbd5ef5
2021-06-04T00:00:13.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d00b51a9-ab93-495d-b159-7c73842a64f6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:00:13.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d00b51a9-ab93-495d-b159-7c73842a64f6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:00:16.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=648bfd2d-0073-447d-88a3-f26b6802ecab PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:00:16.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=648bfd2d-0073-447d-88a3-f26b6802ecab PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a1ae038
2021-06-04T00:00:16.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=648bfd2d-0073-447d-88a3-f26b6802ecab PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:00:16.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=648bfd2d-0073-447d-88a3-f26b6802ecab PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:00:20.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da1a625f-0822-4b46-bcf6-eea83352df14 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:00:20.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da1a625f-0822-4b46-bcf6-eea83352df14 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22fa98f3
2021-06-04T00:00:20.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da1a625f-0822-4b46-bcf6-eea83352df14 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:00:20.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da1a625f-0822-4b46-bcf6-eea83352df14 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:00:22.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05c441a4-0c2f-467e-a3d7-d75d8a940a48 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:00:22.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05c441a4-0c2f-467e-a3d7-d75d8a940a48 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@173b2237
2021-06-04T00:00:22.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05c441a4-0c2f-467e-a3d7-d75d8a940a48 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:00:22.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05c441a4-0c2f-467e-a3d7-d75d8a940a48 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:00:22.744Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T00:00:22.747Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:00:25.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a6aa37c-4622-455e-a140-be5841c10241 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:00:25.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a6aa37c-4622-455e-a140-be5841c10241 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2649cd3
2021-06-04T00:00:25.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a6aa37c-4622-455e-a140-be5841c10241 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:00:25.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a6aa37c-4622-455e-a140-be5841c10241 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:00:28.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7a03707-fcb6-47d2-8798-f2116074b473 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:00:28.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7a03707-fcb6-47d2-8798-f2116074b473 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f22a787
2021-06-04T00:00:28.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7a03707-fcb6-47d2-8798-f2116074b473 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:00:28.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7a03707-fcb6-47d2-8798-f2116074b473 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:00:31.452Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8fcdfdd-e658-4736-b326-2bfabee5c7e8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:00:31.452Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8fcdfdd-e658-4736-b326-2bfabee5c7e8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29699190
2021-06-04T00:00:31.452Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8fcdfdd-e658-4736-b326-2bfabee5c7e8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:00:31.452Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8fcdfdd-e658-4736-b326-2bfabee5c7e8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:00:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef8816f8-452c-445e-bcaf-de88451e9ca7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:00:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef8816f8-452c-445e-bcaf-de88451e9ca7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@678d2410
2021-06-04T00:00:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef8816f8-452c-445e-bcaf-de88451e9ca7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:00:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef8816f8-452c-445e-bcaf-de88451e9ca7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:00:38.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=548889bb-e5d4-41ef-ba05-33a2d5185e4a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:00:38.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=548889bb-e5d4-41ef-ba05-33a2d5185e4a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4129be36
2021-06-04T00:00:38.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=548889bb-e5d4-41ef-ba05-33a2d5185e4a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:00:38.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=548889bb-e5d4-41ef-ba05-33a2d5185e4a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:00:40.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbe1bbde-b1fd-41e3-92e0-7f6fc4867d7c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:00:40.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbe1bbde-b1fd-41e3-92e0-7f6fc4867d7c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b7d270b
2021-06-04T00:00:40.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbe1bbde-b1fd-41e3-92e0-7f6fc4867d7c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:00:40.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbe1bbde-b1fd-41e3-92e0-7f6fc4867d7c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:00:43.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62940fc6-fbec-4e3b-9f89-faaee8eeeaef PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:00:43.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62940fc6-fbec-4e3b-9f89-faaee8eeeaef PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6efdc2e5
2021-06-04T00:00:43.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62940fc6-fbec-4e3b-9f89-faaee8eeeaef PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:00:43.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62940fc6-fbec-4e3b-9f89-faaee8eeeaef PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:00:46.876Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6e048a4-b7ce-4af1-aea0-989947466cf9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:00:46.876Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6e048a4-b7ce-4af1-aea0-989947466cf9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60ded68e
2021-06-04T00:00:46.876Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6e048a4-b7ce-4af1-aea0-989947466cf9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:00:46.876Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6e048a4-b7ce-4af1-aea0-989947466cf9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:00:49.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9750c088-7a0e-4dd4-a62b-8372bc1dafbe PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:00:49.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9750c088-7a0e-4dd4-a62b-8372bc1dafbe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c8a0cad
2021-06-04T00:00:49.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9750c088-7a0e-4dd4-a62b-8372bc1dafbe PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:00:49.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9750c088-7a0e-4dd4-a62b-8372bc1dafbe PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:00:52.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=980ef5f6-e35b-49a1-9616-049163ac30c9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:00:52.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=980ef5f6-e35b-49a1-9616-049163ac30c9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ead2b48
2021-06-04T00:00:52.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=980ef5f6-e35b-49a1-9616-049163ac30c9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:00:52.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=980ef5f6-e35b-49a1-9616-049163ac30c9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:00:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7cf7535c-7e33-48b9-b074-6a76ad1b9449 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:00:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7cf7535c-7e33-48b9-b074-6a76ad1b9449 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e473a92
2021-06-04T00:00:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7cf7535c-7e33-48b9-b074-6a76ad1b9449 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:00:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7cf7535c-7e33-48b9-b074-6a76ad1b9449 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:00:59.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b0c280e-c792-4ff6-aad7-124beff67f89 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:00:59.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b0c280e-c792-4ff6-aad7-124beff67f89 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@18bbe772
2021-06-04T00:00:59.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b0c280e-c792-4ff6-aad7-124beff67f89 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:00:59.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b0c280e-c792-4ff6-aad7-124beff67f89 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:01:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2efd1bf2-4b82-4e45-a482-c4885e3884bf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:01:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2efd1bf2-4b82-4e45-a482-c4885e3884bf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@24e86fac
2021-06-04T00:01:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2efd1bf2-4b82-4e45-a482-c4885e3884bf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:01:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2efd1bf2-4b82-4e45-a482-c4885e3884bf PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:01:04.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69d4da0b-230f-452b-9ae3-fe8890772aca PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:01:04.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69d4da0b-230f-452b-9ae3-fe8890772aca PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43f8e712
2021-06-04T00:01:04.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69d4da0b-230f-452b-9ae3-fe8890772aca PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:01:04.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69d4da0b-230f-452b-9ae3-fe8890772aca PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:01:07.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c3fee3e-7b59-4416-9eaa-7c8d5e8eb430 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:01:07.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c3fee3e-7b59-4416-9eaa-7c8d5e8eb430 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74dcd655
2021-06-04T00:01:07.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c3fee3e-7b59-4416-9eaa-7c8d5e8eb430 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:01:07.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c3fee3e-7b59-4416-9eaa-7c8d5e8eb430 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:01:10.687Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c8a63a86-90f1-46b5-9994-48363feefe00 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:01:10.687Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c8a63a86-90f1-46b5-9994-48363feefe00 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@339b3fcb
2021-06-04T00:01:10.687Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c8a63a86-90f1-46b5-9994-48363feefe00 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:01:10.687Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c8a63a86-90f1-46b5-9994-48363feefe00 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:01:13.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8d89836-bbce-457d-92a1-c29d1c675bd6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:01:13.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8d89836-bbce-457d-92a1-c29d1c675bd6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54e9a31b
2021-06-04T00:01:13.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8d89836-bbce-457d-92a1-c29d1c675bd6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:01:13.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8d89836-bbce-457d-92a1-c29d1c675bd6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:01:16.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8b7e452-40d6-4353-bbdc-49fdb772ca5d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:01:16.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8b7e452-40d6-4353-bbdc-49fdb772ca5d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50ad0ee3
2021-06-04T00:01:16.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8b7e452-40d6-4353-bbdc-49fdb772ca5d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:01:16.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8b7e452-40d6-4353-bbdc-49fdb772ca5d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:01:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=368bddaa-6608-415c-9787-b4665ad0dafd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:01:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=368bddaa-6608-415c-9787-b4665ad0dafd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42d114dd
2021-06-04T00:01:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=368bddaa-6608-415c-9787-b4665ad0dafd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:01:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=368bddaa-6608-415c-9787-b4665ad0dafd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:01:22.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f291e9b1-987f-4e9c-9b3b-391994821c70 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:01:22.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f291e9b1-987f-4e9c-9b3b-391994821c70 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@285e1e2b
2021-06-04T00:01:22.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f291e9b1-987f-4e9c-9b3b-391994821c70 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:01:22.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f291e9b1-987f-4e9c-9b3b-391994821c70 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:01:25.877Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7826a9fb-a00d-4c03-a024-20292e91e0d6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:01:25.877Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7826a9fb-a00d-4c03-a024-20292e91e0d6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@31368140
2021-06-04T00:01:25.877Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7826a9fb-a00d-4c03-a024-20292e91e0d6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:01:25.877Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7826a9fb-a00d-4c03-a024-20292e91e0d6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:01:29.075Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f9f0e06-a8f2-451f-8322-4ac26ff69ad4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:01:29.075Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f9f0e06-a8f2-451f-8322-4ac26ff69ad4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9d44b93
2021-06-04T00:01:29.075Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f9f0e06-a8f2-451f-8322-4ac26ff69ad4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:01:29.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f9f0e06-a8f2-451f-8322-4ac26ff69ad4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:01:31.449Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aff34c4f-793a-4739-a7fb-ff8a31277666 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:01:31.449Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aff34c4f-793a-4739-a7fb-ff8a31277666 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4369c188
2021-06-04T00:01:31.449Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aff34c4f-793a-4739-a7fb-ff8a31277666 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:01:31.449Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aff34c4f-793a-4739-a7fb-ff8a31277666 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:01:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47cafb7a-d9e4-40a0-9411-4520e2865dd3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:01:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47cafb7a-d9e4-40a0-9411-4520e2865dd3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b9e3088
2021-06-04T00:01:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47cafb7a-d9e4-40a0-9411-4520e2865dd3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:01:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47cafb7a-d9e4-40a0-9411-4520e2865dd3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:01:38.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5d48a1c-94f7-4fc8-a861-fcb1a3ad0548 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:01:38.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5d48a1c-94f7-4fc8-a861-fcb1a3ad0548 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e279e3a
2021-06-04T00:01:38.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5d48a1c-94f7-4fc8-a861-fcb1a3ad0548 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:01:38.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5d48a1c-94f7-4fc8-a861-fcb1a3ad0548 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:01:40.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04fdb927-392e-4e32-86e7-e9f12f92e7f2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:01:40.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04fdb927-392e-4e32-86e7-e9f12f92e7f2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3504c6be
2021-06-04T00:01:40.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04fdb927-392e-4e32-86e7-e9f12f92e7f2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:01:40.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04fdb927-392e-4e32-86e7-e9f12f92e7f2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:01:43.730Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51f52eac-a1d3-44c4-b5c7-4e8aeb66856b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:01:43.730Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51f52eac-a1d3-44c4-b5c7-4e8aeb66856b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38ec3417
2021-06-04T00:01:43.730Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51f52eac-a1d3-44c4-b5c7-4e8aeb66856b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:01:43.731Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51f52eac-a1d3-44c4-b5c7-4e8aeb66856b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:01:47.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c269524-a68e-44dd-9684-13faa2a8ef4d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:01:47.077Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c269524-a68e-44dd-9684-13faa2a8ef4d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@529c59f2
2021-06-04T00:01:47.077Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c269524-a68e-44dd-9684-13faa2a8ef4d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:01:47.077Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c269524-a68e-44dd-9684-13faa2a8ef4d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:01:49.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fee7fc2-36b0-42ec-b252-1bc85ab61873 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:01:49.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fee7fc2-36b0-42ec-b252-1bc85ab61873 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7068cbd5
2021-06-04T00:01:49.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fee7fc2-36b0-42ec-b252-1bc85ab61873 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:01:49.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fee7fc2-36b0-42ec-b252-1bc85ab61873 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:01:52.531Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=286f248f-92e7-4e65-8b37-fcb412356436 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:01:52.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=286f248f-92e7-4e65-8b37-fcb412356436 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@63cac250
2021-06-04T00:01:52.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=286f248f-92e7-4e65-8b37-fcb412356436 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:01:52.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=286f248f-92e7-4e65-8b37-fcb412356436 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:01:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9895c352-d954-402d-b8ef-bdba49247c0e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:01:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9895c352-d954-402d-b8ef-bdba49247c0e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3adf1eb2
2021-06-04T00:01:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9895c352-d954-402d-b8ef-bdba49247c0e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:01:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9895c352-d954-402d-b8ef-bdba49247c0e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:01:59.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f548c38d-b838-440d-86fa-5641499a55b0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:01:59.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f548c38d-b838-440d-86fa-5641499a55b0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a3c93d2
2021-06-04T00:01:59.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f548c38d-b838-440d-86fa-5641499a55b0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:01:59.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f548c38d-b838-440d-86fa-5641499a55b0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:02:01.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8669ac63-b4d6-4a31-bb15-673dce7f41be PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:02:01.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8669ac63-b4d6-4a31-bb15-673dce7f41be PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c3cc723
2021-06-04T00:02:01.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8669ac63-b4d6-4a31-bb15-673dce7f41be PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:02:01.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8669ac63-b4d6-4a31-bb15-673dce7f41be PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:02:04.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db06d98d-0829-40b8-83a6-e5acaa1f4902 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:02:04.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db06d98d-0829-40b8-83a6-e5acaa1f4902 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9515ab6
2021-06-04T00:02:04.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db06d98d-0829-40b8-83a6-e5acaa1f4902 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:02:04.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db06d98d-0829-40b8-83a6-e5acaa1f4902 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:02:08.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd90226e-76f1-456f-8576-aa177c5f23df PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:02:08.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd90226e-76f1-456f-8576-aa177c5f23df PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b39efa0
2021-06-04T00:02:08.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd90226e-76f1-456f-8576-aa177c5f23df PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:02:08.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd90226e-76f1-456f-8576-aa177c5f23df PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:02:10.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6dbcfc06-b574-465a-9584-ce5a73c5308f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:02:10.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6dbcfc06-b574-465a-9584-ce5a73c5308f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@25755716
2021-06-04T00:02:10.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6dbcfc06-b574-465a-9584-ce5a73c5308f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:02:10.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6dbcfc06-b574-465a-9584-ce5a73c5308f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:02:13.729Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8948566-dffc-4074-a931-9fe5e34810bd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:02:13.729Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8948566-dffc-4074-a931-9fe5e34810bd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7faa8944
2021-06-04T00:02:13.729Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8948566-dffc-4074-a931-9fe5e34810bd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:02:13.729Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8948566-dffc-4074-a931-9fe5e34810bd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:02:16.876Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9cfdfbaf-5738-460d-94f8-35f1281d53d1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:02:16.876Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9cfdfbaf-5738-460d-94f8-35f1281d53d1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7c2df8ed
2021-06-04T00:02:16.876Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9cfdfbaf-5738-460d-94f8-35f1281d53d1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:02:16.876Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9cfdfbaf-5738-460d-94f8-35f1281d53d1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:02:19.481Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T00:02:19.482Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:02:19.482Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:02:19.482Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:02:19.483Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:02:19.484Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:02:19.484Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:02:19.924Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8803904-d2ba-407d-9741-3846612a2c9b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:02:19.924Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8803904-d2ba-407d-9741-3846612a2c9b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@786d4c27
2021-06-04T00:02:19.924Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8803904-d2ba-407d-9741-3846612a2c9b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:02:19.924Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8803904-d2ba-407d-9741-3846612a2c9b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:02:22.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=323e0bb9-6382-4735-b165-3fc1166db292 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:02:22.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=323e0bb9-6382-4735-b165-3fc1166db292 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@772f79db
2021-06-04T00:02:22.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=323e0bb9-6382-4735-b165-3fc1166db292 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:02:22.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=323e0bb9-6382-4735-b165-3fc1166db292 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:02:25.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86c8afb3-10d0-484e-b7cf-9dd70031fdad PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:02:25.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86c8afb3-10d0-484e-b7cf-9dd70031fdad PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c643ed3
2021-06-04T00:02:25.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86c8afb3-10d0-484e-b7cf-9dd70031fdad PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:02:25.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86c8afb3-10d0-484e-b7cf-9dd70031fdad PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:02:29.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3960d211-5938-42fb-818c-169eb4d88a66 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:02:29.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3960d211-5938-42fb-818c-169eb4d88a66 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f1d5f22
2021-06-04T00:02:29.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3960d211-5938-42fb-818c-169eb4d88a66 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:02:29.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3960d211-5938-42fb-818c-169eb4d88a66 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:02:31.452Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=941394f7-6d09-4b6b-8017-8975ebbf27ee PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:02:31.452Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=941394f7-6d09-4b6b-8017-8975ebbf27ee PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d832e92
2021-06-04T00:02:31.453Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=941394f7-6d09-4b6b-8017-8975ebbf27ee PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:02:31.453Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=941394f7-6d09-4b6b-8017-8975ebbf27ee PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:02:33.816Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T00:02:33.822Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:02:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db0e1a70-d5f4-40ca-878f-40de3140a58a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:02:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db0e1a70-d5f4-40ca-878f-40de3140a58a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@516e7558
2021-06-04T00:02:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db0e1a70-d5f4-40ca-878f-40de3140a58a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:02:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db0e1a70-d5f4-40ca-878f-40de3140a58a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:02:37.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54735eaa-51ce-4d3b-aa88-6ec3ffc282e4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:02:37.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54735eaa-51ce-4d3b-aa88-6ec3ffc282e4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c015b00
2021-06-04T00:02:37.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54735eaa-51ce-4d3b-aa88-6ec3ffc282e4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:02:37.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54735eaa-51ce-4d3b-aa88-6ec3ffc282e4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:02:40.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3c2e38f-1ace-4796-b692-6fc15e5a2756 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:02:40.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3c2e38f-1ace-4796-b692-6fc15e5a2756 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@940f5ed
2021-06-04T00:02:40.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3c2e38f-1ace-4796-b692-6fc15e5a2756 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:02:40.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3c2e38f-1ace-4796-b692-6fc15e5a2756 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:02:43.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49020112-8453-4ba5-a244-53d12ab7e3a4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:02:43.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49020112-8453-4ba5-a244-53d12ab7e3a4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4d73ade9
2021-06-04T00:02:43.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49020112-8453-4ba5-a244-53d12ab7e3a4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:02:43.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49020112-8453-4ba5-a244-53d12ab7e3a4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:02:47.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7963d784-b9f0-4619-8ff9-487b29327576 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:02:47.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7963d784-b9f0-4619-8ff9-487b29327576 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f15d5aa
2021-06-04T00:02:47.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7963d784-b9f0-4619-8ff9-487b29327576 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:02:47.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7963d784-b9f0-4619-8ff9-487b29327576 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:02:50.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27b41b21-e8d5-451c-8385-b2aed03bf388 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:02:50.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27b41b21-e8d5-451c-8385-b2aed03bf388 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49ea4a13
2021-06-04T00:02:50.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27b41b21-e8d5-451c-8385-b2aed03bf388 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:02:50.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27b41b21-e8d5-451c-8385-b2aed03bf388 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:02:52.635Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe5f59e7-1305-428c-8d26-2b8c394be485 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:02:52.635Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe5f59e7-1305-428c-8d26-2b8c394be485 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@478b215e
2021-06-04T00:02:52.635Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe5f59e7-1305-428c-8d26-2b8c394be485 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:02:52.635Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe5f59e7-1305-428c-8d26-2b8c394be485 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:02:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c6a4bf4-d742-4c33-be3f-61c0d00b7b21 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:02:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c6a4bf4-d742-4c33-be3f-61c0d00b7b21 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1747d0a3
2021-06-04T00:02:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c6a4bf4-d742-4c33-be3f-61c0d00b7b21 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:02:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c6a4bf4-d742-4c33-be3f-61c0d00b7b21 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:02:59.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=471334e1-df00-46ee-88c5-67341dbfc2db PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:02:59.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=471334e1-df00-46ee-88c5-67341dbfc2db PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@56beff64
2021-06-04T00:02:59.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=471334e1-df00-46ee-88c5-67341dbfc2db PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:02:59.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=471334e1-df00-46ee-88c5-67341dbfc2db PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:02:59.018Z [BE-Health-Check-Task] INFO o.a.http.impl.execchain.RetryExec RequestID=471334e1-df00-46ee-88c5-67341dbfc2db PartnerName=SDC.BE I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {s}->https://sdc-onboarding-be.onap:8445: The target server failed to respond
2021-06-04T00:02:59.018Z [BE-Health-Check-Task] INFO o.a.http.impl.execchain.RetryExec RequestID=471334e1-df00-46ee-88c5-67341dbfc2db PartnerName=SDC.BE Retrying request to {s}->https://sdc-onboarding-be.onap:8445
2021-06-04T00:02:59.021Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=471334e1-df00-46ee-88c5-67341dbfc2db ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T00:02:59.021Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=471334e1-df00-46ee-88c5-67341dbfc2db ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:03:01.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea048fe2-1b3b-48d7-9713-bf1c9c41b211 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:03:01.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea048fe2-1b3b-48d7-9713-bf1c9c41b211 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5300d44e
2021-06-04T00:03:01.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea048fe2-1b3b-48d7-9713-bf1c9c41b211 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:03:01.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea048fe2-1b3b-48d7-9713-bf1c9c41b211 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:03:01.473Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ea048fe2-1b3b-48d7-9713-bf1c9c41b211 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T00:03:01.473Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ea048fe2-1b3b-48d7-9713-bf1c9c41b211 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:03:04.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93787115-a0e2-43c4-8978-88ad7e45d6e7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:03:04.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93787115-a0e2-43c4-8978-88ad7e45d6e7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b0f51b3
2021-06-04T00:03:04.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93787115-a0e2-43c4-8978-88ad7e45d6e7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:03:04.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93787115-a0e2-43c4-8978-88ad7e45d6e7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:03:04.919Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=93787115-a0e2-43c4-8978-88ad7e45d6e7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T00:03:04.919Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=93787115-a0e2-43c4-8978-88ad7e45d6e7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:03:07.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f486ec0-5b4e-4dd6-9d8d-4b2649f50480 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:03:07.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f486ec0-5b4e-4dd6-9d8d-4b2649f50480 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3fbda81e
2021-06-04T00:03:07.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f486ec0-5b4e-4dd6-9d8d-4b2649f50480 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:03:07.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f486ec0-5b4e-4dd6-9d8d-4b2649f50480 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:03:10.985Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0f486ec0-5b4e-4dd6-9d8d-4b2649f50480 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T00:03:10.985Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0f486ec0-5b4e-4dd6-9d8d-4b2649f50480 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:03:11.388Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a0c2580-ed51-4064-b96d-14108e8dbc50 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:03:11.388Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a0c2580-ed51-4064-b96d-14108e8dbc50 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3af3c250
2021-06-04T00:03:11.388Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a0c2580-ed51-4064-b96d-14108e8dbc50 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:03:11.388Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a0c2580-ed51-4064-b96d-14108e8dbc50 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:03:14.398Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8a0c2580-ed51-4064-b96d-14108e8dbc50 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T00:03:14.398Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8a0c2580-ed51-4064-b96d-14108e8dbc50 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:03:14.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa0cfa06-b814-401c-92e2-4a02115b025f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:03:14.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa0cfa06-b814-401c-92e2-4a02115b025f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57b47c0d
2021-06-04T00:03:14.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa0cfa06-b814-401c-92e2-4a02115b025f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:03:14.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa0cfa06-b814-401c-92e2-4a02115b025f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:03:17.928Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=fa0cfa06-b814-401c-92e2-4a02115b025f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T00:03:17.928Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=fa0cfa06-b814-401c-92e2-4a02115b025f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:03:19.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9aa1a73e-15c8-4a02-8f42-99ac0e8ab2fb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:03:19.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9aa1a73e-15c8-4a02-8f42-99ac0e8ab2fb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6cecc4b6
2021-06-04T00:03:19.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9aa1a73e-15c8-4a02-8f42-99ac0e8ab2fb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:03:19.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9aa1a73e-15c8-4a02-8f42-99ac0e8ab2fb PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:03:22.087Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=9aa1a73e-15c8-4a02-8f42-99ac0e8ab2fb ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T00:03:22.087Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=9aa1a73e-15c8-4a02-8f42-99ac0e8ab2fb ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:03:22.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57dcf295-414c-46b7-935c-d0435ed0ccc4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:03:22.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57dcf295-414c-46b7-935c-d0435ed0ccc4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4343d23f
2021-06-04T00:03:22.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57dcf295-414c-46b7-935c-d0435ed0ccc4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:03:22.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57dcf295-414c-46b7-935c-d0435ed0ccc4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:03:25.224Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=57dcf295-414c-46b7-935c-d0435ed0ccc4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T00:03:25.224Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=57dcf295-414c-46b7-935c-d0435ed0ccc4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:03:25.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1969b3a2-9e1c-4782-8743-4635dba24b46 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:03:25.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1969b3a2-9e1c-4782-8743-4635dba24b46 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a5fd5c1
2021-06-04T00:03:25.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1969b3a2-9e1c-4782-8743-4635dba24b46 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:03:25.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1969b3a2-9e1c-4782-8743-4635dba24b46 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:03:28.783Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=1969b3a2-9e1c-4782-8743-4635dba24b46 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T00:03:28.784Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=1969b3a2-9e1c-4782-8743-4635dba24b46 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:03:29.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6cd0c9bc-ba20-4175-b973-6bc675679158 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:03:29.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6cd0c9bc-ba20-4175-b973-6bc675679158 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3cbea9b7
2021-06-04T00:03:29.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6cd0c9bc-ba20-4175-b973-6bc675679158 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:03:29.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6cd0c9bc-ba20-4175-b973-6bc675679158 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:03:33.073Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=6cd0c9bc-ba20-4175-b973-6bc675679158 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:03:33.073Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=6cd0c9bc-ba20-4175-b973-6bc675679158 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:03:33.635Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72180fd8-eee1-4bd6-be2f-78e76dff2aef PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:03:33.635Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72180fd8-eee1-4bd6-be2f-78e76dff2aef PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2bc4ed3c
2021-06-04T00:03:33.635Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72180fd8-eee1-4bd6-be2f-78e76dff2aef PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:03:33.635Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72180fd8-eee1-4bd6-be2f-78e76dff2aef PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:03:36.706Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=72180fd8-eee1-4bd6-be2f-78e76dff2aef ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:03:36.707Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=72180fd8-eee1-4bd6-be2f-78e76dff2aef ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:03:37.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50e20bdd-018b-446f-88d6-396c39cb0a7d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:03:37.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50e20bdd-018b-446f-88d6-396c39cb0a7d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9483295
2021-06-04T00:03:37.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50e20bdd-018b-446f-88d6-396c39cb0a7d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:03:37.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50e20bdd-018b-446f-88d6-396c39cb0a7d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:03:38.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f049e3f1-3fcc-47a7-aec1-454edf1964c8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:03:38.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f049e3f1-3fcc-47a7-aec1-454edf1964c8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@146fc516
2021-06-04T00:03:38.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f049e3f1-3fcc-47a7-aec1-454edf1964c8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:03:38.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f049e3f1-3fcc-47a7-aec1-454edf1964c8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:03:39.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d835d94-3fd2-4863-9643-c7d7166c833f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:03:39.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d835d94-3fd2-4863-9643-c7d7166c833f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@420a4496
2021-06-04T00:03:39.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d835d94-3fd2-4863-9643-c7d7166c833f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:03:39.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d835d94-3fd2-4863-9643-c7d7166c833f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:03:41.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ded5ee8-a04f-4dd4-b30c-3317d688ea39 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:03:41.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ded5ee8-a04f-4dd4-b30c-3317d688ea39 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a1e1ad8
2021-06-04T00:03:41.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ded5ee8-a04f-4dd4-b30c-3317d688ea39 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:03:41.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ded5ee8-a04f-4dd4-b30c-3317d688ea39 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:03:43.732Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=777146b0-379d-4eb2-b13e-1734dc4ff2de PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:03:43.732Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=777146b0-379d-4eb2-b13e-1734dc4ff2de PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@618a7233
2021-06-04T00:03:43.732Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=777146b0-379d-4eb2-b13e-1734dc4ff2de PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:03:43.732Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=777146b0-379d-4eb2-b13e-1734dc4ff2de PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:03:46.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94faf78c-a021-4fba-bfb2-99b412231311 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:03:46.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94faf78c-a021-4fba-bfb2-99b412231311 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ba74c61
2021-06-04T00:03:46.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94faf78c-a021-4fba-bfb2-99b412231311 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:03:46.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94faf78c-a021-4fba-bfb2-99b412231311 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:03:50.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c22ce47-a559-4c40-be9b-35888fb0b391 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:03:50.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c22ce47-a559-4c40-be9b-35888fb0b391 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b199777
2021-06-04T00:03:50.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c22ce47-a559-4c40-be9b-35888fb0b391 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:03:50.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c22ce47-a559-4c40-be9b-35888fb0b391 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:03:52.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36fe0937-67ac-486e-aa22-861d670ed1f0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:03:52.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36fe0937-67ac-486e-aa22-861d670ed1f0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@612b9616
2021-06-04T00:03:52.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36fe0937-67ac-486e-aa22-861d670ed1f0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:03:52.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36fe0937-67ac-486e-aa22-861d670ed1f0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:03:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cecd983-a01a-4deb-a602-8313abb9076b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:03:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cecd983-a01a-4deb-a602-8313abb9076b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53026bea
2021-06-04T00:03:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cecd983-a01a-4deb-a602-8313abb9076b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:03:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cecd983-a01a-4deb-a602-8313abb9076b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:03:59.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=442d4122-1c59-4c10-bcf5-288e3c3f5120 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:03:59.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=442d4122-1c59-4c10-bcf5-288e3c3f5120 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@62f7e1af
2021-06-04T00:03:59.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=442d4122-1c59-4c10-bcf5-288e3c3f5120 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:03:59.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=442d4122-1c59-4c10-bcf5-288e3c3f5120 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:04:01.480Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69159e83-d7ec-4d49-b228-778f2fc114df PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:04:01.480Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69159e83-d7ec-4d49-b228-778f2fc114df PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@350260a9
2021-06-04T00:04:01.480Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69159e83-d7ec-4d49-b228-778f2fc114df PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:04:01.480Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69159e83-d7ec-4d49-b228-778f2fc114df PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:04:04.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19cfdb5a-3b28-4072-8e4d-8dc3c7e6e588 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:04:04.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19cfdb5a-3b28-4072-8e4d-8dc3c7e6e588 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@8a4db39
2021-06-04T00:04:04.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19cfdb5a-3b28-4072-8e4d-8dc3c7e6e588 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:04:04.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19cfdb5a-3b28-4072-8e4d-8dc3c7e6e588 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:04:08.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=250b9da2-8f1c-430c-a5db-f6d957002c7e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:04:08.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=250b9da2-8f1c-430c-a5db-f6d957002c7e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@48b9bcfc
2021-06-04T00:04:08.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=250b9da2-8f1c-430c-a5db-f6d957002c7e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:04:08.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=250b9da2-8f1c-430c-a5db-f6d957002c7e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:04:11.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ce7303c-1e29-421e-a3ba-f73dd385805c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:04:11.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ce7303c-1e29-421e-a3ba-f73dd385805c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@159ed6dd
2021-06-04T00:04:11.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ce7303c-1e29-421e-a3ba-f73dd385805c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:04:11.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ce7303c-1e29-421e-a3ba-f73dd385805c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:04:13.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b26bff9-63bc-407e-8fae-c301e58cddde PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:04:13.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b26bff9-63bc-407e-8fae-c301e58cddde PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@33bfebef
2021-06-04T00:04:13.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b26bff9-63bc-407e-8fae-c301e58cddde PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:04:13.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b26bff9-63bc-407e-8fae-c301e58cddde PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:04:17.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2eea195b-5898-4539-a149-7f156ba9cef6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:04:17.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2eea195b-5898-4539-a149-7f156ba9cef6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1dec93b2
2021-06-04T00:04:17.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2eea195b-5898-4539-a149-7f156ba9cef6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:04:17.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2eea195b-5898-4539-a149-7f156ba9cef6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:04:19.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f206a1bd-023b-4fcb-9607-3f0e94083a4c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:04:19.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f206a1bd-023b-4fcb-9607-3f0e94083a4c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@183782af
2021-06-04T00:04:19.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f206a1bd-023b-4fcb-9607-3f0e94083a4c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:04:19.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f206a1bd-023b-4fcb-9607-3f0e94083a4c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:04:22.736Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15273230-5d42-4786-9675-7b3592831283 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:04:22.736Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15273230-5d42-4786-9675-7b3592831283 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b7c974a
2021-06-04T00:04:22.736Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15273230-5d42-4786-9675-7b3592831283 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:04:22.736Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15273230-5d42-4786-9675-7b3592831283 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:04:26.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=156779bb-fb74-4191-969f-3dd808d97787 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:04:26.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=156779bb-fb74-4191-969f-3dd808d97787 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@37d0eb59
2021-06-04T00:04:26.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=156779bb-fb74-4191-969f-3dd808d97787 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:04:26.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=156779bb-fb74-4191-969f-3dd808d97787 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:04:28.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd8860d6-4a6d-4473-9828-d2e330f4320b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:04:28.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd8860d6-4a6d-4473-9828-d2e330f4320b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e589f12
2021-06-04T00:04:28.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd8860d6-4a6d-4473-9828-d2e330f4320b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:04:28.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd8860d6-4a6d-4473-9828-d2e330f4320b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:04:30.553Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T00:04:30.553Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:04:30.554Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:04:30.554Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:04:30.554Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:04:30.555Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:04:30.555Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:04:31.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3722b26-e75b-4fa3-8bdb-8d2cfb2b9ce0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:04:31.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3722b26-e75b-4fa3-8bdb-8d2cfb2b9ce0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ade5e8c
2021-06-04T00:04:31.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3722b26-e75b-4fa3-8bdb-8d2cfb2b9ce0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:04:31.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3722b26-e75b-4fa3-8bdb-8d2cfb2b9ce0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:04:34.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16b4e30a-ab1d-404a-806e-9918b8152332 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:04:34.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16b4e30a-ab1d-404a-806e-9918b8152332 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7587525a
2021-06-04T00:04:34.773Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16b4e30a-ab1d-404a-806e-9918b8152332 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:04:34.773Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16b4e30a-ab1d-404a-806e-9918b8152332 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:04:37.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=344c3e7d-de8a-450f-8331-d4977d3a787c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:04:37.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=344c3e7d-de8a-450f-8331-d4977d3a787c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45bde590
2021-06-04T00:04:37.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=344c3e7d-de8a-450f-8331-d4977d3a787c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:04:37.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=344c3e7d-de8a-450f-8331-d4977d3a787c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:04:40.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=effeafdf-b666-49d2-93fc-fd49b5dddd37 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:04:40.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=effeafdf-b666-49d2-93fc-fd49b5dddd37 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f17423a
2021-06-04T00:04:40.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=effeafdf-b666-49d2-93fc-fd49b5dddd37 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:04:40.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=effeafdf-b666-49d2-93fc-fd49b5dddd37 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:04:43.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9025d24c-9b48-4292-ae3b-a0fdce12bbb2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:04:43.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9025d24c-9b48-4292-ae3b-a0fdce12bbb2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57a55f6a
2021-06-04T00:04:43.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9025d24c-9b48-4292-ae3b-a0fdce12bbb2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:04:43.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9025d24c-9b48-4292-ae3b-a0fdce12bbb2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:04:44.888Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T00:04:44.894Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:04:46.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae984f4d-2772-4a9a-bada-52f1d5298471 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:04:46.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae984f4d-2772-4a9a-bada-52f1d5298471 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@187fd246
2021-06-04T00:04:46.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae984f4d-2772-4a9a-bada-52f1d5298471 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:04:46.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae984f4d-2772-4a9a-bada-52f1d5298471 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:04:50.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd7362ad-fa29-4747-b1d7-492c004ebebb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:04:50.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd7362ad-fa29-4747-b1d7-492c004ebebb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@324425bc
2021-06-04T00:04:50.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd7362ad-fa29-4747-b1d7-492c004ebebb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:04:50.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd7362ad-fa29-4747-b1d7-492c004ebebb PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:04:52.535Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=452b29a1-b026-40cd-8223-ca5bba2e7158 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:04:52.535Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=452b29a1-b026-40cd-8223-ca5bba2e7158 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47b7a75c
2021-06-04T00:04:52.535Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=452b29a1-b026-40cd-8223-ca5bba2e7158 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:04:52.535Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=452b29a1-b026-40cd-8223-ca5bba2e7158 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:04:55.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34a24558-e014-413e-b66f-b73ceb577a0c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:04:55.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34a24558-e014-413e-b66f-b73ceb577a0c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a14fecf
2021-06-04T00:04:55.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34a24558-e014-413e-b66f-b73ceb577a0c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:04:55.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34a24558-e014-413e-b66f-b73ceb577a0c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:04:59.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a0f666e-c601-447c-bc77-ab924b22fbac PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:04:59.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a0f666e-c601-447c-bc77-ab924b22fbac PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c1fe629
2021-06-04T00:04:59.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a0f666e-c601-447c-bc77-ab924b22fbac PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:04:59.079Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a0f666e-c601-447c-bc77-ab924b22fbac PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:05:01.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6b31c39-7455-4071-ab29-6dcf73c54daf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:05:01.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6b31c39-7455-4071-ab29-6dcf73c54daf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4fe541d3
2021-06-04T00:05:01.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6b31c39-7455-4071-ab29-6dcf73c54daf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:05:01.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6b31c39-7455-4071-ab29-6dcf73c54daf PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:05:04.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=355b6c39-3c08-47c7-b83f-347f844fc9a1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:05:04.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=355b6c39-3c08-47c7-b83f-347f844fc9a1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35929234
2021-06-04T00:05:04.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=355b6c39-3c08-47c7-b83f-347f844fc9a1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:05:04.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=355b6c39-3c08-47c7-b83f-347f844fc9a1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:05:08.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f628d111-2ef4-4b4a-a69b-505e98b198a1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:05:08.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f628d111-2ef4-4b4a-a69b-505e98b198a1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@286df0cf
2021-06-04T00:05:08.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f628d111-2ef4-4b4a-a69b-505e98b198a1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:05:08.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f628d111-2ef4-4b4a-a69b-505e98b198a1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:05:10.693Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ae6fec0-e747-4d1a-894c-df7cd2dc14a4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:05:10.693Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ae6fec0-e747-4d1a-894c-df7cd2dc14a4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@be07545
2021-06-04T00:05:10.693Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ae6fec0-e747-4d1a-894c-df7cd2dc14a4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:05:10.693Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ae6fec0-e747-4d1a-894c-df7cd2dc14a4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:05:13.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3cda0a27-f7c3-48cf-91d9-3bc0e031749f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:05:13.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3cda0a27-f7c3-48cf-91d9-3bc0e031749f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6eee5633
2021-06-04T00:05:13.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3cda0a27-f7c3-48cf-91d9-3bc0e031749f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:05:13.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3cda0a27-f7c3-48cf-91d9-3bc0e031749f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:05:16.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c4da79e-6a2f-4242-b534-61a0bb67eded PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:05:16.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c4da79e-6a2f-4242-b534-61a0bb67eded PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f4c6ae8
2021-06-04T00:05:16.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c4da79e-6a2f-4242-b534-61a0bb67eded PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:05:16.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c4da79e-6a2f-4242-b534-61a0bb67eded PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:05:19.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1544258-d5dc-4570-ba15-b8b738efc5e4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:05:19.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1544258-d5dc-4570-ba15-b8b738efc5e4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@8e01046
2021-06-04T00:05:19.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1544258-d5dc-4570-ba15-b8b738efc5e4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:05:19.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1544258-d5dc-4570-ba15-b8b738efc5e4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:05:22.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6a8d785-c048-4d8c-9804-d01368dab81d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:05:22.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6a8d785-c048-4d8c-9804-d01368dab81d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@221642
2021-06-04T00:05:22.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6a8d785-c048-4d8c-9804-d01368dab81d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:05:22.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6a8d785-c048-4d8c-9804-d01368dab81d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:05:25.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b50c5a5b-6fd2-4a2c-8c0b-3e00e99382b1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:05:25.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b50c5a5b-6fd2-4a2c-8c0b-3e00e99382b1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c6187bb
2021-06-04T00:05:25.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b50c5a5b-6fd2-4a2c-8c0b-3e00e99382b1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:05:25.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b50c5a5b-6fd2-4a2c-8c0b-3e00e99382b1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:05:28.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f1fc79c-acf5-4d33-b947-874c181962ac PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:05:28.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f1fc79c-acf5-4d33-b947-874c181962ac PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30d6b5f5
2021-06-04T00:05:28.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f1fc79c-acf5-4d33-b947-874c181962ac PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:05:28.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f1fc79c-acf5-4d33-b947-874c181962ac PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:05:31.454Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9bda7819-af35-4eb5-b600-09f9eec0fa03 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:05:31.454Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9bda7819-af35-4eb5-b600-09f9eec0fa03 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@383ce189
2021-06-04T00:05:31.454Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9bda7819-af35-4eb5-b600-09f9eec0fa03 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:05:31.454Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9bda7819-af35-4eb5-b600-09f9eec0fa03 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:05:34.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6076cd20-f417-4611-82ec-0818e8b67d95 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:05:34.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6076cd20-f417-4611-82ec-0818e8b67d95 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28bc70ca
2021-06-04T00:05:34.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6076cd20-f417-4611-82ec-0818e8b67d95 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:05:34.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6076cd20-f417-4611-82ec-0818e8b67d95 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:05:38.080Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5e6b40d-7ca7-49b9-be1f-5af49aa3b726 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:05:38.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5e6b40d-7ca7-49b9-be1f-5af49aa3b726 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38f07639
2021-06-04T00:05:38.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5e6b40d-7ca7-49b9-be1f-5af49aa3b726 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:05:38.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5e6b40d-7ca7-49b9-be1f-5af49aa3b726 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:05:40.688Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1eede9f8-2182-412a-a86e-f5aeb1ecce23 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:05:40.688Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1eede9f8-2182-412a-a86e-f5aeb1ecce23 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29928df8
2021-06-04T00:05:40.688Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1eede9f8-2182-412a-a86e-f5aeb1ecce23 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:05:40.688Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1eede9f8-2182-412a-a86e-f5aeb1ecce23 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:05:43.738Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0cee9a74-c9e4-46fc-a983-466db60175c1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:05:43.738Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0cee9a74-c9e4-46fc-a983-466db60175c1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1268774d
2021-06-04T00:05:43.738Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0cee9a74-c9e4-46fc-a983-466db60175c1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:05:43.738Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0cee9a74-c9e4-46fc-a983-466db60175c1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:05:46.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f6593ae-1127-4d98-9e06-079aa5b99ff4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:05:46.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f6593ae-1127-4d98-9e06-079aa5b99ff4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f172aa2
2021-06-04T00:05:46.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f6593ae-1127-4d98-9e06-079aa5b99ff4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:05:46.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f6593ae-1127-4d98-9e06-079aa5b99ff4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:05:49.969Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1eedf0dc-edc3-4239-995b-01f0e9ed5fa5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:05:49.969Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1eedf0dc-edc3-4239-995b-01f0e9ed5fa5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@31d07165
2021-06-04T00:05:49.969Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1eedf0dc-edc3-4239-995b-01f0e9ed5fa5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:05:49.969Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1eedf0dc-edc3-4239-995b-01f0e9ed5fa5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:05:52.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c3300c7-03ce-47a3-82bd-d069ac110e90 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:05:52.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c3300c7-03ce-47a3-82bd-d069ac110e90 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@c90c7ea
2021-06-04T00:05:52.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c3300c7-03ce-47a3-82bd-d069ac110e90 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:05:52.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c3300c7-03ce-47a3-82bd-d069ac110e90 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:05:55.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49e08178-37a9-4fd4-b96a-1a197d02483b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:05:55.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49e08178-37a9-4fd4-b96a-1a197d02483b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d931b2a
2021-06-04T00:05:55.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49e08178-37a9-4fd4-b96a-1a197d02483b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:05:55.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49e08178-37a9-4fd4-b96a-1a197d02483b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:05:58.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac7ad5c9-1b93-4794-ab8f-f37e1d72f472 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:05:58.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac7ad5c9-1b93-4794-ab8f-f37e1d72f472 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ba76800
2021-06-04T00:05:58.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac7ad5c9-1b93-4794-ab8f-f37e1d72f472 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:05:58.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac7ad5c9-1b93-4794-ab8f-f37e1d72f472 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:06:01.466Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=052215d4-f25c-4dfa-a861-dd70bb7d567c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:06:01.466Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=052215d4-f25c-4dfa-a861-dd70bb7d567c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@194e6f48
2021-06-04T00:06:01.466Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=052215d4-f25c-4dfa-a861-dd70bb7d567c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:06:01.466Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=052215d4-f25c-4dfa-a861-dd70bb7d567c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:06:04.824Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fb2d56e-f69b-44ae-8e62-56577c32fdc2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:06:04.824Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fb2d56e-f69b-44ae-8e62-56577c32fdc2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@13eb441c
2021-06-04T00:06:04.824Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fb2d56e-f69b-44ae-8e62-56577c32fdc2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:06:04.824Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fb2d56e-f69b-44ae-8e62-56577c32fdc2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:06:07.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=276d352d-74c9-4ac2-b147-55bb14576cb1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:06:07.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=276d352d-74c9-4ac2-b147-55bb14576cb1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@56645700
2021-06-04T00:06:07.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=276d352d-74c9-4ac2-b147-55bb14576cb1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:06:07.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=276d352d-74c9-4ac2-b147-55bb14576cb1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:06:10.773Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8d73ece-4aba-4375-b45a-8d559ba1cfc9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:06:10.773Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8d73ece-4aba-4375-b45a-8d559ba1cfc9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4693d2a4
2021-06-04T00:06:10.773Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8d73ece-4aba-4375-b45a-8d559ba1cfc9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:06:10.773Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8d73ece-4aba-4375-b45a-8d559ba1cfc9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:06:13.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=739a8ae3-4d68-4121-9738-ef8e95d16a6f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:06:13.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=739a8ae3-4d68-4121-9738-ef8e95d16a6f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c4dc111
2021-06-04T00:06:13.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=739a8ae3-4d68-4121-9738-ef8e95d16a6f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:06:13.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=739a8ae3-4d68-4121-9738-ef8e95d16a6f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:06:16.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ddf1a04-34cd-48db-a8a2-4a64253ca1cb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:06:16.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ddf1a04-34cd-48db-a8a2-4a64253ca1cb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@654fbb20
2021-06-04T00:06:16.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ddf1a04-34cd-48db-a8a2-4a64253ca1cb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:06:16.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ddf1a04-34cd-48db-a8a2-4a64253ca1cb PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:06:19.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3edee12b-ec6c-4611-922e-d8cd5ce868a7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:06:19.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3edee12b-ec6c-4611-922e-d8cd5ce868a7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@11e73cde
2021-06-04T00:06:19.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3edee12b-ec6c-4611-922e-d8cd5ce868a7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:06:19.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3edee12b-ec6c-4611-922e-d8cd5ce868a7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:06:22.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0c3b5a8-7a8d-4fa8-8afc-ebcb413c607c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:06:22.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0c3b5a8-7a8d-4fa8-8afc-ebcb413c607c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4939cab4
2021-06-04T00:06:22.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0c3b5a8-7a8d-4fa8-8afc-ebcb413c607c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:06:22.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0c3b5a8-7a8d-4fa8-8afc-ebcb413c607c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:06:25.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7eb4ad9f-9cd6-4c14-b3e1-a0e31f5804b7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:06:25.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7eb4ad9f-9cd6-4c14-b3e1-a0e31f5804b7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@bbedfcb
2021-06-04T00:06:25.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7eb4ad9f-9cd6-4c14-b3e1-a0e31f5804b7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:06:25.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7eb4ad9f-9cd6-4c14-b3e1-a0e31f5804b7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:06:29.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2e6393f-0ff1-4809-99f4-ece37f16b675 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:06:29.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2e6393f-0ff1-4809-99f4-ece37f16b675 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1330f327
2021-06-04T00:06:29.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2e6393f-0ff1-4809-99f4-ece37f16b675 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:06:29.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2e6393f-0ff1-4809-99f4-ece37f16b675 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:06:31.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=138f407c-b37d-418e-82ac-7123de3ab0e1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:06:31.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=138f407c-b37d-418e-82ac-7123de3ab0e1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3b193c53
2021-06-04T00:06:31.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=138f407c-b37d-418e-82ac-7123de3ab0e1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:06:31.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=138f407c-b37d-418e-82ac-7123de3ab0e1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:06:34.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=202691c7-9800-4220-8bfc-5311350dde3c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:06:34.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=202691c7-9800-4220-8bfc-5311350dde3c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c723dee
2021-06-04T00:06:34.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=202691c7-9800-4220-8bfc-5311350dde3c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:06:34.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=202691c7-9800-4220-8bfc-5311350dde3c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:06:37.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=287902e5-a164-4351-b7c4-64b05412b5bb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:06:37.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=287902e5-a164-4351-b7c4-64b05412b5bb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41cffd2c
2021-06-04T00:06:37.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=287902e5-a164-4351-b7c4-64b05412b5bb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:06:37.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=287902e5-a164-4351-b7c4-64b05412b5bb PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:06:40.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9d205da-5093-472b-9f0a-655d1cdd063b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:06:40.776Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9d205da-5093-472b-9f0a-655d1cdd063b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@55f287f9
2021-06-04T00:06:40.776Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9d205da-5093-472b-9f0a-655d1cdd063b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:06:40.776Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9d205da-5093-472b-9f0a-655d1cdd063b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:06:41.625Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T00:06:41.625Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:06:41.626Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:06:41.626Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:06:41.626Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:06:41.627Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:06:41.627Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:06:43.733Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1c4ee14-322a-447d-9f71-0aea801f1e7f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:06:43.733Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1c4ee14-322a-447d-9f71-0aea801f1e7f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27fbd2b0
2021-06-04T00:06:43.733Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1c4ee14-322a-447d-9f71-0aea801f1e7f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:06:43.733Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1c4ee14-322a-447d-9f71-0aea801f1e7f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:06:46.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fabe3494-08a6-42a6-98c9-0914ee0eac71 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:06:46.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fabe3494-08a6-42a6-98c9-0914ee0eac71 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@acb16ec
2021-06-04T00:06:46.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fabe3494-08a6-42a6-98c9-0914ee0eac71 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:06:46.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fabe3494-08a6-42a6-98c9-0914ee0eac71 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:06:49.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66aa2259-3ba8-49df-8637-a46f6a181400 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:06:49.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66aa2259-3ba8-49df-8637-a46f6a181400 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3453ac04
2021-06-04T00:06:49.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66aa2259-3ba8-49df-8637-a46f6a181400 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:06:49.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66aa2259-3ba8-49df-8637-a46f6a181400 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:06:52.492Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3af15d17-6f13-4b84-b0f4-07824c71dba3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:06:52.492Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3af15d17-6f13-4b84-b0f4-07824c71dba3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@755f3838
2021-06-04T00:06:52.492Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3af15d17-6f13-4b84-b0f4-07824c71dba3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:06:52.492Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3af15d17-6f13-4b84-b0f4-07824c71dba3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:06:55.960Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T00:06:55.965Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:06:56.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43a09696-5137-4b9d-9a29-4b16b0ba7285 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:06:56.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43a09696-5137-4b9d-9a29-4b16b0ba7285 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@c480a71
2021-06-04T00:06:56.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43a09696-5137-4b9d-9a29-4b16b0ba7285 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:06:56.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43a09696-5137-4b9d-9a29-4b16b0ba7285 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:06:58.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=827289ab-81a2-47f0-b7a8-1b85677766e1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:06:58.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=827289ab-81a2-47f0-b7a8-1b85677766e1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e660162
2021-06-04T00:06:58.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=827289ab-81a2-47f0-b7a8-1b85677766e1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:06:58.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=827289ab-81a2-47f0-b7a8-1b85677766e1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:07:01.493Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6243ddff-5ee6-40f4-96d4-4a4a120f5726 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:07:01.493Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6243ddff-5ee6-40f4-96d4-4a4a120f5726 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@777cb526
2021-06-04T00:07:01.493Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6243ddff-5ee6-40f4-96d4-4a4a120f5726 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:07:01.493Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6243ddff-5ee6-40f4-96d4-4a4a120f5726 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:07:04.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cefa07a1-affc-48f4-94a6-cc68c980e8b8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:07:04.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cefa07a1-affc-48f4-94a6-cc68c980e8b8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b6edd09
2021-06-04T00:07:04.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cefa07a1-affc-48f4-94a6-cc68c980e8b8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:07:04.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cefa07a1-affc-48f4-94a6-cc68c980e8b8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:07:08.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f85175cd-c27d-4504-bacc-24a0596c3056 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:07:08.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f85175cd-c27d-4504-bacc-24a0596c3056 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@37395b97
2021-06-04T00:07:08.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f85175cd-c27d-4504-bacc-24a0596c3056 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:07:08.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f85175cd-c27d-4504-bacc-24a0596c3056 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:07:10.779Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23ea7e9a-f821-4fb6-9432-d2cfdcda3464 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:07:10.779Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23ea7e9a-f821-4fb6-9432-d2cfdcda3464 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@593a3103
2021-06-04T00:07:10.779Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23ea7e9a-f821-4fb6-9432-d2cfdcda3464 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:07:10.779Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23ea7e9a-f821-4fb6-9432-d2cfdcda3464 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:07:13.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d1668bb-aaf2-4f31-9f10-45cab1921bc1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:07:13.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d1668bb-aaf2-4f31-9f10-45cab1921bc1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b7d7a87
2021-06-04T00:07:13.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d1668bb-aaf2-4f31-9f10-45cab1921bc1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:07:13.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d1668bb-aaf2-4f31-9f10-45cab1921bc1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:07:16.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9bf317d1-c38f-42c5-8b39-1307f45c75af PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:07:16.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9bf317d1-c38f-42c5-8b39-1307f45c75af PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@46766074
2021-06-04T00:07:16.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9bf317d1-c38f-42c5-8b39-1307f45c75af PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:07:16.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9bf317d1-c38f-42c5-8b39-1307f45c75af PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:07:20.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a85705a4-c4c4-499d-913e-7a008302bcb8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:07:20.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a85705a4-c4c4-499d-913e-7a008302bcb8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3bee7ece
2021-06-04T00:07:20.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a85705a4-c4c4-499d-913e-7a008302bcb8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:07:20.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a85705a4-c4c4-499d-913e-7a008302bcb8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:07:22.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f93d5560-b279-45c5-93d0-85f9cc92ee4f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:07:22.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f93d5560-b279-45c5-93d0-85f9cc92ee4f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3354f299
2021-06-04T00:07:22.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f93d5560-b279-45c5-93d0-85f9cc92ee4f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:07:22.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f93d5560-b279-45c5-93d0-85f9cc92ee4f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:07:25.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89c474fa-f844-4d77-9e68-a3873d14696c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:07:25.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89c474fa-f844-4d77-9e68-a3873d14696c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@135d0f36
2021-06-04T00:07:25.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89c474fa-f844-4d77-9e68-a3873d14696c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:07:25.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89c474fa-f844-4d77-9e68-a3873d14696c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:07:29.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=298af656-123c-4e2a-a5e7-846f82589eb7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:07:29.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=298af656-123c-4e2a-a5e7-846f82589eb7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@665db8e9
2021-06-04T00:07:29.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=298af656-123c-4e2a-a5e7-846f82589eb7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:07:29.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=298af656-123c-4e2a-a5e7-846f82589eb7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:07:31.696Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4be4fa90-458e-47f6-813d-dded84b43d7f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:07:31.696Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4be4fa90-458e-47f6-813d-dded84b43d7f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e8da2e2
2021-06-04T00:07:31.696Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4be4fa90-458e-47f6-813d-dded84b43d7f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:07:31.696Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4be4fa90-458e-47f6-813d-dded84b43d7f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:07:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0ecd657-7c67-401d-817d-57e67c8b098c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:07:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0ecd657-7c67-401d-817d-57e67c8b098c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a594d90
2021-06-04T00:07:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0ecd657-7c67-401d-817d-57e67c8b098c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:07:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0ecd657-7c67-401d-817d-57e67c8b098c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:07:37.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04176d92-3b18-45b3-81f4-74d97e7046a3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:07:37.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04176d92-3b18-45b3-81f4-74d97e7046a3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4186c152
2021-06-04T00:07:37.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04176d92-3b18-45b3-81f4-74d97e7046a3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:07:37.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04176d92-3b18-45b3-81f4-74d97e7046a3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:07:40.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96e707c1-04cf-4fea-88e3-c74da164f671 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:07:40.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96e707c1-04cf-4fea-88e3-c74da164f671 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a97a37b
2021-06-04T00:07:40.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96e707c1-04cf-4fea-88e3-c74da164f671 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:07:40.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96e707c1-04cf-4fea-88e3-c74da164f671 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:07:43.734Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d58a7d5-4026-4653-a44a-4286cd6d2180 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:07:43.734Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d58a7d5-4026-4653-a44a-4286cd6d2180 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9ce9279
2021-06-04T00:07:43.734Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d58a7d5-4026-4653-a44a-4286cd6d2180 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:07:43.734Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d58a7d5-4026-4653-a44a-4286cd6d2180 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:07:46.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5be847a8-2c71-4d57-8aa9-1b0cfdc78c2d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:07:46.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5be847a8-2c71-4d57-8aa9-1b0cfdc78c2d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@798b6b1d
2021-06-04T00:07:46.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5be847a8-2c71-4d57-8aa9-1b0cfdc78c2d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:07:46.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5be847a8-2c71-4d57-8aa9-1b0cfdc78c2d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:07:49.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0248aab-0e3e-418d-bed8-32702236e123 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:07:49.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0248aab-0e3e-418d-bed8-32702236e123 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e70b92f
2021-06-04T00:07:49.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0248aab-0e3e-418d-bed8-32702236e123 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:07:49.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0248aab-0e3e-418d-bed8-32702236e123 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:07:52.625Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b917d640-a83d-4860-8979-3d84e52a3c8e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:07:52.625Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b917d640-a83d-4860-8979-3d84e52a3c8e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@798b4fe1
2021-06-04T00:07:52.625Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b917d640-a83d-4860-8979-3d84e52a3c8e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:07:52.625Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b917d640-a83d-4860-8979-3d84e52a3c8e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:07:55.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e5b7223-2110-4071-ba36-e23275701074 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:07:55.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e5b7223-2110-4071-ba36-e23275701074 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ab47f3
2021-06-04T00:07:55.879Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e5b7223-2110-4071-ba36-e23275701074 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:07:55.879Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e5b7223-2110-4071-ba36-e23275701074 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:07:59.075Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1624be2-5a43-46e6-829b-aa2e64f70e0d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:07:59.075Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1624be2-5a43-46e6-829b-aa2e64f70e0d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@265a17f8
2021-06-04T00:07:59.075Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1624be2-5a43-46e6-829b-aa2e64f70e0d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:07:59.075Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1624be2-5a43-46e6-829b-aa2e64f70e0d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:08:01.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af7d9883-2fce-4901-8b05-5eba13ce5f6c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:08:01.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af7d9883-2fce-4901-8b05-5eba13ce5f6c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d686bdd
2021-06-04T00:08:01.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af7d9883-2fce-4901-8b05-5eba13ce5f6c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:08:01.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af7d9883-2fce-4901-8b05-5eba13ce5f6c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:08:04.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3410e09-c6bb-482e-be94-61f0b0a63e98 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:08:04.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3410e09-c6bb-482e-be94-61f0b0a63e98 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ebfcdd6
2021-06-04T00:08:04.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3410e09-c6bb-482e-be94-61f0b0a63e98 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:08:04.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3410e09-c6bb-482e-be94-61f0b0a63e98 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:08:07.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68c527b7-50b6-4d90-a99d-5bba75fd448c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:08:07.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68c527b7-50b6-4d90-a99d-5bba75fd448c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5075972d
2021-06-04T00:08:07.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68c527b7-50b6-4d90-a99d-5bba75fd448c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:08:07.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68c527b7-50b6-4d90-a99d-5bba75fd448c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:08:10.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65514c32-743c-40ff-89e8-88d647d86817 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:08:10.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65514c32-743c-40ff-89e8-88d647d86817 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2666bf0c
2021-06-04T00:08:10.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65514c32-743c-40ff-89e8-88d647d86817 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:08:10.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65514c32-743c-40ff-89e8-88d647d86817 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:08:13.742Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=110f6fa2-55eb-4084-8640-f316a71ad8b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:08:13.742Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=110f6fa2-55eb-4084-8640-f316a71ad8b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@48be0e9e
2021-06-04T00:08:13.742Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=110f6fa2-55eb-4084-8640-f316a71ad8b9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:08:13.742Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=110f6fa2-55eb-4084-8640-f316a71ad8b9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:08:16.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63c6103f-a781-4119-9958-714892b0fe41 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:08:16.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63c6103f-a781-4119-9958-714892b0fe41 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@381fbb22
2021-06-04T00:08:16.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63c6103f-a781-4119-9958-714892b0fe41 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:08:16.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63c6103f-a781-4119-9958-714892b0fe41 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:08:20.385Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=113cb4a8-1c26-424b-a4f0-9554507048dd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:08:20.385Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=113cb4a8-1c26-424b-a4f0-9554507048dd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@44af9ff3
2021-06-04T00:08:20.385Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=113cb4a8-1c26-424b-a4f0-9554507048dd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:08:20.385Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=113cb4a8-1c26-424b-a4f0-9554507048dd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:08:20.664Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node06scvbct7xqb550lcwc51an0y417
2021-06-04T00:08:20.664Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node018artekcu4ue21nm4b0owt71j0397
2021-06-04T00:08:20.664Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0wlyvcp3grocqzj6jqt5jvx4y503
2021-06-04T00:08:20.664Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0ykv81hahawfs1p4spnwtr1brs479
2021-06-04T00:08:20.664Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0165vcdlebojkf10uvktf3je2fo481
2021-06-04T00:08:20.665Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01qjnlsggkmw15153v3biiagwd4458
2021-06-04T00:08:20.665Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0wk91k8pmt4o11fe7sfsqwmaqw486
2021-06-04T00:08:20.665Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node014o9xbqmsd9z48b8rq38wge5i516
2021-06-04T00:08:20.665Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0ervw8fnt7ny11n8r3hq14k09z447
2021-06-04T00:08:20.665Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01wk62n9ge6m6zijkba43fyf9q487
2021-06-04T00:08:20.665Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0dx1aghgq5fwswwvo79wef636512
2021-06-04T00:08:20.665Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0f43gdxdz10dw1jnx5xqyrhq3t429
2021-06-04T00:08:20.665Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node05asb8ztag9t2q9d70rxi6avd439
2021-06-04T00:08:20.665Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01iwdhrur8ze86wb5i72i0aptf505
2021-06-04T00:08:20.665Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01gk3no04t3yyr1snzbejv745gp506
2021-06-04T00:08:20.665Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01byfd3cttjsbdw8i1stzyoeq477
2021-06-04T00:08:20.665Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node032qe0evsh9dy676y6y66rvqj422
2021-06-04T00:08:20.665Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0k8p6kq2h280iv9vqazog74xq438
2021-06-04T00:08:20.665Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01vutl6dgjsuku1327qm7r12enr423
2021-06-04T00:08:20.665Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0ynz736hdxi05zsaf4ad6j8jz451
2021-06-04T00:08:20.665Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0nx7tlibwfuox15tel04uwlfan510
2021-06-04T00:08:20.665Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node017h8m8j4ubqm8oaq5dyqdty4f473
2021-06-04T00:08:20.665Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0bxljkjjfbggq1vwgm7lt0loho448
2021-06-04T00:08:20.665Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0fk7ycqqa8b3bjprhsbfcb4cq406
2021-06-04T00:08:20.665Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0t9858s0nt7wbynkqvu29b1l0410
2021-06-04T00:08:20.665Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node07f89myhq0ukw17vj9kwt98tq8459
2021-06-04T00:08:20.665Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01grx7vfznhr91cridfsivdqvg517
2021-06-04T00:08:20.665Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node014az6o614zhfbaztcnyia5tuh454
2021-06-04T00:08:20.666Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node05v6sweas0hfg1lj9v795z793y452
2021-06-04T00:08:20.666Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0yvb5fts7dndf1ubqde5aoqnyn424
2021-06-04T00:08:20.666Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0pt5mblahi8hxhx9ngko1x4oc513
2021-06-04T00:08:20.666Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01sk0c4xq4hw9r15drq5eud55mj463
2021-06-04T00:08:20.666Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0epjgotq8kflt1s8isz98cc2tc430
2021-06-04T00:08:20.666Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node08k4k7yv6cc4dj3p4pn3k5nku437
2021-06-04T00:08:20.666Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0tsq4yrfkz5gd1wv8o655gyf0k518
2021-06-04T00:08:20.666Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01nd35qkb2lckn1t2caasnifklr446
2021-06-04T00:08:20.666Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0vi3hb4vx9fsf86m2kcwjo4vq449
2021-06-04T00:08:20.666Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node05za7opz86w811ixvg374znd4k455
2021-06-04T00:08:20.666Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node018e9gwfi92qrc19wo1px83o7pd499
2021-06-04T00:08:20.666Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0q2a52l38m6hq1pj3el91sfrdf419
2021-06-04T00:08:20.666Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01xzidxfcatg47b4ji2rkyce2482
2021-06-04T00:08:20.666Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node012j2scnmwqviv4joynppp617a408
2021-06-04T00:08:20.666Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node012szq8grc6o7y1rsvo9awx1xwb493
2021-06-04T00:08:20.666Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01tu8cpgbgbvqge19nznv694j4426
2021-06-04T00:08:20.666Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01am0uajltnndi1gjyd4omi4avl407
2021-06-04T00:08:20.666Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node02wb0ymwnxc3acr5yedqc5n9p453
2021-06-04T00:08:20.666Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01t9e9i580yh35hjg07zfc9l9z522
2021-06-04T00:08:20.666Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0empr25k9wc2rzoekfsdhwh4j514
2021-06-04T00:08:20.666Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01f5bmck5xvzdz1i7vmia56o3ye475
2021-06-04T00:08:20.666Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0kj12vokqjm5h85jb1or9ddqb436
2021-06-04T00:08:20.666Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0zgyio10g4dl71v9p7izx5ir5j511
2021-06-04T00:08:20.666Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node011lly79s79ld28u04ct28uiox432
2021-06-04T00:08:20.666Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01aa7dfag9o1yu58onlgmn0edq428
2021-06-04T00:08:20.666Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0145zwtip1qu89oy029iyx1nxq412
2021-06-04T00:08:20.667Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node013ew8q58ltld4gysq6cxagzyp474
2021-06-04T00:08:20.667Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0q80z4kbqj817xareosmdy990467
2021-06-04T00:08:20.667Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01gmgebsvr0ghb5wzoouxywc64501
2021-06-04T00:08:20.667Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01el307kpuudnf9ge9h3091nev418
2021-06-04T00:08:20.667Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0111wgamj6tfwc1o0eeve4519qq435
2021-06-04T00:08:20.667Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01nxar45cmfv5pmhy1i8jf6qox462
2021-06-04T00:08:20.667Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node034djb5r5vjso1usi3gbugoevz464
2021-06-04T00:08:20.667Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0194ah6u4dxcrw15dt4nxlyrmjf509
2021-06-04T00:08:20.667Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0b2csm71088y313ltsyuargz4g411
2021-06-04T00:08:20.667Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node06hgm2kswqq7i4nckmn3ryba1492
2021-06-04T00:08:20.667Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0d3xfx5sr1dq91k5k8i84u7xwx478
2021-06-04T00:08:20.667Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node013hs5h346ohbi1vtltqtwr2y22457
2021-06-04T00:08:20.667Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node017ehew56f9bj1hs737xldm4jd483
2021-06-04T00:08:20.667Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01042b969b9anqm05si2w3dg9x494
2021-06-04T00:08:20.667Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01gshlr3e5en0tjaw6wngwjkpl469
2021-06-04T00:08:20.667Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01hksfvhmbfe0u1nq15n1lq6jg7440
2021-06-04T00:08:20.667Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0lul46p6xy47mdoy3pq1rgq3y498
2021-06-04T00:08:20.667Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0im5wjkr3317vmvdyglhngnd416
2021-06-04T00:08:20.667Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01o7ddxdn8s69ipxvs82pmlmhx413
2021-06-04T00:08:20.667Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01nv72ml1pdmbgkdrr53pmdoou445
2021-06-04T00:08:20.667Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01uw1rsqhy0xyh10u1kx4geejbi489
2021-06-04T00:08:20.667Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0605eh3f0ayi6xo747efdwyyi460
2021-06-04T00:08:20.667Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0q4lo1n44gn8oun35owvnq2hi427
2021-06-04T00:08:20.667Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01alo30xhbwnzf1ochuuzr52lkc456
2021-06-04T00:08:20.668Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01clnulrn0di4l1et7jufajxv0o415
2021-06-04T00:08:20.668Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0e211mgmfmjdk3pemy6runhyf472
2021-06-04T00:08:20.668Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01hmvwxnpx8cf51quqza5wikasf500
2021-06-04T00:08:20.668Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0yiz0sladkx57ed0bbqn38ldq491
2021-06-04T00:08:20.668Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01i873a39nilpd1xv4dmpynfmd2515
2021-06-04T00:08:20.668Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node015wprhgytkh1i17wfz3onndyj5502
2021-06-04T00:08:20.668Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0afvws8nhdzzrk2l0q4atfh81441
2021-06-04T00:08:20.668Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01kb2ou57fvcl8a9fma8wdln2o480
2021-06-04T00:08:20.668Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0yebuglm87ku938og9nm808r6444
2021-06-04T00:08:20.668Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0frzsz83h5t2z1ay2bk2gg98d8425
2021-06-04T00:08:20.668Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01pn1islkrx5evdb6aemc1ngoj476
2021-06-04T00:08:20.668Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0iuehpkwzjrk7inioy0i99mt421
2021-06-04T00:08:20.668Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0sti2elk3pgcb1kajszs44dydm488
2021-06-04T00:08:20.668Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01agq2evf78jib2bemqvh4d4fu497
2021-06-04T00:08:20.668Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0iomvl1rvwc721we2bboybc2r3504
2021-06-04T00:08:20.668Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0mtfd9gvko9j1143ar67plgs97414
2021-06-04T00:08:20.668Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0pzmf7b1hbcscqj3gpurcyg5g496
2021-06-04T00:08:20.668Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01u3wni0wvg13kcj364hnqulmt443
2021-06-04T00:08:20.668Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01666gukg42jhnetvn9t0zjw59420
2021-06-04T00:08:20.668Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0k34hpkg75lsbgbmv6ztb5s0d450
2021-06-04T00:08:20.668Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01xjrwgltun2m9npevil63rg5f507
2021-06-04T00:08:20.668Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01t4705m03jvtf1kqxhpsykvsmx465
2021-06-04T00:08:20.669Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0o3tyvgd531rf16p12oz7zbn8f461
2021-06-04T00:08:20.669Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01qu4tzum72bue10lc78qi0w3ti442
2021-06-04T00:08:20.669Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01dbq925mjsryogxka3t7xzmyy409
2021-06-04T00:08:20.669Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0v6oo5u80r66v1xm927p69zsgf470
2021-06-04T00:08:20.669Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0twzkcs6lcr2mon9qpz5n4mra468
2021-06-04T00:08:20.669Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0138hmxck3bahh4wf8zvd0bt86519
2021-06-04T00:08:20.669Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node013zxjlzyc48k3chvobo55wkm4431
2021-06-04T00:08:20.669Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node04z4qa7qw3lzrvx5a2phh6u13405
2021-06-04T00:08:20.669Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0krgr1vu90iw51nbarwsu1aeo8466
2021-06-04T00:08:20.669Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0jxq4vxi1mtbt124iews6f7930484
2021-06-04T00:08:20.669Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0j6nnmew5rrw0ciqyrdkgda0r508
2021-06-04T00:08:20.669Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0wdb7ajirkxhg1wn93vbmcfysw433
2021-06-04T00:08:20.669Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0u47qoj4ehjihvudzmtd5wfvw490
2021-06-04T00:08:20.669Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0lfyrctrm3xvvg9cwn5pe92ra471
2021-06-04T00:08:20.669Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node018wf82elz3cfx14o2vq5ajnt495
2021-06-04T00:08:20.669Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01p3vjj3s0nb5u1oxhmunvn1sje485
2021-06-04T00:08:20.669Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node019uo09ky9npnwccdb8h0v2xg4434
2021-06-04T00:08:20.669Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01qwozy9wu0usahm49c0qa741t521
2021-06-04T00:08:22.492Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=984d4172-798c-405f-a5c7-3751b1c5cb8b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:08:22.492Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=984d4172-798c-405f-a5c7-3751b1c5cb8b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5722c6b5
2021-06-04T00:08:22.492Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=984d4172-798c-405f-a5c7-3751b1c5cb8b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:08:22.492Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=984d4172-798c-405f-a5c7-3751b1c5cb8b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:08:26.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0e9e28f-49d7-40ee-ae73-351f373df791 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:08:26.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0e9e28f-49d7-40ee-ae73-351f373df791 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6fd0e831
2021-06-04T00:08:26.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0e9e28f-49d7-40ee-ae73-351f373df791 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:08:26.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0e9e28f-49d7-40ee-ae73-351f373df791 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:08:29.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a0b1649-7d47-40d1-8cbc-05b63a67178a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:08:29.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a0b1649-7d47-40d1-8cbc-05b63a67178a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a539842
2021-06-04T00:08:29.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a0b1649-7d47-40d1-8cbc-05b63a67178a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:08:29.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a0b1649-7d47-40d1-8cbc-05b63a67178a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:08:31.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f73acaf7-e192-459e-9ba3-4f61a3e6725d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:08:31.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f73acaf7-e192-459e-9ba3-4f61a3e6725d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@12bbdafc
2021-06-04T00:08:31.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f73acaf7-e192-459e-9ba3-4f61a3e6725d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:08:31.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f73acaf7-e192-459e-9ba3-4f61a3e6725d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:08:34.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3be27f0a-7d01-41ae-ac58-4b13648e3676 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:08:34.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3be27f0a-7d01-41ae-ac58-4b13648e3676 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@536da170
2021-06-04T00:08:34.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3be27f0a-7d01-41ae-ac58-4b13648e3676 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:08:34.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3be27f0a-7d01-41ae-ac58-4b13648e3676 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:08:37.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a584626f-26cf-4a37-b6ca-149033a93c8b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:08:37.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a584626f-26cf-4a37-b6ca-149033a93c8b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3b944a4c
2021-06-04T00:08:37.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a584626f-26cf-4a37-b6ca-149033a93c8b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:08:37.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a584626f-26cf-4a37-b6ca-149033a93c8b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:08:40.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5d43cef-753e-4413-b606-75473dcdc780 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:08:40.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5d43cef-753e-4413-b606-75473dcdc780 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d3344f4
2021-06-04T00:08:40.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5d43cef-753e-4413-b606-75473dcdc780 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:08:40.779Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5d43cef-753e-4413-b606-75473dcdc780 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:08:43.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d58e3a20-8891-4567-8b22-98689077076f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:08:43.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d58e3a20-8891-4567-8b22-98689077076f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41930394
2021-06-04T00:08:43.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d58e3a20-8891-4567-8b22-98689077076f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:08:43.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d58e3a20-8891-4567-8b22-98689077076f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:08:46.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8439b05b-0992-4857-93bd-e447880189ba PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:08:46.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8439b05b-0992-4857-93bd-e447880189ba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f4b4cf7
2021-06-04T00:08:46.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8439b05b-0992-4857-93bd-e447880189ba PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:08:46.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8439b05b-0992-4857-93bd-e447880189ba PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:08:49.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b20ad4fa-644a-4f75-9ab4-9bdf7477d68b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:08:49.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b20ad4fa-644a-4f75-9ab4-9bdf7477d68b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6694bf78
2021-06-04T00:08:49.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b20ad4fa-644a-4f75-9ab4-9bdf7477d68b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:08:49.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b20ad4fa-644a-4f75-9ab4-9bdf7477d68b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:08:52.696Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T00:08:52.697Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:08:52.698Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:08:52.698Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:08:52.698Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:08:52.698Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:08:52.698Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:08:52.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d3d0470-1e44-438c-9997-5d575da41acd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:08:52.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d3d0470-1e44-438c-9997-5d575da41acd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@719753ba
2021-06-04T00:08:52.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d3d0470-1e44-438c-9997-5d575da41acd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:08:52.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d3d0470-1e44-438c-9997-5d575da41acd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:08:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7ab50c1-2363-43bc-b411-ccf112a1d139 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:08:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7ab50c1-2363-43bc-b411-ccf112a1d139 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28c161bf
2021-06-04T00:08:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7ab50c1-2363-43bc-b411-ccf112a1d139 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:08:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7ab50c1-2363-43bc-b411-ccf112a1d139 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:08:58.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3748d78a-35c8-42c5-8b9a-743775e69dbe PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:08:58.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3748d78a-35c8-42c5-8b9a-743775e69dbe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d48bca4
2021-06-04T00:08:58.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3748d78a-35c8-42c5-8b9a-743775e69dbe PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:08:58.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3748d78a-35c8-42c5-8b9a-743775e69dbe PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:09:01.452Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08a1cc8c-41ce-4100-bef2-946c70c2a460 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:09:01.452Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08a1cc8c-41ce-4100-bef2-946c70c2a460 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e64bd0a
2021-06-04T00:09:01.452Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08a1cc8c-41ce-4100-bef2-946c70c2a460 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:09:01.452Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08a1cc8c-41ce-4100-bef2-946c70c2a460 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:09:05.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=769ee66d-4ced-4273-88c6-26495c6df0ee PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:09:05.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=769ee66d-4ced-4273-88c6-26495c6df0ee PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5252dff
2021-06-04T00:09:05.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=769ee66d-4ced-4273-88c6-26495c6df0ee PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:09:05.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=769ee66d-4ced-4273-88c6-26495c6df0ee PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:09:07.033Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T00:09:07.037Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:09:08.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=452db0fd-f319-457b-a009-089b2c3c1b8a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:09:08.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=452db0fd-f319-457b-a009-089b2c3c1b8a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@26ca687d
2021-06-04T00:09:08.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=452db0fd-f319-457b-a009-089b2c3c1b8a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:09:08.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=452db0fd-f319-457b-a009-089b2c3c1b8a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:09:10.771Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c6a79fb-1887-4106-b692-88ff2af13069 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:09:10.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c6a79fb-1887-4106-b692-88ff2af13069 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6eaf4d9c
2021-06-04T00:09:10.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c6a79fb-1887-4106-b692-88ff2af13069 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:09:10.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c6a79fb-1887-4106-b692-88ff2af13069 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:09:13.839Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e259c6e6-9789-47ce-b291-d3d30f86051a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:09:13.840Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e259c6e6-9789-47ce-b291-d3d30f86051a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c821ae
2021-06-04T00:09:13.840Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e259c6e6-9789-47ce-b291-d3d30f86051a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:09:13.840Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e259c6e6-9789-47ce-b291-d3d30f86051a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:09:16.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3ecb2c3-bb3c-4f1a-8196-83f56be80fe5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:09:16.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3ecb2c3-bb3c-4f1a-8196-83f56be80fe5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@292eae3d
2021-06-04T00:09:16.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3ecb2c3-bb3c-4f1a-8196-83f56be80fe5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:09:16.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3ecb2c3-bb3c-4f1a-8196-83f56be80fe5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:09:19.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4824845b-e705-43bd-92a1-1ec4c27d640b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:09:19.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4824845b-e705-43bd-92a1-1ec4c27d640b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c52a2e5
2021-06-04T00:09:19.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4824845b-e705-43bd-92a1-1ec4c27d640b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:09:19.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4824845b-e705-43bd-92a1-1ec4c27d640b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:09:22.718Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aeb694a0-bebc-4cd3-bbed-88520fb1cace PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:09:22.718Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aeb694a0-bebc-4cd3-bbed-88520fb1cace PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4885d75e
2021-06-04T00:09:22.718Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aeb694a0-bebc-4cd3-bbed-88520fb1cace PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:09:22.718Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aeb694a0-bebc-4cd3-bbed-88520fb1cace PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:09:25.969Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=275f5017-8999-4163-ab11-8e112cd6624c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:09:25.969Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=275f5017-8999-4163-ab11-8e112cd6624c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@c845ab1
2021-06-04T00:09:25.969Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=275f5017-8999-4163-ab11-8e112cd6624c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:09:25.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=275f5017-8999-4163-ab11-8e112cd6624c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:09:29.175Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0b1c2db-b5be-475e-b091-df0160c3bd1a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:09:29.175Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0b1c2db-b5be-475e-b091-df0160c3bd1a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5087425a
2021-06-04T00:09:29.175Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0b1c2db-b5be-475e-b091-df0160c3bd1a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:09:29.176Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0b1c2db-b5be-475e-b091-df0160c3bd1a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:09:31.495Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4127e7b4-3e3e-417d-891c-c8a6a280a7d7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:09:31.495Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4127e7b4-3e3e-417d-891c-c8a6a280a7d7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@198b8725
2021-06-04T00:09:31.495Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4127e7b4-3e3e-417d-891c-c8a6a280a7d7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:09:31.495Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4127e7b4-3e3e-417d-891c-c8a6a280a7d7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:09:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6cbea5c-e177-40b5-8362-4a407669bc36 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:09:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6cbea5c-e177-40b5-8362-4a407669bc36 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f529c6d
2021-06-04T00:09:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6cbea5c-e177-40b5-8362-4a407669bc36 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:09:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6cbea5c-e177-40b5-8362-4a407669bc36 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:09:38.077Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdaa299c-6e0d-44da-b901-7ce58f262ce9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:09:38.077Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdaa299c-6e0d-44da-b901-7ce58f262ce9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@512d00e4
2021-06-04T00:09:38.077Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdaa299c-6e0d-44da-b901-7ce58f262ce9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:09:38.077Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdaa299c-6e0d-44da-b901-7ce58f262ce9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:09:40.693Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ffdf8b1-0b86-4472-8d6d-caf57e380099 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:09:40.693Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ffdf8b1-0b86-4472-8d6d-caf57e380099 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3bd21d09
2021-06-04T00:09:40.693Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ffdf8b1-0b86-4472-8d6d-caf57e380099 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:09:40.693Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ffdf8b1-0b86-4472-8d6d-caf57e380099 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:09:43.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7cac8777-a4ab-4db8-aa62-82a8d870306e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:09:43.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7cac8777-a4ab-4db8-aa62-82a8d870306e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e2517f9
2021-06-04T00:09:43.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7cac8777-a4ab-4db8-aa62-82a8d870306e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:09:43.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7cac8777-a4ab-4db8-aa62-82a8d870306e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:09:46.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01226ed7-99ba-4ce6-8644-e518fd320437 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:09:46.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01226ed7-99ba-4ce6-8644-e518fd320437 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15ff4da4
2021-06-04T00:09:46.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01226ed7-99ba-4ce6-8644-e518fd320437 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:09:46.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01226ed7-99ba-4ce6-8644-e518fd320437 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:09:50.089Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8ae44ed-a134-442e-835b-3494225f158b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:09:50.089Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8ae44ed-a134-442e-835b-3494225f158b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c6c55df
2021-06-04T00:09:50.089Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8ae44ed-a134-442e-835b-3494225f158b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:09:50.089Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8ae44ed-a134-442e-835b-3494225f158b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:09:52.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10003a7b-d3a3-44e0-b005-eb9a9c77379f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:09:52.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10003a7b-d3a3-44e0-b005-eb9a9c77379f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@77d3f0e
2021-06-04T00:09:52.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10003a7b-d3a3-44e0-b005-eb9a9c77379f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:09:52.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10003a7b-d3a3-44e0-b005-eb9a9c77379f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:09:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99d29945-74f2-48f0-8df5-371b2c091d0e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:09:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99d29945-74f2-48f0-8df5-371b2c091d0e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@51317ac7
2021-06-04T00:09:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99d29945-74f2-48f0-8df5-371b2c091d0e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:09:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99d29945-74f2-48f0-8df5-371b2c091d0e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:09:59.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f7127f3-45fc-4dc5-8cd6-b18c3e6adff3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:09:59.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f7127f3-45fc-4dc5-8cd6-b18c3e6adff3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ecc9f28
2021-06-04T00:09:59.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f7127f3-45fc-4dc5-8cd6-b18c3e6adff3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:09:59.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f7127f3-45fc-4dc5-8cd6-b18c3e6adff3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:10:01.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4cfe7619-e3dd-44be-a644-e505ffb27a9f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:10:01.451Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4cfe7619-e3dd-44be-a644-e505ffb27a9f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7040e783
2021-06-04T00:10:01.451Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4cfe7619-e3dd-44be-a644-e505ffb27a9f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:10:01.451Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4cfe7619-e3dd-44be-a644-e505ffb27a9f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:10:04.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6313abb2-c5b3-4870-8db8-93aae92beae9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:10:04.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6313abb2-c5b3-4870-8db8-93aae92beae9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e2b33ca
2021-06-04T00:10:04.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6313abb2-c5b3-4870-8db8-93aae92beae9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:10:04.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6313abb2-c5b3-4870-8db8-93aae92beae9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:10:07.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b80df3d3-863d-4c6e-b378-41aba5a095d3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:10:07.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b80df3d3-863d-4c6e-b378-41aba5a095d3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4496958a
2021-06-04T00:10:07.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b80df3d3-863d-4c6e-b378-41aba5a095d3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:10:07.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b80df3d3-863d-4c6e-b378-41aba5a095d3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:10:10.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a216b7d0-a803-4bb1-bd92-1579ef03b38f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:10:10.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a216b7d0-a803-4bb1-bd92-1579ef03b38f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e7977ef
2021-06-04T00:10:10.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a216b7d0-a803-4bb1-bd92-1579ef03b38f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:10:10.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a216b7d0-a803-4bb1-bd92-1579ef03b38f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:10:13.742Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d44b2e67-73ea-47c6-8af7-56f0f1c15062 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:10:13.742Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d44b2e67-73ea-47c6-8af7-56f0f1c15062 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69f2e75c
2021-06-04T00:10:13.742Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d44b2e67-73ea-47c6-8af7-56f0f1c15062 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:10:13.742Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d44b2e67-73ea-47c6-8af7-56f0f1c15062 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:10:16.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=670d05da-996e-45ba-8016-cd201e26db64 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:10:16.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=670d05da-996e-45ba-8016-cd201e26db64 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e003ccb
2021-06-04T00:10:16.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=670d05da-996e-45ba-8016-cd201e26db64 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:10:16.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=670d05da-996e-45ba-8016-cd201e26db64 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:10:19.934Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f41bf61-2182-4b72-a95e-e32ca8b531ae PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:10:19.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f41bf61-2182-4b72-a95e-e32ca8b531ae PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ecac644
2021-06-04T00:10:19.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f41bf61-2182-4b72-a95e-e32ca8b531ae PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:10:19.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f41bf61-2182-4b72-a95e-e32ca8b531ae PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:10:22.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f290180-b296-4613-a5aa-ae1b52594ce6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:10:22.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f290180-b296-4613-a5aa-ae1b52594ce6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b59147d
2021-06-04T00:10:22.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f290180-b296-4613-a5aa-ae1b52594ce6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:10:22.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f290180-b296-4613-a5aa-ae1b52594ce6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:10:25.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11d22089-e6e4-4005-b35b-1fd07f7260e2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:10:25.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11d22089-e6e4-4005-b35b-1fd07f7260e2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@756fca4d
2021-06-04T00:10:25.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11d22089-e6e4-4005-b35b-1fd07f7260e2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:10:25.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11d22089-e6e4-4005-b35b-1fd07f7260e2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:10:28.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e63c8196-22ea-437c-9cf2-f1e5defedef5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:10:28.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e63c8196-22ea-437c-9cf2-f1e5defedef5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5aa6464f
2021-06-04T00:10:28.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e63c8196-22ea-437c-9cf2-f1e5defedef5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:10:28.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e63c8196-22ea-437c-9cf2-f1e5defedef5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:10:31.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3902da4-1cac-405c-b85f-fa8ad719ff10 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:10:31.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3902da4-1cac-405c-b85f-fa8ad719ff10 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@52d653b9
2021-06-04T00:10:31.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3902da4-1cac-405c-b85f-fa8ad719ff10 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:10:31.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3902da4-1cac-405c-b85f-fa8ad719ff10 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:10:34.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e282c479-6b4c-40cf-8c9a-2c929a02911d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:10:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e282c479-6b4c-40cf-8c9a-2c929a02911d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@116f4f62
2021-06-04T00:10:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e282c479-6b4c-40cf-8c9a-2c929a02911d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:10:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e282c479-6b4c-40cf-8c9a-2c929a02911d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:10:37.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1df3b5b-906a-4aad-9077-225e7e7092c2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:10:37.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1df3b5b-906a-4aad-9077-225e7e7092c2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a59c2a0
2021-06-04T00:10:37.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1df3b5b-906a-4aad-9077-225e7e7092c2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:10:37.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1df3b5b-906a-4aad-9077-225e7e7092c2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:10:40.694Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba4e5ed3-0afd-452d-831f-2dd6f9b2815c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:10:40.694Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba4e5ed3-0afd-452d-831f-2dd6f9b2815c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@72a57b9a
2021-06-04T00:10:40.694Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba4e5ed3-0afd-452d-831f-2dd6f9b2815c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:10:40.694Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba4e5ed3-0afd-452d-831f-2dd6f9b2815c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:10:43.824Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d33f7f95-22a3-4e3d-aa44-a3e11dd45424 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:10:43.825Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d33f7f95-22a3-4e3d-aa44-a3e11dd45424 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@128eb5ec
2021-06-04T00:10:43.825Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d33f7f95-22a3-4e3d-aa44-a3e11dd45424 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:10:43.825Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d33f7f95-22a3-4e3d-aa44-a3e11dd45424 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:10:46.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29da9c2c-908a-4bce-8780-fcdbee3ed2dd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:10:46.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29da9c2c-908a-4bce-8780-fcdbee3ed2dd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7971ec80
2021-06-04T00:10:46.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29da9c2c-908a-4bce-8780-fcdbee3ed2dd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:10:46.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29da9c2c-908a-4bce-8780-fcdbee3ed2dd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:10:49.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27c6b4ac-6977-40c0-9836-4b4afe287253 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:10:49.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27c6b4ac-6977-40c0-9836-4b4afe287253 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d696dcc
2021-06-04T00:10:49.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27c6b4ac-6977-40c0-9836-4b4afe287253 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:10:49.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27c6b4ac-6977-40c0-9836-4b4afe287253 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:10:52.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fa32d59-eef2-473d-82b2-d041517b91b4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:10:52.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fa32d59-eef2-473d-82b2-d041517b91b4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74c9ba50
2021-06-04T00:10:52.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fa32d59-eef2-473d-82b2-d041517b91b4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:10:52.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fa32d59-eef2-473d-82b2-d041517b91b4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:10:56.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e32835b-baf2-4b10-a72f-90e443e88d05 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:10:56.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e32835b-baf2-4b10-a72f-90e443e88d05 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@130f50f0
2021-06-04T00:10:56.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e32835b-baf2-4b10-a72f-90e443e88d05 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:10:56.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e32835b-baf2-4b10-a72f-90e443e88d05 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:10:59.074Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d7f3b00-a6cb-4bb4-9fa4-bb80b904a141 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:10:59.074Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d7f3b00-a6cb-4bb4-9fa4-bb80b904a141 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65ecabfd
2021-06-04T00:10:59.074Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d7f3b00-a6cb-4bb4-9fa4-bb80b904a141 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:10:59.074Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d7f3b00-a6cb-4bb4-9fa4-bb80b904a141 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:11:01.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d35db83-7f66-4873-89c2-34ec92c58054 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:11:01.451Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d35db83-7f66-4873-89c2-34ec92c58054 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38dbd81
2021-06-04T00:11:01.451Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d35db83-7f66-4873-89c2-34ec92c58054 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:11:01.451Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d35db83-7f66-4873-89c2-34ec92c58054 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:11:03.769Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T00:11:03.771Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:11:03.771Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:11:03.771Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:11:03.772Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:11:03.773Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:11:03.773Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:11:04.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9c904ef-1668-4714-8e17-8e1f91a8a6dd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:11:04.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9c904ef-1668-4714-8e17-8e1f91a8a6dd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a2f8c9a
2021-06-04T00:11:04.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9c904ef-1668-4714-8e17-8e1f91a8a6dd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:11:04.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9c904ef-1668-4714-8e17-8e1f91a8a6dd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:11:07.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33de89a5-2769-4c29-8cd2-88674792c777 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:11:07.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33de89a5-2769-4c29-8cd2-88674792c777 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53ced3ff
2021-06-04T00:11:07.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33de89a5-2769-4c29-8cd2-88674792c777 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:11:07.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33de89a5-2769-4c29-8cd2-88674792c777 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:11:10.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d73e59b-cd76-4744-89af-3b84c8fe4932 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:11:10.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d73e59b-cd76-4744-89af-3b84c8fe4932 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53fd2938
2021-06-04T00:11:10.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d73e59b-cd76-4744-89af-3b84c8fe4932 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:11:10.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d73e59b-cd76-4744-89af-3b84c8fe4932 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:11:13.820Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d97604b5-4135-4f52-8ce2-e0e33d7bc94d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:11:13.820Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d97604b5-4135-4f52-8ce2-e0e33d7bc94d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d72e773
2021-06-04T00:11:13.820Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d97604b5-4135-4f52-8ce2-e0e33d7bc94d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:11:13.820Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d97604b5-4135-4f52-8ce2-e0e33d7bc94d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:11:16.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be07a339-3a56-438c-8ee2-1c02c9037850 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:11:16.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be07a339-3a56-438c-8ee2-1c02c9037850 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b7ff71b
2021-06-04T00:11:16.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be07a339-3a56-438c-8ee2-1c02c9037850 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:11:16.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be07a339-3a56-438c-8ee2-1c02c9037850 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:11:18.104Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T00:11:18.111Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:11:20.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b1bc672-c9b8-4f74-a84c-31e103017be7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:11:20.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b1bc672-c9b8-4f74-a84c-31e103017be7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e0b82a0
2021-06-04T00:11:20.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b1bc672-c9b8-4f74-a84c-31e103017be7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:11:20.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b1bc672-c9b8-4f74-a84c-31e103017be7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:11:22.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9dc15000-6eea-48d1-8a60-497ad0c7c745 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:11:22.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9dc15000-6eea-48d1-8a60-497ad0c7c745 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6485d4b0
2021-06-04T00:11:22.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9dc15000-6eea-48d1-8a60-497ad0c7c745 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:11:22.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9dc15000-6eea-48d1-8a60-497ad0c7c745 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:11:25.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7275bc2-b542-42a0-9bb0-d379bda33bae PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:11:25.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7275bc2-b542-42a0-9bb0-d379bda33bae PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e66ee2c
2021-06-04T00:11:25.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7275bc2-b542-42a0-9bb0-d379bda33bae PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:11:25.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7275bc2-b542-42a0-9bb0-d379bda33bae PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:11:28.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c564911-98c3-4a64-b74f-483e8d3bd1ef PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:11:28.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c564911-98c3-4a64-b74f-483e8d3bd1ef PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a251fd4
2021-06-04T00:11:28.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c564911-98c3-4a64-b74f-483e8d3bd1ef PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:11:28.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c564911-98c3-4a64-b74f-483e8d3bd1ef PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:11:31.456Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86ba60cc-b16c-49e6-b499-b7ff804f50c7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:11:31.456Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86ba60cc-b16c-49e6-b499-b7ff804f50c7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@48398ab2
2021-06-04T00:11:31.456Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86ba60cc-b16c-49e6-b499-b7ff804f50c7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:11:31.456Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86ba60cc-b16c-49e6-b499-b7ff804f50c7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:11:34.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=571023ad-1fa3-4b62-970c-9438c511aed1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:11:34.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=571023ad-1fa3-4b62-970c-9438c511aed1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@253f751
2021-06-04T00:11:34.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=571023ad-1fa3-4b62-970c-9438c511aed1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:11:34.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=571023ad-1fa3-4b62-970c-9438c511aed1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:11:37.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59434f53-2eee-47cc-aee4-ce6148215485 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:11:37.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59434f53-2eee-47cc-aee4-ce6148215485 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7bbd6eb9
2021-06-04T00:11:37.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59434f53-2eee-47cc-aee4-ce6148215485 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:11:37.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59434f53-2eee-47cc-aee4-ce6148215485 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:11:40.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58759136-8cfa-407a-aaad-50a3a8599846 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:11:40.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58759136-8cfa-407a-aaad-50a3a8599846 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@190415a5
2021-06-04T00:11:40.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58759136-8cfa-407a-aaad-50a3a8599846 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:11:40.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58759136-8cfa-407a-aaad-50a3a8599846 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:11:43.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=880b3ab1-d20f-4df5-97b1-b143f9e8c15e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:11:43.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=880b3ab1-d20f-4df5-97b1-b143f9e8c15e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1dec702d
2021-06-04T00:11:43.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=880b3ab1-d20f-4df5-97b1-b143f9e8c15e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:11:43.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=880b3ab1-d20f-4df5-97b1-b143f9e8c15e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:11:46.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ed23ad6-0a25-4bf1-bd58-606fe407f5fb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:11:46.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ed23ad6-0a25-4bf1-bd58-606fe407f5fb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@98e5be
2021-06-04T00:11:46.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ed23ad6-0a25-4bf1-bd58-606fe407f5fb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:11:46.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ed23ad6-0a25-4bf1-bd58-606fe407f5fb PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:11:50.080Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a74ae40-e257-4628-9aa8-258c9292e3e1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:11:50.080Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a74ae40-e257-4628-9aa8-258c9292e3e1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@10409bb2
2021-06-04T00:11:50.080Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a74ae40-e257-4628-9aa8-258c9292e3e1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:11:50.080Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a74ae40-e257-4628-9aa8-258c9292e3e1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:11:52.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a32e127b-25d6-4fd1-8069-035d00249a6e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:11:52.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a32e127b-25d6-4fd1-8069-035d00249a6e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29501d22
2021-06-04T00:11:52.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a32e127b-25d6-4fd1-8069-035d00249a6e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:11:52.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a32e127b-25d6-4fd1-8069-035d00249a6e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:11:55.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c30a166-12e4-40dd-9167-9c616bf4742d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:11:55.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c30a166-12e4-40dd-9167-9c616bf4742d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57436d3d
2021-06-04T00:11:55.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c30a166-12e4-40dd-9167-9c616bf4742d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:11:55.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c30a166-12e4-40dd-9167-9c616bf4742d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:11:58.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0602ccd9-2f92-46ac-aba2-f819aebac1d6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:11:58.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0602ccd9-2f92-46ac-aba2-f819aebac1d6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@10b1c77e
2021-06-04T00:11:58.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0602ccd9-2f92-46ac-aba2-f819aebac1d6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:11:58.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0602ccd9-2f92-46ac-aba2-f819aebac1d6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:12:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=046b40b9-02a6-4d01-91df-acb9427cc62e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:12:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=046b40b9-02a6-4d01-91df-acb9427cc62e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b853d1
2021-06-04T00:12:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=046b40b9-02a6-4d01-91df-acb9427cc62e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:12:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=046b40b9-02a6-4d01-91df-acb9427cc62e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:12:04.771Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c072c71d-cd11-4385-93b3-2c55d612186a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:12:04.771Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c072c71d-cd11-4385-93b3-2c55d612186a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2da8f769
2021-06-04T00:12:04.771Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c072c71d-cd11-4385-93b3-2c55d612186a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:12:04.771Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c072c71d-cd11-4385-93b3-2c55d612186a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:12:08.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93a5498f-4369-4b17-a664-541d3a6d16f0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:12:08.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93a5498f-4369-4b17-a664-541d3a6d16f0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@61ce5d64
2021-06-04T00:12:08.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93a5498f-4369-4b17-a664-541d3a6d16f0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:12:08.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93a5498f-4369-4b17-a664-541d3a6d16f0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:12:10.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e4ff36d-05a4-44da-b34f-9247c7b63dbe PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:12:10.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e4ff36d-05a4-44da-b34f-9247c7b63dbe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7fdaec14
2021-06-04T00:12:10.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e4ff36d-05a4-44da-b34f-9247c7b63dbe PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:12:10.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e4ff36d-05a4-44da-b34f-9247c7b63dbe PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:12:13.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc02fb5b-0ee5-46fc-8861-8ac08ddf4928 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:12:13.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc02fb5b-0ee5-46fc-8861-8ac08ddf4928 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@39ba0ee5
2021-06-04T00:12:13.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc02fb5b-0ee5-46fc-8861-8ac08ddf4928 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:12:13.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc02fb5b-0ee5-46fc-8861-8ac08ddf4928 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:12:16.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fa926d4-b809-4289-8b7c-dd8ce7b4c91e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:12:16.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fa926d4-b809-4289-8b7c-dd8ce7b4c91e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53c3b504
2021-06-04T00:12:16.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fa926d4-b809-4289-8b7c-dd8ce7b4c91e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:12:16.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fa926d4-b809-4289-8b7c-dd8ce7b4c91e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:12:19.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=495a5228-e57b-4a8d-ba9d-e44d136cc795 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:12:19.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=495a5228-e57b-4a8d-ba9d-e44d136cc795 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@40f5f765
2021-06-04T00:12:19.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=495a5228-e57b-4a8d-ba9d-e44d136cc795 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:12:19.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=495a5228-e57b-4a8d-ba9d-e44d136cc795 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:12:22.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3eeb39d2-5926-400e-a80a-fbf7192d636f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:12:22.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3eeb39d2-5926-400e-a80a-fbf7192d636f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68671923
2021-06-04T00:12:22.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3eeb39d2-5926-400e-a80a-fbf7192d636f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:12:22.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3eeb39d2-5926-400e-a80a-fbf7192d636f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:12:25.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5ca50ec-7b41-4080-9eeb-836b77226ada PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:12:25.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5ca50ec-7b41-4080-9eeb-836b77226ada PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c3efec
2021-06-04T00:12:25.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5ca50ec-7b41-4080-9eeb-836b77226ada PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:12:25.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5ca50ec-7b41-4080-9eeb-836b77226ada PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:12:28.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f60e7cf-ceb3-477b-9c72-1b74a7a4410e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:12:28.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f60e7cf-ceb3-477b-9c72-1b74a7a4410e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f660145
2021-06-04T00:12:28.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f60e7cf-ceb3-477b-9c72-1b74a7a4410e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:12:28.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f60e7cf-ceb3-477b-9c72-1b74a7a4410e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:12:31.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=837b27fe-930a-42e5-8eb4-702423755175 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:12:31.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=837b27fe-930a-42e5-8eb4-702423755175 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20479913
2021-06-04T00:12:31.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=837b27fe-930a-42e5-8eb4-702423755175 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:12:31.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=837b27fe-930a-42e5-8eb4-702423755175 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:12:34.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46b104d3-c4e0-4137-b583-ce76ad1d1489 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:12:34.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46b104d3-c4e0-4137-b583-ce76ad1d1489 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@70393239
2021-06-04T00:12:34.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46b104d3-c4e0-4137-b583-ce76ad1d1489 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:12:34.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46b104d3-c4e0-4137-b583-ce76ad1d1489 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:12:37.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68d13937-b6e0-405b-99cc-4fa4facbb650 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:12:37.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68d13937-b6e0-405b-99cc-4fa4facbb650 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e1b1f5d
2021-06-04T00:12:37.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68d13937-b6e0-405b-99cc-4fa4facbb650 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:12:37.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68d13937-b6e0-405b-99cc-4fa4facbb650 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:12:40.785Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea5464c6-bc18-4f03-b416-76e5d9c53f28 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:12:40.785Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea5464c6-bc18-4f03-b416-76e5d9c53f28 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@110857f2
2021-06-04T00:12:40.785Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea5464c6-bc18-4f03-b416-76e5d9c53f28 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:12:40.785Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea5464c6-bc18-4f03-b416-76e5d9c53f28 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:12:43.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e854c68-80db-4d98-b04b-9b4b2ce390c8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:12:43.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e854c68-80db-4d98-b04b-9b4b2ce390c8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d9bdbc1
2021-06-04T00:12:43.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e854c68-80db-4d98-b04b-9b4b2ce390c8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:12:43.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e854c68-80db-4d98-b04b-9b4b2ce390c8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:12:46.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35f4680a-f8ed-4f74-bcc6-b72f8a3cc74b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:12:46.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35f4680a-f8ed-4f74-bcc6-b72f8a3cc74b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@340a88b1
2021-06-04T00:12:46.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35f4680a-f8ed-4f74-bcc6-b72f8a3cc74b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:12:46.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35f4680a-f8ed-4f74-bcc6-b72f8a3cc74b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:12:50.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a50debc-92be-4fcc-bcbe-3784c632ede0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:12:50.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a50debc-92be-4fcc-bcbe-3784c632ede0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@25d989a
2021-06-04T00:12:50.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a50debc-92be-4fcc-bcbe-3784c632ede0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:12:50.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a50debc-92be-4fcc-bcbe-3784c632ede0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:12:52.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af7aefbd-f82b-4559-9b79-aa0ec984a509 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:12:52.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af7aefbd-f82b-4559-9b79-aa0ec984a509 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@51b9f8e4
2021-06-04T00:12:52.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af7aefbd-f82b-4559-9b79-aa0ec984a509 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:12:52.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af7aefbd-f82b-4559-9b79-aa0ec984a509 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:12:56.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69c9fcb8-78ef-4ec8-8355-46d1ee4447ff PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:12:56.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69c9fcb8-78ef-4ec8-8355-46d1ee4447ff PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22f74c1
2021-06-04T00:12:56.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69c9fcb8-78ef-4ec8-8355-46d1ee4447ff PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:12:56.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69c9fcb8-78ef-4ec8-8355-46d1ee4447ff PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:12:59.378Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40340d34-e3a2-476e-a9a5-caae2b85659d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:12:59.378Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40340d34-e3a2-476e-a9a5-caae2b85659d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@62003b35
2021-06-04T00:12:59.378Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40340d34-e3a2-476e-a9a5-caae2b85659d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:12:59.378Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40340d34-e3a2-476e-a9a5-caae2b85659d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:13:01.452Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72ff77f4-554d-4781-8da5-c2ab97707b1a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:13:01.452Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72ff77f4-554d-4781-8da5-c2ab97707b1a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@cf7e6a7
2021-06-04T00:13:01.452Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72ff77f4-554d-4781-8da5-c2ab97707b1a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:13:01.452Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72ff77f4-554d-4781-8da5-c2ab97707b1a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:13:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07d7f7db-1d36-4867-91e7-ff9e86a1a285 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:13:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07d7f7db-1d36-4867-91e7-ff9e86a1a285 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@12974105
2021-06-04T00:13:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07d7f7db-1d36-4867-91e7-ff9e86a1a285 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:13:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07d7f7db-1d36-4867-91e7-ff9e86a1a285 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:13:08.074Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c63b009-1afd-404e-a56f-9b114073ef2c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:13:08.074Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c63b009-1afd-404e-a56f-9b114073ef2c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b67b6ea
2021-06-04T00:13:08.074Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c63b009-1afd-404e-a56f-9b114073ef2c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:13:08.074Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c63b009-1afd-404e-a56f-9b114073ef2c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:13:10.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22257e37-cb47-4e45-b0a1-1e0a048f926b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:13:10.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22257e37-cb47-4e45-b0a1-1e0a048f926b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@8ddf120
2021-06-04T00:13:10.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22257e37-cb47-4e45-b0a1-1e0a048f926b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:13:10.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22257e37-cb47-4e45-b0a1-1e0a048f926b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:13:13.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44873bbc-2c2d-44e1-ad80-c70850cb5c6b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:13:13.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44873bbc-2c2d-44e1-ad80-c70850cb5c6b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3bacec42
2021-06-04T00:13:13.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44873bbc-2c2d-44e1-ad80-c70850cb5c6b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:13:13.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44873bbc-2c2d-44e1-ad80-c70850cb5c6b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:13:14.840Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T00:13:14.841Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:13:14.841Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:13:14.841Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:13:14.841Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:13:14.842Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:13:14.842Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:13:17.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=954e7981-ecc0-4a6f-abdf-bb733d31a879 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:13:17.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=954e7981-ecc0-4a6f-abdf-bb733d31a879 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@139b0d5b
2021-06-04T00:13:17.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=954e7981-ecc0-4a6f-abdf-bb733d31a879 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:13:17.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=954e7981-ecc0-4a6f-abdf-bb733d31a879 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:13:19.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca23e8d3-a182-4503-8a4b-8434e9679152 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:13:19.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca23e8d3-a182-4503-8a4b-8434e9679152 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@451d3924
2021-06-04T00:13:19.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca23e8d3-a182-4503-8a4b-8434e9679152 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:13:19.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca23e8d3-a182-4503-8a4b-8434e9679152 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:13:22.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bdf8cd2-83bc-435e-921a-a73748c82bf9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:13:22.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bdf8cd2-83bc-435e-921a-a73748c82bf9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22ae9456
2021-06-04T00:13:22.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bdf8cd2-83bc-435e-921a-a73748c82bf9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:13:22.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bdf8cd2-83bc-435e-921a-a73748c82bf9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:13:26.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a250686a-7cd4-4564-871f-904a267673d5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:13:26.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a250686a-7cd4-4564-871f-904a267673d5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ebcb2bd
2021-06-04T00:13:26.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a250686a-7cd4-4564-871f-904a267673d5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:13:26.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a250686a-7cd4-4564-871f-904a267673d5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:13:29.074Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59488e4f-1c3f-4254-b223-10667ddc0d1b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:13:29.074Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59488e4f-1c3f-4254-b223-10667ddc0d1b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@358699e4
2021-06-04T00:13:29.074Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59488e4f-1c3f-4254-b223-10667ddc0d1b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:13:29.074Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59488e4f-1c3f-4254-b223-10667ddc0d1b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:13:29.177Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T00:13:29.184Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:13:31.467Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=efcbff80-dc83-4c02-b63d-b0ece2a551b0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:13:31.467Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=efcbff80-dc83-4c02-b63d-b0ece2a551b0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@19fe4269
2021-06-04T00:13:31.467Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=efcbff80-dc83-4c02-b63d-b0ece2a551b0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:13:31.467Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=efcbff80-dc83-4c02-b63d-b0ece2a551b0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:13:34.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1439791a-1797-4e55-ac58-b622d0465090 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:13:34.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1439791a-1797-4e55-ac58-b622d0465090 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f246924
2021-06-04T00:13:34.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1439791a-1797-4e55-ac58-b622d0465090 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:13:34.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1439791a-1797-4e55-ac58-b622d0465090 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:13:37.969Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66e045ef-5dec-43e9-8f24-d6906e08fa8f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:13:37.969Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66e045ef-5dec-43e9-8f24-d6906e08fa8f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54960327
2021-06-04T00:13:37.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66e045ef-5dec-43e9-8f24-d6906e08fa8f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:13:37.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66e045ef-5dec-43e9-8f24-d6906e08fa8f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:13:40.769Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17bf9eff-8054-4e03-8e5e-b33d6c236811 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:13:40.770Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17bf9eff-8054-4e03-8e5e-b33d6c236811 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@555ef9e8
2021-06-04T00:13:40.770Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17bf9eff-8054-4e03-8e5e-b33d6c236811 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:13:40.770Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17bf9eff-8054-4e03-8e5e-b33d6c236811 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:13:43.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fafca18-b93f-4e87-9e82-cd68f5217475 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:13:43.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fafca18-b93f-4e87-9e82-cd68f5217475 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e580420
2021-06-04T00:13:43.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fafca18-b93f-4e87-9e82-cd68f5217475 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:13:43.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fafca18-b93f-4e87-9e82-cd68f5217475 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:13:46.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a1983ff-8159-463b-b921-dabc4c934a25 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:13:46.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a1983ff-8159-463b-b921-dabc4c934a25 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@52d92786
2021-06-04T00:13:46.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a1983ff-8159-463b-b921-dabc4c934a25 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:13:46.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a1983ff-8159-463b-b921-dabc4c934a25 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:13:50.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64998b57-452a-4349-94bd-46aa441751da PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:13:50.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64998b57-452a-4349-94bd-46aa441751da PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@36b289c1
2021-06-04T00:13:50.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64998b57-452a-4349-94bd-46aa441751da PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:13:50.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64998b57-452a-4349-94bd-46aa441751da PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:13:52.527Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ef5eb80-9aec-435e-8bbd-34eb00caa20b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:13:52.527Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ef5eb80-9aec-435e-8bbd-34eb00caa20b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1401a746
2021-06-04T00:13:52.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ef5eb80-9aec-435e-8bbd-34eb00caa20b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:13:52.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ef5eb80-9aec-435e-8bbd-34eb00caa20b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:13:55.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f90363f5-9dba-4626-8bca-b080b594a1cb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:13:55.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f90363f5-9dba-4626-8bca-b080b594a1cb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6a86d8e2
2021-06-04T00:13:55.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f90363f5-9dba-4626-8bca-b080b594a1cb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:13:55.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f90363f5-9dba-4626-8bca-b080b594a1cb PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:13:59.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02137721-2e41-44d4-9b9e-143a66e8628a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:13:59.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02137721-2e41-44d4-9b9e-143a66e8628a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71783723
2021-06-04T00:13:59.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02137721-2e41-44d4-9b9e-143a66e8628a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:13:59.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02137721-2e41-44d4-9b9e-143a66e8628a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:14:01.461Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4cda90a9-0960-4d7d-bff0-ebe58b7a4d93 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:14:01.461Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4cda90a9-0960-4d7d-bff0-ebe58b7a4d93 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5326544c
2021-06-04T00:14:01.461Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4cda90a9-0960-4d7d-bff0-ebe58b7a4d93 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:14:01.461Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4cda90a9-0960-4d7d-bff0-ebe58b7a4d93 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:14:04.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32622528-26f8-45b1-af64-1a33c64ff9f6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:14:04.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32622528-26f8-45b1-af64-1a33c64ff9f6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a04f2f9
2021-06-04T00:14:04.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32622528-26f8-45b1-af64-1a33c64ff9f6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:14:04.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32622528-26f8-45b1-af64-1a33c64ff9f6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:14:07.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce9f15e0-4328-4347-8f0f-0180bd3beaa8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:14:07.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce9f15e0-4328-4347-8f0f-0180bd3beaa8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@16997293
2021-06-04T00:14:07.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce9f15e0-4328-4347-8f0f-0180bd3beaa8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:14:07.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce9f15e0-4328-4347-8f0f-0180bd3beaa8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:14:10.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=455bfb63-de47-40d4-8464-3d350de40d0e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:14:10.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=455bfb63-de47-40d4-8464-3d350de40d0e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@26688e4c
2021-06-04T00:14:10.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=455bfb63-de47-40d4-8464-3d350de40d0e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:14:10.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=455bfb63-de47-40d4-8464-3d350de40d0e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:14:13.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e58f36f-df09-49dc-9fca-23e55ad4ca84 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:14:13.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e58f36f-df09-49dc-9fca-23e55ad4ca84 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@478d2af9
2021-06-04T00:14:13.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e58f36f-df09-49dc-9fca-23e55ad4ca84 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:14:13.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e58f36f-df09-49dc-9fca-23e55ad4ca84 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:14:16.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f65354ce-af54-4ae9-b67a-db6983b53f0c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:14:16.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f65354ce-af54-4ae9-b67a-db6983b53f0c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a739bcb
2021-06-04T00:14:16.875Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f65354ce-af54-4ae9-b67a-db6983b53f0c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:14:16.875Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f65354ce-af54-4ae9-b67a-db6983b53f0c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:14:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=90fd1748-d712-4052-b77f-d3dd7de27b71 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:14:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=90fd1748-d712-4052-b77f-d3dd7de27b71 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@772369fc
2021-06-04T00:14:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=90fd1748-d712-4052-b77f-d3dd7de27b71 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:14:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=90fd1748-d712-4052-b77f-d3dd7de27b71 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:14:19.918Z [BE-Health-Check-Task] INFO o.a.http.impl.execchain.RetryExec RequestID=90fd1748-d712-4052-b77f-d3dd7de27b71 PartnerName=SDC.BE I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {s}->https://sdc-onboarding-be.onap:8445: The target server failed to respond
2021-06-04T00:14:19.918Z [BE-Health-Check-Task] INFO o.a.http.impl.execchain.RetryExec RequestID=90fd1748-d712-4052-b77f-d3dd7de27b71 PartnerName=SDC.BE Retrying request to {s}->https://sdc-onboarding-be.onap:8445
2021-06-04T00:14:19.921Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=90fd1748-d712-4052-b77f-d3dd7de27b71 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T00:14:19.922Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=90fd1748-d712-4052-b77f-d3dd7de27b71 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:14:22.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d2db4b6-816a-46cb-a7a1-419d86ee01ee PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:14:22.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d2db4b6-816a-46cb-a7a1-419d86ee01ee PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3bafb91a
2021-06-04T00:14:22.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d2db4b6-816a-46cb-a7a1-419d86ee01ee PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:14:22.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d2db4b6-816a-46cb-a7a1-419d86ee01ee PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:14:22.516Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=4d2db4b6-816a-46cb-a7a1-419d86ee01ee ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T00:14:22.517Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=4d2db4b6-816a-46cb-a7a1-419d86ee01ee ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:14:25.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7321daaa-0be2-44fe-9791-30c13d4cfe2d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:14:25.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7321daaa-0be2-44fe-9791-30c13d4cfe2d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@61b434b4
2021-06-04T00:14:25.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7321daaa-0be2-44fe-9791-30c13d4cfe2d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:14:25.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7321daaa-0be2-44fe-9791-30c13d4cfe2d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:14:25.916Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=7321daaa-0be2-44fe-9791-30c13d4cfe2d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T00:14:25.916Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=7321daaa-0be2-44fe-9791-30c13d4cfe2d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:14:29.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2fd50015-56de-437e-acfb-a8d1f652374d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:14:29.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2fd50015-56de-437e-acfb-a8d1f652374d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e1ab60f
2021-06-04T00:14:29.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2fd50015-56de-437e-acfb-a8d1f652374d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:14:29.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2fd50015-56de-437e-acfb-a8d1f652374d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:14:32.093Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2fd50015-56de-437e-acfb-a8d1f652374d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T00:14:32.094Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2fd50015-56de-437e-acfb-a8d1f652374d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:14:32.246Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03eca733-e805-476a-ad4c-7685a3bf706d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:14:32.246Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03eca733-e805-476a-ad4c-7685a3bf706d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d7f9d3
2021-06-04T00:14:32.247Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03eca733-e805-476a-ad4c-7685a3bf706d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:14:32.247Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03eca733-e805-476a-ad4c-7685a3bf706d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:14:35.256Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=03eca733-e805-476a-ad4c-7685a3bf706d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T00:14:35.256Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=03eca733-e805-476a-ad4c-7685a3bf706d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:14:35.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7aa93d46-b23b-4909-bb12-45a393172539 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:14:35.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7aa93d46-b23b-4909-bb12-45a393172539 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b63b638
2021-06-04T00:14:35.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7aa93d46-b23b-4909-bb12-45a393172539 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:14:35.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7aa93d46-b23b-4909-bb12-45a393172539 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:14:38.824Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=7aa93d46-b23b-4909-bb12-45a393172539 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T00:14:38.825Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=7aa93d46-b23b-4909-bb12-45a393172539 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:14:39.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0a44e2b-61f0-426f-97a4-0834882c4c66 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:14:39.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0a44e2b-61f0-426f-97a4-0834882c4c66 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79288ef
2021-06-04T00:14:39.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0a44e2b-61f0-426f-97a4-0834882c4c66 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:14:39.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0a44e2b-61f0-426f-97a4-0834882c4c66 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:14:42.587Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a0a44e2b-61f0-426f-97a4-0834882c4c66 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T00:14:42.588Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a0a44e2b-61f0-426f-97a4-0834882c4c66 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:14:42.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=098a9394-2d2a-4caa-beef-09894cb6014e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:14:42.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=098a9394-2d2a-4caa-beef-09894cb6014e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@376541ec
2021-06-04T00:14:42.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=098a9394-2d2a-4caa-beef-09894cb6014e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:14:42.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=098a9394-2d2a-4caa-beef-09894cb6014e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:14:45.846Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=098a9394-2d2a-4caa-beef-09894cb6014e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T00:14:45.847Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=098a9394-2d2a-4caa-beef-09894cb6014e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:14:46.569Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a50d719-255e-4b70-b9a4-475dd1637e32 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:14:46.569Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a50d719-255e-4b70-b9a4-475dd1637e32 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@169fd3e0
2021-06-04T00:14:46.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a50d719-255e-4b70-b9a4-475dd1637e32 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:14:46.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a50d719-255e-4b70-b9a4-475dd1637e32 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:14:49.580Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=9a50d719-255e-4b70-b9a4-475dd1637e32 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T00:14:49.580Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=9a50d719-255e-4b70-b9a4-475dd1637e32 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:14:50.175Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e750b4c-d68e-4ad0-985c-53f54f6414fa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:14:50.175Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e750b4c-d68e-4ad0-985c-53f54f6414fa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@652b2172
2021-06-04T00:14:50.175Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e750b4c-d68e-4ad0-985c-53f54f6414fa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:14:50.175Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e750b4c-d68e-4ad0-985c-53f54f6414fa PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:14:55.156Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0e750b4c-d68e-4ad0-985c-53f54f6414fa ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:14:55.156Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0e750b4c-d68e-4ad0-985c-53f54f6414fa ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:14:55.673Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb3ada3b-8be4-4754-8e4d-01c91d744a6c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:14:55.673Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb3ada3b-8be4-4754-8e4d-01c91d744a6c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4762d697
2021-06-04T00:14:55.673Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb3ada3b-8be4-4754-8e4d-01c91d744a6c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:14:55.673Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb3ada3b-8be4-4754-8e4d-01c91d744a6c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:14:58.712Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=cb3ada3b-8be4-4754-8e4d-01c91d744a6c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:14:58.712Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=cb3ada3b-8be4-4754-8e4d-01c91d744a6c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:14:59.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=594230bf-ac1c-447d-907c-58d4694d8df6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:14:59.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=594230bf-ac1c-447d-907c-58d4694d8df6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6094e058
2021-06-04T00:14:59.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=594230bf-ac1c-447d-907c-58d4694d8df6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:14:59.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=594230bf-ac1c-447d-907c-58d4694d8df6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:15:00.609Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71a1539e-1edf-4a59-8e2b-91918c76ca44 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:15:00.609Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71a1539e-1edf-4a59-8e2b-91918c76ca44 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e6477a2
2021-06-04T00:15:00.609Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71a1539e-1edf-4a59-8e2b-91918c76ca44 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:15:00.610Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71a1539e-1edf-4a59-8e2b-91918c76ca44 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:15:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=276b352a-521d-48d9-95cd-d1fcedb37a9c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:15:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=276b352a-521d-48d9-95cd-d1fcedb37a9c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@51231c4e
2021-06-04T00:15:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=276b352a-521d-48d9-95cd-d1fcedb37a9c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:15:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=276b352a-521d-48d9-95cd-d1fcedb37a9c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:15:02.008Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cfc468fd-4eba-4c35-adb2-5abbc4eb36d2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:15:02.008Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cfc468fd-4eba-4c35-adb2-5abbc4eb36d2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1672b012
2021-06-04T00:15:02.008Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cfc468fd-4eba-4c35-adb2-5abbc4eb36d2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:15:02.008Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cfc468fd-4eba-4c35-adb2-5abbc4eb36d2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:15:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1716e440-22df-4155-8a71-9ed975379b19 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:15:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1716e440-22df-4155-8a71-9ed975379b19 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1775c01f
2021-06-04T00:15:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1716e440-22df-4155-8a71-9ed975379b19 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:15:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1716e440-22df-4155-8a71-9ed975379b19 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:15:07.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9707a979-43f2-4a15-8e0e-12d84da90311 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:15:07.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9707a979-43f2-4a15-8e0e-12d84da90311 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a417c34
2021-06-04T00:15:07.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9707a979-43f2-4a15-8e0e-12d84da90311 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:15:07.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9707a979-43f2-4a15-8e0e-12d84da90311 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:15:10.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afb70e8a-51e7-424d-adb9-64b292a11308 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:15:10.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afb70e8a-51e7-424d-adb9-64b292a11308 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3349ce5e
2021-06-04T00:15:10.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afb70e8a-51e7-424d-adb9-64b292a11308 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:15:10.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afb70e8a-51e7-424d-adb9-64b292a11308 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:15:13.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3db4991-5649-4ac6-9057-439b7da3cc38 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:15:13.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3db4991-5649-4ac6-9057-439b7da3cc38 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30381a05
2021-06-04T00:15:13.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3db4991-5649-4ac6-9057-439b7da3cc38 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:15:13.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3db4991-5649-4ac6-9057-439b7da3cc38 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:15:16.969Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e65ae82-7b86-4ee4-ba68-0d0421ce9676 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:15:16.969Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e65ae82-7b86-4ee4-ba68-0d0421ce9676 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9f44125
2021-06-04T00:15:16.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e65ae82-7b86-4ee4-ba68-0d0421ce9676 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:15:16.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e65ae82-7b86-4ee4-ba68-0d0421ce9676 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:15:19.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc5eaf7a-073b-4ae4-aa33-2f6f1b2995c4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:15:19.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc5eaf7a-073b-4ae4-aa33-2f6f1b2995c4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@78a53cf3
2021-06-04T00:15:19.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc5eaf7a-073b-4ae4-aa33-2f6f1b2995c4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:15:19.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc5eaf7a-073b-4ae4-aa33-2f6f1b2995c4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:15:22.531Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b495edd0-0f7a-4d83-9233-93bef0472f8a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:15:22.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b495edd0-0f7a-4d83-9233-93bef0472f8a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e32687
2021-06-04T00:15:22.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b495edd0-0f7a-4d83-9233-93bef0472f8a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:15:22.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b495edd0-0f7a-4d83-9233-93bef0472f8a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:15:25.912Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T00:15:25.913Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:15:25.914Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:15:25.914Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:15:25.914Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:15:25.915Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:15:25.915Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:15:25.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db5a254a-6ccd-48d8-b212-e6db0b914e14 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:15:25.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db5a254a-6ccd-48d8-b212-e6db0b914e14 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@757bec0c
2021-06-04T00:15:25.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db5a254a-6ccd-48d8-b212-e6db0b914e14 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:15:25.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db5a254a-6ccd-48d8-b212-e6db0b914e14 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:15:29.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47336aa4-d4f6-434d-a5c8-39cf110fc279 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:15:29.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47336aa4-d4f6-434d-a5c8-39cf110fc279 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e2d66ef
2021-06-04T00:15:29.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47336aa4-d4f6-434d-a5c8-39cf110fc279 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:15:29.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47336aa4-d4f6-434d-a5c8-39cf110fc279 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:15:31.493Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa01bce2-3150-4dd0-8b75-edc59bf669fe PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:15:31.493Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa01bce2-3150-4dd0-8b75-edc59bf669fe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@fbe8b7d
2021-06-04T00:15:31.493Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa01bce2-3150-4dd0-8b75-edc59bf669fe PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:15:31.494Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa01bce2-3150-4dd0-8b75-edc59bf669fe PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:15:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e77433cc-d246-4503-b7ed-1b6d324da509 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:15:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e77433cc-d246-4503-b7ed-1b6d324da509 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@13f55313
2021-06-04T00:15:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e77433cc-d246-4503-b7ed-1b6d324da509 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:15:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e77433cc-d246-4503-b7ed-1b6d324da509 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:15:37.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6a8cb0c-e8bf-4a00-8b3d-7c9a780ff780 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:15:37.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6a8cb0c-e8bf-4a00-8b3d-7c9a780ff780 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@39c4c6ed
2021-06-04T00:15:37.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6a8cb0c-e8bf-4a00-8b3d-7c9a780ff780 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:15:37.879Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6a8cb0c-e8bf-4a00-8b3d-7c9a780ff780 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:15:40.248Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T00:15:40.251Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:15:40.685Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52bdeb3c-29b5-4171-8c33-0f3c6046565f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:15:40.685Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52bdeb3c-29b5-4171-8c33-0f3c6046565f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@cebc524
2021-06-04T00:15:40.685Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52bdeb3c-29b5-4171-8c33-0f3c6046565f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:15:40.685Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52bdeb3c-29b5-4171-8c33-0f3c6046565f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:15:43.925Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18c95e71-1cb7-4a48-b1bd-fa86d92224ea PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:15:43.925Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18c95e71-1cb7-4a48-b1bd-fa86d92224ea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@777542a7
2021-06-04T00:15:43.925Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18c95e71-1cb7-4a48-b1bd-fa86d92224ea PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:15:43.926Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18c95e71-1cb7-4a48-b1bd-fa86d92224ea PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:15:46.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a134d204-69a2-4150-b422-d670da020db1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:15:46.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a134d204-69a2-4150-b422-d670da020db1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ea1ea91
2021-06-04T00:15:46.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a134d204-69a2-4150-b422-d670da020db1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:15:46.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a134d204-69a2-4150-b422-d670da020db1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:15:50.274Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=914e9620-e268-4125-b5b8-bb30783e5acf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:15:50.274Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=914e9620-e268-4125-b5b8-bb30783e5acf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@514dae06
2021-06-04T00:15:50.275Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=914e9620-e268-4125-b5b8-bb30783e5acf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:15:50.275Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=914e9620-e268-4125-b5b8-bb30783e5acf PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:15:52.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab74a191-b008-472f-83ae-a280fe3cd11e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:15:52.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab74a191-b008-472f-83ae-a280fe3cd11e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3dd93ee
2021-06-04T00:15:52.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab74a191-b008-472f-83ae-a280fe3cd11e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:15:52.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab74a191-b008-472f-83ae-a280fe3cd11e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:15:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99097cf3-607f-4309-b03c-d2fa01658448 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:15:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99097cf3-607f-4309-b03c-d2fa01658448 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e609948
2021-06-04T00:15:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99097cf3-607f-4309-b03c-d2fa01658448 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:15:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99097cf3-607f-4309-b03c-d2fa01658448 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:15:59.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27da42dc-a4eb-49fa-b328-c0523764c3a6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:15:59.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27da42dc-a4eb-49fa-b328-c0523764c3a6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f540577
2021-06-04T00:15:59.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27da42dc-a4eb-49fa-b328-c0523764c3a6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:15:59.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27da42dc-a4eb-49fa-b328-c0523764c3a6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:16:01.523Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=baa3e187-79b6-4a56-acd0-5722c5f9a880 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:16:01.523Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=baa3e187-79b6-4a56-acd0-5722c5f9a880 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23d5b505
2021-06-04T00:16:01.523Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=baa3e187-79b6-4a56-acd0-5722c5f9a880 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:16:01.523Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=baa3e187-79b6-4a56-acd0-5722c5f9a880 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:16:05.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d51db053-9ca6-41d7-b8a2-e529275ac785 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:16:05.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d51db053-9ca6-41d7-b8a2-e529275ac785 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4cf81072
2021-06-04T00:16:05.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d51db053-9ca6-41d7-b8a2-e529275ac785 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:16:05.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d51db053-9ca6-41d7-b8a2-e529275ac785 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:16:07.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=589e62cc-2869-4053-a1b9-6cda0ff9a01e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:16:07.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=589e62cc-2869-4053-a1b9-6cda0ff9a01e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@16086a7c
2021-06-04T00:16:07.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=589e62cc-2869-4053-a1b9-6cda0ff9a01e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:16:07.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=589e62cc-2869-4053-a1b9-6cda0ff9a01e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:16:10.789Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0927a112-0224-4cfd-8745-11952e9569e9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:16:10.789Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0927a112-0224-4cfd-8745-11952e9569e9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2948aa77
2021-06-04T00:16:10.789Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0927a112-0224-4cfd-8745-11952e9569e9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:16:10.789Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0927a112-0224-4cfd-8745-11952e9569e9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:16:13.738Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c74fc136-4c8a-4e37-9d12-bbcc6f5d55f7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:16:13.738Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c74fc136-4c8a-4e37-9d12-bbcc6f5d55f7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27bb4fc6
2021-06-04T00:16:13.738Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c74fc136-4c8a-4e37-9d12-bbcc6f5d55f7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:16:13.738Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c74fc136-4c8a-4e37-9d12-bbcc6f5d55f7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:16:16.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10868f47-a3da-4249-b985-68075306eb93 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:16:16.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10868f47-a3da-4249-b985-68075306eb93 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b4ca0c3
2021-06-04T00:16:16.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10868f47-a3da-4249-b985-68075306eb93 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:16:16.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10868f47-a3da-4249-b985-68075306eb93 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:16:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04a1a8fc-23fa-4bcd-a4ae-eb5f180173aa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:16:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04a1a8fc-23fa-4bcd-a4ae-eb5f180173aa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e42745c
2021-06-04T00:16:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04a1a8fc-23fa-4bcd-a4ae-eb5f180173aa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:16:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04a1a8fc-23fa-4bcd-a4ae-eb5f180173aa PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:16:22.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7895e37-8dd0-43ee-b2e8-4c97132c08a3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:16:22.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7895e37-8dd0-43ee-b2e8-4c97132c08a3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@123572f1
2021-06-04T00:16:22.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7895e37-8dd0-43ee-b2e8-4c97132c08a3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:16:22.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7895e37-8dd0-43ee-b2e8-4c97132c08a3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:16:25.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09d2bd7d-449d-4bca-aeeb-7614f0073416 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:16:25.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09d2bd7d-449d-4bca-aeeb-7614f0073416 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f8dca0e
2021-06-04T00:16:25.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09d2bd7d-449d-4bca-aeeb-7614f0073416 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:16:25.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09d2bd7d-449d-4bca-aeeb-7614f0073416 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:16:29.179Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=535772a4-0229-40b5-a1f6-7c60eb5e028a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:16:29.179Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=535772a4-0229-40b5-a1f6-7c60eb5e028a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@21893584
2021-06-04T00:16:29.179Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=535772a4-0229-40b5-a1f6-7c60eb5e028a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:16:29.179Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=535772a4-0229-40b5-a1f6-7c60eb5e028a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:16:31.454Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d1ea86b-e180-41e9-a161-8bbf7747cd9a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:16:31.454Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d1ea86b-e180-41e9-a161-8bbf7747cd9a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c04457d
2021-06-04T00:16:31.454Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d1ea86b-e180-41e9-a161-8bbf7747cd9a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:16:31.454Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d1ea86b-e180-41e9-a161-8bbf7747cd9a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:16:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14b19b3c-9715-47be-b4c2-76edddcb8dca PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:16:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14b19b3c-9715-47be-b4c2-76edddcb8dca PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@751f14f6
2021-06-04T00:16:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14b19b3c-9715-47be-b4c2-76edddcb8dca PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:16:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14b19b3c-9715-47be-b4c2-76edddcb8dca PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:16:38.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd74fbed-002b-490e-ae8f-e860af9731cd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:16:38.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd74fbed-002b-490e-ae8f-e860af9731cd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74c36de1
2021-06-04T00:16:38.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd74fbed-002b-490e-ae8f-e860af9731cd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:16:38.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd74fbed-002b-490e-ae8f-e860af9731cd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:16:40.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2adaa840-cb83-4315-9708-e327066e6198 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:16:40.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2adaa840-cb83-4315-9708-e327066e6198 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c8e43e8
2021-06-04T00:16:40.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2adaa840-cb83-4315-9708-e327066e6198 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:16:40.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2adaa840-cb83-4315-9708-e327066e6198 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:16:43.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed93a6f8-60e9-44b7-8f91-a20af12e8a55 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:16:43.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed93a6f8-60e9-44b7-8f91-a20af12e8a55 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@72cfd2a9
2021-06-04T00:16:43.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed93a6f8-60e9-44b7-8f91-a20af12e8a55 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:16:43.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed93a6f8-60e9-44b7-8f91-a20af12e8a55 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:16:46.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9782d3dc-99a6-4882-82c7-e1ab2265fe2b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:16:46.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9782d3dc-99a6-4882-82c7-e1ab2265fe2b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f7ad0a2
2021-06-04T00:16:46.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9782d3dc-99a6-4882-82c7-e1ab2265fe2b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:16:46.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9782d3dc-99a6-4882-82c7-e1ab2265fe2b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:16:50.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a84f6de8-8247-4dd5-93a6-216559192c61 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:16:50.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a84f6de8-8247-4dd5-93a6-216559192c61 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@103906c9
2021-06-04T00:16:50.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a84f6de8-8247-4dd5-93a6-216559192c61 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:16:50.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a84f6de8-8247-4dd5-93a6-216559192c61 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:16:52.527Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d17eccd-e30a-458c-8a1d-ea872244c9d8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:16:52.527Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d17eccd-e30a-458c-8a1d-ea872244c9d8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e469625
2021-06-04T00:16:52.527Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d17eccd-e30a-458c-8a1d-ea872244c9d8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:16:52.527Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d17eccd-e30a-458c-8a1d-ea872244c9d8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:16:55.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8c594f1-27b3-41f8-8041-30658652110c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:16:55.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8c594f1-27b3-41f8-8041-30658652110c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@729049de
2021-06-04T00:16:55.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8c594f1-27b3-41f8-8041-30658652110c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:16:55.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8c594f1-27b3-41f8-8041-30658652110c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:16:58.876Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54e51cb8-8878-42a4-bf14-2aeb13f2156b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:16:58.876Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54e51cb8-8878-42a4-bf14-2aeb13f2156b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b4678ee
2021-06-04T00:16:58.876Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54e51cb8-8878-42a4-bf14-2aeb13f2156b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:16:58.876Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54e51cb8-8878-42a4-bf14-2aeb13f2156b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:17:01.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65c223d5-bbdf-43db-b38f-ebebbf2f71c1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:17:01.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65c223d5-bbdf-43db-b38f-ebebbf2f71c1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3913201
2021-06-04T00:17:01.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65c223d5-bbdf-43db-b38f-ebebbf2f71c1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:17:01.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65c223d5-bbdf-43db-b38f-ebebbf2f71c1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:17:04.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b41ece41-c785-4cba-8000-f93f1e169d3b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:17:04.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b41ece41-c785-4cba-8000-f93f1e169d3b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49ac6be8
2021-06-04T00:17:04.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b41ece41-c785-4cba-8000-f93f1e169d3b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:17:04.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b41ece41-c785-4cba-8000-f93f1e169d3b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:17:07.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7baed47c-27df-458b-8d58-0cb947c8f7fd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:17:07.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7baed47c-27df-458b-8d58-0cb947c8f7fd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@398205ba
2021-06-04T00:17:07.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7baed47c-27df-458b-8d58-0cb947c8f7fd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:17:07.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7baed47c-27df-458b-8d58-0cb947c8f7fd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:17:10.694Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9673bc6f-6da1-43f7-ad40-ec1d3f692b44 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:17:10.694Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9673bc6f-6da1-43f7-ad40-ec1d3f692b44 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@516b9b6c
2021-06-04T00:17:10.694Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9673bc6f-6da1-43f7-ad40-ec1d3f692b44 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:17:10.694Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9673bc6f-6da1-43f7-ad40-ec1d3f692b44 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:17:13.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57ad11e9-17c1-4702-9e66-fadbba1efe7f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:17:13.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57ad11e9-17c1-4702-9e66-fadbba1efe7f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b60ba7a
2021-06-04T00:17:13.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57ad11e9-17c1-4702-9e66-fadbba1efe7f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:17:13.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57ad11e9-17c1-4702-9e66-fadbba1efe7f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:17:16.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9708eaf3-4937-437e-a68a-91808b2069bd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:17:16.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9708eaf3-4937-437e-a68a-91808b2069bd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71b979d5
2021-06-04T00:17:16.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9708eaf3-4937-437e-a68a-91808b2069bd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:17:16.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9708eaf3-4937-437e-a68a-91808b2069bd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:17:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39a581ab-14ee-4451-8781-5ba03529796b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:17:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39a581ab-14ee-4451-8781-5ba03529796b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58bf1d8d
2021-06-04T00:17:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39a581ab-14ee-4451-8781-5ba03529796b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:17:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39a581ab-14ee-4451-8781-5ba03529796b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:17:22.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2c2ce0e-7c84-4aae-b8cd-08cb39cefea0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:17:22.451Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2c2ce0e-7c84-4aae-b8cd-08cb39cefea0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@55825d0d
2021-06-04T00:17:22.451Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2c2ce0e-7c84-4aae-b8cd-08cb39cefea0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:17:22.451Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2c2ce0e-7c84-4aae-b8cd-08cb39cefea0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:17:26.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0f2e64f-66e3-4401-957a-c9e3f6ef76bf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:17:26.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0f2e64f-66e3-4401-957a-c9e3f6ef76bf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@bef9ead
2021-06-04T00:17:26.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0f2e64f-66e3-4401-957a-c9e3f6ef76bf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:17:26.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0f2e64f-66e3-4401-957a-c9e3f6ef76bf PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:17:29.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=498e6fb3-ca6b-4d1f-9b7c-fe9303d56574 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:17:29.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=498e6fb3-ca6b-4d1f-9b7c-fe9303d56574 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@31a239d4
2021-06-04T00:17:29.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=498e6fb3-ca6b-4d1f-9b7c-fe9303d56574 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:17:29.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=498e6fb3-ca6b-4d1f-9b7c-fe9303d56574 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:17:31.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50b472f3-3156-4516-b174-4862d7bc4c4c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:17:31.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50b472f3-3156-4516-b174-4862d7bc4c4c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@11511918
2021-06-04T00:17:31.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50b472f3-3156-4516-b174-4862d7bc4c4c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:17:31.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50b472f3-3156-4516-b174-4862d7bc4c4c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:17:34.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67151fe4-dd70-42e9-a5eb-3463d1b1026a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:17:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67151fe4-dd70-42e9-a5eb-3463d1b1026a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@56fc540a
2021-06-04T00:17:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67151fe4-dd70-42e9-a5eb-3463d1b1026a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:17:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67151fe4-dd70-42e9-a5eb-3463d1b1026a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:17:36.984Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T00:17:36.984Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:17:36.985Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:17:36.985Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:17:36.985Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:17:36.985Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:17:36.985Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:17:38.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6867905b-91d6-48a3-aab7-b0a39b43520c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:17:38.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6867905b-91d6-48a3-aab7-b0a39b43520c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2191b28e
2021-06-04T00:17:38.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6867905b-91d6-48a3-aab7-b0a39b43520c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:17:38.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6867905b-91d6-48a3-aab7-b0a39b43520c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:17:40.692Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4677ed43-4558-4a1d-a9a4-2eff06cb4ade PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:17:40.692Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4677ed43-4558-4a1d-a9a4-2eff06cb4ade PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1dd43f1
2021-06-04T00:17:40.692Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4677ed43-4558-4a1d-a9a4-2eff06cb4ade PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:17:40.692Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4677ed43-4558-4a1d-a9a4-2eff06cb4ade PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:17:43.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b18e698-2f4c-4a1a-bdb2-24c7d7b5623b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:17:43.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b18e698-2f4c-4a1a-bdb2-24c7d7b5623b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@185d030b
2021-06-04T00:17:43.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b18e698-2f4c-4a1a-bdb2-24c7d7b5623b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:17:43.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b18e698-2f4c-4a1a-bdb2-24c7d7b5623b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:17:46.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=965dc6c0-0424-440b-b0e1-2de638f11787 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:17:46.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=965dc6c0-0424-440b-b0e1-2de638f11787 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2cb5580e
2021-06-04T00:17:46.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=965dc6c0-0424-440b-b0e1-2de638f11787 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:17:46.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=965dc6c0-0424-440b-b0e1-2de638f11787 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:17:49.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=097e968e-3a5b-4053-8f63-29cc1f47beaf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:17:49.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=097e968e-3a5b-4053-8f63-29cc1f47beaf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c8ad4
2021-06-04T00:17:49.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=097e968e-3a5b-4053-8f63-29cc1f47beaf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:17:49.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=097e968e-3a5b-4053-8f63-29cc1f47beaf PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:17:51.320Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T00:17:51.322Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:17:52.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ea65303-88e3-4813-a4b4-93874d894fa3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:17:52.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ea65303-88e3-4813-a4b4-93874d894fa3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b3583ed
2021-06-04T00:17:52.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ea65303-88e3-4813-a4b4-93874d894fa3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:17:52.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ea65303-88e3-4813-a4b4-93874d894fa3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:17:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11c9ff40-6141-449e-be90-019457886b37 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:17:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11c9ff40-6141-449e-be90-019457886b37 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b8080db
2021-06-04T00:17:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11c9ff40-6141-449e-be90-019457886b37 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:17:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11c9ff40-6141-449e-be90-019457886b37 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:17:59.075Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c05a5b37-783e-481d-b0bc-ace998b64052 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:17:59.075Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c05a5b37-783e-481d-b0bc-ace998b64052 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1df3de8d
2021-06-04T00:17:59.075Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c05a5b37-783e-481d-b0bc-ace998b64052 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:17:59.075Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c05a5b37-783e-481d-b0bc-ace998b64052 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:18:01.451Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28f2b58a-9ea3-4fcc-97b5-025f5a4e4e9c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:18:01.452Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28f2b58a-9ea3-4fcc-97b5-025f5a4e4e9c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@795dbdcd
2021-06-04T00:18:01.452Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28f2b58a-9ea3-4fcc-97b5-025f5a4e4e9c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:18:01.452Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28f2b58a-9ea3-4fcc-97b5-025f5a4e4e9c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:18:04.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a622acd-99c6-4e55-892f-0cc65330d5b5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:18:04.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a622acd-99c6-4e55-892f-0cc65330d5b5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e3063e0
2021-06-04T00:18:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a622acd-99c6-4e55-892f-0cc65330d5b5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:18:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a622acd-99c6-4e55-892f-0cc65330d5b5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:18:07.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c66179b-755b-4b78-ad80-7bbd41bfa500 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:18:07.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c66179b-755b-4b78-ad80-7bbd41bfa500 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@21a9aaa5
2021-06-04T00:18:07.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c66179b-755b-4b78-ad80-7bbd41bfa500 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:18:07.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c66179b-755b-4b78-ad80-7bbd41bfa500 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:18:10.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78ee502b-72a2-4bb0-b175-54a91fe464ea PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:18:10.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78ee502b-72a2-4bb0-b175-54a91fe464ea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@222d0fab
2021-06-04T00:18:10.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78ee502b-72a2-4bb0-b175-54a91fe464ea PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:18:10.779Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78ee502b-72a2-4bb0-b175-54a91fe464ea PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:18:13.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b5b073c-092b-4677-a64b-8361bfa5a15d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:18:13.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b5b073c-092b-4677-a64b-8361bfa5a15d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@368a6df6
2021-06-04T00:18:13.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b5b073c-092b-4677-a64b-8361bfa5a15d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:18:13.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b5b073c-092b-4677-a64b-8361bfa5a15d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:18:16.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80bc9f89-f263-400c-b0e6-4075144dbab0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:18:16.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80bc9f89-f263-400c-b0e6-4075144dbab0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b9827a4
2021-06-04T00:18:16.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80bc9f89-f263-400c-b0e6-4075144dbab0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:18:16.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80bc9f89-f263-400c-b0e6-4075144dbab0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:18:20.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ae6d68e-9891-4731-a1ca-d9db017a7b52 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:18:20.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ae6d68e-9891-4731-a1ca-d9db017a7b52 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@678858f0
2021-06-04T00:18:20.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ae6d68e-9891-4731-a1ca-d9db017a7b52 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:18:20.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ae6d68e-9891-4731-a1ca-d9db017a7b52 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:18:20.671Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0qbcin8u223a81nfqn21jxi3ec530
2021-06-04T00:18:20.672Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node014ome6l4k04h07el24ybmszz2523
2021-06-04T00:18:20.672Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node019oilgq8sd3vt25ih7rh8eqeq525
2021-06-04T00:18:20.672Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node019w7el2uk948y12xojw8irnaap528
2021-06-04T00:18:20.672Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01bkgysfwlq2olumjrh7r4il92531
2021-06-04T00:18:20.672Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01bo8qrh0x2g271x8qvzt6fged0526
2021-06-04T00:18:20.672Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01nexq4a83wsqeg05wapi2h0z4532
2021-06-04T00:18:20.672Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01t2x8apmuox3s1y1kgtwk4887c527
2021-06-04T00:18:20.672Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0o2v55pzaqulc91vkc2tnngc1529
2021-06-04T00:18:20.672Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0uvu1yunxz8o1evzdebbc18i1524
2021-06-04T00:18:22.489Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad0ba45c-3461-44f6-a554-69a08bca9ead PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:18:22.489Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad0ba45c-3461-44f6-a554-69a08bca9ead PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d9243fd
2021-06-04T00:18:22.489Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad0ba45c-3461-44f6-a554-69a08bca9ead PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:18:22.489Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad0ba45c-3461-44f6-a554-69a08bca9ead PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:18:25.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62ad9ba5-f4e0-42ad-95ca-95a4d00084d3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:18:25.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62ad9ba5-f4e0-42ad-95ca-95a4d00084d3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@48126e64
2021-06-04T00:18:25.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62ad9ba5-f4e0-42ad-95ca-95a4d00084d3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:18:25.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62ad9ba5-f4e0-42ad-95ca-95a4d00084d3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:18:29.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c3d916d-d1fc-46ee-8011-cd070f238cbf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:18:29.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c3d916d-d1fc-46ee-8011-cd070f238cbf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27dd5c5
2021-06-04T00:18:29.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c3d916d-d1fc-46ee-8011-cd070f238cbf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:18:29.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c3d916d-d1fc-46ee-8011-cd070f238cbf PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:18:31.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7274098b-d4f5-4915-8569-02d7b97007ba PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:18:31.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7274098b-d4f5-4915-8569-02d7b97007ba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@279742a2
2021-06-04T00:18:31.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7274098b-d4f5-4915-8569-02d7b97007ba PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:18:31.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7274098b-d4f5-4915-8569-02d7b97007ba PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:18:34.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8eb3b08f-9c09-4540-a37a-842def0d77a0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:18:34.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8eb3b08f-9c09-4540-a37a-842def0d77a0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@18257006
2021-06-04T00:18:34.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8eb3b08f-9c09-4540-a37a-842def0d77a0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:18:34.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8eb3b08f-9c09-4540-a37a-842def0d77a0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:18:38.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44ca5f7e-de31-4130-a97b-2034e36d391c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:18:38.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44ca5f7e-de31-4130-a97b-2034e36d391c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@431f4c28
2021-06-04T00:18:38.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44ca5f7e-de31-4130-a97b-2034e36d391c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:18:38.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44ca5f7e-de31-4130-a97b-2034e36d391c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:18:40.785Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07741676-7ef8-4d4b-bbe0-df57610b34b1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:18:40.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07741676-7ef8-4d4b-bbe0-df57610b34b1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f207a73
2021-06-04T00:18:40.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07741676-7ef8-4d4b-bbe0-df57610b34b1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:18:40.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07741676-7ef8-4d4b-bbe0-df57610b34b1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:18:43.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6911e7ca-a491-469a-b3a3-d10028bdc559 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:18:43.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6911e7ca-a491-469a-b3a3-d10028bdc559 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@32bfaf67
2021-06-04T00:18:43.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6911e7ca-a491-469a-b3a3-d10028bdc559 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:18:43.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6911e7ca-a491-469a-b3a3-d10028bdc559 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:18:46.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbb84925-82e0-4dd4-9392-e8ad4d859a80 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:18:46.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbb84925-82e0-4dd4-9392-e8ad4d859a80 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a94c76
2021-06-04T00:18:46.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbb84925-82e0-4dd4-9392-e8ad4d859a80 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:18:46.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbb84925-82e0-4dd4-9392-e8ad4d859a80 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:18:50.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79d5dd58-eb07-4aae-b80f-7dac7c83c44e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:18:50.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79d5dd58-eb07-4aae-b80f-7dac7c83c44e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38ee2e67
2021-06-04T00:18:50.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79d5dd58-eb07-4aae-b80f-7dac7c83c44e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:18:50.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79d5dd58-eb07-4aae-b80f-7dac7c83c44e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:18:52.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ff7e851-e699-4c23-a4cc-bbcdbe07fc39 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:18:52.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ff7e851-e699-4c23-a4cc-bbcdbe07fc39 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@143128eb
2021-06-04T00:18:52.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ff7e851-e699-4c23-a4cc-bbcdbe07fc39 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:18:52.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ff7e851-e699-4c23-a4cc-bbcdbe07fc39 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:18:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1808534d-3276-4bbe-b19a-f728322ddb4d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:18:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1808534d-3276-4bbe-b19a-f728322ddb4d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b3a699d
2021-06-04T00:18:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1808534d-3276-4bbe-b19a-f728322ddb4d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:18:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1808534d-3276-4bbe-b19a-f728322ddb4d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:18:58.877Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=476a0293-3b41-4814-9e43-35b516948f5f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:18:58.877Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=476a0293-3b41-4814-9e43-35b516948f5f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@103b5470
2021-06-04T00:18:58.877Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=476a0293-3b41-4814-9e43-35b516948f5f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:18:58.877Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=476a0293-3b41-4814-9e43-35b516948f5f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:19:01.464Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed4a82a9-6a27-4c89-82ea-1e6b21ba7940 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:19:01.464Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed4a82a9-6a27-4c89-82ea-1e6b21ba7940 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@596fcd06
2021-06-04T00:19:01.464Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed4a82a9-6a27-4c89-82ea-1e6b21ba7940 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:19:01.464Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed4a82a9-6a27-4c89-82ea-1e6b21ba7940 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:19:04.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bce96242-73da-46c9-a3e6-c73e7cad9819 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:19:04.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bce96242-73da-46c9-a3e6-c73e7cad9819 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4404c0b0
2021-06-04T00:19:04.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bce96242-73da-46c9-a3e6-c73e7cad9819 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:19:04.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bce96242-73da-46c9-a3e6-c73e7cad9819 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:19:08.079Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d92b0469-0219-4b51-a46e-bf2595bb994d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:19:08.079Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d92b0469-0219-4b51-a46e-bf2595bb994d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4cfa3f2c
2021-06-04T00:19:08.079Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d92b0469-0219-4b51-a46e-bf2595bb994d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:19:08.079Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d92b0469-0219-4b51-a46e-bf2595bb994d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:19:10.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e9abaf9-2548-49cd-9e88-db21e682bc9a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:19:10.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e9abaf9-2548-49cd-9e88-db21e682bc9a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6286a17
2021-06-04T00:19:10.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e9abaf9-2548-49cd-9e88-db21e682bc9a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:19:10.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e9abaf9-2548-49cd-9e88-db21e682bc9a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:19:13.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7c2fc14-c68d-459c-8777-38e0a53927bf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:19:13.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7c2fc14-c68d-459c-8777-38e0a53927bf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@21088029
2021-06-04T00:19:13.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7c2fc14-c68d-459c-8777-38e0a53927bf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:19:13.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7c2fc14-c68d-459c-8777-38e0a53927bf PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:19:16.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3ae1e58-ece1-412f-8d1a-a4362afb90c8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:19:16.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3ae1e58-ece1-412f-8d1a-a4362afb90c8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@436bd5f8
2021-06-04T00:19:16.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3ae1e58-ece1-412f-8d1a-a4362afb90c8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:19:16.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3ae1e58-ece1-412f-8d1a-a4362afb90c8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:19:20.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5202abb-1546-48fc-867d-0dbb2f150ec8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:19:20.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5202abb-1546-48fc-867d-0dbb2f150ec8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e7591e6
2021-06-04T00:19:20.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5202abb-1546-48fc-867d-0dbb2f150ec8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:19:20.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5202abb-1546-48fc-867d-0dbb2f150ec8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:19:22.523Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d39df82-776f-4f61-a1f7-6c181fa0db7a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:19:22.523Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d39df82-776f-4f61-a1f7-6c181fa0db7a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1bc820ed
2021-06-04T00:19:22.523Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d39df82-776f-4f61-a1f7-6c181fa0db7a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:19:22.523Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d39df82-776f-4f61-a1f7-6c181fa0db7a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:19:26.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b63c4b46-8ac8-4f87-be62-00f5ea62a6db PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:19:26.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b63c4b46-8ac8-4f87-be62-00f5ea62a6db PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e24e275
2021-06-04T00:19:26.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b63c4b46-8ac8-4f87-be62-00f5ea62a6db PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:19:26.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b63c4b46-8ac8-4f87-be62-00f5ea62a6db PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:19:29.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=491819d9-6ff5-4493-b71f-baec69c31e83 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:19:29.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=491819d9-6ff5-4493-b71f-baec69c31e83 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@637d2c5c
2021-06-04T00:19:29.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=491819d9-6ff5-4493-b71f-baec69c31e83 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:19:29.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=491819d9-6ff5-4493-b71f-baec69c31e83 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:19:31.462Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd250808-f602-4219-9bda-758aa2d6c764 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:19:31.463Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd250808-f602-4219-9bda-758aa2d6c764 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@11f57b74
2021-06-04T00:19:31.463Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd250808-f602-4219-9bda-758aa2d6c764 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:19:31.463Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd250808-f602-4219-9bda-758aa2d6c764 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:19:34.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=045b8a49-5533-49e6-83cd-8686a529d7f7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:19:34.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=045b8a49-5533-49e6-83cd-8686a529d7f7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b60feef
2021-06-04T00:19:34.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=045b8a49-5533-49e6-83cd-8686a529d7f7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:19:34.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=045b8a49-5533-49e6-83cd-8686a529d7f7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:19:37.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab08c464-8e51-44bf-83ea-fac15da69411 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:19:37.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab08c464-8e51-44bf-83ea-fac15da69411 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@128e8abc
2021-06-04T00:19:37.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab08c464-8e51-44bf-83ea-fac15da69411 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:19:37.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab08c464-8e51-44bf-83ea-fac15da69411 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:19:40.776Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8087b62d-cebc-4ce8-898e-5a2b8162599b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:19:40.776Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8087b62d-cebc-4ce8-898e-5a2b8162599b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@181b4b7d
2021-06-04T00:19:40.776Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8087b62d-cebc-4ce8-898e-5a2b8162599b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:19:40.776Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8087b62d-cebc-4ce8-898e-5a2b8162599b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:19:43.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa59176a-ee34-40df-9df6-7b8d94a930b4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:19:43.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa59176a-ee34-40df-9df6-7b8d94a930b4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@228fbdd1
2021-06-04T00:19:43.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa59176a-ee34-40df-9df6-7b8d94a930b4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:19:43.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa59176a-ee34-40df-9df6-7b8d94a930b4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:19:46.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f51e6565-ceb8-42e9-aa2b-c04314aafa89 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:19:46.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f51e6565-ceb8-42e9-aa2b-c04314aafa89 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e54b8e9
2021-06-04T00:19:46.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f51e6565-ceb8-42e9-aa2b-c04314aafa89 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:19:46.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f51e6565-ceb8-42e9-aa2b-c04314aafa89 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:19:48.057Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T00:19:48.058Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:19:48.059Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:19:48.059Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:19:48.059Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:19:48.060Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:19:48.060Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:19:49.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eba0590e-b8e7-49ef-84f7-88c1c158892c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:19:49.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eba0590e-b8e7-49ef-84f7-88c1c158892c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@86914f5
2021-06-04T00:19:49.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eba0590e-b8e7-49ef-84f7-88c1c158892c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:19:49.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eba0590e-b8e7-49ef-84f7-88c1c158892c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:19:52.624Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48a3ff9e-8aec-497e-9ed3-bd4b184fdd93 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:19:52.624Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48a3ff9e-8aec-497e-9ed3-bd4b184fdd93 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4aebf626
2021-06-04T00:19:52.624Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48a3ff9e-8aec-497e-9ed3-bd4b184fdd93 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:19:52.624Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48a3ff9e-8aec-497e-9ed3-bd4b184fdd93 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:19:55.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=adfee54e-cc46-4f33-b802-10683a8faf6a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:19:55.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=adfee54e-cc46-4f33-b802-10683a8faf6a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1555bb9f
2021-06-04T00:19:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=adfee54e-cc46-4f33-b802-10683a8faf6a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:19:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=adfee54e-cc46-4f33-b802-10683a8faf6a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:19:58.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50af3620-a108-4a7f-9023-7726fe4669bf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:19:58.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50af3620-a108-4a7f-9023-7726fe4669bf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e8dda2c
2021-06-04T00:19:58.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50af3620-a108-4a7f-9023-7726fe4669bf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:19:58.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50af3620-a108-4a7f-9023-7726fe4669bf PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:19:59.031Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://message-router.onap:3904: The target server failed to respond
2021-06-04T00:19:59.031Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:19:59.034Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:19:59.034Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:19:59.035Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:19:59.035Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:19:59.035Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:19:59.035Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:19:59.035Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:19:59.035Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:19:59.035Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:19:59.036Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:19:59.036Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:19:59.036Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:19:59.036Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:19:59.036Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:19:59.037Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:19:59.037Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:19:59.038Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:19:59.038Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:19:59.039Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:19:59.039Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:19:59.039Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:19:59.039Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:19:59.039Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:19:59.040Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:19:59.040Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:19:59.040Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:19:59.040Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:19:59.040Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:19:59.040Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:19:59.040Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:19:59.041Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:19:59.041Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:19:59.041Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:19:59.041Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:19:59.041Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:19:59.042Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:19:59.042Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:19:59.045Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:19:59.045Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:19:59.045Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:19:59.047Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:19:59.047Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:19:59.047Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:19:59.047Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:19:59.051Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:19:59.051Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:19:59.051Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:19:59.051Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:19:59.051Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:19:59.064Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:19:59.064Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:19:59.067Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:19:59.068Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:19:59.068Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:19:59.068Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:19:59.068Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:19:59.068Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:19:59.068Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:19:59.073Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:19:59.074Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:19:59.074Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:19:59.074Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:19:59.074Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:19:59.074Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:19:59.074Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:19:59.075Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:19:59.075Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:19:59.075Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:19:59.075Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:19:59.075Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:19:59.075Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:19:59.075Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:19:59.076Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:19:59.076Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:19:59.076Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:19:59.076Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:19:59.076Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:19:59.077Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:19:59.077Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:19:59.077Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:19:59.077Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:19:59.078Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:19:59.078Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:19:59.078Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:19:59.078Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:19:59.078Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:19:59.079Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:19:59.079Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:19:59.079Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:19:59.079Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:19:59.079Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:19:59.079Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:19:59.079Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:19:59.080Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:19:59.080Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:19:59.080Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:19:59.080Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:19:59.080Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:19:59.080Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:19:59.080Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:19:59.087Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:19:59.087Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:19:59.087Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:19:59.087Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:19:59.087Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:19:59.087Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:19:59.087Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:19:59.088Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:19:59.088Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:19:59.088Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:19:59.088Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:19:59.089Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:19:59.089Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:19:59.089Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:19:59.089Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:19:59.090Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:19:59.090Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:19:59.090Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:19:59.090Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:19:59.090Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:19:59.090Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:19:59.091Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:19:59.091Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:19:59.091Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:19:59.091Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:19:59.091Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:19:59.091Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:19:59.091Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:19:59.092Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:19:59.092Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:19:59.092Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:19:59.092Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:19:59.092Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:19:59.092Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:19:59.092Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:19:59.093Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:19:59.093Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:19:59.093Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:19:59.093Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:19:59.093Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:19:59.093Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:19:59.094Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:19:59.094Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:19:59.094Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:19:59.095Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:19:59.095Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:19:59.095Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:19:59.095Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:19:59.095Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:19:59.096Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:19:59.096Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:19:59.096Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:20:01.480Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2c7380a-f53b-4555-996e-3d6e45656a4a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:20:01.480Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2c7380a-f53b-4555-996e-3d6e45656a4a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e03a3b4
2021-06-04T00:20:01.480Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2c7380a-f53b-4555-996e-3d6e45656a4a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:20:01.480Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2c7380a-f53b-4555-996e-3d6e45656a4a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:20:02.392Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T00:20:02.397Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.398Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.400Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.401Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.402Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.403Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.404Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.405Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.406Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.407Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.408Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.409Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.410Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.411Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.412Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.413Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.417Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.418Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.419Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.419Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.421Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.422Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.423Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.424Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.425Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.427Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.428Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.429Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.429Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.430Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.431Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.432Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.433Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.434Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.435Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.436Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.436Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.437Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.438Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.439Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.440Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.440Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.441Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.442Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.443Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.443Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.444Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.445Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.446Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.447Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.448Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.449Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.450Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.451Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.452Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.453Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.453Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.454Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.455Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.456Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.457Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.458Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.459Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.459Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.460Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.461Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.462Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.463Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.464Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.465Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.466Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.466Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.467Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.468Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.469Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.470Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.470Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.471Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.472Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.473Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.474Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.475Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.475Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.476Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.477Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.478Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.478Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.479Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.480Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.481Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.482Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.483Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.484Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.485Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.486Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.487Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.488Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.489Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.490Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.491Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.491Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.492Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.493Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.494Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.494Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.495Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.496Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.496Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.497Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.498Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.498Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.499Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.500Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.501Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.501Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.502Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.503Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.503Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.504Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.505Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.506Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.506Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.507Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.508Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.508Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.509Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.510Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.510Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.511Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.512Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.512Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.513Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.514Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.514Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.515Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.516Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.516Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.517Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.518Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.518Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.519Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.520Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.520Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.521Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.522Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.523Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.523Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.524Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.524Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.526Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.527Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.528Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.528Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.529Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.529Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.530Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.531Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.531Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.532Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.533Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.533Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.534Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.535Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.536Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.536Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.537Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.537Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.538Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.539Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.540Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.540Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.541Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.542Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.547Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.548Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.549Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.549Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.550Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.550Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.551Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.552Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.552Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.553Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.554Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.555Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.555Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.556Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.557Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.557Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.558Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.559Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.560Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.561Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.561Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.562Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.563Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.563Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.564Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.565Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.566Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.566Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.567Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.568Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.568Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.569Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.570Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.570Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.571Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.572Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.572Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.573Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.574Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.574Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.575Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.576Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.577Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.577Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.578Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.578Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.579Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.580Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.580Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.581Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.582Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.583Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.583Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.584Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.585Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.585Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.586Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.587Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.587Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.588Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.589Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.589Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.590Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.591Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.591Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.592Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.593Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.593Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.594Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.595Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.595Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.596Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.597Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.597Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.598Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.599Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.599Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.600Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.601Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.601Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.602Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.603Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.604Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.604Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.605Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.606Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.607Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.607Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.608Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.608Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.609Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.610Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.611Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.611Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.612Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.613Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.613Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.614Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.615Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.615Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.616Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.617Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.617Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.618Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.619Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.619Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.620Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.621Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.622Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.622Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.623Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.624Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.624Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.625Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.626Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.626Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.627Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.627Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.628Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.629Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.629Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.630Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.631Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.631Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.632Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.633Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.634Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.634Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.635Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.636Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.637Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.637Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.638Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.639Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.639Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.640Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.641Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.641Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.642Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.643Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.643Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.644Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.645Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.646Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.647Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.647Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.648Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.649Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.650Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.651Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.651Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.652Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.653Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.653Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.654Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.655Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.655Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.656Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.657Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.657Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.658Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.659Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.659Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.660Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.661Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.661Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.662Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.663Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.663Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.664Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.665Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.665Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.666Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.667Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.667Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.668Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.669Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.669Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.670Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.671Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.671Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.672Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.673Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.673Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.674Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.675Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.675Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.676Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.677Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.677Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.678Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.679Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.679Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.680Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.681Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.681Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.682Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.683Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.683Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.684Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.685Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.685Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.686Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.686Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.687Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.688Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.689Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.689Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.690Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.690Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.691Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.692Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.693Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.693Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.694Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.694Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.695Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.696Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.697Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.697Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.698Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.698Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.699Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.700Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.700Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.701Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.702Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.702Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.703Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.704Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.704Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.705Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.706Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.706Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.707Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.707Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.708Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.709Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.709Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.710Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.711Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.711Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.712Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.713Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.713Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.714Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.715Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.715Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.716Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.717Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.717Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.718Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.719Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.720Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.722Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.723Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.724Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.725Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.725Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.726Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.726Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.727Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.728Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.728Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.729Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.729Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.730Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.731Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.731Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.732Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.733Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.733Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.734Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.734Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.735Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.736Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.736Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.737Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.738Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.738Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.739Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.740Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.740Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.741Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.742Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.742Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.743Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.743Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.744Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.745Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.746Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.746Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.747Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.747Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.748Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.749Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.749Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.750Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.751Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.751Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.752Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.753Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.753Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.754Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.755Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.755Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.756Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.757Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.757Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.758Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.759Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.759Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.760Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.760Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.761Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.957Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.959Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:02.960Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:02.961Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18fb685f-56af-491c-9a25-513042736037 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:20:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18fb685f-56af-491c-9a25-513042736037 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@bcc3c94
2021-06-04T00:20:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18fb685f-56af-491c-9a25-513042736037 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:20:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18fb685f-56af-491c-9a25-513042736037 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:20:07.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d62bf34-75e7-48aa-a2fa-810b9c33e287 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:20:07.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d62bf34-75e7-48aa-a2fa-810b9c33e287 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@33fde731
2021-06-04T00:20:07.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d62bf34-75e7-48aa-a2fa-810b9c33e287 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:20:07.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d62bf34-75e7-48aa-a2fa-810b9c33e287 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:20:10.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5a37c807-4c7d-4b68-84bf-2bba8b3a5021 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:20:10.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5a37c807-4c7d-4b68-84bf-2bba8b3a5021 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@39107d8
2021-06-04T00:20:10.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5a37c807-4c7d-4b68-84bf-2bba8b3a5021 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:20:10.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5a37c807-4c7d-4b68-84bf-2bba8b3a5021 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:20:13.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bef09d90-788c-417f-8cbf-7b5c5e7040e8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:20:13.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bef09d90-788c-417f-8cbf-7b5c5e7040e8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@8c1a1d
2021-06-04T00:20:13.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bef09d90-788c-417f-8cbf-7b5c5e7040e8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:20:13.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bef09d90-788c-417f-8cbf-7b5c5e7040e8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:20:16.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be6ee3de-7e7d-48bc-9330-c447f31fffc9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:20:16.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be6ee3de-7e7d-48bc-9330-c447f31fffc9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6a4eae04
2021-06-04T00:20:16.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be6ee3de-7e7d-48bc-9330-c447f31fffc9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:20:16.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be6ee3de-7e7d-48bc-9330-c447f31fffc9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:20:17.722Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=be6ee3de-7e7d-48bc-9330-c447f31fffc9 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:20:17.722Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=be6ee3de-7e7d-48bc-9330-c447f31fffc9 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:20:17.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:17.952Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:17.953Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:17.954Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:20.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd61a466-8b5d-4a15-acc0-be921c89b038 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:20:20.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd61a466-8b5d-4a15-acc0-be921c89b038 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@36561813
2021-06-04T00:20:20.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd61a466-8b5d-4a15-acc0-be921c89b038 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:20:20.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd61a466-8b5d-4a15-acc0-be921c89b038 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:20:22.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b66f3c2d-2973-4f2d-bad9-ce3577979489 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:20:22.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b66f3c2d-2973-4f2d-bad9-ce3577979489 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d7276c6
2021-06-04T00:20:22.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b66f3c2d-2973-4f2d-bad9-ce3577979489 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:20:22.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b66f3c2d-2973-4f2d-bad9-ce3577979489 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:20:26.652Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=719514c3-e33e-4738-9b29-3148548efba8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:20:26.652Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=719514c3-e33e-4738-9b29-3148548efba8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d4ecf87
2021-06-04T00:20:26.652Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=719514c3-e33e-4738-9b29-3148548efba8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:20:26.652Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=719514c3-e33e-4738-9b29-3148548efba8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:20:30.752Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bec0922e-3175-40b0-bd21-e82551989e6e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:20:30.752Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bec0922e-3175-40b0-bd21-e82551989e6e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42ef64a4
2021-06-04T00:20:30.752Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bec0922e-3175-40b0-bd21-e82551989e6e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:20:30.752Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bec0922e-3175-40b0-bd21-e82551989e6e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:20:31.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c10f999d-18cf-4e14-8481-278fee3dc020 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:20:31.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c10f999d-18cf-4e14-8481-278fee3dc020 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@44ff7a6a
2021-06-04T00:20:31.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c10f999d-18cf-4e14-8481-278fee3dc020 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:20:31.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c10f999d-18cf-4e14-8481-278fee3dc020 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:20:32.955Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:32.960Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:32.961Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:32.962Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:35.191Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30eaff56-593d-47bf-a3ad-917ec94689be PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:20:35.191Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30eaff56-593d-47bf-a3ad-917ec94689be PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6a15e075
2021-06-04T00:20:35.191Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30eaff56-593d-47bf-a3ad-917ec94689be PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:20:35.191Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30eaff56-593d-47bf-a3ad-917ec94689be PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:20:38.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f4d162e-6b13-4cd8-a4a5-96c251bf3ca7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:20:38.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f4d162e-6b13-4cd8-a4a5-96c251bf3ca7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@418c3847
2021-06-04T00:20:38.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f4d162e-6b13-4cd8-a4a5-96c251bf3ca7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:20:38.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f4d162e-6b13-4cd8-a4a5-96c251bf3ca7 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:20:40.856Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f978c1bb-5538-4cfc-ba9a-3d5a34bd1548 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:20:40.856Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f978c1bb-5538-4cfc-ba9a-3d5a34bd1548 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@787fbe96
2021-06-04T00:20:40.856Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f978c1bb-5538-4cfc-ba9a-3d5a34bd1548 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:20:40.856Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f978c1bb-5538-4cfc-ba9a-3d5a34bd1548 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:20:43.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0df7ee0b-196c-4deb-85b4-5f17b8243ffb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:20:43.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0df7ee0b-196c-4deb-85b4-5f17b8243ffb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@476cb7d9
2021-06-04T00:20:43.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0df7ee0b-196c-4deb-85b4-5f17b8243ffb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:20:43.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0df7ee0b-196c-4deb-85b4-5f17b8243ffb PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:20:46.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81bf47c1-10aa-4777-b1f7-929c47a8f7bc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:20:46.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81bf47c1-10aa-4777-b1f7-929c47a8f7bc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23fe109
2021-06-04T00:20:46.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81bf47c1-10aa-4777-b1f7-929c47a8f7bc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:20:46.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81bf47c1-10aa-4777-b1f7-929c47a8f7bc PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:20:47.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:47.952Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:47.953Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:20:47.954Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:48.961Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:20:48.961Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:20:48.962Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:20:48.962Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:20:48.964Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:20:48.965Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:20:48.965Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:20:50.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d6bbda0-e50f-479c-9c49-c3d24b9e7e9b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:20:50.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d6bbda0-e50f-479c-9c49-c3d24b9e7e9b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2251af09
2021-06-04T00:20:50.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d6bbda0-e50f-479c-9c49-c3d24b9e7e9b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:20:50.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d6bbda0-e50f-479c-9c49-c3d24b9e7e9b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:20:52.867Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04857ba2-b5b3-4139-8a83-621e2b392e71 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:20:52.867Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04857ba2-b5b3-4139-8a83-621e2b392e71 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@275f2edb
2021-06-04T00:20:52.867Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04857ba2-b5b3-4139-8a83-621e2b392e71 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:20:52.867Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04857ba2-b5b3-4139-8a83-621e2b392e71 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:20:56.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd3fb782-9efd-42db-8c9a-c041c01eeb81 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:20:56.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd3fb782-9efd-42db-8c9a-c041c01eeb81 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5af9796
2021-06-04T00:20:56.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd3fb782-9efd-42db-8c9a-c041c01eeb81 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:20:56.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd3fb782-9efd-42db-8c9a-c041c01eeb81 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:20:59.276Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=106b150b-46fd-4b5b-9d2a-120cac006ab6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:20:59.276Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=106b150b-46fd-4b5b-9d2a-120cac006ab6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@78651983
2021-06-04T00:20:59.276Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=106b150b-46fd-4b5b-9d2a-120cac006ab6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:20:59.276Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=106b150b-46fd-4b5b-9d2a-120cac006ab6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:21:02.066Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8810841-ea24-413a-bbd5-e9dd5be0d56e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:21:02.066Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8810841-ea24-413a-bbd5-e9dd5be0d56e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57e3d861
2021-06-04T00:21:02.066Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8810841-ea24-413a-bbd5-e9dd5be0d56e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:21:02.066Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8810841-ea24-413a-bbd5-e9dd5be0d56e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:21:02.951Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:21:02.952Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:21:02.953Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:21:02.954Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T00:21:05.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ff87d71-e02c-4b44-ac62-abe19a1928ac PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:21:05.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ff87d71-e02c-4b44-ac62-abe19a1928ac PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9941db0
2021-06-04T00:21:05.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ff87d71-e02c-4b44-ac62-abe19a1928ac PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:21:05.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ff87d71-e02c-4b44-ac62-abe19a1928ac PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:21:08.069Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7dedefc4-8ce9-42e1-86fd-e8bcda7a0d6b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:21:08.069Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7dedefc4-8ce9-42e1-86fd-e8bcda7a0d6b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@707e3833
2021-06-04T00:21:08.069Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7dedefc4-8ce9-42e1-86fd-e8bcda7a0d6b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:21:08.069Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7dedefc4-8ce9-42e1-86fd-e8bcda7a0d6b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:21:11.250Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2ee33d9-2fd3-4cf8-b570-eeee01a2dabf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:21:11.250Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2ee33d9-2fd3-4cf8-b570-eeee01a2dabf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20879ebe
2021-06-04T00:21:11.250Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2ee33d9-2fd3-4cf8-b570-eeee01a2dabf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:21:11.250Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2ee33d9-2fd3-4cf8-b570-eeee01a2dabf PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:21:13.825Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b29c35b3-00f4-440b-bc97-c503404950c1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:21:13.825Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b29c35b3-00f4-440b-bc97-c503404950c1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@696e6a1f
2021-06-04T00:21:13.825Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b29c35b3-00f4-440b-bc97-c503404950c1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:21:13.825Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b29c35b3-00f4-440b-bc97-c503404950c1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:21:17.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a60452e4-f106-43f2-9197-12391d046238 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:21:17.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a60452e4-f106-43f2-9197-12391d046238 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@403e931f
2021-06-04T00:21:17.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a60452e4-f106-43f2-9197-12391d046238 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:21:17.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a60452e4-f106-43f2-9197-12391d046238 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:21:17.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:21:19.527Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:21:19.528Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T00:21:20.170Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e232a40f-ae9e-4cd2-b4e4-2f480d7bad33 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:21:20.170Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e232a40f-ae9e-4cd2-b4e4-2f480d7bad33 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4100948b
2021-06-04T00:21:20.170Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e232a40f-ae9e-4cd2-b4e4-2f480d7bad33 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:21:20.170Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e232a40f-ae9e-4cd2-b4e4-2f480d7bad33 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:21:22.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4057cff5-bc28-4aa3-b5ef-4a9eccbdcac8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:21:22.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4057cff5-bc28-4aa3-b5ef-4a9eccbdcac8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d6e807b
2021-06-04T00:21:22.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4057cff5-bc28-4aa3-b5ef-4a9eccbdcac8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:21:22.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4057cff5-bc28-4aa3-b5ef-4a9eccbdcac8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:21:23.253Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=4057cff5-bc28-4aa3-b5ef-4a9eccbdcac8 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:21:23.253Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=4057cff5-bc28-4aa3-b5ef-4a9eccbdcac8 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:21:25.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65ee5dd1-07ed-4fd2-8730-ed103c1b67d5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:21:25.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65ee5dd1-07ed-4fd2-8730-ed103c1b67d5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47ca275b
2021-06-04T00:21:25.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65ee5dd1-07ed-4fd2-8730-ed103c1b67d5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:21:25.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65ee5dd1-07ed-4fd2-8730-ed103c1b67d5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:21:28.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=311b00ce-2fa2-4682-a1ba-c7a9c0996eeb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:21:28.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=311b00ce-2fa2-4682-a1ba-c7a9c0996eeb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7358f2d6
2021-06-04T00:21:28.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=311b00ce-2fa2-4682-a1ba-c7a9c0996eeb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:21:28.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=311b00ce-2fa2-4682-a1ba-c7a9c0996eeb PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:21:31.962Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ac442ae-c481-44fd-ac40-295753f7ef70 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:21:31.962Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ac442ae-c481-44fd-ac40-295753f7ef70 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@36b984fa
2021-06-04T00:21:31.962Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ac442ae-c481-44fd-ac40-295753f7ef70 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:21:31.962Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ac442ae-c481-44fd-ac40-295753f7ef70 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:21:32.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:21:33.092Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:21:35.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd072807-f747-42d0-890e-88758c6e1c71 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:21:35.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd072807-f747-42d0-890e-88758c6e1c71 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ffda70e
2021-06-04T00:21:35.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd072807-f747-42d0-890e-88758c6e1c71 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:21:35.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd072807-f747-42d0-890e-88758c6e1c71 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:21:37.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c303ee2e-bfc8-4fdc-8165-8846dd228542 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:21:37.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c303ee2e-bfc8-4fdc-8165-8846dd228542 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@99bbb55
2021-06-04T00:21:37.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c303ee2e-bfc8-4fdc-8165-8846dd228542 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:21:37.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c303ee2e-bfc8-4fdc-8165-8846dd228542 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:21:40.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f59021fc-2d33-49ff-83ff-1e5935ef1c22 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:21:40.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f59021fc-2d33-49ff-83ff-1e5935ef1c22 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d6136f2
2021-06-04T00:21:40.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f59021fc-2d33-49ff-83ff-1e5935ef1c22 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:21:40.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f59021fc-2d33-49ff-83ff-1e5935ef1c22 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:21:44.185Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=406baa0f-935f-4ee1-be5a-e6bb42e674b1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:21:44.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=406baa0f-935f-4ee1-be5a-e6bb42e674b1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4785fbf0
2021-06-04T00:21:44.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=406baa0f-935f-4ee1-be5a-e6bb42e674b1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:21:44.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=406baa0f-935f-4ee1-be5a-e6bb42e674b1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:21:47.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:21:48.252Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:21:48.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f40efdcb-0de4-4b69-bdb7-c4fd94d31c8a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:21:48.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f40efdcb-0de4-4b69-bdb7-c4fd94d31c8a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3532e1d9
2021-06-04T00:21:48.647Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f40efdcb-0de4-4b69-bdb7-c4fd94d31c8a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:21:48.647Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f40efdcb-0de4-4b69-bdb7-c4fd94d31c8a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:21:48.961Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:21:48.961Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:21:48.962Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:21:48.962Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:21:50.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=051ad237-f2c9-405c-bbb3-cca56e9cd926 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:21:50.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=051ad237-f2c9-405c-bbb3-cca56e9cd926 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@61a7b539
2021-06-04T00:21:50.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=051ad237-f2c9-405c-bbb3-cca56e9cd926 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:21:50.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=051ad237-f2c9-405c-bbb3-cca56e9cd926 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:21:53.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49ac33d2-11d2-4dac-abb0-7966c69b5bb9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:21:53.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49ac33d2-11d2-4dac-abb0-7966c69b5bb9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5545d959
2021-06-04T00:21:53.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49ac33d2-11d2-4dac-abb0-7966c69b5bb9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:21:53.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49ac33d2-11d2-4dac-abb0-7966c69b5bb9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:21:56.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=301cc092-40ed-4352-b272-97b8be4f6541 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:21:56.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=301cc092-40ed-4352-b272-97b8be4f6541 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d77e27a
2021-06-04T00:21:56.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=301cc092-40ed-4352-b272-97b8be4f6541 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:21:56.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=301cc092-40ed-4352-b272-97b8be4f6541 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:21:58.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a5bc509-bb9e-449c-a8ac-0f5442bb40c6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:21:58.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a5bc509-bb9e-449c-a8ac-0f5442bb40c6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1fe9e024
2021-06-04T00:21:58.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a5bc509-bb9e-449c-a8ac-0f5442bb40c6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:21:58.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a5bc509-bb9e-449c-a8ac-0f5442bb40c6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:22:01.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a26382b-4926-46ce-b5fd-79ff14b096df PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:22:01.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a26382b-4926-46ce-b5fd-79ff14b096df PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@433b909d
2021-06-04T00:22:01.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a26382b-4926-46ce-b5fd-79ff14b096df PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:22:01.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a26382b-4926-46ce-b5fd-79ff14b096df PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:22:02.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:22:03.080Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:22:04.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=459c4661-1229-4e22-9689-0e28caf17d36 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:22:04.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=459c4661-1229-4e22-9689-0e28caf17d36 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@384f16b2
2021-06-04T00:22:04.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=459c4661-1229-4e22-9689-0e28caf17d36 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:22:04.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=459c4661-1229-4e22-9689-0e28caf17d36 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:22:08.158Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6807b437-1694-4d8d-9374-11d6c5098952 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:22:08.158Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6807b437-1694-4d8d-9374-11d6c5098952 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a2947f3
2021-06-04T00:22:08.158Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6807b437-1694-4d8d-9374-11d6c5098952 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:22:08.158Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6807b437-1694-4d8d-9374-11d6c5098952 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:22:11.351Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9609a8d7-2d04-4703-9a42-a84ec6ec4b53 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:22:11.351Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9609a8d7-2d04-4703-9a42-a84ec6ec4b53 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6a916852
2021-06-04T00:22:11.351Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9609a8d7-2d04-4703-9a42-a84ec6ec4b53 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:22:11.351Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9609a8d7-2d04-4703-9a42-a84ec6ec4b53 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:22:13.944Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:22:14.349Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=206f73d5-36ce-45b4-b255-c1e08b406ea7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:22:14.349Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=206f73d5-36ce-45b4-b255-c1e08b406ea7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7531a2e5
2021-06-04T00:22:14.349Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=206f73d5-36ce-45b4-b255-c1e08b406ea7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:22:14.349Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=206f73d5-36ce-45b4-b255-c1e08b406ea7 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:22:17.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2fb0541-3805-4db5-93c0-e7b862ee6402 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:22:17.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2fb0541-3805-4db5-93c0-e7b862ee6402 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@358bd077
2021-06-04T00:22:17.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2fb0541-3805-4db5-93c0-e7b862ee6402 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:22:17.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2fb0541-3805-4db5-93c0-e7b862ee6402 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:22:17.952Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:22:20.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8863164a-31f8-46e6-8927-6b02db765a2f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:22:20.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8863164a-31f8-46e6-8927-6b02db765a2f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45ed1fea
2021-06-04T00:22:20.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8863164a-31f8-46e6-8927-6b02db765a2f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:22:20.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8863164a-31f8-46e6-8927-6b02db765a2f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:22:22.866Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d8fe30f-1a6f-4eec-b95b-f077a6e50e4f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:22:22.866Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d8fe30f-1a6f-4eec-b95b-f077a6e50e4f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@24df3cfd
2021-06-04T00:22:22.866Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d8fe30f-1a6f-4eec-b95b-f077a6e50e4f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:22:22.866Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d8fe30f-1a6f-4eec-b95b-f077a6e50e4f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:22:25.952Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T00:22:26.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81ac49d6-0b92-4d69-984d-7ac92197df8a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:22:26.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81ac49d6-0b92-4d69-984d-7ac92197df8a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c018409
2021-06-04T00:22:26.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81ac49d6-0b92-4d69-984d-7ac92197df8a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:22:26.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81ac49d6-0b92-4d69-984d-7ac92197df8a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:22:26.496Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:22:26.498Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:22:26.530Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:22:26.530Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:22:26.554Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:22:26.554Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:22:29.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3cc1dec-0f38-4a2c-9817-f4a263ea90e1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:22:29.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3cc1dec-0f38-4a2c-9817-f4a263ea90e1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3762ef96
2021-06-04T00:22:29.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3cc1dec-0f38-4a2c-9817-f4a263ea90e1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:22:29.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3cc1dec-0f38-4a2c-9817-f4a263ea90e1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:22:32.020Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a3cc1dec-0f38-4a2c-9817-f4a263ea90e1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:22:32.022Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a3cc1dec-0f38-4a2c-9817-f4a263ea90e1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:22:32.022Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a3cc1dec-0f38-4a2c-9817-f4a263ea90e1 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:22:32.022Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a3cc1dec-0f38-4a2c-9817-f4a263ea90e1 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:22:32.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:22:32.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:22:35.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:22:36.267Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:22:36.269Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:22:36.454Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e14eadc1-6a14-4b6d-8e1d-0a0c3b6d9558 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:22:36.454Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e14eadc1-6a14-4b6d-8e1d-0a0c3b6d9558 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a5db4df
2021-06-04T00:22:36.454Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e14eadc1-6a14-4b6d-8e1d-0a0c3b6d9558 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:22:36.454Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e14eadc1-6a14-4b6d-8e1d-0a0c3b6d9558 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:22:36.754Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e14eadc1-6a14-4b6d-8e1d-0a0c3b6d9558 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:22:36.755Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e14eadc1-6a14-4b6d-8e1d-0a0c3b6d9558 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:22:37.380Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86030174-5356-44aa-8ba7-a81f811c76f0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:22:37.380Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86030174-5356-44aa-8ba7-a81f811c76f0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1749be9f
2021-06-04T00:22:37.380Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86030174-5356-44aa-8ba7-a81f811c76f0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:22:37.380Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86030174-5356-44aa-8ba7-a81f811c76f0 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:22:37.782Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:22:37.974Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=86030174-5356-44aa-8ba7-a81f811c76f0 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:22:37.974Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=86030174-5356-44aa-8ba7-a81f811c76f0 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:22:38.770Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a890342-128f-4ff4-aeed-d416e076944f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:22:38.770Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a890342-128f-4ff4-aeed-d416e076944f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3777fdbf
2021-06-04T00:22:38.770Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a890342-128f-4ff4-aeed-d416e076944f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:22:38.771Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a890342-128f-4ff4-aeed-d416e076944f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:22:41.773Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3a890342-128f-4ff4-aeed-d416e076944f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:22:41.774Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3a890342-128f-4ff4-aeed-d416e076944f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:22:41.774Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3a890342-128f-4ff4-aeed-d416e076944f ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:22:41.774Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3a890342-128f-4ff4-aeed-d416e076944f ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:22:43.564Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:22:43.565Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:22:44.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:22:44.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:22:46.576Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:22:47.288Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ed658b0-7948-4716-b7f0-b925dea98b78 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:22:47.288Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ed658b0-7948-4716-b7f0-b925dea98b78 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@407b4cc2
2021-06-04T00:22:47.288Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ed658b0-7948-4716-b7f0-b925dea98b78 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:22:47.289Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ed658b0-7948-4716-b7f0-b925dea98b78 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:22:48.119Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=5ed658b0-7948-4716-b7f0-b925dea98b78 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:22:48.119Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=5ed658b0-7948-4716-b7f0-b925dea98b78 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:22:48.952Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ce0b046-b840-409d-a2e6-009f096a0812 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:22:48.952Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ce0b046-b840-409d-a2e6-009f096a0812 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ffcf1b9
2021-06-04T00:22:48.952Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ce0b046-b840-409d-a2e6-009f096a0812 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:22:48.952Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ce0b046-b840-409d-a2e6-009f096a0812 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:22:48.961Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:22:48.962Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:22:48.962Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:22:50.034Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:22:50.034Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:22:51.024Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:22:51.024Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:22:51.036Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:22:51.036Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:22:51.056Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T00:22:51.057Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T00:22:51.057Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T00:22:51.957Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=6ce0b046-b840-409d-a2e6-009f096a0812 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:22:51.958Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=6ce0b046-b840-409d-a2e6-009f096a0812 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:22:51.959Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=6ce0b046-b840-409d-a2e6-009f096a0812 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:22:51.959Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=6ce0b046-b840-409d-a2e6-009f096a0812 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:22:55.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce09ac67-b1aa-4b90-8bc9-6040a3dbd43d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:22:55.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce09ac67-b1aa-4b90-8bc9-6040a3dbd43d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17ee6dfc
2021-06-04T00:22:55.055Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce09ac67-b1aa-4b90-8bc9-6040a3dbd43d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:22:55.055Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce09ac67-b1aa-4b90-8bc9-6040a3dbd43d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:22:58.101Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ce09ac67-b1aa-4b90-8bc9-6040a3dbd43d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:22:58.102Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ce09ac67-b1aa-4b90-8bc9-6040a3dbd43d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:23:01.168Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c99fd2a-d634-4879-87a6-4800f707c8d6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:23:01.168Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c99fd2a-d634-4879-87a6-4800f707c8d6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@107938fb
2021-06-04T00:23:01.168Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c99fd2a-d634-4879-87a6-4800f707c8d6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:23:01.168Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c99fd2a-d634-4879-87a6-4800f707c8d6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:23:04.222Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=6c99fd2a-d634-4879-87a6-4800f707c8d6 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:23:04.222Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=6c99fd2a-d634-4879-87a6-4800f707c8d6 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:23:04.968Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b723b2f-ec38-47f7-a371-c3b18edfe850 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:23:04.968Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b723b2f-ec38-47f7-a371-c3b18edfe850 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@c95631b
2021-06-04T00:23:04.968Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b723b2f-ec38-47f7-a371-c3b18edfe850 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:23:04.969Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b723b2f-ec38-47f7-a371-c3b18edfe850 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:23:08.034Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8b723b2f-ec38-47f7-a371-c3b18edfe850 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:23:08.035Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8b723b2f-ec38-47f7-a371-c3b18edfe850 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:23:08.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:23:08.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:23:10.682Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:23:16.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7be9297b-224d-4d10-bfd9-c8de3795c73c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:23:16.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7be9297b-224d-4d10-bfd9-c8de3795c73c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@112bfec2
2021-06-04T00:23:16.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7be9297b-224d-4d10-bfd9-c8de3795c73c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:23:16.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7be9297b-224d-4d10-bfd9-c8de3795c73c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:23:19.595Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=7be9297b-224d-4d10-bfd9-c8de3795c73c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:23:19.595Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=7be9297b-224d-4d10-bfd9-c8de3795c73c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:23:20.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:23:20.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:23:22.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=886e229f-6f1a-4d30-9d66-4d4f7141539e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:23:22.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=886e229f-6f1a-4d30-9d66-4d4f7141539e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d0974a5
2021-06-04T00:23:22.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=886e229f-6f1a-4d30-9d66-4d4f7141539e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:23:22.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=886e229f-6f1a-4d30-9d66-4d4f7141539e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:23:22.615Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:23:25.584Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=886e229f-6f1a-4d30-9d66-4d4f7141539e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:23:25.585Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=886e229f-6f1a-4d30-9d66-4d4f7141539e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:23:26.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:23:26.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:23:29.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:23:32.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:23:35.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:23:37.563Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:23:37.566Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:23:38.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:23:41.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:23:44.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:23:47.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:23:48.961Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:23:48.961Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:23:48.962Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:23:48.962Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:23:49.364Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46df2395-5584-4540-a33e-09d23559b0f0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:23:49.364Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46df2395-5584-4540-a33e-09d23559b0f0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3eb5e9c5
2021-06-04T00:23:49.364Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46df2395-5584-4540-a33e-09d23559b0f0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:23:49.364Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46df2395-5584-4540-a33e-09d23559b0f0 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:23:50.308Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:23:50.308Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:23:50.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:23:51.395Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=46df2395-5584-4540-a33e-09d23559b0f0 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:23:51.395Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=46df2395-5584-4540-a33e-09d23559b0f0 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:23:52.110Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:23:52.110Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:23:52.562Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:23:52.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6c6cef0-5d70-47b0-a69d-1a4a064967b2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:23:52.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6c6cef0-5d70-47b0-a69d-1a4a064967b2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@48a6193d
2021-06-04T00:23:52.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6c6cef0-5d70-47b0-a69d-1a4a064967b2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:23:52.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6c6cef0-5d70-47b0-a69d-1a4a064967b2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:23:53.871Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f6c6cef0-5d70-47b0-a69d-1a4a064967b2 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:23:53.871Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=f6c6cef0-5d70-47b0-a69d-1a4a064967b2 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:23:54.966Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a42492c4-6f96-4ecc-ac85-5e852f868863 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:23:54.966Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a42492c4-6f96-4ecc-ac85-5e852f868863 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e613d78
2021-06-04T00:23:54.966Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a42492c4-6f96-4ecc-ac85-5e852f868863 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:23:54.966Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a42492c4-6f96-4ecc-ac85-5e852f868863 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:23:55.375Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a42492c4-6f96-4ecc-ac85-5e852f868863 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:23:55.375Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a42492c4-6f96-4ecc-ac85-5e852f868863 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:23:56.069Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60810661-054a-4ce1-8404-e14bee55c1d1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:23:56.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60810661-054a-4ce1-8404-e14bee55c1d1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f0b16b0
2021-06-04T00:23:56.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60810661-054a-4ce1-8404-e14bee55c1d1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:23:56.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60810661-054a-4ce1-8404-e14bee55c1d1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:23:58.058Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05b1e078-7149-4cda-8faf-309b860f827a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:23:58.058Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05b1e078-7149-4cda-8faf-309b860f827a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@263ec31c
2021-06-04T00:23:58.058Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05b1e078-7149-4cda-8faf-309b860f827a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:23:58.058Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05b1e078-7149-4cda-8faf-309b860f827a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:24:00.264Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:24:00.264Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:24:01.064Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=05b1e078-7149-4cda-8faf-309b860f827a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:24:01.064Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=05b1e078-7149-4cda-8faf-309b860f827a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:24:01.064Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=05b1e078-7149-4cda-8faf-309b860f827a ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:24:01.064Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=05b1e078-7149-4cda-8faf-309b860f827a ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:24:02.165Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00d5ba3b-f464-484b-82e5-55938828819e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:24:02.165Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00d5ba3b-f464-484b-82e5-55938828819e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ea94917
2021-06-04T00:24:02.165Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00d5ba3b-f464-484b-82e5-55938828819e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:24:02.165Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00d5ba3b-f464-484b-82e5-55938828819e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:24:03.656Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=00d5ba3b-f464-484b-82e5-55938828819e ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:24:03.656Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=00d5ba3b-f464-484b-82e5-55938828819e ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:24:04.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e4f52fa-53b4-4e37-b926-013b72776c51 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:24:04.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e4f52fa-53b4-4e37-b926-013b72776c51 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e5d0655
2021-06-04T00:24:04.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e4f52fa-53b4-4e37-b926-013b72776c51 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:24:04.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e4f52fa-53b4-4e37-b926-013b72776c51 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:24:10.346Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6efdfe6-1d06-4bfd-9f6d-8fea2cc38e8e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:24:10.346Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6efdfe6-1d06-4bfd-9f6d-8fea2cc38e8e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e2b10a1
2021-06-04T00:24:10.346Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6efdfe6-1d06-4bfd-9f6d-8fea2cc38e8e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:24:10.346Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6efdfe6-1d06-4bfd-9f6d-8fea2cc38e8e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:24:13.351Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f6efdfe6-1d06-4bfd-9f6d-8fea2cc38e8e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:24:13.352Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f6efdfe6-1d06-4bfd-9f6d-8fea2cc38e8e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:24:13.352Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f6efdfe6-1d06-4bfd-9f6d-8fea2cc38e8e ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:24:13.352Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f6efdfe6-1d06-4bfd-9f6d-8fea2cc38e8e ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:24:14.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:24:14.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:24:17.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:24:20.065Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:24:20.066Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:24:20.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:24:23.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:24:26.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:24:28.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd09720d-0463-407d-9675-f39254dded31 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:24:28.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd09720d-0463-407d-9675-f39254dded31 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ade1982
2021-06-04T00:24:28.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd09720d-0463-407d-9675-f39254dded31 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:24:28.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd09720d-0463-407d-9675-f39254dded31 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:24:28.914Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:24:31.094Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=dd09720d-0463-407d-9675-f39254dded31 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:24:31.095Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=dd09720d-0463-407d-9675-f39254dded31 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:24:36.852Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8603d3b-77ee-468c-9a6c-799f8a865280 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:24:36.852Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8603d3b-77ee-468c-9a6c-799f8a865280 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5431c42d
2021-06-04T00:24:36.852Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8603d3b-77ee-468c-9a6c-799f8a865280 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:24:36.852Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8603d3b-77ee-468c-9a6c-799f8a865280 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:24:39.901Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d8603d3b-77ee-468c-9a6c-799f8a865280 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:24:39.901Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d8603d3b-77ee-468c-9a6c-799f8a865280 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:24:42.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7236dfa-03d8-4776-9162-dd1e323f0448 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:24:42.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7236dfa-03d8-4776-9162-dd1e323f0448 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68317bd8
2021-06-04T00:24:42.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7236dfa-03d8-4776-9162-dd1e323f0448 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:24:42.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7236dfa-03d8-4776-9162-dd1e323f0448 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:24:42.187Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e7236dfa-03d8-4776-9162-dd1e323f0448 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:24:42.187Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e7236dfa-03d8-4776-9162-dd1e323f0448 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:24:43.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47f2d6d2-bd26-4861-aed0-ca35c9b3d49a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:24:43.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47f2d6d2-bd26-4861-aed0-ca35c9b3d49a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50bd761b
2021-06-04T00:24:43.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47f2d6d2-bd26-4861-aed0-ca35c9b3d49a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:24:43.285Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47f2d6d2-bd26-4861-aed0-ca35c9b3d49a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:24:46.289Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=47f2d6d2-bd26-4861-aed0-ca35c9b3d49a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:24:46.289Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=47f2d6d2-bd26-4861-aed0-ca35c9b3d49a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:24:46.289Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=47f2d6d2-bd26-4861-aed0-ca35c9b3d49a ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:24:46.289Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=47f2d6d2-bd26-4861-aed0-ca35c9b3d49a ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:24:50.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5915b04-1d98-4933-8137-1c805659cce3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:24:50.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5915b04-1d98-4933-8137-1c805659cce3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@59fd5df6
2021-06-04T00:24:50.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5915b04-1d98-4933-8137-1c805659cce3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:24:50.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5915b04-1d98-4933-8137-1c805659cce3 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:24:50.891Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b5915b04-1d98-4933-8137-1c805659cce3 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:24:50.891Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b5915b04-1d98-4933-8137-1c805659cce3 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:24:51.414Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:24:51.414Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:24:51.472Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:24:51.472Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:24:51.474Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:24:51.474Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:24:51.480Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T00:24:51.481Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:24:51.485Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:24:51.485Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:24:51.488Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:24:51.488Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:24:51.543Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:24:51.544Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:24:51.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e557bfb-fc77-4770-9e63-3d535d592d52 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:24:51.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e557bfb-fc77-4770-9e63-3d535d592d52 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@eecd74b
2021-06-04T00:24:51.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e557bfb-fc77-4770-9e63-3d535d592d52 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:24:51.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e557bfb-fc77-4770-9e63-3d535d592d52 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:24:51.563Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:24:51.564Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:24:51.575Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:24:51.576Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:24:51.591Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:24:51.592Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:24:51.713Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:24:51.715Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:24:51.803Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:24:51.804Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:24:51.839Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:24:51.840Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:24:51.883Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:24:51.884Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:24:51.905Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:24:51.906Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:24:51.931Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:24:51.932Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:24:51.939Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:24:51.940Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:24:51.963Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:24:51.964Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:24:51.971Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:24:51.972Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:24:52.008Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:24:52.009Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:24:52.028Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:24:52.029Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:24:52.050Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:24:52.050Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T00:24:52.246Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65c05deb-ced0-433b-ad54-29eedde9ba4d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:24:52.246Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65c05deb-ced0-433b-ad54-29eedde9ba4d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@355a6523
2021-06-04T00:24:52.246Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65c05deb-ced0-433b-ad54-29eedde9ba4d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:24:52.246Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65c05deb-ced0-433b-ad54-29eedde9ba4d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:24:52.866Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6494169-75e6-42bc-94ef-22259f7386c1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:24:52.866Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6494169-75e6-42bc-94ef-22259f7386c1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@67b9c93
2021-06-04T00:24:52.866Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6494169-75e6-42bc-94ef-22259f7386c1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:24:52.866Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6494169-75e6-42bc-94ef-22259f7386c1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:24:53.357Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f6494169-75e6-42bc-94ef-22259f7386c1 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:24:53.357Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f6494169-75e6-42bc-94ef-22259f7386c1 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:24:54.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00a7d4b5-84ad-4286-b888-b03006449bd5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:24:54.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00a7d4b5-84ad-4286-b888-b03006449bd5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34ad3ab4
2021-06-04T00:24:54.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00a7d4b5-84ad-4286-b888-b03006449bd5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:24:54.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00a7d4b5-84ad-4286-b888-b03006449bd5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:24:55.856Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28657c4d-172b-42d0-81ba-4327d8498940 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:24:55.856Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28657c4d-172b-42d0-81ba-4327d8498940 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c13e5e5
2021-06-04T00:24:55.856Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28657c4d-172b-42d0-81ba-4327d8498940 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:24:55.856Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28657c4d-172b-42d0-81ba-4327d8498940 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:24:57.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59cbf5a6-5557-4e82-925c-20245104f498 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:24:57.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59cbf5a6-5557-4e82-925c-20245104f498 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a86f039
2021-06-04T00:24:57.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59cbf5a6-5557-4e82-925c-20245104f498 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:24:57.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59cbf5a6-5557-4e82-925c-20245104f498 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:24:58.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6ea1fb5-0809-4ce5-89a2-c5a481d5042e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:24:58.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6ea1fb5-0809-4ce5-89a2-c5a481d5042e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60c36cfe
2021-06-04T00:24:58.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6ea1fb5-0809-4ce5-89a2-c5a481d5042e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:24:58.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6ea1fb5-0809-4ce5-89a2-c5a481d5042e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:24:59.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2bc0e48-e131-4391-a5cd-7165a5d3deff PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:24:59.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2bc0e48-e131-4391-a5cd-7165a5d3deff PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3de692c8
2021-06-04T00:24:59.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2bc0e48-e131-4391-a5cd-7165a5d3deff PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:24:59.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2bc0e48-e131-4391-a5cd-7165a5d3deff PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:01.146Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8cb201e-94b0-4aaa-901e-de7116c061fa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:01.146Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8cb201e-94b0-4aaa-901e-de7116c061fa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e99745c
2021-06-04T00:25:01.146Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8cb201e-94b0-4aaa-901e-de7116c061fa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:01.146Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8cb201e-94b0-4aaa-901e-de7116c061fa PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:02.461Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97ac7f7e-aee1-4e0d-aac4-8f76ae40ce41 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:02.461Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97ac7f7e-aee1-4e0d-aac4-8f76ae40ce41 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7393548e
2021-06-04T00:25:02.461Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97ac7f7e-aee1-4e0d-aac4-8f76ae40ce41 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:02.461Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97ac7f7e-aee1-4e0d-aac4-8f76ae40ce41 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:02.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:25:02.981Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:25:03.354Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a00a6ace-1572-43e3-aef9-a7c3aa98024c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:03.354Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a00a6ace-1572-43e3-aef9-a7c3aa98024c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@8cc729e
2021-06-04T00:25:03.354Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a00a6ace-1572-43e3-aef9-a7c3aa98024c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:03.354Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a00a6ace-1572-43e3-aef9-a7c3aa98024c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:04.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f55e8593-3726-47ac-85c1-09b06c97b685 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:04.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f55e8593-3726-47ac-85c1-09b06c97b685 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@135d19d
2021-06-04T00:25:04.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f55e8593-3726-47ac-85c1-09b06c97b685 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:04.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f55e8593-3726-47ac-85c1-09b06c97b685 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:05.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f78ac90e-6492-40ef-b9d8-3773cd723b67 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:05.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f78ac90e-6492-40ef-b9d8-3773cd723b67 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@343b6e73
2021-06-04T00:25:05.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f78ac90e-6492-40ef-b9d8-3773cd723b67 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:05.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f78ac90e-6492-40ef-b9d8-3773cd723b67 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:06.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1ca6ba4-3f8f-49d8-b0d4-e311e2b67641 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:06.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1ca6ba4-3f8f-49d8-b0d4-e311e2b67641 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d656b5e
2021-06-04T00:25:06.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1ca6ba4-3f8f-49d8-b0d4-e311e2b67641 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:06.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1ca6ba4-3f8f-49d8-b0d4-e311e2b67641 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:06.964Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:25:06.964Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:25:06.964Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:25:06.964Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:25:07.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9a0d032-f7a7-4680-a1a9-84b3c60405c1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:07.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9a0d032-f7a7-4680-a1a9-84b3c60405c1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3656aaee
2021-06-04T00:25:07.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9a0d032-f7a7-4680-a1a9-84b3c60405c1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:07.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9a0d032-f7a7-4680-a1a9-84b3c60405c1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:08.969Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bc2e37c-41d1-44d1-b393-70d7be00fd6f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:08.969Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bc2e37c-41d1-44d1-b393-70d7be00fd6f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@19c03c80
2021-06-04T00:25:08.969Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bc2e37c-41d1-44d1-b393-70d7be00fd6f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:08.969Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bc2e37c-41d1-44d1-b393-70d7be00fd6f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:10.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=008919a5-9f78-4339-858d-5dc44f24db3e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:10.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=008919a5-9f78-4339-858d-5dc44f24db3e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@76e7913d
2021-06-04T00:25:10.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=008919a5-9f78-4339-858d-5dc44f24db3e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:10.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=008919a5-9f78-4339-858d-5dc44f24db3e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:11.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6433910-e1a5-4117-a6a4-103579c1de31 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:11.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6433910-e1a5-4117-a6a4-103579c1de31 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e2b24
2021-06-04T00:25:11.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6433910-e1a5-4117-a6a4-103579c1de31 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:11.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6433910-e1a5-4117-a6a4-103579c1de31 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:12.757Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ba99a88-2dee-4061-81ac-f8f66dd72c50 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:12.757Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ba99a88-2dee-4061-81ac-f8f66dd72c50 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@32cf015
2021-06-04T00:25:12.757Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ba99a88-2dee-4061-81ac-f8f66dd72c50 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:12.757Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ba99a88-2dee-4061-81ac-f8f66dd72c50 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:14.267Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2bb7897-c702-4b96-a2a5-5954af90926e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:14.267Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2bb7897-c702-4b96-a2a5-5954af90926e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b90e8cc
2021-06-04T00:25:14.267Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2bb7897-c702-4b96-a2a5-5954af90926e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:14.267Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2bb7897-c702-4b96-a2a5-5954af90926e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:16.279Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ff75358-62ab-42c2-9f3a-b0eecb43d16f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:16.279Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ff75358-62ab-42c2-9f3a-b0eecb43d16f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5134ecfa
2021-06-04T00:25:16.279Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ff75358-62ab-42c2-9f3a-b0eecb43d16f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:16.279Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ff75358-62ab-42c2-9f3a-b0eecb43d16f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:17.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5384625-88d9-4d0a-a0b7-5ea32b11de0a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:17.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5384625-88d9-4d0a-a0b7-5ea32b11de0a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20329af3
2021-06-04T00:25:17.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5384625-88d9-4d0a-a0b7-5ea32b11de0a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:17.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5384625-88d9-4d0a-a0b7-5ea32b11de0a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:17.954Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:25:18.002Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:25:18.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b391bf35-67ca-4813-9122-14cd8ca6e13a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:18.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b391bf35-67ca-4813-9122-14cd8ca6e13a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@44fa6ab8
2021-06-04T00:25:18.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b391bf35-67ca-4813-9122-14cd8ca6e13a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:18.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b391bf35-67ca-4813-9122-14cd8ca6e13a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:20.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0a06219-2ccb-495d-a939-d18f8e37b0d0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:20.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0a06219-2ccb-495d-a939-d18f8e37b0d0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58303c63
2021-06-04T00:25:20.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0a06219-2ccb-495d-a939-d18f8e37b0d0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:20.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0a06219-2ccb-495d-a939-d18f8e37b0d0 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:21.346Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a32c4308-2f11-4c34-beee-a43dffe718d2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:21.346Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a32c4308-2f11-4c34-beee-a43dffe718d2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e9558a3
2021-06-04T00:25:21.346Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a32c4308-2f11-4c34-beee-a43dffe718d2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:21.346Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a32c4308-2f11-4c34-beee-a43dffe718d2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:22.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75e187a3-cb1a-41bb-a6ac-6a04cc4e39d0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:22.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75e187a3-cb1a-41bb-a6ac-6a04cc4e39d0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ac4aa80
2021-06-04T00:25:22.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75e187a3-cb1a-41bb-a6ac-6a04cc4e39d0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:22.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75e187a3-cb1a-41bb-a6ac-6a04cc4e39d0 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:23.411Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:25:23.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3f3b3c7-d27c-4f5e-95e3-c249852ddb9d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:23.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3f3b3c7-d27c-4f5e-95e3-c249852ddb9d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@dfcacca
2021-06-04T00:25:23.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3f3b3c7-d27c-4f5e-95e3-c249852ddb9d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:23.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3f3b3c7-d27c-4f5e-95e3-c249852ddb9d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:26.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e89bc345-5b56-42db-a83a-e254a68648c9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:26.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e89bc345-5b56-42db-a83a-e254a68648c9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54f64a32
2021-06-04T00:25:26.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e89bc345-5b56-42db-a83a-e254a68648c9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:26.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e89bc345-5b56-42db-a83a-e254a68648c9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:27.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c9052b5-ce61-4495-b52c-366856f9c652 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:27.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c9052b5-ce61-4495-b52c-366856f9c652 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50a2504f
2021-06-04T00:25:27.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c9052b5-ce61-4495-b52c-366856f9c652 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:27.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c9052b5-ce61-4495-b52c-366856f9c652 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:29.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:25:29.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:25:31.356Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24348705-062d-4452-91b5-bc6e51be3e15 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:31.356Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24348705-062d-4452-91b5-bc6e51be3e15 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f0d6071
2021-06-04T00:25:31.356Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24348705-062d-4452-91b5-bc6e51be3e15 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:31.356Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24348705-062d-4452-91b5-bc6e51be3e15 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:31.668Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=24348705-062d-4452-91b5-bc6e51be3e15 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:25:31.668Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=24348705-062d-4452-91b5-bc6e51be3e15 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:25:31.670Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:25:32.683Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ccbfcf3-bf7d-490a-beec-c88cd49cf892 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:32.683Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ccbfcf3-bf7d-490a-beec-c88cd49cf892 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ff0ba6
2021-06-04T00:25:32.683Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ccbfcf3-bf7d-490a-beec-c88cd49cf892 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:32.683Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ccbfcf3-bf7d-490a-beec-c88cd49cf892 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:32.952Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:25:33.327Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:25:33.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8fc3dbd-5d1a-462d-a816-fb6f40622796 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:33.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8fc3dbd-5d1a-462d-a816-fb6f40622796 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@61be76b1
2021-06-04T00:25:33.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8fc3dbd-5d1a-462d-a816-fb6f40622796 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:33.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8fc3dbd-5d1a-462d-a816-fb6f40622796 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:34.058Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f8fc3dbd-5d1a-462d-a816-fb6f40622796 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:25:34.058Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f8fc3dbd-5d1a-462d-a816-fb6f40622796 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:25:34.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91b01fac-062d-49e2-afc3-9b6227facba2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:34.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91b01fac-062d-49e2-afc3-9b6227facba2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23dc62e1
2021-06-04T00:25:34.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91b01fac-062d-49e2-afc3-9b6227facba2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:34.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91b01fac-062d-49e2-afc3-9b6227facba2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:36.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6416347b-e777-4ea6-81f2-4274a62cb766 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:36.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6416347b-e777-4ea6-81f2-4274a62cb766 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27d69003
2021-06-04T00:25:36.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6416347b-e777-4ea6-81f2-4274a62cb766 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:36.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6416347b-e777-4ea6-81f2-4274a62cb766 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:40.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5546fa1d-8fa8-4a0a-a018-c0f5a99f6bd2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:40.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5546fa1d-8fa8-4a0a-a018-c0f5a99f6bd2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@588b1d64
2021-06-04T00:25:40.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5546fa1d-8fa8-4a0a-a018-c0f5a99f6bd2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:40.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5546fa1d-8fa8-4a0a-a018-c0f5a99f6bd2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:42.146Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=607181cc-4a8a-4950-bee3-a4ab9b5f3e64 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:42.146Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=607181cc-4a8a-4950-bee3-a4ab9b5f3e64 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a92e33a
2021-06-04T00:25:42.148Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=607181cc-4a8a-4950-bee3-a4ab9b5f3e64 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:42.148Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=607181cc-4a8a-4950-bee3-a4ab9b5f3e64 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:44.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bab3e0d4-41d3-425d-b7d7-366553064aad PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:44.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bab3e0d4-41d3-425d-b7d7-366553064aad PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a194be3
2021-06-04T00:25:44.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bab3e0d4-41d3-425d-b7d7-366553064aad PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:44.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bab3e0d4-41d3-425d-b7d7-366553064aad PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:47.394Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebda6458-0bfe-4203-a249-e0ff5c796180 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:47.394Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebda6458-0bfe-4203-a249-e0ff5c796180 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@195c942b
2021-06-04T00:25:47.394Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebda6458-0bfe-4203-a249-e0ff5c796180 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:47.394Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebda6458-0bfe-4203-a249-e0ff5c796180 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:47.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:25:48.487Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b4e9f0e-8d7c-4582-86e4-5cd1f25c3694 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:48.487Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b4e9f0e-8d7c-4582-86e4-5cd1f25c3694 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@193cca59
2021-06-04T00:25:48.487Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b4e9f0e-8d7c-4582-86e4-5cd1f25c3694 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:48.487Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b4e9f0e-8d7c-4582-86e4-5cd1f25c3694 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:48.961Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:25:48.962Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:25:48.962Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:25:51.295Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:25:52.190Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=817ab98b-daf0-4514-b0a4-317d7689539e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:52.190Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=817ab98b-daf0-4514-b0a4-317d7689539e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@446a7177
2021-06-04T00:25:52.190Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=817ab98b-daf0-4514-b0a4-317d7689539e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:52.190Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=817ab98b-daf0-4514-b0a4-317d7689539e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:53.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c31e47b-b906-4f80-8233-21592e2b4e8b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:53.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c31e47b-b906-4f80-8233-21592e2b4e8b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ec7c4a
2021-06-04T00:25:53.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c31e47b-b906-4f80-8233-21592e2b4e8b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:53.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c31e47b-b906-4f80-8233-21592e2b4e8b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:55.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f147ca8-87ec-4e7a-b644-b0171c29857c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:55.451Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f147ca8-87ec-4e7a-b644-b0171c29857c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79ec4d30
2021-06-04T00:25:55.451Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f147ca8-87ec-4e7a-b644-b0171c29857c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:55.451Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f147ca8-87ec-4e7a-b644-b0171c29857c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:56.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58c5076b-d9c1-4dd1-9219-51a27717e24c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:56.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58c5076b-d9c1-4dd1-9219-51a27717e24c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@67d3e56
2021-06-04T00:25:56.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58c5076b-d9c1-4dd1-9219-51a27717e24c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:56.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58c5076b-d9c1-4dd1-9219-51a27717e24c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:58.179Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92034855-51a4-471c-8111-791d03c0b88b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:58.179Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92034855-51a4-471c-8111-791d03c0b88b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@110b1627
2021-06-04T00:25:58.179Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92034855-51a4-471c-8111-791d03c0b88b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:58.179Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92034855-51a4-471c-8111-791d03c0b88b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:25:59.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3e45814-d686-4d0f-ba88-0da27229ac0c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:25:59.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3e45814-d686-4d0f-ba88-0da27229ac0c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@76622660
2021-06-04T00:25:59.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3e45814-d686-4d0f-ba88-0da27229ac0c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:25:59.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3e45814-d686-4d0f-ba88-0da27229ac0c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:26:01.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=938103c5-6f6e-4217-a369-2b56d9682842 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:26:01.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=938103c5-6f6e-4217-a369-2b56d9682842 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d7c7051
2021-06-04T00:26:01.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=938103c5-6f6e-4217-a369-2b56d9682842 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:26:01.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=938103c5-6f6e-4217-a369-2b56d9682842 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:26:02.951Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:26:02.952Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4a92497-2971-460d-9340-e55afc147736 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:26:02.952Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4a92497-2971-460d-9340-e55afc147736 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@21c7c26
2021-06-04T00:26:02.952Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4a92497-2971-460d-9340-e55afc147736 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:26:02.952Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4a92497-2971-460d-9340-e55afc147736 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:26:03.176Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:26:04.066Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0bdb90a-0c10-4b91-b1ad-4f54675bc90c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:26:04.066Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0bdb90a-0c10-4b91-b1ad-4f54675bc90c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b6ff86c
2021-06-04T00:26:04.066Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0bdb90a-0c10-4b91-b1ad-4f54675bc90c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:26:04.066Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0bdb90a-0c10-4b91-b1ad-4f54675bc90c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:26:05.938Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:26:06.273Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c9ee204-a77f-43c6-b22a-8df1caf28cc7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:26:06.273Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c9ee204-a77f-43c6-b22a-8df1caf28cc7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2cd98647
2021-06-04T00:26:06.273Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c9ee204-a77f-43c6-b22a-8df1caf28cc7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:26:06.273Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c9ee204-a77f-43c6-b22a-8df1caf28cc7 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:26:07.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22d5bef4-40ea-43b0-81b2-1cf178ff6de2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:26:07.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22d5bef4-40ea-43b0-81b2-1cf178ff6de2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22a99575
2021-06-04T00:26:07.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22d5bef4-40ea-43b0-81b2-1cf178ff6de2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:26:07.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22d5bef4-40ea-43b0-81b2-1cf178ff6de2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:26:10.799Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2fbf5a8-b35a-4739-a090-c8ff6315b936 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:26:10.799Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2fbf5a8-b35a-4739-a090-c8ff6315b936 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4335204a
2021-06-04T00:26:10.799Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2fbf5a8-b35a-4739-a090-c8ff6315b936 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:26:10.799Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2fbf5a8-b35a-4739-a090-c8ff6315b936 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:26:14.453Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fcaac56-e0d7-4d70-901f-7309bc83fef5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:26:14.453Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fcaac56-e0d7-4d70-901f-7309bc83fef5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@77ad1cd8
2021-06-04T00:26:14.453Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fcaac56-e0d7-4d70-901f-7309bc83fef5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:26:14.453Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fcaac56-e0d7-4d70-901f-7309bc83fef5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:26:17.512Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae9bd188-5222-4590-93de-635aa9ae6617 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:26:17.512Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae9bd188-5222-4590-93de-635aa9ae6617 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@172647d4
2021-06-04T00:26:17.512Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae9bd188-5222-4590-93de-635aa9ae6617 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:26:17.512Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae9bd188-5222-4590-93de-635aa9ae6617 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:26:17.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:26:18.408Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:26:19.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccea2ecd-7d30-44ca-8718-d66def3f3d9e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:26:19.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccea2ecd-7d30-44ca-8718-d66def3f3d9e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@794a7a78
2021-06-04T00:26:19.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccea2ecd-7d30-44ca-8718-d66def3f3d9e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:26:19.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccea2ecd-7d30-44ca-8718-d66def3f3d9e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:26:22.958Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0583e822-e653-472f-8201-3b6cb581b7f3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:26:22.958Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0583e822-e653-472f-8201-3b6cb581b7f3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1397326b
2021-06-04T00:26:22.958Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0583e822-e653-472f-8201-3b6cb581b7f3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:26:22.958Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0583e822-e653-472f-8201-3b6cb581b7f3 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:26:26.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcbac1cc-3b97-4d3e-8957-125c6c169e14 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:26:26.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcbac1cc-3b97-4d3e-8957-125c6c169e14 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@cc3b71d
2021-06-04T00:26:26.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcbac1cc-3b97-4d3e-8957-125c6c169e14 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:26:26.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcbac1cc-3b97-4d3e-8957-125c6c169e14 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:26:29.175Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7096079-fcbd-45e0-aa23-0e248b4587c6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:26:29.175Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7096079-fcbd-45e0-aa23-0e248b4587c6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29fe59b6
2021-06-04T00:26:29.175Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7096079-fcbd-45e0-aa23-0e248b4587c6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:26:29.175Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7096079-fcbd-45e0-aa23-0e248b4587c6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:26:31.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6ed45b7-75a6-4d0f-b9e3-45d2b04eb234 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:26:31.851Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6ed45b7-75a6-4d0f-b9e3-45d2b04eb234 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34d6f4b
2021-06-04T00:26:31.851Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6ed45b7-75a6-4d0f-b9e3-45d2b04eb234 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:26:31.851Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6ed45b7-75a6-4d0f-b9e3-45d2b04eb234 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:26:32.951Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:26:33.239Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:26:35.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:26:35.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:26:38.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:26:39.164Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a0f2ceb-37cd-400d-8dff-62242d8b15b4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:26:39.164Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a0f2ceb-37cd-400d-8dff-62242d8b15b4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29631123
2021-06-04T00:26:39.164Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a0f2ceb-37cd-400d-8dff-62242d8b15b4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:26:39.164Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a0f2ceb-37cd-400d-8dff-62242d8b15b4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:26:40.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b3731f9-7f8e-46dd-ad4d-d8fbc381bb57 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:26:40.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b3731f9-7f8e-46dd-ad4d-d8fbc381bb57 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3889204d
2021-06-04T00:26:40.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b3731f9-7f8e-46dd-ad4d-d8fbc381bb57 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:26:40.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b3731f9-7f8e-46dd-ad4d-d8fbc381bb57 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:26:40.672Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:26:40.785Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8b3731f9-7f8e-46dd-ad4d-d8fbc381bb57 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:26:40.785Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=8b3731f9-7f8e-46dd-ad4d-d8fbc381bb57 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:26:41.294Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fda3af26-a7fc-40b1-8340-ba5b37f3ceb6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:26:41.294Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fda3af26-a7fc-40b1-8340-ba5b37f3ceb6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@63e1fd03
2021-06-04T00:26:41.294Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fda3af26-a7fc-40b1-8340-ba5b37f3ceb6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:26:41.294Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fda3af26-a7fc-40b1-8340-ba5b37f3ceb6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:26:41.519Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fda3af26-a7fc-40b1-8340-ba5b37f3ceb6 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:26:41.520Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fda3af26-a7fc-40b1-8340-ba5b37f3ceb6 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:26:45.347Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34e9c5f9-57aa-40d7-9c05-527bd74ed7d0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:26:45.347Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34e9c5f9-57aa-40d7-9c05-527bd74ed7d0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b3ef103
2021-06-04T00:26:45.347Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34e9c5f9-57aa-40d7-9c05-527bd74ed7d0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:26:45.348Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34e9c5f9-57aa-40d7-9c05-527bd74ed7d0 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:26:47.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e6103c7-11c8-49b4-8cf0-1b968bd0fb3a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:26:47.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e6103c7-11c8-49b4-8cf0-1b968bd0fb3a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a65034e
2021-06-04T00:26:47.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e6103c7-11c8-49b4-8cf0-1b968bd0fb3a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:26:47.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e6103c7-11c8-49b4-8cf0-1b968bd0fb3a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:26:47.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:26:48.215Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:26:48.961Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:26:48.962Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:26:48.962Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:26:50.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11176db8-8846-4a20-a1e7-ac35dedf0f45 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:26:50.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11176db8-8846-4a20-a1e7-ac35dedf0f45 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b9fc707
2021-06-04T00:26:50.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11176db8-8846-4a20-a1e7-ac35dedf0f45 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:26:50.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11176db8-8846-4a20-a1e7-ac35dedf0f45 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:26:52.780Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5164c83-3dff-4a13-9a6f-6cfd3a087306 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:26:52.780Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5164c83-3dff-4a13-9a6f-6cfd3a087306 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27fa2292
2021-06-04T00:26:52.780Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5164c83-3dff-4a13-9a6f-6cfd3a087306 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:26:52.780Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5164c83-3dff-4a13-9a6f-6cfd3a087306 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:26:56.346Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b7a165c-ced9-4b37-a5eb-608af9851beb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:26:56.346Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b7a165c-ced9-4b37-a5eb-608af9851beb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b307987
2021-06-04T00:26:56.346Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b7a165c-ced9-4b37-a5eb-608af9851beb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:26:56.346Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b7a165c-ced9-4b37-a5eb-608af9851beb PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:26:59.350Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09f301fb-54c4-47b8-a4d0-f80d9996f90a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:26:59.350Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09f301fb-54c4-47b8-a4d0-f80d9996f90a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@495d7edc
2021-06-04T00:26:59.350Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09f301fb-54c4-47b8-a4d0-f80d9996f90a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:26:59.350Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09f301fb-54c4-47b8-a4d0-f80d9996f90a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:27:02.356Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=09f301fb-54c4-47b8-a4d0-f80d9996f90a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:27:02.357Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=09f301fb-54c4-47b8-a4d0-f80d9996f90a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:27:02.357Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=09f301fb-54c4-47b8-a4d0-f80d9996f90a ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:27:02.357Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=09f301fb-54c4-47b8-a4d0-f80d9996f90a ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:27:02.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:27:02.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:27:02.951Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:27:03.122Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:27:05.101Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:27:05.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:27:08.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:27:11.166Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:27:12.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7587e301-3040-4a84-9c3f-98df5100d179 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:27:12.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7587e301-3040-4a84-9c3f-98df5100d179 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7c4f2f0f
2021-06-04T00:27:12.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7587e301-3040-4a84-9c3f-98df5100d179 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:27:12.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7587e301-3040-4a84-9c3f-98df5100d179 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:27:13.367Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=7587e301-3040-4a84-9c3f-98df5100d179 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:27:13.367Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=7587e301-3040-4a84-9c3f-98df5100d179 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:27:14.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b346398d-4164-4011-acb4-8442c45ce2ed PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:27:14.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b346398d-4164-4011-acb4-8442c45ce2ed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5273d02a
2021-06-04T00:27:14.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b346398d-4164-4011-acb4-8442c45ce2ed PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:27:14.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b346398d-4164-4011-acb4-8442c45ce2ed PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:27:15.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bf376cd-7a65-43e2-b428-5eb4da39f903 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:27:15.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bf376cd-7a65-43e2-b428-5eb4da39f903 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@707aff26
2021-06-04T00:27:15.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bf376cd-7a65-43e2-b428-5eb4da39f903 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:27:15.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bf376cd-7a65-43e2-b428-5eb4da39f903 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:27:17.951Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:27:18.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb7f48e3-f718-4508-b792-bc6a88b3a4b7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:27:18.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb7f48e3-f718-4508-b792-bc6a88b3a4b7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@75c89171
2021-06-04T00:27:18.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb7f48e3-f718-4508-b792-bc6a88b3a4b7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:27:18.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb7f48e3-f718-4508-b792-bc6a88b3a4b7 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:27:20.148Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa07f657-9788-4440-a883-9b231d329165 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:27:20.148Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa07f657-9788-4440-a883-9b231d329165 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@444be132
2021-06-04T00:27:20.148Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa07f657-9788-4440-a883-9b231d329165 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:27:20.148Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa07f657-9788-4440-a883-9b231d329165 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:27:23.151Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b333bfd4-72a5-40bf-a661-b688e2c9352b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:27:23.151Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b333bfd4-72a5-40bf-a661-b688e2c9352b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@8f59b11
2021-06-04T00:27:23.151Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b333bfd4-72a5-40bf-a661-b688e2c9352b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:27:23.152Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b333bfd4-72a5-40bf-a661-b688e2c9352b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:27:24.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1dbcd950-c826-4025-bf87-76a3f2cbae5e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:27:24.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1dbcd950-c826-4025-bf87-76a3f2cbae5e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2fd1d6e6
2021-06-04T00:27:24.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1dbcd950-c826-4025-bf87-76a3f2cbae5e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:27:24.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1dbcd950-c826-4025-bf87-76a3f2cbae5e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:27:24.897Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:27:24.898Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:27:25.950Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T00:27:27.033Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=1dbcd950-c826-4025-bf87-76a3f2cbae5e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:27:27.034Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=1dbcd950-c826-4025-bf87-76a3f2cbae5e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:27:27.034Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=1dbcd950-c826-4025-bf87-76a3f2cbae5e ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:27:27.034Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=1dbcd950-c826-4025-bf87-76a3f2cbae5e ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:27:29.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1126ae59-3a46-496a-bbdd-de96f1017498 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:27:29.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1126ae59-3a46-496a-bbdd-de96f1017498 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e239974
2021-06-04T00:27:29.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1126ae59-3a46-496a-bbdd-de96f1017498 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:27:29.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1126ae59-3a46-496a-bbdd-de96f1017498 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:27:29.518Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=1126ae59-3a46-496a-bbdd-de96f1017498 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:27:29.518Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=1126ae59-3a46-496a-bbdd-de96f1017498 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:27:30.086Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:27:30.185Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8dc95b11-eaa3-47e8-b966-cdc4a3d2edb7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:27:30.185Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8dc95b11-eaa3-47e8-b966-cdc4a3d2edb7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@21f3975e
2021-06-04T00:27:30.185Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8dc95b11-eaa3-47e8-b966-cdc4a3d2edb7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:27:30.185Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8dc95b11-eaa3-47e8-b966-cdc4a3d2edb7 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:27:30.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e0c935f-ee56-4958-81c5-6160009638b2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:27:30.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e0c935f-ee56-4958-81c5-6160009638b2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b40360
2021-06-04T00:27:30.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e0c935f-ee56-4958-81c5-6160009638b2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:27:30.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e0c935f-ee56-4958-81c5-6160009638b2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:27:31.773Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c146fb1-d56c-4807-9af3-10205f1fdd2b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:27:31.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c146fb1-d56c-4807-9af3-10205f1fdd2b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@25ec23b
2021-06-04T00:27:31.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c146fb1-d56c-4807-9af3-10205f1fdd2b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:27:31.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c146fb1-d56c-4807-9af3-10205f1fdd2b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:27:32.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:27:33.286Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:27:33.286Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T00:27:34.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2218ef9b-9102-4920-9628-1f394675f5bc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:27:34.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2218ef9b-9102-4920-9628-1f394675f5bc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@52bbd6b2
2021-06-04T00:27:34.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2218ef9b-9102-4920-9628-1f394675f5bc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:27:34.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2218ef9b-9102-4920-9628-1f394675f5bc PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:27:35.418Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=2218ef9b-9102-4920-9628-1f394675f5bc ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:27:35.418Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=2218ef9b-9102-4920-9628-1f394675f5bc ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:27:37.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=797f82a0-c34a-46d5-bb40-7de70ab17621 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:27:37.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=797f82a0-c34a-46d5-bb40-7de70ab17621 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6fcff2dc
2021-06-04T00:27:37.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=797f82a0-c34a-46d5-bb40-7de70ab17621 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:27:37.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=797f82a0-c34a-46d5-bb40-7de70ab17621 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:27:41.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d4164a1-a310-4826-ad60-08ba4b4ed7d4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:27:41.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d4164a1-a310-4826-ad60-08ba4b4ed7d4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f405346
2021-06-04T00:27:41.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d4164a1-a310-4826-ad60-08ba4b4ed7d4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:27:41.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d4164a1-a310-4826-ad60-08ba4b4ed7d4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:27:43.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df0e78b9-b8be-46b8-a030-6f3c405746a5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:27:43.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df0e78b9-b8be-46b8-a030-6f3c405746a5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3b7b0f8f
2021-06-04T00:27:43.855Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df0e78b9-b8be-46b8-a030-6f3c405746a5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:27:43.855Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df0e78b9-b8be-46b8-a030-6f3c405746a5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:27:46.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5a6fbde2-ac0b-4888-b9de-2d6329fdeeb1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:27:46.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5a6fbde2-ac0b-4888-b9de-2d6329fdeeb1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@37f94014
2021-06-04T00:27:46.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5a6fbde2-ac0b-4888-b9de-2d6329fdeeb1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:27:46.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5a6fbde2-ac0b-4888-b9de-2d6329fdeeb1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:27:47.955Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:27:48.053Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:27:48.962Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:27:48.963Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:27:48.963Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:27:50.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0747bf7d-72f4-419b-9b0e-f54812731a78 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:27:50.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0747bf7d-72f4-419b-9b0e-f54812731a78 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27b01d25
2021-06-04T00:27:50.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0747bf7d-72f4-419b-9b0e-f54812731a78 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:27:50.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0747bf7d-72f4-419b-9b0e-f54812731a78 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:27:52.579Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f9f3a91-5a6d-46fb-8ead-83e5c24fd808 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:27:52.579Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f9f3a91-5a6d-46fb-8ead-83e5c24fd808 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6a27b0f6
2021-06-04T00:27:52.579Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f9f3a91-5a6d-46fb-8ead-83e5c24fd808 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:27:52.579Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f9f3a91-5a6d-46fb-8ead-83e5c24fd808 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:27:55.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bef01e10-7ecf-4a7c-9dc5-f9d8673b587d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:27:55.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bef01e10-7ecf-4a7c-9dc5-f9d8673b587d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9c3dd4a
2021-06-04T00:27:55.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bef01e10-7ecf-4a7c-9dc5-f9d8673b587d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:27:55.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bef01e10-7ecf-4a7c-9dc5-f9d8673b587d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:27:58.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1fb9d2b-dc6e-410f-ada0-95104cd93218 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:27:58.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1fb9d2b-dc6e-410f-ada0-95104cd93218 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7447c586
2021-06-04T00:27:58.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1fb9d2b-dc6e-410f-ada0-95104cd93218 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:27:58.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1fb9d2b-dc6e-410f-ada0-95104cd93218 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:28:02.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e8fc242-df72-43e2-9f6a-280a2aa264b8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:28:02.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e8fc242-df72-43e2-9f6a-280a2aa264b8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5339a71e
2021-06-04T00:28:02.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e8fc242-df72-43e2-9f6a-280a2aa264b8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:28:02.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e8fc242-df72-43e2-9f6a-280a2aa264b8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:28:02.952Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:28:03.589Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:28:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b7aa620-fad6-4abc-aa46-41e119a35b06 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:28:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b7aa620-fad6-4abc-aa46-41e119a35b06 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@44e0d8f
2021-06-04T00:28:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b7aa620-fad6-4abc-aa46-41e119a35b06 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:28:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b7aa620-fad6-4abc-aa46-41e119a35b06 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:28:06.871Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:28:07.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9224d310-a9a9-4c3f-afb3-cbf2fac8f87d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:28:07.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9224d310-a9a9-4c3f-afb3-cbf2fac8f87d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1370b9c1
2021-06-04T00:28:07.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9224d310-a9a9-4c3f-afb3-cbf2fac8f87d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:28:07.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9224d310-a9a9-4c3f-afb3-cbf2fac8f87d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:28:11.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b867d7c-a120-4a1a-84b5-007fcbadf9d6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:28:11.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b867d7c-a120-4a1a-84b5-007fcbadf9d6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@595135dc
2021-06-04T00:28:11.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b867d7c-a120-4a1a-84b5-007fcbadf9d6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:28:11.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b867d7c-a120-4a1a-84b5-007fcbadf9d6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:28:14.355Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71566680-c063-442e-91f2-b3df7d206c0d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:28:14.355Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71566680-c063-442e-91f2-b3df7d206c0d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47ce78bf
2021-06-04T00:28:14.355Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71566680-c063-442e-91f2-b3df7d206c0d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:28:14.355Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71566680-c063-442e-91f2-b3df7d206c0d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:28:16.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c3e406d-ceb8-4703-9662-a9dc31b31100 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:28:16.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c3e406d-ceb8-4703-9662-a9dc31b31100 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@331827bc
2021-06-04T00:28:16.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c3e406d-ceb8-4703-9662-a9dc31b31100 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:28:16.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c3e406d-ceb8-4703-9662-a9dc31b31100 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:28:17.951Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:28:19.264Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:28:20.351Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21c10336-875a-4307-b028-fd43bfc4891d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:28:20.351Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21c10336-875a-4307-b028-fd43bfc4891d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@25b03eaf
2021-06-04T00:28:20.351Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21c10336-875a-4307-b028-fd43bfc4891d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:28:20.351Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21c10336-875a-4307-b028-fd43bfc4891d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:28:20.673Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01wv27ysvdxvng1wixtnamcoci3539
2021-06-04T00:28:20.674Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node02e13g02ddt8h1rkn3wm3bir6w535
2021-06-04T00:28:20.674Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01bhzk4odlpsto17y7kieckze54537
2021-06-04T00:28:20.674Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0199xddmxt9a3ci666gxw9m6u6534
2021-06-04T00:28:20.674Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0nnzkyvwcluyq1pstkrer86ihg538
2021-06-04T00:28:20.674Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node015xleucja3zyi1xqdctbn24zp8536
2021-06-04T00:28:20.674Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0rip43s31jcxggy0lekugbgod542
2021-06-04T00:28:20.674Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0kg0os42adoytrhn7etk9vmen541
2021-06-04T00:28:20.674Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0101dim7r1gt2e1qnd3mi6wvzkl533
2021-06-04T00:28:20.674Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0116r8abm7h82oaza111zxgbs2540
2021-06-04T00:28:23.458Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dac4fa39-bff7-4762-a966-5a5abaf9a424 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:28:23.458Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dac4fa39-bff7-4762-a966-5a5abaf9a424 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@751f0010
2021-06-04T00:28:23.458Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dac4fa39-bff7-4762-a966-5a5abaf9a424 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:28:23.458Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dac4fa39-bff7-4762-a966-5a5abaf9a424 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:28:26.466Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=dac4fa39-bff7-4762-a966-5a5abaf9a424 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:28:26.467Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=dac4fa39-bff7-4762-a966-5a5abaf9a424 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:28:26.467Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=dac4fa39-bff7-4762-a966-5a5abaf9a424 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:28:26.467Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=dac4fa39-bff7-4762-a966-5a5abaf9a424 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:28:26.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:28:26.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:28:29.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:28:31.550Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:28:31.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=599bf1bc-fdf0-4cb8-b247-34b5ed22a882 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:28:31.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=599bf1bc-fdf0-4cb8-b247-34b5ed22a882 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4120958c
2021-06-04T00:28:31.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=599bf1bc-fdf0-4cb8-b247-34b5ed22a882 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:28:31.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=599bf1bc-fdf0-4cb8-b247-34b5ed22a882 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:28:32.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:28:33.391Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=599bf1bc-fdf0-4cb8-b247-34b5ed22a882 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:28:33.391Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=599bf1bc-fdf0-4cb8-b247-34b5ed22a882 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:28:35.153Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb4b9467-e9be-406f-8f09-cd850a09b013 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:28:35.153Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb4b9467-e9be-406f-8f09-cd850a09b013 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17167a54
2021-06-04T00:28:35.153Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb4b9467-e9be-406f-8f09-cd850a09b013 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:28:35.153Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb4b9467-e9be-406f-8f09-cd850a09b013 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:28:36.458Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51a76893-dcc4-4461-8b1d-4e9274b2e93e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:28:36.458Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51a76893-dcc4-4461-8b1d-4e9274b2e93e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a04f726
2021-06-04T00:28:36.458Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51a76893-dcc4-4461-8b1d-4e9274b2e93e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:28:36.458Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51a76893-dcc4-4461-8b1d-4e9274b2e93e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:28:37.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dda08ccc-db2d-4a44-aacd-ae0a4ea57e4a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:28:37.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dda08ccc-db2d-4a44-aacd-ae0a4ea57e4a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f4d9d1f
2021-06-04T00:28:37.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dda08ccc-db2d-4a44-aacd-ae0a4ea57e4a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:28:37.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dda08ccc-db2d-4a44-aacd-ae0a4ea57e4a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:28:38.591Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb5e5a63-bc3f-4f3a-98b0-4fdc5a076f7f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:28:38.591Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb5e5a63-bc3f-4f3a-98b0-4fdc5a076f7f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@574c68d2
2021-06-04T00:28:38.591Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb5e5a63-bc3f-4f3a-98b0-4fdc5a076f7f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:28:38.591Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb5e5a63-bc3f-4f3a-98b0-4fdc5a076f7f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:28:39.147Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:28:39.149Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:28:40.455Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:28:41.180Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=755cd6eb-0ea0-4389-bdaa-346d249f969e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:28:41.180Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=755cd6eb-0ea0-4389-bdaa-346d249f969e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@73ac7cb5
2021-06-04T00:28:41.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=755cd6eb-0ea0-4389-bdaa-346d249f969e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:28:41.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=755cd6eb-0ea0-4389-bdaa-346d249f969e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:28:44.358Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b3f1a0f-3085-4517-8b0c-4e17fc1a775f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:28:44.358Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b3f1a0f-3085-4517-8b0c-4e17fc1a775f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4eac0821
2021-06-04T00:28:44.358Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b3f1a0f-3085-4517-8b0c-4e17fc1a775f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:28:44.358Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b3f1a0f-3085-4517-8b0c-4e17fc1a775f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:28:47.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0af1c333-9701-4f14-aac9-cd83ab92975e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:28:47.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0af1c333-9701-4f14-aac9-cd83ab92975e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d3ad18e
2021-06-04T00:28:47.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0af1c333-9701-4f14-aac9-cd83ab92975e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:28:47.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0af1c333-9701-4f14-aac9-cd83ab92975e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:28:47.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:28:48.961Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:28:48.962Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:28:48.962Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:28:49.635Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:28:50.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a9bf63e-8aa6-484a-b101-8e42de391be2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:28:50.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a9bf63e-8aa6-484a-b101-8e42de391be2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49043c03
2021-06-04T00:28:50.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a9bf63e-8aa6-484a-b101-8e42de391be2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:28:50.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a9bf63e-8aa6-484a-b101-8e42de391be2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:28:52.859Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dde7f626-bad4-4185-96dd-01799a345624 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:28:52.859Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dde7f626-bad4-4185-96dd-01799a345624 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@595db842
2021-06-04T00:28:52.859Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dde7f626-bad4-4185-96dd-01799a345624 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:28:52.859Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dde7f626-bad4-4185-96dd-01799a345624 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:28:56.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:28:56.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:28:57.652Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4db7abd2-9f70-406e-ad4a-73dec4e2c359 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:28:57.652Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4db7abd2-9f70-406e-ad4a-73dec4e2c359 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@771e4e48
2021-06-04T00:28:57.652Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4db7abd2-9f70-406e-ad4a-73dec4e2c359 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:28:57.652Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4db7abd2-9f70-406e-ad4a-73dec4e2c359 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:28:59.614Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:28:59.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e34b3c99-d6c8-4fa3-b480-26083ea39210 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:28:59.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e34b3c99-d6c8-4fa3-b480-26083ea39210 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c835784
2021-06-04T00:28:59.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e34b3c99-d6c8-4fa3-b480-26083ea39210 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:28:59.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e34b3c99-d6c8-4fa3-b480-26083ea39210 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:29:00.573Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e34b3c99-d6c8-4fa3-b480-26083ea39210 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:29:00.573Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=e34b3c99-d6c8-4fa3-b480-26083ea39210 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:29:02.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7baf867-daf5-48c0-b8ff-20f304fc7186 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:29:02.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7baf867-daf5-48c0-b8ff-20f304fc7186 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@348f9c33
2021-06-04T00:29:02.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7baf867-daf5-48c0-b8ff-20f304fc7186 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:29:02.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7baf867-daf5-48c0-b8ff-20f304fc7186 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:29:02.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:29:03.320Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e7baf867-daf5-48c0-b8ff-20f304fc7186 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:29:03.320Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e7baf867-daf5-48c0-b8ff-20f304fc7186 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:29:05.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8347b18-5353-4c56-9596-e1815ebce47a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:29:05.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8347b18-5353-4c56-9596-e1815ebce47a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@24bd48
2021-06-04T00:29:05.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8347b18-5353-4c56-9596-e1815ebce47a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:29:05.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8347b18-5353-4c56-9596-e1815ebce47a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:29:05.301Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:29:08.376Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5a97ae90-53fe-4f69-826b-3a4f8629d65a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:29:08.377Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5a97ae90-53fe-4f69-826b-3a4f8629d65a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5cdcf0a
2021-06-04T00:29:08.377Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5a97ae90-53fe-4f69-826b-3a4f8629d65a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:29:08.377Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5a97ae90-53fe-4f69-826b-3a4f8629d65a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:29:11.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2ba70bb-e23c-4920-9fc2-ee00bd7b2c6f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:29:11.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2ba70bb-e23c-4920-9fc2-ee00bd7b2c6f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43b48740
2021-06-04T00:29:11.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2ba70bb-e23c-4920-9fc2-ee00bd7b2c6f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:29:11.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2ba70bb-e23c-4920-9fc2-ee00bd7b2c6f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:29:14.348Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:29:14.463Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd36f622-d054-4c31-b037-e6937ad1e27a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:29:14.463Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd36f622-d054-4c31-b037-e6937ad1e27a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b12e501
2021-06-04T00:29:14.463Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd36f622-d054-4c31-b037-e6937ad1e27a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:29:14.463Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd36f622-d054-4c31-b037-e6937ad1e27a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:29:17.569Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0238b794-e471-49c5-acb9-15afb0da4575 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:29:17.569Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0238b794-e471-49c5-acb9-15afb0da4575 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e79c7d6
2021-06-04T00:29:17.569Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0238b794-e471-49c5-acb9-15afb0da4575 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:29:17.569Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0238b794-e471-49c5-acb9-15afb0da4575 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:29:17.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:29:20.663Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81aec0a1-c777-4256-b2f2-d0da13051d66 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:29:20.663Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81aec0a1-c777-4256-b2f2-d0da13051d66 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45a7e88c
2021-06-04T00:29:20.663Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81aec0a1-c777-4256-b2f2-d0da13051d66 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:29:20.663Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81aec0a1-c777-4256-b2f2-d0da13051d66 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:29:23.446Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7743b0c-d860-4439-bb62-7c955d0d1ca1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:29:23.446Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7743b0c-d860-4439-bb62-7c955d0d1ca1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22cee9ff
2021-06-04T00:29:23.446Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7743b0c-d860-4439-bb62-7c955d0d1ca1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:29:23.446Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7743b0c-d860-4439-bb62-7c955d0d1ca1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:29:25.949Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T00:29:26.449Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e7743b0c-d860-4439-bb62-7c955d0d1ca1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:29:26.449Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e7743b0c-d860-4439-bb62-7c955d0d1ca1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:29:26.449Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e7743b0c-d860-4439-bb62-7c955d0d1ca1 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:29:26.449Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e7743b0c-d860-4439-bb62-7c955d0d1ca1 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:29:31.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fd15d98-0b2f-4ff8-b884-b083d29d1685 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:29:31.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fd15d98-0b2f-4ff8-b884-b083d29d1685 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ee82a4a
2021-06-04T00:29:31.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fd15d98-0b2f-4ff8-b884-b083d29d1685 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:29:31.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fd15d98-0b2f-4ff8-b884-b083d29d1685 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:29:31.769Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=7fd15d98-0b2f-4ff8-b884-b083d29d1685 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:29:31.769Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=7fd15d98-0b2f-4ff8-b884-b083d29d1685 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:29:35.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:29:35.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:29:38.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:29:41.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:29:44.301Z [cluster1-nio-worker-1] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T00:29:44.301Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad5d38e1-3134-44a7-8702-59649bec3716 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:29:44.301Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad5d38e1-3134-44a7-8702-59649bec3716 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@24d66dfb
2021-06-04T00:29:44.301Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad5d38e1-3134-44a7-8702-59649bec3716 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:29:44.301Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad5d38e1-3134-44a7-8702-59649bec3716 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:29:44.949Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:29:46.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed0af419-8a62-4751-9382-e778ad7d7842 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:29:46.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed0af419-8a62-4751-9382-e778ad7d7842 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7182f98f
2021-06-04T00:29:46.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed0af419-8a62-4751-9382-e778ad7d7842 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:29:46.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed0af419-8a62-4751-9382-e778ad7d7842 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:29:46.311Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:29:46.313Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:29:47.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:29:47.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:29:48.961Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:29:48.962Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:29:48.962Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:29:49.682Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:29:52.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f9741b7-6303-424e-9c48-a2d633845aba PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:29:52.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f9741b7-6303-424e-9c48-a2d633845aba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ec7278f
2021-06-04T00:29:52.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f9741b7-6303-424e-9c48-a2d633845aba PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:29:52.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f9741b7-6303-424e-9c48-a2d633845aba PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:29:53.418Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=1f9741b7-6303-424e-9c48-a2d633845aba ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:29:53.418Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=1f9741b7-6303-424e-9c48-a2d633845aba ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:29:54.075Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20c7c529-412d-4558-9d1d-1773c86fd516 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:29:54.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20c7c529-412d-4558-9d1d-1773c86fd516 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28c7bddc
2021-06-04T00:29:54.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20c7c529-412d-4558-9d1d-1773c86fd516 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:29:54.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20c7c529-412d-4558-9d1d-1773c86fd516 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:29:54.775Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=20c7c529-412d-4558-9d1d-1773c86fd516 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:29:54.775Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=20c7c529-412d-4558-9d1d-1773c86fd516 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:29:55.376Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a437925c-9553-4439-bb20-bada8d39b40a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:29:55.376Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a437925c-9553-4439-bb20-bada8d39b40a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3fe9b48a
2021-06-04T00:29:55.376Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a437925c-9553-4439-bb20-bada8d39b40a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:29:55.376Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a437925c-9553-4439-bb20-bada8d39b40a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:29:57.752Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5c47620-7e88-4a4a-b99a-1da4410d8620 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:29:57.752Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5c47620-7e88-4a4a-b99a-1da4410d8620 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@59416c79
2021-06-04T00:29:57.752Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5c47620-7e88-4a4a-b99a-1da4410d8620 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:29:57.752Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5c47620-7e88-4a4a-b99a-1da4410d8620 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:29:59.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42fed31d-3586-4259-a6bb-42dd3dedcf96 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:29:59.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42fed31d-3586-4259-a6bb-42dd3dedcf96 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e8dc381
2021-06-04T00:29:59.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42fed31d-3586-4259-a6bb-42dd3dedcf96 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:29:59.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42fed31d-3586-4259-a6bb-42dd3dedcf96 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:30:01.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ee21553-79a0-4066-b653-472dad7a8ce5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:30:01.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ee21553-79a0-4066-b653-472dad7a8ce5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7bb1bad1
2021-06-04T00:30:01.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ee21553-79a0-4066-b653-472dad7a8ce5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:30:01.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ee21553-79a0-4066-b653-472dad7a8ce5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:30:04.556Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0ee21553-79a0-4066-b653-472dad7a8ce5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:30:04.556Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0ee21553-79a0-4066-b653-472dad7a8ce5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:30:04.556Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0ee21553-79a0-4066-b653-472dad7a8ce5 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:30:04.556Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0ee21553-79a0-4066-b653-472dad7a8ce5 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:30:06.655Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=604407d7-a507-41fe-b6a1-db3b8ae0032d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:30:06.655Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=604407d7-a507-41fe-b6a1-db3b8ae0032d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@90e1cc9
2021-06-04T00:30:06.655Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=604407d7-a507-41fe-b6a1-db3b8ae0032d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:30:06.655Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=604407d7-a507-41fe-b6a1-db3b8ae0032d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:30:08.881Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=604407d7-a507-41fe-b6a1-db3b8ae0032d ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:30:08.881Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=604407d7-a507-41fe-b6a1-db3b8ae0032d ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:30:09.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a1f18b3-8d2a-474b-a0a1-e91941357818 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:30:09.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a1f18b3-8d2a-474b-a0a1-e91941357818 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5befca10
2021-06-04T00:30:09.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a1f18b3-8d2a-474b-a0a1-e91941357818 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:30:09.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a1f18b3-8d2a-474b-a0a1-e91941357818 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:30:10.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c55da849-dd3f-46e8-a80d-8482e6769c92 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:30:10.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c55da849-dd3f-46e8-a80d-8482e6769c92 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d7e848e
2021-06-04T00:30:10.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c55da849-dd3f-46e8-a80d-8482e6769c92 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:30:10.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c55da849-dd3f-46e8-a80d-8482e6769c92 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:30:11.587Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:30:11.593Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:30:11.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=152d331e-e16c-4be4-a0a4-c1090d1e3e75 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:30:11.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=152d331e-e16c-4be4-a0a4-c1090d1e3e75 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@546f3dbc
2021-06-04T00:30:11.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=152d331e-e16c-4be4-a0a4-c1090d1e3e75 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:30:11.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=152d331e-e16c-4be4-a0a4-c1090d1e3e75 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:30:13.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f5165da-b96f-4390-b6e2-a6c387cafbe9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:30:13.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f5165da-b96f-4390-b6e2-a6c387cafbe9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b672327
2021-06-04T00:30:13.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f5165da-b96f-4390-b6e2-a6c387cafbe9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:30:13.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f5165da-b96f-4390-b6e2-a6c387cafbe9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:30:15.606Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10edb74b-3de4-484b-9ca6-d8393a3252fb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:30:15.606Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10edb74b-3de4-484b-9ca6-d8393a3252fb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e7dc911
2021-06-04T00:30:15.606Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10edb74b-3de4-484b-9ca6-d8393a3252fb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:30:15.606Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10edb74b-3de4-484b-9ca6-d8393a3252fb PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:30:16.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fded9f9-a25a-41e4-a276-fb2bb74113d4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:30:16.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fded9f9-a25a-41e4-a276-fb2bb74113d4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7fe6ca4
2021-06-04T00:30:16.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fded9f9-a25a-41e4-a276-fb2bb74113d4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:30:16.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fded9f9-a25a-41e4-a276-fb2bb74113d4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:30:20.058Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b066ec1-453f-405d-82a1-5c3e98e46baf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:30:20.059Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b066ec1-453f-405d-82a1-5c3e98e46baf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ad1233a
2021-06-04T00:30:20.059Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b066ec1-453f-405d-82a1-5c3e98e46baf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:30:20.059Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b066ec1-453f-405d-82a1-5c3e98e46baf PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:30:20.440Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:30:20.442Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:30:21.640Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:30:21.642Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:30:21.674Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:30:21.675Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:30:21.689Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:30:21.690Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:30:21.790Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:30:21.791Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:30:22.247Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:30:22.248Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:30:22.379Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:30:22.380Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:30:22.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=488e8010-e09d-4364-9647-d94f52b5be97 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:30:22.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=488e8010-e09d-4364-9647-d94f52b5be97 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@686d435c
2021-06-04T00:30:22.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=488e8010-e09d-4364-9647-d94f52b5be97 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:30:22.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=488e8010-e09d-4364-9647-d94f52b5be97 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:30:23.255Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:30:23.256Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T00:30:23.759Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7da7b9d0-932b-4afb-91b7-085f3e151ad8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:30:23.759Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7da7b9d0-932b-4afb-91b7-085f3e151ad8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58e82a01
2021-06-04T00:30:23.759Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7da7b9d0-932b-4afb-91b7-085f3e151ad8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:30:23.759Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7da7b9d0-932b-4afb-91b7-085f3e151ad8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:30:25.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dff310ec-281e-4053-bf3f-826e3a8c126f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:30:25.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dff310ec-281e-4053-bf3f-826e3a8c126f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c07f6f4
2021-06-04T00:30:25.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dff310ec-281e-4053-bf3f-826e3a8c126f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:30:25.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dff310ec-281e-4053-bf3f-826e3a8c126f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:30:25.618Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=dff310ec-281e-4053-bf3f-826e3a8c126f ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:30:25.618Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=dff310ec-281e-4053-bf3f-826e3a8c126f ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:30:26.468Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd71e985-05dd-4ed8-ba82-b7215db55864 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:30:26.468Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd71e985-05dd-4ed8-ba82-b7215db55864 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@f6cc8bd
2021-06-04T00:30:26.468Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd71e985-05dd-4ed8-ba82-b7215db55864 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:30:26.469Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd71e985-05dd-4ed8-ba82-b7215db55864 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:30:30.466Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af5ba9b6-845e-4570-8e29-f8dcd3474365 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:30:30.466Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af5ba9b6-845e-4570-8e29-f8dcd3474365 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d990daf
2021-06-04T00:30:30.466Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af5ba9b6-845e-4570-8e29-f8dcd3474365 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:30:30.466Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af5ba9b6-845e-4570-8e29-f8dcd3474365 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:30:31.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83473884-4ca4-4d9d-81c1-b7b4c2358906 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:30:31.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83473884-4ca4-4d9d-81c1-b7b4c2358906 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1438963f
2021-06-04T00:30:31.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83473884-4ca4-4d9d-81c1-b7b4c2358906 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:30:31.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83473884-4ca4-4d9d-81c1-b7b4c2358906 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:30:31.883Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:30:32.952Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:30:33.068Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:30:35.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bdc7e43-484e-4979-9e75-a9769343e409 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:30:35.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bdc7e43-484e-4979-9e75-a9769343e409 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79b721a
2021-06-04T00:30:35.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bdc7e43-484e-4979-9e75-a9769343e409 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:30:35.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bdc7e43-484e-4979-9e75-a9769343e409 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:30:37.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7de30114-2f9f-428d-a3ac-613ebe85dd3b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:30:37.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7de30114-2f9f-428d-a3ac-613ebe85dd3b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e5b7b74
2021-06-04T00:30:37.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7de30114-2f9f-428d-a3ac-613ebe85dd3b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:30:37.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7de30114-2f9f-428d-a3ac-613ebe85dd3b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:30:40.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97295800-8046-44a5-9dc3-7f6017caa8b1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:30:40.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97295800-8046-44a5-9dc3-7f6017caa8b1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b6ae765
2021-06-04T00:30:40.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97295800-8046-44a5-9dc3-7f6017caa8b1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:30:40.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97295800-8046-44a5-9dc3-7f6017caa8b1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:30:47.951Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:30:48.266Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:30:48.962Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:30:48.964Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:30:48.964Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:30:50.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:30:50.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:30:51.251Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9a2d092-adc4-4ff6-8614-f33192ec0c5a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:30:51.251Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9a2d092-adc4-4ff6-8614-f33192ec0c5a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b330559
2021-06-04T00:30:51.251Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9a2d092-adc4-4ff6-8614-f33192ec0c5a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:30:51.251Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9a2d092-adc4-4ff6-8614-f33192ec0c5a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:30:51.675Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3342ae3a-6763-4384-96c2-27f68441d67e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:30:51.676Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3342ae3a-6763-4384-96c2-27f68441d67e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27e4b387
2021-06-04T00:30:51.676Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3342ae3a-6763-4384-96c2-27f68441d67e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:30:51.676Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3342ae3a-6763-4384-96c2-27f68441d67e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:30:51.886Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3342ae3a-6763-4384-96c2-27f68441d67e ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:30:51.886Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=3342ae3a-6763-4384-96c2-27f68441d67e ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:30:52.455Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6327bb1-f604-435a-85ea-9a3d2c4e17cb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:30:52.455Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6327bb1-f604-435a-85ea-9a3d2c4e17cb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1251ecd4
2021-06-04T00:30:52.455Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6327bb1-f604-435a-85ea-9a3d2c4e17cb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:30:52.455Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6327bb1-f604-435a-85ea-9a3d2c4e17cb PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:30:52.549Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:30:53.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=518b4b81-88e9-4829-a46d-998c37b5e84b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:30:53.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=518b4b81-88e9-4829-a46d-998c37b5e84b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e7c7034
2021-06-04T00:30:53.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=518b4b81-88e9-4829-a46d-998c37b5e84b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:30:53.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=518b4b81-88e9-4829-a46d-998c37b5e84b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:30:54.218Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=518b4b81-88e9-4829-a46d-998c37b5e84b ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:30:54.218Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=518b4b81-88e9-4829-a46d-998c37b5e84b ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:30:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f51b38a-f69e-4e8e-8370-7718a19f975c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:30:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f51b38a-f69e-4e8e-8370-7718a19f975c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d06a96f
2021-06-04T00:30:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f51b38a-f69e-4e8e-8370-7718a19f975c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:30:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f51b38a-f69e-4e8e-8370-7718a19f975c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:30:59.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03c9866f-d84a-4578-b772-4659c7034d16 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:30:59.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03c9866f-d84a-4578-b772-4659c7034d16 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@f7c5bc3
2021-06-04T00:30:59.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03c9866f-d84a-4578-b772-4659c7034d16 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:30:59.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03c9866f-d84a-4578-b772-4659c7034d16 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:31:01.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b277960-4ea3-4d99-8ce7-40e63aff19e7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:31:01.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b277960-4ea3-4d99-8ce7-40e63aff19e7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@12d621b4
2021-06-04T00:31:01.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b277960-4ea3-4d99-8ce7-40e63aff19e7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:31:01.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b277960-4ea3-4d99-8ce7-40e63aff19e7 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:31:02.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:31:04.524Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:31:05.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b922e43-115c-427f-9512-8f4df88d7a2d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:31:05.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b922e43-115c-427f-9512-8f4df88d7a2d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1fa61e0a
2021-06-04T00:31:05.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b922e43-115c-427f-9512-8f4df88d7a2d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:31:05.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b922e43-115c-427f-9512-8f4df88d7a2d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:31:08.108Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b7a8332-1301-44e8-bf85-47ae784ea288 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:31:08.108Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b7a8332-1301-44e8-bf85-47ae784ea288 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27d38140
2021-06-04T00:31:08.108Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b7a8332-1301-44e8-bf85-47ae784ea288 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:31:08.108Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b7a8332-1301-44e8-bf85-47ae784ea288 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:31:10.780Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c5918c7-6d3b-46c4-a988-4ea54f15fec9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:31:10.780Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c5918c7-6d3b-46c4-a988-4ea54f15fec9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a9c643a
2021-06-04T00:31:10.780Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c5918c7-6d3b-46c4-a988-4ea54f15fec9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:31:10.780Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c5918c7-6d3b-46c4-a988-4ea54f15fec9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:31:13.964Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a32dcf05-5157-4bb2-bbe5-a7f7b83cf9af PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:31:13.964Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a32dcf05-5157-4bb2-bbe5-a7f7b83cf9af PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6964275c
2021-06-04T00:31:13.964Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a32dcf05-5157-4bb2-bbe5-a7f7b83cf9af PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:31:13.964Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a32dcf05-5157-4bb2-bbe5-a7f7b83cf9af PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:31:15.687Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:31:16.970Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a32dcf05-5157-4bb2-bbe5-a7f7b83cf9af ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:31:16.971Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a32dcf05-5157-4bb2-bbe5-a7f7b83cf9af ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:31:16.971Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a32dcf05-5157-4bb2-bbe5-a7f7b83cf9af ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:31:16.971Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a32dcf05-5157-4bb2-bbe5-a7f7b83cf9af ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:31:17.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:31:17.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:31:17.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:31:18.557Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23af1d1d-2021-4524-9249-7807ce976b00 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:31:18.557Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23af1d1d-2021-4524-9249-7807ce976b00 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@461d2234
2021-06-04T00:31:18.557Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23af1d1d-2021-4524-9249-7807ce976b00 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:31:18.557Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23af1d1d-2021-4524-9249-7807ce976b00 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:31:18.701Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:31:19.057Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=23af1d1d-2021-4524-9249-7807ce976b00 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:31:19.057Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=23af1d1d-2021-4524-9249-7807ce976b00 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:31:19.900Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:31:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=788603b5-329a-41a5-ad62-0cd6add89de3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:31:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=788603b5-329a-41a5-ad62-0cd6add89de3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54eb6417
2021-06-04T00:31:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=788603b5-329a-41a5-ad62-0cd6add89de3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:31:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=788603b5-329a-41a5-ad62-0cd6add89de3 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:31:20.474Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=788603b5-329a-41a5-ad62-0cd6add89de3 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:31:20.474Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=788603b5-329a-41a5-ad62-0cd6add89de3 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:31:23.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=73af286d-d007-4144-ba14-0aaf0a07eb49 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:31:23.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=73af286d-d007-4144-ba14-0aaf0a07eb49 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c7df711
2021-06-04T00:31:23.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=73af286d-d007-4144-ba14-0aaf0a07eb49 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:31:23.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=73af286d-d007-4144-ba14-0aaf0a07eb49 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:31:24.166Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=73af286d-d007-4144-ba14-0aaf0a07eb49 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:31:24.166Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=73af286d-d007-4144-ba14-0aaf0a07eb49 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:31:26.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=513ec630-e007-4b72-9678-3c7cb37b0e90 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:31:26.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=513ec630-e007-4b72-9678-3c7cb37b0e90 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@335e6a28
2021-06-04T00:31:26.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=513ec630-e007-4b72-9678-3c7cb37b0e90 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:31:26.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=513ec630-e007-4b72-9678-3c7cb37b0e90 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:31:29.079Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5318e023-c98e-4ae5-8d40-853b43d74ca4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:31:29.080Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5318e023-c98e-4ae5-8d40-853b43d74ca4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35b6c0a7
2021-06-04T00:31:29.080Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5318e023-c98e-4ae5-8d40-853b43d74ca4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:31:29.080Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5318e023-c98e-4ae5-8d40-853b43d74ca4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:31:31.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c6e5547-9cf9-4276-9d0c-c1e3b7eb8080 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:31:31.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c6e5547-9cf9-4276-9d0c-c1e3b7eb8080 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a72d1da
2021-06-04T00:31:31.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c6e5547-9cf9-4276-9d0c-c1e3b7eb8080 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:31:31.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c6e5547-9cf9-4276-9d0c-c1e3b7eb8080 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:31:32.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:31:35.658Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df3cec2f-86fe-4383-9a65-9a1186eaa797 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:31:35.658Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df3cec2f-86fe-4383-9a65-9a1186eaa797 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49c46cfa
2021-06-04T00:31:35.658Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df3cec2f-86fe-4383-9a65-9a1186eaa797 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:31:35.658Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df3cec2f-86fe-4383-9a65-9a1186eaa797 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:31:39.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0090b4b2-af13-426b-a277-29fdc268dac5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:31:39.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0090b4b2-af13-426b-a277-29fdc268dac5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@98b40c0
2021-06-04T00:31:39.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0090b4b2-af13-426b-a277-29fdc268dac5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:31:39.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0090b4b2-af13-426b-a277-29fdc268dac5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:31:40.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc60c973-ac58-4629-a6f0-7bccff777a8d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:31:40.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc60c973-ac58-4629-a6f0-7bccff777a8d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@abb0aae
2021-06-04T00:31:40.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc60c973-ac58-4629-a6f0-7bccff777a8d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:31:40.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc60c973-ac58-4629-a6f0-7bccff777a8d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:31:40.949Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T00:31:46.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50c96b2e-f367-4c41-a176-81f2676c5ea6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:31:46.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50c96b2e-f367-4c41-a176-81f2676c5ea6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@26ebe622
2021-06-04T00:31:46.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50c96b2e-f367-4c41-a176-81f2676c5ea6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:31:46.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50c96b2e-f367-4c41-a176-81f2676c5ea6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:31:46.321Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=50c96b2e-f367-4c41-a176-81f2676c5ea6 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:31:46.321Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=50c96b2e-f367-4c41-a176-81f2676c5ea6 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:31:46.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c22e72c-175a-4d42-a739-d0d347283b16 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:31:46.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c22e72c-175a-4d42-a739-d0d347283b16 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c22fdb9
2021-06-04T00:31:46.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c22e72c-175a-4d42-a739-d0d347283b16 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:31:46.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c22e72c-175a-4d42-a739-d0d347283b16 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:31:48.339Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:31:48.340Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:31:48.961Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:31:48.962Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:31:48.962Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:31:50.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=277e7103-1b58-4084-abb6-df9708ae1977 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:31:50.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=277e7103-1b58-4084-abb6-df9708ae1977 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ffc39bd
2021-06-04T00:31:50.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=277e7103-1b58-4084-abb6-df9708ae1977 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:31:50.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=277e7103-1b58-4084-abb6-df9708ae1977 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:31:54.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c602489-f032-4996-8a15-30ca94c2429f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:31:54.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c602489-f032-4996-8a15-30ca94c2429f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4d40ae96
2021-06-04T00:31:54.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c602489-f032-4996-8a15-30ca94c2429f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:31:54.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c602489-f032-4996-8a15-30ca94c2429f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:31:56.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d09facb-e60d-4e79-aa25-63b2329737ea PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:31:56.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d09facb-e60d-4e79-aa25-63b2329737ea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34e38bea
2021-06-04T00:31:56.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d09facb-e60d-4e79-aa25-63b2329737ea PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:31:56.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d09facb-e60d-4e79-aa25-63b2329737ea PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:31:57.355Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:31:57.355Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:31:57.390Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:31:57.390Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:31:57.398Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:31:57.398Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:31:57.400Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T00:31:57.401Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:31:57.403Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:31:57.403Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:31:57.404Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:31:57.404Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:31:57.406Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:31:57.406Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:31:57.407Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T00:31:57.408Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:31:57.409Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:31:57.409Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:31:57.412Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:31:57.412Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:31:57.820Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:31:57.820Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:31:57.879Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:31:59.069Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aae974ed-242f-4994-ae7d-be36d6a5299c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:31:59.069Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aae974ed-242f-4994-ae7d-be36d6a5299c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f7777fa
2021-06-04T00:31:59.069Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aae974ed-242f-4994-ae7d-be36d6a5299c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:31:59.069Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aae974ed-242f-4994-ae7d-be36d6a5299c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:32:01.875Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f092c2f-27ef-4346-bc29-3588d5a2cdf0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:32:01.875Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f092c2f-27ef-4346-bc29-3588d5a2cdf0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@11b89a78
2021-06-04T00:32:01.875Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f092c2f-27ef-4346-bc29-3588d5a2cdf0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:32:01.875Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f092c2f-27ef-4346-bc29-3588d5a2cdf0 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:32:02.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:32:03.040Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:32:03.040Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T00:32:05.173Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce8d549a-7257-4e79-a556-c0b9b3762ae8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:32:05.173Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce8d549a-7257-4e79-a556-c0b9b3762ae8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@59c4a2c7
2021-06-04T00:32:05.173Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce8d549a-7257-4e79-a556-c0b9b3762ae8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:32:05.173Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce8d549a-7257-4e79-a556-c0b9b3762ae8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:32:05.618Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ce8d549a-7257-4e79-a556-c0b9b3762ae8 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:32:05.618Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ce8d549a-7257-4e79-a556-c0b9b3762ae8 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:32:07.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6240cfe-0b08-4c2c-a757-1519fb84ef2a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:32:07.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6240cfe-0b08-4c2c-a757-1519fb84ef2a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7150dece
2021-06-04T00:32:07.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6240cfe-0b08-4c2c-a757-1519fb84ef2a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:32:07.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6240cfe-0b08-4c2c-a757-1519fb84ef2a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:32:10.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9d9281b-7393-44df-8951-04b730d982f1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:32:10.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9d9281b-7393-44df-8951-04b730d982f1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@254cafb9
2021-06-04T00:32:10.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9d9281b-7393-44df-8951-04b730d982f1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:32:10.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9d9281b-7393-44df-8951-04b730d982f1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:32:14.007Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:32:15.049Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77b6d8a1-e4fc-4f38-8ad5-b23d1416bbf3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:32:15.049Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77b6d8a1-e4fc-4f38-8ad5-b23d1416bbf3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@70729a32
2021-06-04T00:32:15.049Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77b6d8a1-e4fc-4f38-8ad5-b23d1416bbf3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:32:15.049Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77b6d8a1-e4fc-4f38-8ad5-b23d1416bbf3 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:32:16.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3669fe8-7122-4421-8752-2840b24961f3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:32:16.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3669fe8-7122-4421-8752-2840b24961f3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@c5cdc61
2021-06-04T00:32:16.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3669fe8-7122-4421-8752-2840b24961f3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:32:16.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3669fe8-7122-4421-8752-2840b24961f3 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:32:17.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:32:20.066Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37191326-b32a-4359-8327-c1ea09195ba2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:32:20.066Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37191326-b32a-4359-8327-c1ea09195ba2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b8dc58a
2021-06-04T00:32:20.066Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37191326-b32a-4359-8327-c1ea09195ba2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:32:20.066Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37191326-b32a-4359-8327-c1ea09195ba2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:32:21.827Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:32:22.794Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1188e67-a4b7-42d2-be36-5c54023a29a3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:32:22.794Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1188e67-a4b7-42d2-be36-5c54023a29a3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3bfc8c25
2021-06-04T00:32:22.794Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1188e67-a4b7-42d2-be36-5c54023a29a3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:32:22.794Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1188e67-a4b7-42d2-be36-5c54023a29a3 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:32:25.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a397ecb-6e2e-40ca-a0be-094280b438ad PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:32:25.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a397ecb-6e2e-40ca-a0be-094280b438ad PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5fbb3262
2021-06-04T00:32:25.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a397ecb-6e2e-40ca-a0be-094280b438ad PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:32:25.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a397ecb-6e2e-40ca-a0be-094280b438ad PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:32:29.075Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e49d6d6-a188-42e5-8d58-9f9d7328ddba PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:32:29.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e49d6d6-a188-42e5-8d58-9f9d7328ddba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@356e5220
2021-06-04T00:32:29.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e49d6d6-a188-42e5-8d58-9f9d7328ddba PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:32:29.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e49d6d6-a188-42e5-8d58-9f9d7328ddba PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:32:31.689Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=041dca90-a15b-42f8-b0b7-9ad0c6a60af7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:32:31.689Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=041dca90-a15b-42f8-b0b7-9ad0c6a60af7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@205a6092
2021-06-04T00:32:31.689Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=041dca90-a15b-42f8-b0b7-9ad0c6a60af7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:32:31.689Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=041dca90-a15b-42f8-b0b7-9ad0c6a60af7 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:32:32.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:32:34.303Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:32:35.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=916a7763-eaaa-45ac-b1cb-11d2fced2c9a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:32:35.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=916a7763-eaaa-45ac-b1cb-11d2fced2c9a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f984d18
2021-06-04T00:32:35.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=916a7763-eaaa-45ac-b1cb-11d2fced2c9a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:32:35.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=916a7763-eaaa-45ac-b1cb-11d2fced2c9a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:32:38.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37ff6f81-5362-47ce-b653-ff6738e36cda PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:32:38.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37ff6f81-5362-47ce-b653-ff6738e36cda PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@793658ab
2021-06-04T00:32:38.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37ff6f81-5362-47ce-b653-ff6738e36cda PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:32:38.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37ff6f81-5362-47ce-b653-ff6738e36cda PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:32:41.456Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c34caf1-14b0-4d48-8ca6-b2a035c94f29 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:32:41.456Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c34caf1-14b0-4d48-8ca6-b2a035c94f29 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e8efaff
2021-06-04T00:32:41.456Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c34caf1-14b0-4d48-8ca6-b2a035c94f29 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:32:41.456Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c34caf1-14b0-4d48-8ca6-b2a035c94f29 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:32:44.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:32:44.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:32:45.162Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0df0c898-57dd-4d6e-89b7-d03ca75fc2c8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:32:45.162Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0df0c898-57dd-4d6e-89b7-d03ca75fc2c8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4da3534c
2021-06-04T00:32:45.162Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0df0c898-57dd-4d6e-89b7-d03ca75fc2c8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:32:45.162Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0df0c898-57dd-4d6e-89b7-d03ca75fc2c8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:32:46.746Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:32:47.956Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:32:48.166Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0df0c898-57dd-4d6e-89b7-d03ca75fc2c8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:32:48.167Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0df0c898-57dd-4d6e-89b7-d03ca75fc2c8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:32:48.167Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0df0c898-57dd-4d6e-89b7-d03ca75fc2c8 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:32:48.167Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0df0c898-57dd-4d6e-89b7-d03ca75fc2c8 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:32:48.961Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:32:48.962Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:32:48.963Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:32:49.511Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:32:49.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8133c1c-1405-46ad-9e36-e30c994dff66 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:32:49.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8133c1c-1405-46ad-9e36-e30c994dff66 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@706e276d
2021-06-04T00:32:49.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8133c1c-1405-46ad-9e36-e30c994dff66 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:32:49.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8133c1c-1405-46ad-9e36-e30c994dff66 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:32:50.354Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e8133c1c-1405-46ad-9e36-e30c994dff66 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:32:50.354Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e8133c1c-1405-46ad-9e36-e30c994dff66 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:32:51.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45be07d8-18f0-4a7d-a7eb-fe938d98d284 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:32:51.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45be07d8-18f0-4a7d-a7eb-fe938d98d284 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7246965c
2021-06-04T00:32:51.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45be07d8-18f0-4a7d-a7eb-fe938d98d284 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:32:51.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45be07d8-18f0-4a7d-a7eb-fe938d98d284 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:32:53.354Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b0c5699-45b1-4a45-a29e-db08a8863c14 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:32:53.354Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b0c5699-45b1-4a45-a29e-db08a8863c14 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2528826b
2021-06-04T00:32:53.354Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b0c5699-45b1-4a45-a29e-db08a8863c14 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:32:53.354Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b0c5699-45b1-4a45-a29e-db08a8863c14 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:32:55.960Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=451bfeeb-68e6-4452-8b34-832ed84d9f66 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:32:55.960Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=451bfeeb-68e6-4452-8b34-832ed84d9f66 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@247c8cec
2021-06-04T00:32:55.960Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=451bfeeb-68e6-4452-8b34-832ed84d9f66 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:32:55.960Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=451bfeeb-68e6-4452-8b34-832ed84d9f66 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:32:59.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a3062bd-4057-4d1a-a020-dd8ce56f18f8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:32:59.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a3062bd-4057-4d1a-a020-dd8ce56f18f8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29f19a2a
2021-06-04T00:32:59.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a3062bd-4057-4d1a-a020-dd8ce56f18f8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:32:59.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a3062bd-4057-4d1a-a020-dd8ce56f18f8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:33:02.149Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16c4cf62-ea74-4b09-a758-6e0cd45aec16 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:33:02.149Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16c4cf62-ea74-4b09-a758-6e0cd45aec16 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6fc30d3e
2021-06-04T00:33:02.149Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16c4cf62-ea74-4b09-a758-6e0cd45aec16 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:33:02.149Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16c4cf62-ea74-4b09-a758-6e0cd45aec16 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:33:02.951Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:33:03.029Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:33:04.660Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:33:05.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=583ead91-3489-4fd1-9946-3134d37126a1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:33:05.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=583ead91-3489-4fd1-9946-3134d37126a1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e19e177
2021-06-04T00:33:05.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=583ead91-3489-4fd1-9946-3134d37126a1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:33:05.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=583ead91-3489-4fd1-9946-3134d37126a1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:33:07.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf967933-c3ed-4cc0-a0fb-6afb5f40c837 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:33:07.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf967933-c3ed-4cc0-a0fb-6afb5f40c837 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e4207b4
2021-06-04T00:33:07.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf967933-c3ed-4cc0-a0fb-6afb5f40c837 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:33:07.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf967933-c3ed-4cc0-a0fb-6afb5f40c837 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:33:11.190Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0eba7c7e-fb95-42a7-abd3-10b38ad90ce8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:33:11.190Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0eba7c7e-fb95-42a7-abd3-10b38ad90ce8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b47f49c
2021-06-04T00:33:11.190Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0eba7c7e-fb95-42a7-abd3-10b38ad90ce8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:33:11.190Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0eba7c7e-fb95-42a7-abd3-10b38ad90ce8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:33:13.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cac50816-30cd-4b1d-ab3c-3f09b0d6e9b5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:33:13.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cac50816-30cd-4b1d-ab3c-3f09b0d6e9b5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c9abe37
2021-06-04T00:33:13.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cac50816-30cd-4b1d-ab3c-3f09b0d6e9b5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:33:13.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cac50816-30cd-4b1d-ab3c-3f09b0d6e9b5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:33:16.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afe1d889-896b-429a-b160-e5362580d7aa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:33:16.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afe1d889-896b-429a-b160-e5362580d7aa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5dc9e68a
2021-06-04T00:33:16.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afe1d889-896b-429a-b160-e5362580d7aa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:33:16.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afe1d889-896b-429a-b160-e5362580d7aa PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:33:17.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:33:20.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76aad8ce-7d1c-48c5-b2f8-d72633739a06 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:33:20.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76aad8ce-7d1c-48c5-b2f8-d72633739a06 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3682520
2021-06-04T00:33:20.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76aad8ce-7d1c-48c5-b2f8-d72633739a06 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:33:20.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76aad8ce-7d1c-48c5-b2f8-d72633739a06 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:33:22.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b41a650c-dd45-4777-a147-a77533e053ae PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:33:22.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b41a650c-dd45-4777-a147-a77533e053ae PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@575fd2c5
2021-06-04T00:33:22.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b41a650c-dd45-4777-a147-a77533e053ae PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:33:22.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b41a650c-dd45-4777-a147-a77533e053ae PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:33:25.459Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:33:25.460Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:33:25.950Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T00:33:26.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=313bc6e5-e677-4758-9809-6295a0b9413e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:33:26.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=313bc6e5-e677-4758-9809-6295a0b9413e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e7da51f
2021-06-04T00:33:26.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=313bc6e5-e677-4758-9809-6295a0b9413e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:33:26.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=313bc6e5-e677-4758-9809-6295a0b9413e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:33:29.191Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=313bc6e5-e677-4758-9809-6295a0b9413e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:33:29.192Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=313bc6e5-e677-4758-9809-6295a0b9413e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:33:29.192Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=313bc6e5-e677-4758-9809-6295a0b9413e ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:33:29.192Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=313bc6e5-e677-4758-9809-6295a0b9413e ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:33:30.571Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:33:31.155Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af46179f-956b-470a-9c9c-631dfadfa62a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:33:31.155Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af46179f-956b-470a-9c9c-631dfadfa62a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@c12fdec
2021-06-04T00:33:31.155Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af46179f-956b-470a-9c9c-631dfadfa62a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:33:31.155Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af46179f-956b-470a-9c9c-631dfadfa62a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:33:31.481Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=af46179f-956b-470a-9c9c-631dfadfa62a ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:33:31.482Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=af46179f-956b-470a-9c9c-631dfadfa62a ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:33:32.266Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9bd9fe83-e5f7-4f3f-8f52-7a5de7394720 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:33:32.266Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9bd9fe83-e5f7-4f3f-8f52-7a5de7394720 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@67f1a296
2021-06-04T00:33:32.266Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9bd9fe83-e5f7-4f3f-8f52-7a5de7394720 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:33:32.266Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9bd9fe83-e5f7-4f3f-8f52-7a5de7394720 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:33:32.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:33:34.139Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:33:34.139Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T00:33:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f17491d-3a1f-4fd6-b15c-1ec531ed2ac8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:33:34.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f17491d-3a1f-4fd6-b15c-1ec531ed2ac8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@14d7a62a
2021-06-04T00:33:34.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f17491d-3a1f-4fd6-b15c-1ec531ed2ac8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:33:34.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f17491d-3a1f-4fd6-b15c-1ec531ed2ac8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:33:36.517Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0f17491d-3a1f-4fd6-b15c-1ec531ed2ac8 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:33:36.517Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0f17491d-3a1f-4fd6-b15c-1ec531ed2ac8 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:33:38.803Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=054b8dad-fea0-4c0d-bb83-ad567f3200c3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:33:38.803Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=054b8dad-fea0-4c0d-bb83-ad567f3200c3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@fb1c4c1
2021-06-04T00:33:38.803Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=054b8dad-fea0-4c0d-bb83-ad567f3200c3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:33:38.804Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=054b8dad-fea0-4c0d-bb83-ad567f3200c3 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:33:40.851Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8e12f9b-51c6-4357-8368-83136142e42b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:33:40.851Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8e12f9b-51c6-4357-8368-83136142e42b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4da1c79c
2021-06-04T00:33:40.851Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8e12f9b-51c6-4357-8368-83136142e42b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:33:40.851Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8e12f9b-51c6-4357-8368-83136142e42b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:33:44.187Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fa151ff-5f20-4dd7-8fd0-b22e062e0537 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:33:44.187Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fa151ff-5f20-4dd7-8fd0-b22e062e0537 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27ae39ac
2021-06-04T00:33:44.187Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fa151ff-5f20-4dd7-8fd0-b22e062e0537 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:33:44.187Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fa151ff-5f20-4dd7-8fd0-b22e062e0537 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:33:46.906Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a73665f-f214-45d4-aa3a-c88a69271776 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:33:46.906Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a73665f-f214-45d4-aa3a-c88a69271776 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ee13d85
2021-06-04T00:33:46.906Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a73665f-f214-45d4-aa3a-c88a69271776 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:33:46.906Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a73665f-f214-45d4-aa3a-c88a69271776 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:33:47.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:33:48.367Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:33:48.961Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:33:48.962Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:33:48.962Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:33:50.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0ba9a1b-36ce-4620-80f4-11cb9c715240 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:33:50.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0ba9a1b-36ce-4620-80f4-11cb9c715240 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@f776754
2021-06-04T00:33:50.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0ba9a1b-36ce-4620-80f4-11cb9c715240 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:33:50.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0ba9a1b-36ce-4620-80f4-11cb9c715240 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:33:52.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54c90afd-5373-43d4-b1d4-7eead1f12c5c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:33:52.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54c90afd-5373-43d4-b1d4-7eead1f12c5c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ca9dc01
2021-06-04T00:33:52.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54c90afd-5373-43d4-b1d4-7eead1f12c5c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:33:52.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54c90afd-5373-43d4-b1d4-7eead1f12c5c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:33:55.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb32f8ad-9645-44c4-9b52-ddd4e7c63bfc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:33:55.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb32f8ad-9645-44c4-9b52-ddd4e7c63bfc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a1cef61
2021-06-04T00:33:55.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb32f8ad-9645-44c4-9b52-ddd4e7c63bfc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:33:55.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb32f8ad-9645-44c4-9b52-ddd4e7c63bfc PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:33:59.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:33:59.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:34:01.551Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:34:01.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5928847-e0cf-4287-9bd8-5a3ac407d9ed PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:34:01.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5928847-e0cf-4287-9bd8-5a3ac407d9ed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d16e4b2
2021-06-04T00:34:01.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5928847-e0cf-4287-9bd8-5a3ac407d9ed PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:34:01.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5928847-e0cf-4287-9bd8-5a3ac407d9ed PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:34:02.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52843e3c-6833-4658-b4aa-091ca14b5c70 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:34:02.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52843e3c-6833-4658-b4aa-091ca14b5c70 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29ef7d83
2021-06-04T00:34:02.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52843e3c-6833-4658-b4aa-091ca14b5c70 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:34:02.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52843e3c-6833-4658-b4aa-091ca14b5c70 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:34:02.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:34:04.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=beeb4d37-4a69-4e37-b0e5-c9ee9ecb4471 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:34:04.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=beeb4d37-4a69-4e37-b0e5-c9ee9ecb4471 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ba4e56b
2021-06-04T00:34:04.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=beeb4d37-4a69-4e37-b0e5-c9ee9ecb4471 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:34:04.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=beeb4d37-4a69-4e37-b0e5-c9ee9ecb4471 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:34:06.982Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:34:07.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07fbdf8c-3730-4163-bc40-ec340cb4936c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:34:07.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07fbdf8c-3730-4163-bc40-ec340cb4936c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@56be6099
2021-06-04T00:34:07.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07fbdf8c-3730-4163-bc40-ec340cb4936c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:34:07.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07fbdf8c-3730-4163-bc40-ec340cb4936c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:34:08.459Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:34:08.460Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:34:09.792Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:34:11.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa85cff7-3d09-4af1-8b53-00f353eb318b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:34:11.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa85cff7-3d09-4af1-8b53-00f353eb318b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ca72d88
2021-06-04T00:34:11.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa85cff7-3d09-4af1-8b53-00f353eb318b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:34:11.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa85cff7-3d09-4af1-8b53-00f353eb318b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:34:14.594Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad62f9a7-ea26-4907-914a-1f689cfc1e17 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:34:14.594Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad62f9a7-ea26-4907-914a-1f689cfc1e17 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ef644fa
2021-06-04T00:34:14.594Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad62f9a7-ea26-4907-914a-1f689cfc1e17 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:34:14.595Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad62f9a7-ea26-4907-914a-1f689cfc1e17 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:34:17.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6beb0df-ebf3-4831-b31e-646e0f3176c3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:34:17.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6beb0df-ebf3-4831-b31e-646e0f3176c3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@227573f2
2021-06-04T00:34:17.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6beb0df-ebf3-4831-b31e-646e0f3176c3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:34:17.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6beb0df-ebf3-4831-b31e-646e0f3176c3 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:34:17.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:34:19.434Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:34:19.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d319503-0676-4413-b4d4-e29168fe50f7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:34:19.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d319503-0676-4413-b4d4-e29168fe50f7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@76a658d
2021-06-04T00:34:19.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d319503-0676-4413-b4d4-e29168fe50f7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:34:19.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d319503-0676-4413-b4d4-e29168fe50f7 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:34:23.465Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f91bc303-aa56-44c8-87b0-c87341e350fa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:34:23.465Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f91bc303-aa56-44c8-87b0-c87341e350fa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42e4d385
2021-06-04T00:34:23.465Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f91bc303-aa56-44c8-87b0-c87341e350fa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:34:23.465Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f91bc303-aa56-44c8-87b0-c87341e350fa PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:34:25.960Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1aa0495f-6f97-4f4e-9694-96e3b02aa7bb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:34:25.960Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1aa0495f-6f97-4f4e-9694-96e3b02aa7bb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ea98eb7
2021-06-04T00:34:25.961Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1aa0495f-6f97-4f4e-9694-96e3b02aa7bb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:34:25.961Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1aa0495f-6f97-4f4e-9694-96e3b02aa7bb PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:34:29.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=246a1b36-42fa-4b14-bced-29e2ba6c974c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:34:29.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=246a1b36-42fa-4b14-bced-29e2ba6c974c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57ca8c73
2021-06-04T00:34:29.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=246a1b36-42fa-4b14-bced-29e2ba6c974c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:34:29.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=246a1b36-42fa-4b14-bced-29e2ba6c974c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:34:32.078Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=246a1b36-42fa-4b14-bced-29e2ba6c974c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:34:32.079Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=246a1b36-42fa-4b14-bced-29e2ba6c974c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:34:32.079Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=246a1b36-42fa-4b14-bced-29e2ba6c974c ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:34:32.079Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=246a1b36-42fa-4b14-bced-29e2ba6c974c ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:34:32.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:34:35.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:34:35.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:34:38.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:34:38.767Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63ce93fe-be45-4db4-a277-03cbabb2c1fc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:34:38.767Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63ce93fe-be45-4db4-a277-03cbabb2c1fc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@358dd0a
2021-06-04T00:34:38.767Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63ce93fe-be45-4db4-a277-03cbabb2c1fc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:34:38.767Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63ce93fe-be45-4db4-a277-03cbabb2c1fc PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:34:39.156Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:34:39.157Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:34:39.170Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:34:39.171Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:34:39.174Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:34:39.174Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:34:39.351Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=63ce93fe-be45-4db4-a277-03cbabb2c1fc ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:34:39.352Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=63ce93fe-be45-4db4-a277-03cbabb2c1fc ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:34:40.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed03d2ec-d36d-4ba4-b72f-6ba99218daa0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:34:40.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed03d2ec-d36d-4ba4-b72f-6ba99218daa0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@750aa866
2021-06-04T00:34:40.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed03d2ec-d36d-4ba4-b72f-6ba99218daa0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:34:40.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed03d2ec-d36d-4ba4-b72f-6ba99218daa0 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:34:40.474Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ed03d2ec-d36d-4ba4-b72f-6ba99218daa0 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:34:40.474Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=ed03d2ec-d36d-4ba4-b72f-6ba99218daa0 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:34:40.898Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:34:40.949Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T00:34:41.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22e0ec43-dc2a-4ec2-957c-446f9d9f4c07 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:34:41.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22e0ec43-dc2a-4ec2-957c-446f9d9f4c07 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@76200ba0
2021-06-04T00:34:41.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22e0ec43-dc2a-4ec2-957c-446f9d9f4c07 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:34:41.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22e0ec43-dc2a-4ec2-957c-446f9d9f4c07 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:34:41.678Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcd5d30c-fba7-4564-93d5-daea06ee229f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:34:41.678Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcd5d30c-fba7-4564-93d5-daea06ee229f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@335538e3
2021-06-04T00:34:41.678Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcd5d30c-fba7-4564-93d5-daea06ee229f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:34:41.678Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcd5d30c-fba7-4564-93d5-daea06ee229f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:34:42.092Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=dcd5d30c-fba7-4564-93d5-daea06ee229f ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:34:42.092Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=dcd5d30c-fba7-4564-93d5-daea06ee229f ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:34:42.396Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:34:42.397Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:34:43.927Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3f3026c-c9db-47db-a407-6bf72e7b6f4b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:34:43.927Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3f3026c-c9db-47db-a407-6bf72e7b6f4b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@76a4bc30
2021-06-04T00:34:43.927Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3f3026c-c9db-47db-a407-6bf72e7b6f4b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:34:43.927Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3f3026c-c9db-47db-a407-6bf72e7b6f4b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:34:44.255Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:34:47.358Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb12d91c-3db0-46fc-b7c2-2c4df4b2092e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:34:47.358Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb12d91c-3db0-46fc-b7c2-2c4df4b2092e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@564d631a
2021-06-04T00:34:47.358Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb12d91c-3db0-46fc-b7c2-2c4df4b2092e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:34:47.358Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb12d91c-3db0-46fc-b7c2-2c4df4b2092e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:34:47.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:34:48.306Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:34:48.307Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T00:34:48.961Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:34:48.961Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:34:48.961Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:34:50.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ae62153-4389-45f8-a8d5-aafed36bc139 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:34:50.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ae62153-4389-45f8-a8d5-aafed36bc139 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20460f78
2021-06-04T00:34:50.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ae62153-4389-45f8-a8d5-aafed36bc139 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:34:50.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ae62153-4389-45f8-a8d5-aafed36bc139 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:34:50.782Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=2ae62153-4389-45f8-a8d5-aafed36bc139 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:34:50.783Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=2ae62153-4389-45f8-a8d5-aafed36bc139 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:34:52.667Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=539fd352-e783-44d1-b5c3-44293b63a544 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:34:52.667Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=539fd352-e783-44d1-b5c3-44293b63a544 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3acea9b3
2021-06-04T00:34:52.667Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=539fd352-e783-44d1-b5c3-44293b63a544 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:34:52.667Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=539fd352-e783-44d1-b5c3-44293b63a544 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:34:56.166Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64954eb2-ca88-46c6-9aba-c0bb4fd444e4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:34:56.166Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64954eb2-ca88-46c6-9aba-c0bb4fd444e4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69d8c7e6
2021-06-04T00:34:56.166Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64954eb2-ca88-46c6-9aba-c0bb4fd444e4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:34:56.166Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64954eb2-ca88-46c6-9aba-c0bb4fd444e4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:34:59.173Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e28e4b2d-c0cd-421c-b094-3cf6abc7f0ef PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:34:59.173Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e28e4b2d-c0cd-421c-b094-3cf6abc7f0ef PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54303c74
2021-06-04T00:34:59.173Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e28e4b2d-c0cd-421c-b094-3cf6abc7f0ef PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:34:59.173Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e28e4b2d-c0cd-421c-b094-3cf6abc7f0ef PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:35:02.176Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e28e4b2d-c0cd-421c-b094-3cf6abc7f0ef ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:35:02.177Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e28e4b2d-c0cd-421c-b094-3cf6abc7f0ef ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:35:02.177Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e28e4b2d-c0cd-421c-b094-3cf6abc7f0ef ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:35:02.177Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e28e4b2d-c0cd-421c-b094-3cf6abc7f0ef ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:35:02.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:35:03.457Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2898692-3d01-45b2-b17b-c385567e81b1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:35:03.457Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2898692-3d01-45b2-b17b-c385567e81b1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@449dc445
2021-06-04T00:35:03.457Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2898692-3d01-45b2-b17b-c385567e81b1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:35:03.457Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2898692-3d01-45b2-b17b-c385567e81b1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:35:04.353Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c2898692-3d01-45b2-b17b-c385567e81b1 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:35:04.353Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c2898692-3d01-45b2-b17b-c385567e81b1 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:35:04.504Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:35:04.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d45d1d5-4f62-4aef-bbbd-fbf49343ec05 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:35:04.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d45d1d5-4f62-4aef-bbbd-fbf49343ec05 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@24197f3f
2021-06-04T00:35:04.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d45d1d5-4f62-4aef-bbbd-fbf49343ec05 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:35:04.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d45d1d5-4f62-4aef-bbbd-fbf49343ec05 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:35:07.917Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=9d45d1d5-4f62-4aef-bbbd-fbf49343ec05 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:35:07.918Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=9d45d1d5-4f62-4aef-bbbd-fbf49343ec05 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:35:07.918Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9d45d1d5-4f62-4aef-bbbd-fbf49343ec05 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:35:07.918Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9d45d1d5-4f62-4aef-bbbd-fbf49343ec05 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:35:08.578Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9be527a0-91ab-4327-96b5-62aa00318036 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:35:08.578Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9be527a0-91ab-4327-96b5-62aa00318036 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@711f3454
2021-06-04T00:35:08.578Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9be527a0-91ab-4327-96b5-62aa00318036 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:35:08.578Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9be527a0-91ab-4327-96b5-62aa00318036 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:35:11.382Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9be527a0-91ab-4327-96b5-62aa00318036 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:35:11.382Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9be527a0-91ab-4327-96b5-62aa00318036 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:35:11.596Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:35:11.858Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf2ab415-6059-464f-b446-302ac7fbc2ae PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:35:11.858Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf2ab415-6059-464f-b446-302ac7fbc2ae PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ba90f35
2021-06-04T00:35:11.858Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf2ab415-6059-464f-b446-302ac7fbc2ae PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:35:11.858Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf2ab415-6059-464f-b446-302ac7fbc2ae PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:35:14.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a716c77e-c9e3-46cb-9d75-3baed817645b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:35:14.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a716c77e-c9e3-46cb-9d75-3baed817645b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34a663f8
2021-06-04T00:35:14.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a716c77e-c9e3-46cb-9d75-3baed817645b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:35:14.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a716c77e-c9e3-46cb-9d75-3baed817645b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:35:16.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d9020b7-4e85-4468-ab05-075ab9213aad PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:35:16.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d9020b7-4e85-4468-ab05-075ab9213aad PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c135cac
2021-06-04T00:35:16.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d9020b7-4e85-4468-ab05-075ab9213aad PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:35:16.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d9020b7-4e85-4468-ab05-075ab9213aad PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:35:17.953Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:35:17.996Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:35:20.077Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76a7bd73-6113-4ca3-b721-b133b73b3aaf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:35:20.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76a7bd73-6113-4ca3-b721-b133b73b3aaf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34df8679
2021-06-04T00:35:20.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76a7bd73-6113-4ca3-b721-b133b73b3aaf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:35:20.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76a7bd73-6113-4ca3-b721-b133b73b3aaf PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:35:28.952Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:35:28.953Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:35:29.953Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:35:31.858Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca986175-9bdf-433e-8c0c-6dd08a1e369c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:35:31.858Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca986175-9bdf-433e-8c0c-6dd08a1e369c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@271cf770
2021-06-04T00:35:31.858Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca986175-9bdf-433e-8c0c-6dd08a1e369c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:35:31.858Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca986175-9bdf-433e-8c0c-6dd08a1e369c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:35:32.077Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:35:32.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:35:32.953Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53c09ab0-a5f3-4c2f-8a04-4931cd31cc21 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:35:32.953Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53c09ab0-a5f3-4c2f-8a04-4931cd31cc21 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2022e9c8
2021-06-04T00:35:32.953Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53c09ab0-a5f3-4c2f-8a04-4931cd31cc21 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:35:32.953Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53c09ab0-a5f3-4c2f-8a04-4931cd31cc21 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:35:34.276Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c643340-f64a-4bdd-8f0a-c21e371539c2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:35:34.276Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c643340-f64a-4bdd-8f0a-c21e371539c2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f2375c
2021-06-04T00:35:34.276Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c643340-f64a-4bdd-8f0a-c21e371539c2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:35:34.276Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c643340-f64a-4bdd-8f0a-c21e371539c2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:35:36.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=365c37c3-64b3-42b0-ade7-dee6f37a2563 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:35:36.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=365c37c3-64b3-42b0-ade7-dee6f37a2563 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ed685b5
2021-06-04T00:35:36.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=365c37c3-64b3-42b0-ade7-dee6f37a2563 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:35:36.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=365c37c3-64b3-42b0-ade7-dee6f37a2563 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:35:38.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:35:38.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:35:39.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ddaf042-8787-4cd3-9d88-a41cb5eba341 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:35:39.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ddaf042-8787-4cd3-9d88-a41cb5eba341 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@eb15c68
2021-06-04T00:35:39.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ddaf042-8787-4cd3-9d88-a41cb5eba341 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:35:39.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ddaf042-8787-4cd3-9d88-a41cb5eba341 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:35:40.482Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=6ddaf042-8787-4cd3-9d88-a41cb5eba341 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:35:40.482Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=6ddaf042-8787-4cd3-9d88-a41cb5eba341 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:35:40.770Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:35:40.950Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T00:35:40.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38d09186-57e8-4f66-8024-a942b4a1b5cc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:35:40.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38d09186-57e8-4f66-8024-a942b4a1b5cc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@396a88df
2021-06-04T00:35:40.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38d09186-57e8-4f66-8024-a942b4a1b5cc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:35:40.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38d09186-57e8-4f66-8024-a942b4a1b5cc PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:35:41.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eda5fdb6-d3cf-4702-8fdf-a533a2fc26b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:35:41.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eda5fdb6-d3cf-4702-8fdf-a533a2fc26b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e351079
2021-06-04T00:35:41.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eda5fdb6-d3cf-4702-8fdf-a533a2fc26b9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:35:41.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eda5fdb6-d3cf-4702-8fdf-a533a2fc26b9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T00:35:41.955Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=eda5fdb6-d3cf-4702-8fdf-a533a2fc26b9 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:35:41.955Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=eda5fdb6-d3cf-4702-8fdf-a533a2fc26b9 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:35:48.961Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:35:48.962Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:35:48.962Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:35:49.583Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://message-router.onap:3904: The target server failed to respond
2021-06-04T00:35:49.583Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:35:49.609Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:35:49.609Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:35:49.628Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:35:49.628Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:36:03.264Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:36:03.264Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:36:03.432Z [cluster1-timeouter-0] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.138.69:9042] Operation timed out
at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T00:36:03.433Z [cluster1-timeouter-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.ConnectionException: [cassandra.onap/10.242.138.69:9042] Pool was closed during initialization
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:173)
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:158)
at com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1080)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.google.common.util.concurrent.CollectionFuture.handleAllCompleted(CollectionFuture.java:69)
at com.google.common.util.concurrent.AggregateFuture.processCompleted(AggregateFuture.java:282)
at com.google.common.util.concurrent.AggregateFuture.decrementCountAndMaybeComplete(AggregateFuture.java:264)
at com.google.common.util.concurrent.AggregateFuture.access$200(AggregateFuture.java:42)
at com.google.common.util.concurrent.AggregateFuture$1.run(AggregateFuture.java:147)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179)
at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179)
at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:100)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771)
at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T00:36:03.433Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3655bc43-3efb-4c56-9460-9b11f0fd1060 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:36:03.433Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3655bc43-3efb-4c56-9460-9b11f0fd1060 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5434c327
2021-06-04T00:36:03.433Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3655bc43-3efb-4c56-9460-9b11f0fd1060 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:36:03.433Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3655bc43-3efb-4c56-9460-9b11f0fd1060 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:36:03.928Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:36:03.930Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:36:04.088Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:36:04.089Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:36:04.264Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:36:05.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:36:06.438Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3655bc43-3efb-4c56-9460-9b11f0fd1060 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:36:06.439Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3655bc43-3efb-4c56-9460-9b11f0fd1060 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:36:06.440Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3655bc43-3efb-4c56-9460-9b11f0fd1060 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:36:06.440Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3655bc43-3efb-4c56-9460-9b11f0fd1060 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:36:07.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf783c03-8603-4a70-85e6-d7bee1665a64 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:36:07.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf783c03-8603-4a70-85e6-d7bee1665a64 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@506297d5
2021-06-04T00:36:07.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf783c03-8603-4a70-85e6-d7bee1665a64 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:36:07.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf783c03-8603-4a70-85e6-d7bee1665a64 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:36:08.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:36:10.224Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=cf783c03-8603-4a70-85e6-d7bee1665a64 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:36:10.224Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=cf783c03-8603-4a70-85e6-d7bee1665a64 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:36:10.225Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=cf783c03-8603-4a70-85e6-d7bee1665a64 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:36:10.225Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=cf783c03-8603-4a70-85e6-d7bee1665a64 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:36:10.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f54eac73-c0b6-4cb7-bc18-87940b210081 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:36:10.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f54eac73-c0b6-4cb7-bc18-87940b210081 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3b13a873
2021-06-04T00:36:10.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f54eac73-c0b6-4cb7-bc18-87940b210081 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:36:10.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f54eac73-c0b6-4cb7-bc18-87940b210081 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:36:11.467Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:36:11.468Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:36:11.516Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 503 Service Unavailable
2021-06-04T00:36:11.517Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 503
2021-06-04T00:36:11.518Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=503, variables=[]]
2021-06-04T00:36:11.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:36:13.629Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f54eac73-c0b6-4cb7-bc18-87940b210081 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:36:13.629Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f54eac73-c0b6-4cb7-bc18-87940b210081 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:36:14.141Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=477af705-8772-4b6b-8196-4194ddd288d9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:36:14.141Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=477af705-8772-4b6b-8196-4194ddd288d9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d54930e
2021-06-04T00:36:14.141Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=477af705-8772-4b6b-8196-4194ddd288d9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:36:14.142Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=477af705-8772-4b6b-8196-4194ddd288d9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:36:14.174Z [pool-8-thread-1] WARN o.j.diskstorage.log.kcvs.KCVSLog Could not read messages for timestamp [2021-06-04T00:36:02.714856Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:56)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:158)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:726)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:100)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
... 8 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:792)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:789)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:147)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:161)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
... 9 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308)
at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 26 common frames omitted
2021-06-04T00:36:14.248Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation RequestID=null ErrorCategory=INFO ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=500 TargetEntity=ReplaceDataTypesCache Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177)
at org.apache.tinkerpop.gremlin.structure.Element.keys(Element.java:69)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getProperties(JanusGraphGenericDao.java:1491)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getByCriteria(JanusGraphGenericDao.java:759)
at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypeNodes(PropertyOperation.java:1566)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.findAllDataTypesLazy(ApplicationDataTypeCache.java:309)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.hasDataTypesChanged(ApplicationDataTypeCache.java:220)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:200)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T00:36:14.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:36:17.061Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:36:17.063Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:36:17.116Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:36:17.118Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:36:17.131Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:36:17.192Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=477af705-8772-4b6b-8196-4194ddd288d9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:36:17.192Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=477af705-8772-4b6b-8196-4194ddd288d9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:36:17.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:36:17.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:36:17.963Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:36:17.963Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T00:36:17.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3e4f3d3-191f-48b2-a1cb-1260f2218d32 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:36:17.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3e4f3d3-191f-48b2-a1cb-1260f2218d32 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@8a92e3b
2021-06-04T00:36:17.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3e4f3d3-191f-48b2-a1cb-1260f2218d32 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:36:17.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3e4f3d3-191f-48b2-a1cb-1260f2218d32 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:36:19.658Z [JanusGraph-Health-Check-Thread] INFO o.j.d.util.BackendOperation Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.execute(VertexCentricQueryBuilder.java:73)
at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.properties(VertexCentricQueryBuilder.java:100)
at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177)
at org.apache.tinkerpop.gremlin.structure.Vertex.property(Vertex.java:70)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:341)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:336)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
... 4 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T00:36:19.658Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation RequestID=null ErrorCategory=INFO ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=500 TargetEntity=ReplaceDataTypesCache Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177)
at org.apache.tinkerpop.gremlin.structure.Element.keys(Element.java:69)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getProperties(JanusGraphGenericDao.java:1491)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getByCriteria(JanusGraphGenericDao.java:759)
at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypeNodes(PropertyOperation.java:1566)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.findAllDataTypesLazy(ApplicationDataTypeCache.java:309)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.hasDataTypesChanged(ApplicationDataTypeCache.java:220)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:200)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308)
at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 26 common frames omitted
2021-06-04T00:36:19.659Z [cluster1-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T00:36:19.661Z [cluster1-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 2000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T00:36:20.372Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:36:20.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e4813f1-a310-4e52-a0c7-b08852f8b64e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:36:20.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e4813f1-a310-4e52-a0c7-b08852f8b64e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@be4975f
2021-06-04T00:36:20.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e4813f1-a310-4e52-a0c7-b08852f8b64e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:36:20.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e4813f1-a310-4e52-a0c7-b08852f8b64e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:36:21.174Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0e4813f1-a310-4e52-a0c7-b08852f8b64e ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:36:21.175Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0e4813f1-a310-4e52-a0c7-b08852f8b64e ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:36:21.391Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=125e045c-4c11-40c1-bc23-8e7fdb46f100 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:36:21.391Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=125e045c-4c11-40c1-bc23-8e7fdb46f100 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f325743
2021-06-04T00:36:21.391Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=125e045c-4c11-40c1-bc23-8e7fdb46f100 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:36:21.391Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=125e045c-4c11-40c1-bc23-8e7fdb46f100 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:36:22.098Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7799afa3-13ce-4b68-b853-a721ba3dfd12 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:36:22.098Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7799afa3-13ce-4b68-b853-a721ba3dfd12 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e2b7268
2021-06-04T00:36:22.098Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7799afa3-13ce-4b68-b853-a721ba3dfd12 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:36:22.098Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7799afa3-13ce-4b68-b853-a721ba3dfd12 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:36:22.377Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44cba232-29e9-4e88-9e2d-d81887f2f0d1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:36:22.377Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44cba232-29e9-4e88-9e2d-d81887f2f0d1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@31e23b63
2021-06-04T00:36:22.377Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44cba232-29e9-4e88-9e2d-d81887f2f0d1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:36:22.377Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44cba232-29e9-4e88-9e2d-d81887f2f0d1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:36:22.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cfb9f3c5-d8b4-496d-996e-13839c513fbb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:36:22.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cfb9f3c5-d8b4-496d-996e-13839c513fbb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e130c6f
2021-06-04T00:36:22.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cfb9f3c5-d8b4-496d-996e-13839c513fbb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:36:22.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cfb9f3c5-d8b4-496d-996e-13839c513fbb PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:36:23.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a8034d1-c72b-4150-8f40-2205cdad7244 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:36:23.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a8034d1-c72b-4150-8f40-2205cdad7244 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5356d8a1
2021-06-04T00:36:23.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a8034d1-c72b-4150-8f40-2205cdad7244 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:36:23.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a8034d1-c72b-4150-8f40-2205cdad7244 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:36:24.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef11a291-a8af-48eb-82a7-83cc0b433218 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:36:24.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef11a291-a8af-48eb-82a7-83cc0b433218 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@162b5891
2021-06-04T00:36:24.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef11a291-a8af-48eb-82a7-83cc0b433218 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:36:24.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef11a291-a8af-48eb-82a7-83cc0b433218 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:36:25.879Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28bd9be2-7d97-4764-93a5-0c826517ef1b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:36:25.879Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28bd9be2-7d97-4764-93a5-0c826517ef1b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@36325014
2021-06-04T00:36:25.879Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28bd9be2-7d97-4764-93a5-0c826517ef1b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:36:25.879Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28bd9be2-7d97-4764-93a5-0c826517ef1b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:36:27.274Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b75809e3-33f9-41a9-a3e7-eb44d3ca1e6b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:36:27.274Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b75809e3-33f9-41a9-a3e7-eb44d3ca1e6b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@304442c9
2021-06-04T00:36:27.274Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b75809e3-33f9-41a9-a3e7-eb44d3ca1e6b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:36:27.274Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b75809e3-33f9-41a9-a3e7-eb44d3ca1e6b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:36:30.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acf6b94e-c746-404c-b7f7-86b6f3e193e9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:36:30.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acf6b94e-c746-404c-b7f7-86b6f3e193e9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@553217b0
2021-06-04T00:36:30.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acf6b94e-c746-404c-b7f7-86b6f3e193e9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:36:30.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acf6b94e-c746-404c-b7f7-86b6f3e193e9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:36:31.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd9b430e-1d1c-467d-967d-feda9a0dd223 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:36:31.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd9b430e-1d1c-467d-967d-feda9a0dd223 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@19112257
2021-06-04T00:36:31.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd9b430e-1d1c-467d-967d-feda9a0dd223 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:36:31.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd9b430e-1d1c-467d-967d-feda9a0dd223 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:36:32.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=517172b8-97f5-451b-ad24-2672defcc383 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:36:32.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=517172b8-97f5-451b-ad24-2672defcc383 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d877391
2021-06-04T00:36:32.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=517172b8-97f5-451b-ad24-2672defcc383 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:36:32.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=517172b8-97f5-451b-ad24-2672defcc383 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:36:32.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:36:34.098Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:36:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccd5ccea-2703-4f00-860b-284b548e63d8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:36:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccd5ccea-2703-4f00-860b-284b548e63d8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f473ce2
2021-06-04T00:36:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccd5ccea-2703-4f00-860b-284b548e63d8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:36:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccd5ccea-2703-4f00-860b-284b548e63d8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:36:37.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07732e77-c88c-44ec-877b-ae93e20e3990 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:36:37.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07732e77-c88c-44ec-877b-ae93e20e3990 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6a0d212d
2021-06-04T00:36:37.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07732e77-c88c-44ec-877b-ae93e20e3990 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:36:37.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07732e77-c88c-44ec-877b-ae93e20e3990 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:36:40.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29b7f427-32e3-4b25-95fc-9dcd68216a81 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:36:40.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29b7f427-32e3-4b25-95fc-9dcd68216a81 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a1ea5a1
2021-06-04T00:36:40.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29b7f427-32e3-4b25-95fc-9dcd68216a81 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:36:40.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29b7f427-32e3-4b25-95fc-9dcd68216a81 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:36:44.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5244c2d5-2a07-46b2-abe7-f360abe009c4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:36:44.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5244c2d5-2a07-46b2-abe7-f360abe009c4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7c835a88
2021-06-04T00:36:44.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5244c2d5-2a07-46b2-abe7-f360abe009c4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:36:44.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5244c2d5-2a07-46b2-abe7-f360abe009c4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:36:47.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca44fa20-f428-4d95-b80c-b7b5292c8042 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:36:47.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca44fa20-f428-4d95-b80c-b7b5292c8042 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6a35d9d6
2021-06-04T00:36:47.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca44fa20-f428-4d95-b80c-b7b5292c8042 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:36:47.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca44fa20-f428-4d95-b80c-b7b5292c8042 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:36:47.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:36:48.341Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:36:48.961Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:36:48.962Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:36:48.962Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:36:49.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ccb4f4b-9d05-4e4e-9eb1-4fcebe23dd1d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:36:49.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ccb4f4b-9d05-4e4e-9eb1-4fcebe23dd1d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69b299f4
2021-06-04T00:36:49.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ccb4f4b-9d05-4e4e-9eb1-4fcebe23dd1d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:36:49.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ccb4f4b-9d05-4e4e-9eb1-4fcebe23dd1d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:36:52.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e60bec9-1150-4057-9540-e319053105d9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:36:52.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e60bec9-1150-4057-9540-e319053105d9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@668e1ace
2021-06-04T00:36:52.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e60bec9-1150-4057-9540-e319053105d9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:36:52.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e60bec9-1150-4057-9540-e319053105d9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:36:55.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78da1dbe-9f4e-4c8b-9281-3cd091f7091c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:36:55.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78da1dbe-9f4e-4c8b-9281-3cd091f7091c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@bf4b8d
2021-06-04T00:36:55.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78da1dbe-9f4e-4c8b-9281-3cd091f7091c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:36:55.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78da1dbe-9f4e-4c8b-9281-3cd091f7091c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:36:55.917Z [BE-Health-Check-Task] INFO o.a.http.impl.execchain.RetryExec RequestID=78da1dbe-9f4e-4c8b-9281-3cd091f7091c PartnerName=SDC.BE I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {s}->https://sdc-onboarding-be.onap:8445: The target server failed to respond
2021-06-04T00:36:55.917Z [BE-Health-Check-Task] INFO o.a.http.impl.execchain.RetryExec RequestID=78da1dbe-9f4e-4c8b-9281-3cd091f7091c PartnerName=SDC.BE Retrying request to {s}->https://sdc-onboarding-be.onap:8445
2021-06-04T00:36:55.921Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=78da1dbe-9f4e-4c8b-9281-3cd091f7091c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T00:36:55.921Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=78da1dbe-9f4e-4c8b-9281-3cd091f7091c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:36:55.922Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=78da1dbe-9f4e-4c8b-9281-3cd091f7091c ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:36:55.922Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=78da1dbe-9f4e-4c8b-9281-3cd091f7091c ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:36:59.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2cdc49cc-0292-4702-85f4-07778a70c200 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:36:59.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2cdc49cc-0292-4702-85f4-07778a70c200 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@39808578
2021-06-04T00:36:59.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2cdc49cc-0292-4702-85f4-07778a70c200 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:36:59.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2cdc49cc-0292-4702-85f4-07778a70c200 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:36:59.174Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2cdc49cc-0292-4702-85f4-07778a70c200 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T00:36:59.175Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2cdc49cc-0292-4702-85f4-07778a70c200 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:37:01.694Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59619a98-6dcd-4ac9-ad64-c9eb6bf315cd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:37:01.694Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59619a98-6dcd-4ac9-ad64-c9eb6bf315cd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@55d765ab
2021-06-04T00:37:01.695Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59619a98-6dcd-4ac9-ad64-c9eb6bf315cd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:37:01.695Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59619a98-6dcd-4ac9-ad64-c9eb6bf315cd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:37:01.696Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=59619a98-6dcd-4ac9-ad64-c9eb6bf315cd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T00:37:01.696Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=59619a98-6dcd-4ac9-ad64-c9eb6bf315cd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:37:02.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:37:03.924Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:37:04.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ce53169-9453-453e-a1cc-358841c6d1a3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:37:04.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ce53169-9453-453e-a1cc-358841c6d1a3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2acaab03
2021-06-04T00:37:04.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ce53169-9453-453e-a1cc-358841c6d1a3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:37:04.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ce53169-9453-453e-a1cc-358841c6d1a3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:37:05.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:37:05.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:37:07.770Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:37:07.924Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8ce53169-9453-453e-a1cc-358841c6d1a3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T00:37:07.924Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8ce53169-9453-453e-a1cc-358841c6d1a3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:37:08.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7fddbf3-b3e4-4687-b9af-0ab980927397 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:37:08.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7fddbf3-b3e4-4687-b9af-0ab980927397 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e4d6eeb
2021-06-04T00:37:08.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7fddbf3-b3e4-4687-b9af-0ab980927397 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:37:08.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7fddbf3-b3e4-4687-b9af-0ab980927397 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:37:11.878Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=c7fddbf3-b3e4-4687-b9af-0ab980927397 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T00:37:11.878Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=c7fddbf3-b3e4-4687-b9af-0ab980927397 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:37:12.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=795831a3-f34c-4a94-8000-d6e1e6a7f322 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:37:12.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=795831a3-f34c-4a94-8000-d6e1e6a7f322 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@14b75cc3
2021-06-04T00:37:12.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=795831a3-f34c-4a94-8000-d6e1e6a7f322 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:37:12.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=795831a3-f34c-4a94-8000-d6e1e6a7f322 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:37:12.312Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:37:15.028Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=795831a3-f34c-4a94-8000-d6e1e6a7f322 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T00:37:15.029Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=795831a3-f34c-4a94-8000-d6e1e6a7f322 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:37:15.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=115ad960-e30c-4ad5-b27c-29dab19660a4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:37:15.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=115ad960-e30c-4ad5-b27c-29dab19660a4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ca73244
2021-06-04T00:37:15.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=115ad960-e30c-4ad5-b27c-29dab19660a4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:37:15.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=115ad960-e30c-4ad5-b27c-29dab19660a4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:37:17.953Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:37:18.349Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:37:18.726Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=115ad960-e30c-4ad5-b27c-29dab19660a4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T00:37:18.727Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=115ad960-e30c-4ad5-b27c-29dab19660a4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:37:19.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5613e9a8-4e3f-47b3-9150-d1ad23ea7baa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:37:19.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5613e9a8-4e3f-47b3-9150-d1ad23ea7baa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a3a5ae7
2021-06-04T00:37:19.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5613e9a8-4e3f-47b3-9150-d1ad23ea7baa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:37:19.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5613e9a8-4e3f-47b3-9150-d1ad23ea7baa PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:37:22.586Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=5613e9a8-4e3f-47b3-9150-d1ad23ea7baa ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T00:37:22.587Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=5613e9a8-4e3f-47b3-9150-d1ad23ea7baa ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:37:23.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c77eb479-24d2-4843-9646-892b0cbc1310 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:37:23.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c77eb479-24d2-4843-9646-892b0cbc1310 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47375e05
2021-06-04T00:37:23.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c77eb479-24d2-4843-9646-892b0cbc1310 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:37:23.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c77eb479-24d2-4843-9646-892b0cbc1310 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:37:28.117Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=c77eb479-24d2-4843-9646-892b0cbc1310 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:37:28.118Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=c77eb479-24d2-4843-9646-892b0cbc1310 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:37:28.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd1ce553-7ecb-4e13-ac89-ce71cd36e299 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:37:28.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd1ce553-7ecb-4e13-ac89-ce71cd36e299 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@11d601b9
2021-06-04T00:37:28.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd1ce553-7ecb-4e13-ac89-ce71cd36e299 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:37:28.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd1ce553-7ecb-4e13-ac89-ce71cd36e299 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:37:29.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:37:29.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:37:31.598Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:37:31.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fb64490-a911-4bf2-932d-26873f91ad6c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:37:31.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fb64490-a911-4bf2-932d-26873f91ad6c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@75fa3972
2021-06-04T00:37:31.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fb64490-a911-4bf2-932d-26873f91ad6c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:37:31.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fb64490-a911-4bf2-932d-26873f91ad6c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:37:32.084Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8fb64490-a911-4bf2-932d-26873f91ad6c ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:37:32.084Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=8fb64490-a911-4bf2-932d-26873f91ad6c ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:37:32.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e65f2ed6-23f9-4d36-a501-cca0242fd34e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:37:32.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e65f2ed6-23f9-4d36-a501-cca0242fd34e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60b4339a
2021-06-04T00:37:32.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e65f2ed6-23f9-4d36-a501-cca0242fd34e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:37:32.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e65f2ed6-23f9-4d36-a501-cca0242fd34e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:37:32.382Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e65f2ed6-23f9-4d36-a501-cca0242fd34e ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:37:32.382Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e65f2ed6-23f9-4d36-a501-cca0242fd34e ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:37:32.620Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9c17867-cb4d-4c45-bf41-60ec4e58c0db PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:37:32.620Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9c17867-cb4d-4c45-bf41-60ec4e58c0db PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41ce3dfc
2021-06-04T00:37:32.620Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9c17867-cb4d-4c45-bf41-60ec4e58c0db PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:37:32.620Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9c17867-cb4d-4c45-bf41-60ec4e58c0db PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:37:32.953Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:37:33.651Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:37:33.651Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:37:34.111Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:37:34.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63db88fa-0ed6-45a1-8247-d477c60066b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:37:34.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63db88fa-0ed6-45a1-8247-d477c60066b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4dca6c1d
2021-06-04T00:37:34.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63db88fa-0ed6-45a1-8247-d477c60066b9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:37:34.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63db88fa-0ed6-45a1-8247-d477c60066b9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:37:38.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4664e75-8f38-42fb-b065-dc4cb27377e0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:37:38.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4664e75-8f38-42fb-b065-dc4cb27377e0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69dfed7f
2021-06-04T00:37:38.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4664e75-8f38-42fb-b065-dc4cb27377e0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:37:38.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4664e75-8f38-42fb-b065-dc4cb27377e0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:37:40.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=837ae57c-0e6f-4442-a4d8-aee6d1372ba3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:37:40.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=837ae57c-0e6f-4442-a4d8-aee6d1372ba3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28b63b3d
2021-06-04T00:37:40.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=837ae57c-0e6f-4442-a4d8-aee6d1372ba3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:37:40.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=837ae57c-0e6f-4442-a4d8-aee6d1372ba3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:37:43.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc394a4b-a76d-4e36-a88d-441439670e3e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:37:43.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc394a4b-a76d-4e36-a88d-441439670e3e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@18a7d20a
2021-06-04T00:37:43.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc394a4b-a76d-4e36-a88d-441439670e3e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:37:43.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc394a4b-a76d-4e36-a88d-441439670e3e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:37:46.796Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8646544-26e1-4a3e-b9e4-5b547b087f50 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:37:46.796Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8646544-26e1-4a3e-b9e4-5b547b087f50 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@693ef87
2021-06-04T00:37:46.796Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8646544-26e1-4a3e-b9e4-5b547b087f50 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:37:46.797Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8646544-26e1-4a3e-b9e4-5b547b087f50 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:37:47.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:37:48.100Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:37:48.962Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:37:48.963Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:37:48.963Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:37:49.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3def8695-3eeb-4eff-8d59-b2d8caf0370c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:37:49.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3def8695-3eeb-4eff-8d59-b2d8caf0370c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@10314e3f
2021-06-04T00:37:49.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3def8695-3eeb-4eff-8d59-b2d8caf0370c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:37:49.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3def8695-3eeb-4eff-8d59-b2d8caf0370c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:37:50.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:37:50.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:37:52.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f84f6a6-3033-4f5f-922f-2a1f77f635f4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:37:52.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f84f6a6-3033-4f5f-922f-2a1f77f635f4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@947f0d7
2021-06-04T00:37:52.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f84f6a6-3033-4f5f-922f-2a1f77f635f4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:37:52.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f84f6a6-3033-4f5f-922f-2a1f77f635f4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:37:52.652Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:37:54.356Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3f84f6a6-3033-4f5f-922f-2a1f77f635f4 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:37:54.357Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=3f84f6a6-3033-4f5f-922f-2a1f77f635f4 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:37:56.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=90e895a6-d739-4087-8be3-0ed84a23815d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:37:56.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=90e895a6-d739-4087-8be3-0ed84a23815d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2fd64477
2021-06-04T00:37:56.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=90e895a6-d739-4087-8be3-0ed84a23815d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:37:56.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=90e895a6-d739-4087-8be3-0ed84a23815d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:37:56.884Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=90e895a6-d739-4087-8be3-0ed84a23815d ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:37:56.884Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=90e895a6-d739-4087-8be3-0ed84a23815d ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:37:59.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f93912c7-f853-41b1-a322-a90e98881bcc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:37:59.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f93912c7-f853-41b1-a322-a90e98881bcc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@36a069dd
2021-06-04T00:37:59.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f93912c7-f853-41b1-a322-a90e98881bcc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:37:59.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f93912c7-f853-41b1-a322-a90e98881bcc PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:38:01.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5035da2f-58b4-4887-94c6-6357bafce6d6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:38:01.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5035da2f-58b4-4887-94c6-6357bafce6d6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c7a9980
2021-06-04T00:38:01.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5035da2f-58b4-4887-94c6-6357bafce6d6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:38:01.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5035da2f-58b4-4887-94c6-6357bafce6d6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:38:02.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:38:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdfb6f4e-f7d1-4bc1-9d88-ac5d1c779aaa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:38:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdfb6f4e-f7d1-4bc1-9d88-ac5d1c779aaa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a8d0590
2021-06-04T00:38:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdfb6f4e-f7d1-4bc1-9d88-ac5d1c779aaa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:38:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdfb6f4e-f7d1-4bc1-9d88-ac5d1c779aaa PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:38:06.466Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:38:07.053Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:38:07.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5842b988-7852-4924-97be-674b7562731e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:38:07.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5842b988-7852-4924-97be-674b7562731e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7651f4a
2021-06-04T00:38:07.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5842b988-7852-4924-97be-674b7562731e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:38:07.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5842b988-7852-4924-97be-674b7562731e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:38:10.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7db1bb17-3e9e-4b75-89a2-5c5308e8fa9a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:38:10.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7db1bb17-3e9e-4b75-89a2-5c5308e8fa9a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@32be60fa
2021-06-04T00:38:10.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7db1bb17-3e9e-4b75-89a2-5c5308e8fa9a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:38:10.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7db1bb17-3e9e-4b75-89a2-5c5308e8fa9a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:38:13.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ddb2c41-2014-480b-888f-62bee578214b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:38:13.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ddb2c41-2014-480b-888f-62bee578214b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a7059b4
2021-06-04T00:38:13.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ddb2c41-2014-480b-888f-62bee578214b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:38:13.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ddb2c41-2014-480b-888f-62bee578214b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:38:17.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba449005-dbb0-4a6c-af0b-02a47a478cc3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:38:17.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba449005-dbb0-4a6c-af0b-02a47a478cc3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@382364ef
2021-06-04T00:38:17.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba449005-dbb0-4a6c-af0b-02a47a478cc3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:38:17.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba449005-dbb0-4a6c-af0b-02a47a478cc3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:38:17.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:38:19.008Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:38:20.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fd67939-ea25-4875-839a-155a6eeafb02 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:38:20.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fd67939-ea25-4875-839a-155a6eeafb02 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1713b3ee
2021-06-04T00:38:20.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fd67939-ea25-4875-839a-155a6eeafb02 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:38:20.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fd67939-ea25-4875-839a-155a6eeafb02 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:38:20.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:38:20.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:38:20.675Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0mh8n7jin51zz1891daj4o9w6d545
2021-06-04T00:38:20.675Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0sjgcbhnc5qom1t172h72z5ybh551
2021-06-04T00:38:20.675Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0e9shs1f0dkll1mguzdr2ym2rj544
2021-06-04T00:38:20.675Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0l22wmteh8slf1xgzxpqoh9gb3543
2021-06-04T00:38:20.675Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0oa2px3a4y2m4zo5eyxltfszh549
2021-06-04T00:38:20.675Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0dxy5rfh6jbom1kqltnzdolvli552
2021-06-04T00:38:20.675Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0g3w1ldyqdgf41d47vpyrvvdw8546
2021-06-04T00:38:20.675Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0rb0uv9dq1ezn5z7gdohlauwz550
2021-06-04T00:38:20.675Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0v8rrysvd1l5p2xr7by6t2yx548
2021-06-04T00:38:20.675Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01v1ocqfposumo1x7hs5ovl9ut0547
2021-06-04T00:38:23.121Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=4fd67939-ea25-4875-839a-155a6eeafb02 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:38:23.121Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=4fd67939-ea25-4875-839a-155a6eeafb02 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:38:23.122Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=4fd67939-ea25-4875-839a-155a6eeafb02 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:38:23.122Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=4fd67939-ea25-4875-839a-155a6eeafb02 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:38:23.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:38:23.624Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23efeeb7-2e82-448c-98b7-134fbc3d85b6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:38:23.624Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23efeeb7-2e82-448c-98b7-134fbc3d85b6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@56eba846
2021-06-04T00:38:23.624Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23efeeb7-2e82-448c-98b7-134fbc3d85b6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:38:23.624Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23efeeb7-2e82-448c-98b7-134fbc3d85b6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:38:26.717Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=23efeeb7-2e82-448c-98b7-134fbc3d85b6 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:38:26.718Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=23efeeb7-2e82-448c-98b7-134fbc3d85b6 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:38:26.718Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=23efeeb7-2e82-448c-98b7-134fbc3d85b6 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:38:26.718Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=23efeeb7-2e82-448c-98b7-134fbc3d85b6 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:38:26.762Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:38:27.477Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b61d0536-2e29-4413-a47e-cf2029371a98 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:38:27.477Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b61d0536-2e29-4413-a47e-cf2029371a98 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d39fde6
2021-06-04T00:38:27.477Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b61d0536-2e29-4413-a47e-cf2029371a98 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:38:27.477Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b61d0536-2e29-4413-a47e-cf2029371a98 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:38:28.659Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b61d0536-2e29-4413-a47e-cf2029371a98 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:38:28.659Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=b61d0536-2e29-4413-a47e-cf2029371a98 ErrorCategory=ERROR ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:38:29.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0b93193-6913-4464-9452-fe0bfb9a726e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:38:29.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0b93193-6913-4464-9452-fe0bfb9a726e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c9d8245
2021-06-04T00:38:29.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0b93193-6913-4464-9452-fe0bfb9a726e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:38:29.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0b93193-6913-4464-9452-fe0bfb9a726e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:38:30.052Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b0b93193-6913-4464-9452-fe0bfb9a726e ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:38:30.052Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b0b93193-6913-4464-9452-fe0bfb9a726e ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:38:31.686Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0eeee3eb-bbb7-4af4-b738-33917941dc8b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:38:31.686Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0eeee3eb-bbb7-4af4-b738-33917941dc8b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@555c6b46
2021-06-04T00:38:31.686Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0eeee3eb-bbb7-4af4-b738-33917941dc8b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:38:31.686Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0eeee3eb-bbb7-4af4-b738-33917941dc8b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:38:32.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:38:34.060Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:38:34.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a94f4dd8-f708-47ed-8064-a4c4f8e8df9e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:38:34.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a94f4dd8-f708-47ed-8064-a4c4f8e8df9e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27f87ac6
2021-06-04T00:38:34.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a94f4dd8-f708-47ed-8064-a4c4f8e8df9e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:38:34.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a94f4dd8-f708-47ed-8064-a4c4f8e8df9e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:38:37.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e2b4877-03dd-4b5f-9e78-7d23caac66b3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:38:37.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e2b4877-03dd-4b5f-9e78-7d23caac66b3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d262f90
2021-06-04T00:38:37.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e2b4877-03dd-4b5f-9e78-7d23caac66b3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:38:37.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e2b4877-03dd-4b5f-9e78-7d23caac66b3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:38:40.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7470e25a-6eaa-4392-9c5a-798c3dec6b15 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:38:40.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7470e25a-6eaa-4392-9c5a-798c3dec6b15 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d7907db
2021-06-04T00:38:40.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7470e25a-6eaa-4392-9c5a-798c3dec6b15 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:38:40.792Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7470e25a-6eaa-4392-9c5a-798c3dec6b15 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:38:43.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e8677fb-7710-4dd7-b0eb-edf2e8aee141 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:38:43.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e8677fb-7710-4dd7-b0eb-edf2e8aee141 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@bc94d69
2021-06-04T00:38:43.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e8677fb-7710-4dd7-b0eb-edf2e8aee141 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:38:43.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e8677fb-7710-4dd7-b0eb-edf2e8aee141 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:38:46.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc8d82fc-981b-4901-bec0-505a5367496a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:38:46.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc8d82fc-981b-4901-bec0-505a5367496a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f03289c
2021-06-04T00:38:46.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc8d82fc-981b-4901-bec0-505a5367496a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:38:46.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc8d82fc-981b-4901-bec0-505a5367496a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:38:47.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:38:48.961Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:38:48.962Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:38:48.962Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:38:49.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1bbc954-9034-4b7b-abe4-047567e10643 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:38:49.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1bbc954-9034-4b7b-abe4-047567e10643 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3305c043
2021-06-04T00:38:49.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1bbc954-9034-4b7b-abe4-047567e10643 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:38:49.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1bbc954-9034-4b7b-abe4-047567e10643 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:38:52.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba91da61-bf55-435e-9e32-e26861593a5e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:38:52.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba91da61-bf55-435e-9e32-e26861593a5e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@46374e27
2021-06-04T00:38:52.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba91da61-bf55-435e-9e32-e26861593a5e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:38:52.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba91da61-bf55-435e-9e32-e26861593a5e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:38:54.526Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:38:54.527Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:38:54.624Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:38:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47414796-5c9c-44dd-ba72-e24170b4e344 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:38:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47414796-5c9c-44dd-ba72-e24170b4e344 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d4f18d
2021-06-04T00:38:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47414796-5c9c-44dd-ba72-e24170b4e344 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:38:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47414796-5c9c-44dd-ba72-e24170b4e344 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:38:59.077Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65283afb-e25a-48ca-8b80-72a58900e948 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:38:59.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65283afb-e25a-48ca-8b80-72a58900e948 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71656e23
2021-06-04T00:38:59.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65283afb-e25a-48ca-8b80-72a58900e948 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:38:59.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65283afb-e25a-48ca-8b80-72a58900e948 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:39:01.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e0cf79f-ae71-4330-8d05-e7246faa3f95 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:39:01.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e0cf79f-ae71-4330-8d05-e7246faa3f95 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6cffbf94
2021-06-04T00:39:01.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e0cf79f-ae71-4330-8d05-e7246faa3f95 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:39:01.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e0cf79f-ae71-4330-8d05-e7246faa3f95 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:39:02.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:39:04.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e22deed9-e924-404e-ab50-91987bd26383 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:39:04.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e22deed9-e924-404e-ab50-91987bd26383 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@10c5925a
2021-06-04T00:39:04.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e22deed9-e924-404e-ab50-91987bd26383 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:39:04.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e22deed9-e924-404e-ab50-91987bd26383 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:39:05.601Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:39:07.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50b9f3a5-079f-4d28-bb52-7b8bde898a06 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:39:07.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50b9f3a5-079f-4d28-bb52-7b8bde898a06 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30bd4156
2021-06-04T00:39:07.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50b9f3a5-079f-4d28-bb52-7b8bde898a06 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:39:07.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50b9f3a5-079f-4d28-bb52-7b8bde898a06 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:39:10.803Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1804d93e-e084-4f15-a16e-2be862b4472d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:39:10.803Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1804d93e-e084-4f15-a16e-2be862b4472d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6af33514
2021-06-04T00:39:10.803Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1804d93e-e084-4f15-a16e-2be862b4472d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:39:10.803Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1804d93e-e084-4f15-a16e-2be862b4472d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:39:11.374Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:39:14.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd45d83f-9c77-4bfd-8930-73f85c0b741e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:39:14.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd45d83f-9c77-4bfd-8930-73f85c0b741e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7be134c1
2021-06-04T00:39:14.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd45d83f-9c77-4bfd-8930-73f85c0b741e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:39:14.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd45d83f-9c77-4bfd-8930-73f85c0b741e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:39:17.024Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=dd45d83f-9c77-4bfd-8930-73f85c0b741e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:39:17.024Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=dd45d83f-9c77-4bfd-8930-73f85c0b741e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:39:17.024Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=dd45d83f-9c77-4bfd-8930-73f85c0b741e ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:39:17.024Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=dd45d83f-9c77-4bfd-8930-73f85c0b741e ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:39:17.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:39:17.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:39:17.684Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2024fba0-b89e-4855-8d2b-30121e1fe68e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:39:17.684Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2024fba0-b89e-4855-8d2b-30121e1fe68e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@470a3ea5
2021-06-04T00:39:17.684Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2024fba0-b89e-4855-8d2b-30121e1fe68e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:39:17.684Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2024fba0-b89e-4855-8d2b-30121e1fe68e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:39:17.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:39:18.539Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:39:19.619Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=2024fba0-b89e-4855-8d2b-30121e1fe68e ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:39:19.619Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=2024fba0-b89e-4855-8d2b-30121e1fe68e ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:39:19.815Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:39:20.175Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d65a15cd-d6b9-4b21-a42f-21af30483297 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:39:20.175Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d65a15cd-d6b9-4b21-a42f-21af30483297 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ecfbdde
2021-06-04T00:39:20.175Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d65a15cd-d6b9-4b21-a42f-21af30483297 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:39:20.175Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d65a15cd-d6b9-4b21-a42f-21af30483297 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:39:20.382Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=d65a15cd-d6b9-4b21-a42f-21af30483297 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:39:20.382Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=d65a15cd-d6b9-4b21-a42f-21af30483297 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:39:22.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84db9204-d0b4-42ad-aab1-47a6e3b834d8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:39:22.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84db9204-d0b4-42ad-aab1-47a6e3b834d8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c7acbfa
2021-06-04T00:39:22.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84db9204-d0b4-42ad-aab1-47a6e3b834d8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:39:22.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84db9204-d0b4-42ad-aab1-47a6e3b834d8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:39:23.230Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=84db9204-d0b4-42ad-aab1-47a6e3b834d8 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:39:23.230Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=84db9204-d0b4-42ad-aab1-47a6e3b834d8 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:39:26.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ba793ba-6f8e-4563-9025-ee6874596c7d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:39:26.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ba793ba-6f8e-4563-9025-ee6874596c7d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a9331c6
2021-06-04T00:39:26.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ba793ba-6f8e-4563-9025-ee6874596c7d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:39:26.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ba793ba-6f8e-4563-9025-ee6874596c7d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:39:29.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4fcf1fa-837d-4287-bd5c-f22b01186396 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:39:29.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4fcf1fa-837d-4287-bd5c-f22b01186396 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2cd5281f
2021-06-04T00:39:29.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4fcf1fa-837d-4287-bd5c-f22b01186396 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:39:29.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4fcf1fa-837d-4287-bd5c-f22b01186396 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:39:31.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93cfd191-aaa7-416f-bdd0-2280f7d54362 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:39:31.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93cfd191-aaa7-416f-bdd0-2280f7d54362 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3fe75116
2021-06-04T00:39:31.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93cfd191-aaa7-416f-bdd0-2280f7d54362 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:39:31.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93cfd191-aaa7-416f-bdd0-2280f7d54362 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:39:32.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:39:35.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c0851d1-f9c6-456d-923c-8fe93e69e264 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:39:35.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c0851d1-f9c6-456d-923c-8fe93e69e264 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7588780b
2021-06-04T00:39:35.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c0851d1-f9c6-456d-923c-8fe93e69e264 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:39:35.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c0851d1-f9c6-456d-923c-8fe93e69e264 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:39:38.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15c7a6bc-68d9-48ee-9c11-2ecb7c013d53 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:39:38.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15c7a6bc-68d9-48ee-9c11-2ecb7c013d53 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@66867a7d
2021-06-04T00:39:38.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15c7a6bc-68d9-48ee-9c11-2ecb7c013d53 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:39:38.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15c7a6bc-68d9-48ee-9c11-2ecb7c013d53 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:39:40.777Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84d484ee-b6dd-4098-be55-82863ed57cd5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:39:40.777Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84d484ee-b6dd-4098-be55-82863ed57cd5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@63162362
2021-06-04T00:39:40.777Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84d484ee-b6dd-4098-be55-82863ed57cd5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:39:40.777Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84d484ee-b6dd-4098-be55-82863ed57cd5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:39:40.949Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T00:39:43.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f20a468-ee66-4e69-8fbc-dcce4b2c1aaa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:39:43.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f20a468-ee66-4e69-8fbc-dcce4b2c1aaa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@66fcb1f7
2021-06-04T00:39:43.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f20a468-ee66-4e69-8fbc-dcce4b2c1aaa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:39:43.736Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f20a468-ee66-4e69-8fbc-dcce4b2c1aaa PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:39:44.179Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=2f20a468-ee66-4e69-8fbc-dcce4b2c1aaa ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:39:44.180Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=2f20a468-ee66-4e69-8fbc-dcce4b2c1aaa ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:39:47.047Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:39:47.053Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:39:47.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed797afb-0ce3-4a5d-81f2-77bf4ffc8cec PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:39:47.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed797afb-0ce3-4a5d-81f2-77bf4ffc8cec PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5002d503
2021-06-04T00:39:47.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed797afb-0ce3-4a5d-81f2-77bf4ffc8cec PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:39:47.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed797afb-0ce3-4a5d-81f2-77bf4ffc8cec PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:39:48.962Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:39:48.963Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:39:48.963Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:39:49.542Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:39:49.544Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:39:50.080Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ed797afb-0ce3-4a5d-81f2-77bf4ffc8cec ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:39:50.080Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ed797afb-0ce3-4a5d-81f2-77bf4ffc8cec ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:39:50.081Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ed797afb-0ce3-4a5d-81f2-77bf4ffc8cec ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:39:50.081Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ed797afb-0ce3-4a5d-81f2-77bf4ffc8cec ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:39:50.231Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:39:50.232Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T00:39:50.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6abf15d9-a5e8-4aaa-a861-fd425786b649 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:39:50.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6abf15d9-a5e8-4aaa-a861-fd425786b649 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58208ec
2021-06-04T00:39:50.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6abf15d9-a5e8-4aaa-a861-fd425786b649 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:39:50.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6abf15d9-a5e8-4aaa-a861-fd425786b649 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:39:51.483Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=6abf15d9-a5e8-4aaa-a861-fd425786b649 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:39:51.483Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=6abf15d9-a5e8-4aaa-a861-fd425786b649 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:39:52.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ef9840e-afb7-4e35-88df-94532ea85b07 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:39:52.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ef9840e-afb7-4e35-88df-94532ea85b07 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@542d4608
2021-06-04T00:39:52.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ef9840e-afb7-4e35-88df-94532ea85b07 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:39:52.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ef9840e-afb7-4e35-88df-94532ea85b07 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:39:52.621Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8ef9840e-afb7-4e35-88df-94532ea85b07 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:39:52.621Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8ef9840e-afb7-4e35-88df-94532ea85b07 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:39:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe160662-8a80-4571-b416-5e9b5875612e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:39:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe160662-8a80-4571-b416-5e9b5875612e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@12413b43
2021-06-04T00:39:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe160662-8a80-4571-b416-5e9b5875612e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:39:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe160662-8a80-4571-b416-5e9b5875612e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:39:59.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25b93237-b6b2-4e77-b46b-937a6fa86f91 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:39:59.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25b93237-b6b2-4e77-b46b-937a6fa86f91 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@791948f
2021-06-04T00:39:59.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25b93237-b6b2-4e77-b46b-937a6fa86f91 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:39:59.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25b93237-b6b2-4e77-b46b-937a6fa86f91 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:40:01.689Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb963b81-a95f-4b0c-9874-a9587288e49c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:40:01.689Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb963b81-a95f-4b0c-9874-a9587288e49c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3942a72e
2021-06-04T00:40:01.689Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb963b81-a95f-4b0c-9874-a9587288e49c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:40:01.689Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb963b81-a95f-4b0c-9874-a9587288e49c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:40:02.951Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:40:04.695Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=eb963b81-a95f-4b0c-9874-a9587288e49c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:40:04.696Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=eb963b81-a95f-4b0c-9874-a9587288e49c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:40:04.696Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=eb963b81-a95f-4b0c-9874-a9587288e49c ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:40:04.696Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=eb963b81-a95f-4b0c-9874-a9587288e49c ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:40:05.272Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf4adac0-ad05-4620-a9e5-d26452c264e7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:40:05.272Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf4adac0-ad05-4620-a9e5-d26452c264e7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e1ab08
2021-06-04T00:40:05.272Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf4adac0-ad05-4620-a9e5-d26452c264e7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:40:05.272Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf4adac0-ad05-4620-a9e5-d26452c264e7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:40:06.219Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=cf4adac0-ad05-4620-a9e5-d26452c264e7 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:40:06.219Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=cf4adac0-ad05-4620-a9e5-d26452c264e7 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:40:07.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02f902a3-8999-4878-bf68-d0137c033a33 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:40:07.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02f902a3-8999-4878-bf68-d0137c033a33 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17dfc97b
2021-06-04T00:40:07.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02f902a3-8999-4878-bf68-d0137c033a33 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:40:07.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02f902a3-8999-4878-bf68-d0137c033a33 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:40:10.949Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T00:40:11.173Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=583b0dcf-fd5e-49da-850b-9cf2b9b7d99d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:40:11.173Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=583b0dcf-fd5e-49da-850b-9cf2b9b7d99d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3b087779
2021-06-04T00:40:11.173Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=583b0dcf-fd5e-49da-850b-9cf2b9b7d99d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:40:11.173Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=583b0dcf-fd5e-49da-850b-9cf2b9b7d99d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:40:13.740Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0721db0-0383-4f0e-9664-ee62f007c93e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:40:13.741Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0721db0-0383-4f0e-9664-ee62f007c93e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@31bb22fb
2021-06-04T00:40:13.741Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0721db0-0383-4f0e-9664-ee62f007c93e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:40:13.741Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0721db0-0383-4f0e-9664-ee62f007c93e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:40:14.176Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e0721db0-0383-4f0e-9664-ee62f007c93e ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:40:14.176Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e0721db0-0383-4f0e-9664-ee62f007c93e ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:40:17.075Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=148e91e0-bad1-41f1-adff-a8eef1d3fc5e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:40:17.075Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=148e91e0-bad1-41f1-adff-a8eef1d3fc5e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@25526aeb
2021-06-04T00:40:17.075Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=148e91e0-bad1-41f1-adff-a8eef1d3fc5e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:40:17.075Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=148e91e0-bad1-41f1-adff-a8eef1d3fc5e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:40:20.080Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=148e91e0-bad1-41f1-adff-a8eef1d3fc5e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:40:20.080Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=148e91e0-bad1-41f1-adff-a8eef1d3fc5e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:40:20.081Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=148e91e0-bad1-41f1-adff-a8eef1d3fc5e ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:40:20.081Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=148e91e0-bad1-41f1-adff-a8eef1d3fc5e ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:40:20.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68508bb5-f93a-44c7-b042-ff6f01e7c2da PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:40:20.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68508bb5-f93a-44c7-b042-ff6f01e7c2da PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4cafeb2b
2021-06-04T00:40:20.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68508bb5-f93a-44c7-b042-ff6f01e7c2da PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:40:20.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68508bb5-f93a-44c7-b042-ff6f01e7c2da PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:40:20.800Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=68508bb5-f93a-44c7-b042-ff6f01e7c2da ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:40:20.800Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=68508bb5-f93a-44c7-b042-ff6f01e7c2da ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:40:22.527Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7eb1cd19-16cf-4a2e-baed-f50fd5c2a7cd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:40:22.527Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7eb1cd19-16cf-4a2e-baed-f50fd5c2a7cd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c20bef5
2021-06-04T00:40:22.527Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7eb1cd19-16cf-4a2e-baed-f50fd5c2a7cd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:40:22.527Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7eb1cd19-16cf-4a2e-baed-f50fd5c2a7cd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:40:24.824Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:40:26.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c336772f-d615-4591-89b5-afbe84811d2f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:40:26.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c336772f-d615-4591-89b5-afbe84811d2f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6a9392a8
2021-06-04T00:40:26.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c336772f-d615-4591-89b5-afbe84811d2f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:40:26.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c336772f-d615-4591-89b5-afbe84811d2f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:40:26.962Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:40:26.963Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:40:28.268Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:40:28.269Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:40:28.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=571d677d-b96a-4cae-8fb7-cc71349191fa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:40:28.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=571d677d-b96a-4cae-8fb7-cc71349191fa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5956da62
2021-06-04T00:40:28.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=571d677d-b96a-4cae-8fb7-cc71349191fa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:40:28.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=571d677d-b96a-4cae-8fb7-cc71349191fa PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:40:31.457Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c18e201-46ce-4323-8df7-2319052fb987 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:40:31.457Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c18e201-46ce-4323-8df7-2319052fb987 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a52e81e
2021-06-04T00:40:31.457Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c18e201-46ce-4323-8df7-2319052fb987 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:40:31.457Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c18e201-46ce-4323-8df7-2319052fb987 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:40:35.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6843541b-7253-47ab-8d41-b94ddafa4420 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:40:35.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6843541b-7253-47ab-8d41-b94ddafa4420 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@135c20b7
2021-06-04T00:40:35.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6843541b-7253-47ab-8d41-b94ddafa4420 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:40:35.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6843541b-7253-47ab-8d41-b94ddafa4420 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:40:36.024Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:40:36.025Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:40:36.412Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:40:36.414Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:40:36.571Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:40:36.572Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T00:40:37.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc2611ac-58f7-4029-a4ec-ea21b46d56f4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:40:37.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc2611ac-58f7-4029-a4ec-ea21b46d56f4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65ace6a6
2021-06-04T00:40:37.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc2611ac-58f7-4029-a4ec-ea21b46d56f4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:40:37.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc2611ac-58f7-4029-a4ec-ea21b46d56f4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:40:39.349Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fc2611ac-58f7-4029-a4ec-ea21b46d56f4 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:40:39.349Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fc2611ac-58f7-4029-a4ec-ea21b46d56f4 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:40:40.771Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91ff8bf4-b538-4499-9f6b-3f3c3a72a717 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:40:40.771Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91ff8bf4-b538-4499-9f6b-3f3c3a72a717 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ac6a5bb
2021-06-04T00:40:40.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91ff8bf4-b538-4499-9f6b-3f3c3a72a717 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:40:40.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91ff8bf4-b538-4499-9f6b-3f3c3a72a717 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:40:43.919Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11e829cf-f738-4c22-9895-15fbd51113f9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:40:43.919Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11e829cf-f738-4c22-9895-15fbd51113f9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5709bee5
2021-06-04T00:40:43.919Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11e829cf-f738-4c22-9895-15fbd51113f9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:40:43.919Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11e829cf-f738-4c22-9895-15fbd51113f9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:40:46.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a34c8dd2-958a-42e1-b3c2-b3eee5ffaf23 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:40:46.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a34c8dd2-958a-42e1-b3c2-b3eee5ffaf23 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2522752b
2021-06-04T00:40:46.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a34c8dd2-958a-42e1-b3c2-b3eee5ffaf23 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:40:46.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a34c8dd2-958a-42e1-b3c2-b3eee5ffaf23 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:40:47.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:40:48.003Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:40:48.961Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:40:48.962Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:40:48.962Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:40:50.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9552326e-f683-48d7-bd8d-4ad5e38c817c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:40:50.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9552326e-f683-48d7-bd8d-4ad5e38c817c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27b93eff
2021-06-04T00:40:50.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9552326e-f683-48d7-bd8d-4ad5e38c817c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:40:50.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9552326e-f683-48d7-bd8d-4ad5e38c817c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:40:52.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e22cd8e-a2a0-411a-adbc-f398383cac57 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:40:52.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e22cd8e-a2a0-411a-adbc-f398383cac57 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@18edacce
2021-06-04T00:40:52.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e22cd8e-a2a0-411a-adbc-f398383cac57 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:40:52.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e22cd8e-a2a0-411a-adbc-f398383cac57 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:40:55.476Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8e22cd8e-a2a0-411a-adbc-f398383cac57 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:40:55.477Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8e22cd8e-a2a0-411a-adbc-f398383cac57 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:40:55.477Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8e22cd8e-a2a0-411a-adbc-f398383cac57 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:40:55.477Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8e22cd8e-a2a0-411a-adbc-f398383cac57 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:40:56.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2bd2a73-7aac-4916-9f2a-78c710d01b1d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:40:56.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2bd2a73-7aac-4916-9f2a-78c710d01b1d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@209d7a0
2021-06-04T00:40:56.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2bd2a73-7aac-4916-9f2a-78c710d01b1d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:40:56.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2bd2a73-7aac-4916-9f2a-78c710d01b1d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:40:59.161Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d2bd2a73-7aac-4916-9f2a-78c710d01b1d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:40:59.162Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d2bd2a73-7aac-4916-9f2a-78c710d01b1d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:40:59.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8dd9e0e1-2691-4f0c-bc45-429a12f560d5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:40:59.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8dd9e0e1-2691-4f0c-bc45-429a12f560d5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a14ff48
2021-06-04T00:40:59.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8dd9e0e1-2691-4f0c-bc45-429a12f560d5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:40:59.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8dd9e0e1-2691-4f0c-bc45-429a12f560d5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:41:00.481Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8dd9e0e1-2691-4f0c-bc45-429a12f560d5 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:41:00.482Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8dd9e0e1-2691-4f0c-bc45-429a12f560d5 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:41:01.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a928eb89-a6cf-4fb2-b0b2-a1aeab85aaf7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:41:01.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a928eb89-a6cf-4fb2-b0b2-a1aeab85aaf7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6312d582
2021-06-04T00:41:01.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a928eb89-a6cf-4fb2-b0b2-a1aeab85aaf7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:41:01.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a928eb89-a6cf-4fb2-b0b2-a1aeab85aaf7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:41:02.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:41:05.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1159d781-cce3-473a-89c3-1a2f1c8478a6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:41:05.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1159d781-cce3-473a-89c3-1a2f1c8478a6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74be3b5e
2021-06-04T00:41:05.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1159d781-cce3-473a-89c3-1a2f1c8478a6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:41:05.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1159d781-cce3-473a-89c3-1a2f1c8478a6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:41:07.622Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:41:07.623Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:41:07.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=074fd47b-2f1f-4368-9ed7-50581cf15b44 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:41:07.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=074fd47b-2f1f-4368-9ed7-50581cf15b44 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9ad643e
2021-06-04T00:41:07.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=074fd47b-2f1f-4368-9ed7-50581cf15b44 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:41:07.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=074fd47b-2f1f-4368-9ed7-50581cf15b44 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:41:10.734Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:41:10.735Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:41:10.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5773582a-91bd-4192-8226-b6f74e5b7f6e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:41:10.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5773582a-91bd-4192-8226-b6f74e5b7f6e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@73256470
2021-06-04T00:41:10.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5773582a-91bd-4192-8226-b6f74e5b7f6e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:41:10.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5773582a-91bd-4192-8226-b6f74e5b7f6e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:41:13.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=945c5e0d-2841-4f2c-af9a-47e353343f3e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:41:13.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=945c5e0d-2841-4f2c-af9a-47e353343f3e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@66e1153
2021-06-04T00:41:13.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=945c5e0d-2841-4f2c-af9a-47e353343f3e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:41:13.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=945c5e0d-2841-4f2c-af9a-47e353343f3e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:41:16.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4147b371-de51-4324-8a74-700cd60d3cc4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:41:16.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4147b371-de51-4324-8a74-700cd60d3cc4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38fae0b
2021-06-04T00:41:16.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4147b371-de51-4324-8a74-700cd60d3cc4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:41:16.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4147b371-de51-4324-8a74-700cd60d3cc4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:41:17.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:41:18.744Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:41:20.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ded6c506-c6d6-4fa0-8a91-981a36c171dd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:41:20.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ded6c506-c6d6-4fa0-8a91-981a36c171dd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@61e1b6d0
2021-06-04T00:41:20.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ded6c506-c6d6-4fa0-8a91-981a36c171dd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:41:20.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ded6c506-c6d6-4fa0-8a91-981a36c171dd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:41:22.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c664d50-82a8-458a-98d8-b6d90938a392 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:41:22.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c664d50-82a8-458a-98d8-b6d90938a392 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@39bf4878
2021-06-04T00:41:22.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c664d50-82a8-458a-98d8-b6d90938a392 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:41:22.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c664d50-82a8-458a-98d8-b6d90938a392 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:41:23.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:41:23.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:41:26.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ac7e97f-6cac-428a-b2a6-92f91af5dec9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:41:26.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ac7e97f-6cac-428a-b2a6-92f91af5dec9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4fad3295
2021-06-04T00:41:26.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ac7e97f-6cac-428a-b2a6-92f91af5dec9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:41:26.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ac7e97f-6cac-428a-b2a6-92f91af5dec9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:41:29.021Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3ac7e97f-6cac-428a-b2a6-92f91af5dec9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:41:29.021Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3ac7e97f-6cac-428a-b2a6-92f91af5dec9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:41:29.021Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3ac7e97f-6cac-428a-b2a6-92f91af5dec9 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:41:29.021Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=3ac7e97f-6cac-428a-b2a6-92f91af5dec9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:41:30.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d4c617e-e96f-48ee-bfad-3c9593371812 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:41:30.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d4c617e-e96f-48ee-bfad-3c9593371812 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@312c329d
2021-06-04T00:41:30.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d4c617e-e96f-48ee-bfad-3c9593371812 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:41:30.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d4c617e-e96f-48ee-bfad-3c9593371812 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:41:30.062Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:41:31.559Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8d4c617e-e96f-48ee-bfad-3c9593371812 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:41:31.560Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=8d4c617e-e96f-48ee-bfad-3c9593371812 ErrorCategory=ERROR ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:41:31.684Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24df19ad-362c-4366-8e81-7155d9c66900 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:41:31.684Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24df19ad-362c-4366-8e81-7155d9c66900 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e283a1c
2021-06-04T00:41:31.684Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24df19ad-362c-4366-8e81-7155d9c66900 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:41:31.684Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24df19ad-362c-4366-8e81-7155d9c66900 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:41:32.369Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=24df19ad-362c-4366-8e81-7155d9c66900 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:41:32.369Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=24df19ad-362c-4366-8e81-7155d9c66900 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:41:32.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:41:32.973Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:41:35.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96f23214-ce36-4c30-b393-9cb27166939e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:41:35.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96f23214-ce36-4c30-b393-9cb27166939e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38378ad6
2021-06-04T00:41:35.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96f23214-ce36-4c30-b393-9cb27166939e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:41:35.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96f23214-ce36-4c30-b393-9cb27166939e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:41:37.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6791ed81-5c2b-4472-9b2a-c94caebc8eb5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:41:37.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6791ed81-5c2b-4472-9b2a-c94caebc8eb5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68dfff97
2021-06-04T00:41:37.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6791ed81-5c2b-4472-9b2a-c94caebc8eb5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:41:37.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6791ed81-5c2b-4472-9b2a-c94caebc8eb5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:41:40.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf3a7e25-3b64-4496-83c7-33cb0340aeb8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:41:40.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf3a7e25-3b64-4496-83c7-33cb0340aeb8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@f857a77
2021-06-04T00:41:40.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf3a7e25-3b64-4496-83c7-33cb0340aeb8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:41:40.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf3a7e25-3b64-4496-83c7-33cb0340aeb8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:41:43.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50100f26-cb78-4f45-bfd8-bb7c476435ec PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:41:43.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50100f26-cb78-4f45-bfd8-bb7c476435ec PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50a24941
2021-06-04T00:41:43.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50100f26-cb78-4f45-bfd8-bb7c476435ec PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:41:43.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50100f26-cb78-4f45-bfd8-bb7c476435ec PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:41:46.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c35f18d-223e-4c4d-85b0-01fee2361205 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:41:46.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c35f18d-223e-4c4d-85b0-01fee2361205 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54c718b9
2021-06-04T00:41:46.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c35f18d-223e-4c4d-85b0-01fee2361205 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:41:46.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c35f18d-223e-4c4d-85b0-01fee2361205 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:41:47.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:41:48.030Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:41:48.961Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:41:48.962Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:41:48.962Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:41:50.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01428c83-7c75-4dd0-b549-71855e15170b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:41:50.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01428c83-7c75-4dd0-b549-71855e15170b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43f376f1
2021-06-04T00:41:50.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01428c83-7c75-4dd0-b549-71855e15170b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:41:50.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01428c83-7c75-4dd0-b549-71855e15170b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:41:52.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edae5037-db37-4927-a941-82a3f84a6ca8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:41:52.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edae5037-db37-4927-a941-82a3f84a6ca8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6701ea3a
2021-06-04T00:41:52.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edae5037-db37-4927-a941-82a3f84a6ca8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:41:52.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edae5037-db37-4927-a941-82a3f84a6ca8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:41:56.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8072dac-ec1a-4508-80ff-21caef44c314 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:41:56.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8072dac-ec1a-4508-80ff-21caef44c314 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@25ab5fda
2021-06-04T00:41:56.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8072dac-ec1a-4508-80ff-21caef44c314 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:41:56.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8072dac-ec1a-4508-80ff-21caef44c314 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:41:59.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6501dbb2-edf1-47ea-b951-0e106d01e2a3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:41:59.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6501dbb2-edf1-47ea-b951-0e106d01e2a3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49c59906
2021-06-04T00:41:59.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6501dbb2-edf1-47ea-b951-0e106d01e2a3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:41:59.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6501dbb2-edf1-47ea-b951-0e106d01e2a3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:42:01.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d24b25da-20d9-4427-a529-3adb0df034f4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:42:01.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d24b25da-20d9-4427-a529-3adb0df034f4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@11593a31
2021-06-04T00:42:01.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d24b25da-20d9-4427-a529-3adb0df034f4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:42:01.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d24b25da-20d9-4427-a529-3adb0df034f4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:42:02.954Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:42:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70f16ecc-3c09-4e12-8050-638515994917 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:42:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70f16ecc-3c09-4e12-8050-638515994917 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79e1521a
2021-06-04T00:42:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70f16ecc-3c09-4e12-8050-638515994917 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:42:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70f16ecc-3c09-4e12-8050-638515994917 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:42:08.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a2b64ca-51ae-48cf-8024-d45e504b2be4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:42:08.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a2b64ca-51ae-48cf-8024-d45e504b2be4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@64b9773
2021-06-04T00:42:08.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a2b64ca-51ae-48cf-8024-d45e504b2be4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:42:08.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a2b64ca-51ae-48cf-8024-d45e504b2be4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:42:10.877Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f539d64-259d-46a9-b570-9e862737c891 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:42:10.877Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f539d64-259d-46a9-b570-9e862737c891 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@63a33315
2021-06-04T00:42:10.877Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f539d64-259d-46a9-b570-9e862737c891 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:42:10.877Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f539d64-259d-46a9-b570-9e862737c891 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:42:10.956Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T00:42:11.000Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:42:11.003Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:42:11.530Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:42:11.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:42:11.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:42:11.851Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:42:13.715Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:42:13.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6602531-1bd0-464b-9668-8e7c231b07fd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:42:13.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6602531-1bd0-464b-9668-8e7c231b07fd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3bf315e2
2021-06-04T00:42:13.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6602531-1bd0-464b-9668-8e7c231b07fd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:42:13.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6602531-1bd0-464b-9668-8e7c231b07fd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:42:14.318Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c6602531-1bd0-464b-9668-8e7c231b07fd ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:42:14.318Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=c6602531-1bd0-464b-9668-8e7c231b07fd ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:42:16.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=865618a8-4e7c-4b60-b1c2-72e661ce6def PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:42:16.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=865618a8-4e7c-4b60-b1c2-72e661ce6def PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4871e104
2021-06-04T00:42:16.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=865618a8-4e7c-4b60-b1c2-72e661ce6def PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:42:16.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=865618a8-4e7c-4b60-b1c2-72e661ce6def PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:42:17.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:42:18.279Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=865618a8-4e7c-4b60-b1c2-72e661ce6def ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:42:18.279Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=865618a8-4e7c-4b60-b1c2-72e661ce6def ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:42:20.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ad775df-64b1-4f10-8e3e-e114c9264780 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:42:20.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ad775df-64b1-4f10-8e3e-e114c9264780 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@12db0776
2021-06-04T00:42:20.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ad775df-64b1-4f10-8e3e-e114c9264780 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:42:20.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ad775df-64b1-4f10-8e3e-e114c9264780 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:42:22.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c914a774-af4e-4b28-ac1e-2c2c18bb5891 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:42:22.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c914a774-af4e-4b28-ac1e-2c2c18bb5891 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@681ab5a3
2021-06-04T00:42:22.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c914a774-af4e-4b28-ac1e-2c2c18bb5891 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:42:22.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c914a774-af4e-4b28-ac1e-2c2c18bb5891 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:42:25.199Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:42:25.200Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:42:26.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eca71273-9f0e-4729-ab3f-8c897a0c0c1e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:42:26.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eca71273-9f0e-4729-ab3f-8c897a0c0c1e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4be5e147
2021-06-04T00:42:26.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eca71273-9f0e-4729-ab3f-8c897a0c0c1e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:42:26.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eca71273-9f0e-4729-ab3f-8c897a0c0c1e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:42:26.660Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:42:29.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15a05868-0d43-4333-9b59-8e06df745102 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:42:29.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15a05868-0d43-4333-9b59-8e06df745102 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@cdb40fe
2021-06-04T00:42:29.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15a05868-0d43-4333-9b59-8e06df745102 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:42:29.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15a05868-0d43-4333-9b59-8e06df745102 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:42:31.779Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48579972-773b-4639-8004-210826bf9b30 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:42:31.779Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48579972-773b-4639-8004-210826bf9b30 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@467106a4
2021-06-04T00:42:31.779Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48579972-773b-4639-8004-210826bf9b30 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:42:31.779Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48579972-773b-4639-8004-210826bf9b30 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:42:32.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:42:34.724Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:42:34.724Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T00:42:35.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e68dfcdd-4fbc-41aa-84c4-6efb3d07b80f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:42:35.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e68dfcdd-4fbc-41aa-84c4-6efb3d07b80f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b7b0464
2021-06-04T00:42:35.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e68dfcdd-4fbc-41aa-84c4-6efb3d07b80f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:42:35.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e68dfcdd-4fbc-41aa-84c4-6efb3d07b80f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:42:38.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87f539fb-c9b0-41ca-96d4-5f1fde2a10c5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:42:38.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87f539fb-c9b0-41ca-96d4-5f1fde2a10c5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f703d95
2021-06-04T00:42:38.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87f539fb-c9b0-41ca-96d4-5f1fde2a10c5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:42:38.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87f539fb-c9b0-41ca-96d4-5f1fde2a10c5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:42:38.657Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=87f539fb-c9b0-41ca-96d4-5f1fde2a10c5 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:42:38.657Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=87f539fb-c9b0-41ca-96d4-5f1fde2a10c5 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:42:40.875Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a084aaa-a255-4434-bd6b-5ac93f477c69 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:42:40.875Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a084aaa-a255-4434-bd6b-5ac93f477c69 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49fa4235
2021-06-04T00:42:40.875Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a084aaa-a255-4434-bd6b-5ac93f477c69 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:42:40.875Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a084aaa-a255-4434-bd6b-5ac93f477c69 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:42:43.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b0fa459-a223-4977-9cba-cc863b55f5e4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:42:43.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b0fa459-a223-4977-9cba-cc863b55f5e4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f03988
2021-06-04T00:42:43.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b0fa459-a223-4977-9cba-cc863b55f5e4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:42:43.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b0fa459-a223-4977-9cba-cc863b55f5e4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:42:46.833Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0b0fa459-a223-4977-9cba-cc863b55f5e4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:42:46.834Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0b0fa459-a223-4977-9cba-cc863b55f5e4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:42:46.834Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0b0fa459-a223-4977-9cba-cc863b55f5e4 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:42:46.834Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0b0fa459-a223-4977-9cba-cc863b55f5e4 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:42:47.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a52fb77a-5f74-426a-bddd-cf5fe0f06990 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:42:47.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a52fb77a-5f74-426a-bddd-cf5fe0f06990 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@240b5536
2021-06-04T00:42:47.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a52fb77a-5f74-426a-bddd-cf5fe0f06990 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:42:47.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a52fb77a-5f74-426a-bddd-cf5fe0f06990 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:42:47.951Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:42:47.969Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:42:48.961Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:42:48.962Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:42:48.962Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:42:49.119Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a52fb77a-5f74-426a-bddd-cf5fe0f06990 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:42:49.119Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a52fb77a-5f74-426a-bddd-cf5fe0f06990 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:42:49.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ee9fd98-0ba0-409a-885b-1df3d6f0d177 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:42:49.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ee9fd98-0ba0-409a-885b-1df3d6f0d177 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@21795e39
2021-06-04T00:42:49.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ee9fd98-0ba0-409a-885b-1df3d6f0d177 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:42:49.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ee9fd98-0ba0-409a-885b-1df3d6f0d177 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:42:52.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ad406b6-a3d5-4841-8773-7879801a533f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:42:52.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ad406b6-a3d5-4841-8773-7879801a533f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27431fe7
2021-06-04T00:42:52.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ad406b6-a3d5-4841-8773-7879801a533f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:42:52.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ad406b6-a3d5-4841-8773-7879801a533f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:42:55.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a7a3015-db0b-429a-b231-083411bb17eb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:42:55.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a7a3015-db0b-429a-b231-083411bb17eb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@599f5cdc
2021-06-04T00:42:55.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a7a3015-db0b-429a-b231-083411bb17eb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:42:55.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a7a3015-db0b-429a-b231-083411bb17eb PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:42:59.170Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ce5556d-fe22-4929-b230-50e297e31132 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:42:59.170Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ce5556d-fe22-4929-b230-50e297e31132 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29a3fbb8
2021-06-04T00:42:59.170Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ce5556d-fe22-4929-b230-50e297e31132 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:42:59.170Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ce5556d-fe22-4929-b230-50e297e31132 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:43:01.686Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67c644fe-7dc7-4cbc-bc52-875c594ddfba PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:43:01.686Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67c644fe-7dc7-4cbc-bc52-875c594ddfba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42c0e023
2021-06-04T00:43:01.686Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67c644fe-7dc7-4cbc-bc52-875c594ddfba PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:43:01.686Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67c644fe-7dc7-4cbc-bc52-875c594ddfba PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:43:02.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:43:04.744Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:43:04.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e38f828-0eb5-46b5-ac86-25c78237b48d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:43:04.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e38f828-0eb5-46b5-ac86-25c78237b48d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d4363bb
2021-06-04T00:43:04.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e38f828-0eb5-46b5-ac86-25c78237b48d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:43:04.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e38f828-0eb5-46b5-ac86-25c78237b48d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:43:06.819Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:43:08.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d3917ec-788d-432a-ac9b-c28d24e4aa76 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:43:08.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d3917ec-788d-432a-ac9b-c28d24e4aa76 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e99b973
2021-06-04T00:43:08.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d3917ec-788d-432a-ac9b-c28d24e4aa76 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:43:08.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d3917ec-788d-432a-ac9b-c28d24e4aa76 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:43:11.119Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=9d3917ec-788d-432a-ac9b-c28d24e4aa76 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:43:11.119Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=9d3917ec-788d-432a-ac9b-c28d24e4aa76 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:43:11.120Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9d3917ec-788d-432a-ac9b-c28d24e4aa76 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:43:11.120Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9d3917ec-788d-432a-ac9b-c28d24e4aa76 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:43:11.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bdd1820-69e4-4665-838e-d502d72b3457 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:43:11.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bdd1820-69e4-4665-838e-d502d72b3457 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68d1f723
2021-06-04T00:43:11.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bdd1820-69e4-4665-838e-d502d72b3457 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:43:11.578Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bdd1820-69e4-4665-838e-d502d72b3457 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:43:13.018Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3bdd1820-69e4-4665-838e-d502d72b3457 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:43:13.018Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3bdd1820-69e4-4665-838e-d502d72b3457 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:43:13.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29c9e7bd-23e0-43c1-bfe8-d035956410a0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:43:13.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29c9e7bd-23e0-43c1-bfe8-d035956410a0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b6d3358
2021-06-04T00:43:13.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29c9e7bd-23e0-43c1-bfe8-d035956410a0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:43:13.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29c9e7bd-23e0-43c1-bfe8-d035956410a0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:43:16.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd2e09cc-ffa1-4c79-bf4e-15ab105f1b39 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:43:16.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd2e09cc-ffa1-4c79-bf4e-15ab105f1b39 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58ac4967
2021-06-04T00:43:16.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd2e09cc-ffa1-4c79-bf4e-15ab105f1b39 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:43:16.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd2e09cc-ffa1-4c79-bf4e-15ab105f1b39 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:43:17.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:43:18.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:43:19.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cca65359-386d-489e-98d1-0e0ccbe8b97a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:43:19.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cca65359-386d-489e-98d1-0e0ccbe8b97a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f23d5be
2021-06-04T00:43:19.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cca65359-386d-489e-98d1-0e0ccbe8b97a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:43:19.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cca65359-386d-489e-98d1-0e0ccbe8b97a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:43:22.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8f69dc06-3335-4638-a0c8-ecf02dc1c154 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:43:22.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8f69dc06-3335-4638-a0c8-ecf02dc1c154 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ceacb6b
2021-06-04T00:43:22.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8f69dc06-3335-4638-a0c8-ecf02dc1c154 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:43:22.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8f69dc06-3335-4638-a0c8-ecf02dc1c154 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:43:25.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3abb2d2f-ddce-44b4-a812-39f135ca69ca PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:43:25.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3abb2d2f-ddce-44b4-a812-39f135ca69ca PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e3fc85d
2021-06-04T00:43:25.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3abb2d2f-ddce-44b4-a812-39f135ca69ca PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:43:25.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3abb2d2f-ddce-44b4-a812-39f135ca69ca PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:43:29.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c747ca2-ae16-471e-b4b4-7e9ed80794cf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:43:29.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c747ca2-ae16-471e-b4b4-7e9ed80794cf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@24625d8c
2021-06-04T00:43:29.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c747ca2-ae16-471e-b4b4-7e9ed80794cf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:43:29.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c747ca2-ae16-471e-b4b4-7e9ed80794cf PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:43:31.597Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bac94159-309c-4bd8-b442-7bcd8ce7f5e9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:43:31.597Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bac94159-309c-4bd8-b442-7bcd8ce7f5e9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5cde29b
2021-06-04T00:43:31.597Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bac94159-309c-4bd8-b442-7bcd8ce7f5e9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:43:31.597Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bac94159-309c-4bd8-b442-7bcd8ce7f5e9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:43:32.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:43:33.516Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:43:35.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d731b85-3e03-4114-9ede-4c29e5d77baa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:43:35.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d731b85-3e03-4114-9ede-4c29e5d77baa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f16d0da
2021-06-04T00:43:35.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d731b85-3e03-4114-9ede-4c29e5d77baa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:43:35.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d731b85-3e03-4114-9ede-4c29e5d77baa PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:43:37.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c77a0448-5d4d-44b7-9e8f-8a72ba85bfa6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:43:37.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c77a0448-5d4d-44b7-9e8f-8a72ba85bfa6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@f8b9045
2021-06-04T00:43:37.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c77a0448-5d4d-44b7-9e8f-8a72ba85bfa6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:43:37.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c77a0448-5d4d-44b7-9e8f-8a72ba85bfa6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:43:38.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:43:38.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:43:40.671Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:43:40.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc14e868-7b0e-43fc-ad95-a6781a5e3aa3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:43:40.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc14e868-7b0e-43fc-ad95-a6781a5e3aa3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@39b32205
2021-06-04T00:43:40.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc14e868-7b0e-43fc-ad95-a6781a5e3aa3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:43:40.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc14e868-7b0e-43fc-ad95-a6781a5e3aa3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:43:43.151Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=dc14e868-7b0e-43fc-ad95-a6781a5e3aa3 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:43:43.151Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=dc14e868-7b0e-43fc-ad95-a6781a5e3aa3 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:43:43.824Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57216dac-cda7-4558-b79e-2b9b1b4f8a7b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:43:43.824Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57216dac-cda7-4558-b79e-2b9b1b4f8a7b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5380d692
2021-06-04T00:43:43.824Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57216dac-cda7-4558-b79e-2b9b1b4f8a7b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:43:43.824Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57216dac-cda7-4558-b79e-2b9b1b4f8a7b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:43:46.828Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=57216dac-cda7-4558-b79e-2b9b1b4f8a7b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:43:46.829Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=57216dac-cda7-4558-b79e-2b9b1b4f8a7b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:43:46.829Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=57216dac-cda7-4558-b79e-2b9b1b4f8a7b ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:43:46.829Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=57216dac-cda7-4558-b79e-2b9b1b4f8a7b ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:43:47.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c463c991-33ea-42ce-8274-234efd83af55 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:43:47.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c463c991-33ea-42ce-8274-234efd83af55 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a494c38
2021-06-04T00:43:47.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c463c991-33ea-42ce-8274-234efd83af55 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:43:47.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c463c991-33ea-42ce-8274-234efd83af55 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:43:47.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:43:48.283Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c463c991-33ea-42ce-8274-234efd83af55 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:43:48.283Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c463c991-33ea-42ce-8274-234efd83af55 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:43:48.961Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:43:48.962Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:43:48.962Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:43:50.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d166599-e2b2-465a-a6b5-9e367274e7b2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:43:50.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d166599-e2b2-465a-a6b5-9e367274e7b2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79905ea1
2021-06-04T00:43:50.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d166599-e2b2-465a-a6b5-9e367274e7b2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:43:50.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d166599-e2b2-465a-a6b5-9e367274e7b2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:43:52.455Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c0c9f39-ccf3-42ed-80ff-62a0fc3694f0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:43:52.455Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c0c9f39-ccf3-42ed-80ff-62a0fc3694f0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2cf12347
2021-06-04T00:43:52.455Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c0c9f39-ccf3-42ed-80ff-62a0fc3694f0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:43:52.455Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c0c9f39-ccf3-42ed-80ff-62a0fc3694f0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:43:55.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a96520e5-5131-48b7-a10a-7dced21e607f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:43:55.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a96520e5-5131-48b7-a10a-7dced21e607f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c99826d
2021-06-04T00:43:55.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a96520e5-5131-48b7-a10a-7dced21e607f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:43:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a96520e5-5131-48b7-a10a-7dced21e607f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:43:55.949Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T00:43:57.728Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:43:57.728Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:43:57.734Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:43:57.734Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:43:57.782Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:43:57.782Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:43:57.802Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T00:43:57.803Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:43:57.818Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:43:57.818Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:43:57.830Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:43:57.830Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:43:57.832Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:43:57.832Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:43:57.850Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T00:43:59.077Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f99ba98-22f5-483d-bc25-46a68b4fe9f5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:43:59.077Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f99ba98-22f5-483d-bc25-46a68b4fe9f5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2aa8e4ee
2021-06-04T00:43:59.077Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f99ba98-22f5-483d-bc25-46a68b4fe9f5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:43:59.077Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f99ba98-22f5-483d-bc25-46a68b4fe9f5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:43:59.774Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=1f99ba98-22f5-483d-bc25-46a68b4fe9f5 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:43:59.774Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=1f99ba98-22f5-483d-bc25-46a68b4fe9f5 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:44:01.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6eb80212-7500-452c-baa1-318154dab8c4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:44:01.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6eb80212-7500-452c-baa1-318154dab8c4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5136c24c
2021-06-04T00:44:01.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6eb80212-7500-452c-baa1-318154dab8c4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:44:01.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6eb80212-7500-452c-baa1-318154dab8c4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:44:02.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:44:03.408Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:44:03.408Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T00:44:05.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be7d3bc1-c112-4f7e-a158-34bf33aa58a6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:44:05.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be7d3bc1-c112-4f7e-a158-34bf33aa58a6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74783836
2021-06-04T00:44:05.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be7d3bc1-c112-4f7e-a158-34bf33aa58a6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:44:05.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be7d3bc1-c112-4f7e-a158-34bf33aa58a6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:44:07.618Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=be7d3bc1-c112-4f7e-a158-34bf33aa58a6 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:44:07.618Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=be7d3bc1-c112-4f7e-a158-34bf33aa58a6 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:44:08.276Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50f45a42-3a77-4599-a4ea-e108d304927d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:44:08.276Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50f45a42-3a77-4599-a4ea-e108d304927d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5452463e
2021-06-04T00:44:08.276Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50f45a42-3a77-4599-a4ea-e108d304927d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:44:08.276Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50f45a42-3a77-4599-a4ea-e108d304927d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:44:10.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55bb33ae-37b1-487a-9511-9c721f261313 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:44:10.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55bb33ae-37b1-487a-9511-9c721f261313 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@393057ce
2021-06-04T00:44:10.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55bb33ae-37b1-487a-9511-9c721f261313 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:44:10.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55bb33ae-37b1-487a-9511-9c721f261313 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:44:13.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51fe582f-a623-4e75-bcc8-5eae291890b7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:44:13.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51fe582f-a623-4e75-bcc8-5eae291890b7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ef3c606
2021-06-04T00:44:13.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51fe582f-a623-4e75-bcc8-5eae291890b7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:44:13.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51fe582f-a623-4e75-bcc8-5eae291890b7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:44:17.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15ca37b6-fd1c-405f-a1be-0449fc4d3888 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:44:17.079Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15ca37b6-fd1c-405f-a1be-0449fc4d3888 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b7ffc66
2021-06-04T00:44:17.079Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15ca37b6-fd1c-405f-a1be-0449fc4d3888 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:44:17.079Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15ca37b6-fd1c-405f-a1be-0449fc4d3888 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:44:17.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:44:20.084Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=15ca37b6-fd1c-405f-a1be-0449fc4d3888 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:44:20.085Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=15ca37b6-fd1c-405f-a1be-0449fc4d3888 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:44:20.085Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=15ca37b6-fd1c-405f-a1be-0449fc4d3888 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:44:20.085Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=15ca37b6-fd1c-405f-a1be-0449fc4d3888 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:44:20.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:44:20.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:44:20.679Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a0f0438-5bcc-4ab0-9a17-beb727844b56 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:44:20.680Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a0f0438-5bcc-4ab0-9a17-beb727844b56 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2dda2481
2021-06-04T00:44:20.680Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a0f0438-5bcc-4ab0-9a17-beb727844b56 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:44:20.680Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a0f0438-5bcc-4ab0-9a17-beb727844b56 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:44:23.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:44:23.720Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=1a0f0438-5bcc-4ab0-9a17-beb727844b56 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:44:23.721Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=1a0f0438-5bcc-4ab0-9a17-beb727844b56 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:44:24.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=962aca0f-b1ca-4909-8892-c251c4dddab9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:44:24.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=962aca0f-b1ca-4909-8892-c251c4dddab9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@566cbfee
2021-06-04T00:44:24.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=962aca0f-b1ca-4909-8892-c251c4dddab9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:44:24.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=962aca0f-b1ca-4909-8892-c251c4dddab9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:44:25.949Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T00:44:26.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:44:27.163Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=962aca0f-b1ca-4909-8892-c251c4dddab9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:44:27.164Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=962aca0f-b1ca-4909-8892-c251c4dddab9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:44:27.164Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=962aca0f-b1ca-4909-8892-c251c4dddab9 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:44:27.164Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=962aca0f-b1ca-4909-8892-c251c4dddab9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:44:27.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=232fd4c7-2298-4e68-bcb6-3911b2b5ff2e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:44:27.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=232fd4c7-2298-4e68-bcb6-3911b2b5ff2e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ee62f68
2021-06-04T00:44:27.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=232fd4c7-2298-4e68-bcb6-3911b2b5ff2e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:44:27.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=232fd4c7-2298-4e68-bcb6-3911b2b5ff2e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:44:28.870Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:44:28.979Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=232fd4c7-2298-4e68-bcb6-3911b2b5ff2e ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:44:28.980Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=232fd4c7-2298-4e68-bcb6-3911b2b5ff2e ErrorCategory=ERROR ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:44:29.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd72c284-213f-4f83-b395-80b5b5099f06 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:44:29.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd72c284-213f-4f83-b395-80b5b5099f06 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6705c7d2
2021-06-04T00:44:29.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd72c284-213f-4f83-b395-80b5b5099f06 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:44:29.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd72c284-213f-4f83-b395-80b5b5099f06 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:44:31.093Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=cd72c284-213f-4f83-b395-80b5b5099f06 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:44:31.093Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=cd72c284-213f-4f83-b395-80b5b5099f06 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:44:31.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44fa7ee0-7c7a-44a4-b1be-0adc4a00f6ec PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:44:31.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44fa7ee0-7c7a-44a4-b1be-0adc4a00f6ec PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a82e16
2021-06-04T00:44:31.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44fa7ee0-7c7a-44a4-b1be-0adc4a00f6ec PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:44:31.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44fa7ee0-7c7a-44a4-b1be-0adc4a00f6ec PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:44:34.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3b9f76a-ea2d-46c2-8484-8077f1c1f6f1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:44:34.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3b9f76a-ea2d-46c2-8484-8077f1c1f6f1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@dbacc44
2021-06-04T00:44:34.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3b9f76a-ea2d-46c2-8484-8077f1c1f6f1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:44:34.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3b9f76a-ea2d-46c2-8484-8077f1c1f6f1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:44:35.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:44:35.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:44:37.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17f30a26-0b37-4ee9-89b3-c3b3a7ab2a06 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:44:37.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17f30a26-0b37-4ee9-89b3-c3b3a7ab2a06 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@75ec4a3d
2021-06-04T00:44:37.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17f30a26-0b37-4ee9-89b3-c3b3a7ab2a06 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:44:37.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17f30a26-0b37-4ee9-89b3-c3b3a7ab2a06 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:44:38.114Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:44:38.477Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=17f30a26-0b37-4ee9-89b3-c3b3a7ab2a06 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:44:38.478Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=17f30a26-0b37-4ee9-89b3-c3b3a7ab2a06 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:44:40.785Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abcab92b-33fa-455a-aca8-aab6af5d01dc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:44:40.785Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abcab92b-33fa-455a-aca8-aab6af5d01dc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c9e2805
2021-06-04T00:44:40.785Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abcab92b-33fa-455a-aca8-aab6af5d01dc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:44:40.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abcab92b-33fa-455a-aca8-aab6af5d01dc PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:44:42.520Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=abcab92b-33fa-455a-aca8-aab6af5d01dc ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:44:42.520Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=abcab92b-33fa-455a-aca8-aab6af5d01dc ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:44:43.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4327d6e-c36e-4540-a4d2-cd8a1f73e797 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:44:43.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4327d6e-c36e-4540-a4d2-cd8a1f73e797 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f85691e
2021-06-04T00:44:43.820Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4327d6e-c36e-4540-a4d2-cd8a1f73e797 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:44:43.820Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4327d6e-c36e-4540-a4d2-cd8a1f73e797 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:44:46.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f10b9cd9-53d9-4a78-84ab-505a3d3fedf7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:44:46.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f10b9cd9-53d9-4a78-84ab-505a3d3fedf7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@24864246
2021-06-04T00:44:46.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f10b9cd9-53d9-4a78-84ab-505a3d3fedf7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:44:46.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f10b9cd9-53d9-4a78-84ab-505a3d3fedf7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:44:49.218Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:44:49.224Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:44:49.893Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f10b9cd9-53d9-4a78-84ab-505a3d3fedf7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:44:49.894Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f10b9cd9-53d9-4a78-84ab-505a3d3fedf7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:44:49.895Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f10b9cd9-53d9-4a78-84ab-505a3d3fedf7 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:44:49.895Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f10b9cd9-53d9-4a78-84ab-505a3d3fedf7 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:44:50.272Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a52293b-f418-4384-81f5-06ea229019d9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:44:50.272Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a52293b-f418-4384-81f5-06ea229019d9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@332c5949
2021-06-04T00:44:50.272Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a52293b-f418-4384-81f5-06ea229019d9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:44:50.272Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a52293b-f418-4384-81f5-06ea229019d9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:44:50.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:44:50.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:44:51.475Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:44:51.475Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:44:51.476Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:44:51.476Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:44:51.855Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8a52293b-f418-4384-81f5-06ea229019d9 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:44:51.855Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8a52293b-f418-4384-81f5-06ea229019d9 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:44:52.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9cef160-5b0b-4a1b-b9b1-2dfac2079302 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:44:52.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9cef160-5b0b-4a1b-b9b1-2dfac2079302 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a26ca69
2021-06-04T00:44:52.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9cef160-5b0b-4a1b-b9b1-2dfac2079302 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:44:52.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9cef160-5b0b-4a1b-b9b1-2dfac2079302 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:44:52.917Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:44:53.957Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=d9cef160-5b0b-4a1b-b9b1-2dfac2079302 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:44:53.958Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=d9cef160-5b0b-4a1b-b9b1-2dfac2079302 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:44:55.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e3c4e5d-0601-4500-85f3-77bec2247507 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:44:55.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e3c4e5d-0601-4500-85f3-77bec2247507 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ca42919
2021-06-04T00:44:55.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e3c4e5d-0601-4500-85f3-77bec2247507 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:44:55.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e3c4e5d-0601-4500-85f3-77bec2247507 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:44:56.035Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:44:56.036Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:44:56.318Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9e3c4e5d-0601-4500-85f3-77bec2247507 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:44:56.318Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9e3c4e5d-0601-4500-85f3-77bec2247507 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:44:59.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1bc7cca6-59c5-4b83-9936-d153fb7e0887 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:44:59.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1bc7cca6-59c5-4b83-9936-d153fb7e0887 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d13d9d5
2021-06-04T00:44:59.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1bc7cca6-59c5-4b83-9936-d153fb7e0887 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:44:59.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1bc7cca6-59c5-4b83-9936-d153fb7e0887 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:45:01.785Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55fb455f-1c9c-4036-9483-2709637787e5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:45:01.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55fb455f-1c9c-4036-9483-2709637787e5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f272b97
2021-06-04T00:45:01.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55fb455f-1c9c-4036-9483-2709637787e5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:45:01.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55fb455f-1c9c-4036-9483-2709637787e5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:45:04.789Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=55fb455f-1c9c-4036-9483-2709637787e5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:45:04.789Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=55fb455f-1c9c-4036-9483-2709637787e5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:45:04.790Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=55fb455f-1c9c-4036-9483-2709637787e5 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:45:04.790Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=55fb455f-1c9c-4036-9483-2709637787e5 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:45:05.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c15be9fb-5fe7-4c6d-9b3c-b196720f2682 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:45:05.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c15be9fb-5fe7-4c6d-9b3c-b196720f2682 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@734ed198
2021-06-04T00:45:05.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c15be9fb-5fe7-4c6d-9b3c-b196720f2682 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:45:05.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c15be9fb-5fe7-4c6d-9b3c-b196720f2682 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:45:05.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:45:05.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:45:08.350Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=c15be9fb-5fe7-4c6d-9b3c-b196720f2682 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:45:08.350Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=c15be9fb-5fe7-4c6d-9b3c-b196720f2682 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:45:08.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:45:09.271Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=643ae0c1-fac6-4721-b945-da31c37d45a9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:45:09.271Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=643ae0c1-fac6-4721-b945-da31c37d45a9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d91737a
2021-06-04T00:45:09.271Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=643ae0c1-fac6-4721-b945-da31c37d45a9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:45:09.271Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=643ae0c1-fac6-4721-b945-da31c37d45a9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:45:11.523Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:45:11.525Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:45:11.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:45:11.958Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=643ae0c1-fac6-4721-b945-da31c37d45a9 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:45:11.958Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=643ae0c1-fac6-4721-b945-da31c37d45a9 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:45:12.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8bbbf367-4870-432a-b268-42db6fb3e22e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:45:12.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8bbbf367-4870-432a-b268-42db6fb3e22e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e7b4232
2021-06-04T00:45:12.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8bbbf367-4870-432a-b268-42db6fb3e22e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:45:12.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8bbbf367-4870-432a-b268-42db6fb3e22e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:45:13.915Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:45:13.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f7f14c7-ffe9-401b-9971-0d1588a2e06c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:45:13.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f7f14c7-ffe9-401b-9971-0d1588a2e06c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ec4ee6e
2021-06-04T00:45:13.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f7f14c7-ffe9-401b-9971-0d1588a2e06c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:45:13.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f7f14c7-ffe9-401b-9971-0d1588a2e06c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:45:16.921Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=7f7f14c7-ffe9-401b-9971-0d1588a2e06c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:45:16.922Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=7f7f14c7-ffe9-401b-9971-0d1588a2e06c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:45:16.922Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=7f7f14c7-ffe9-401b-9971-0d1588a2e06c ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:45:16.922Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=7f7f14c7-ffe9-401b-9971-0d1588a2e06c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:45:17.675Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a733d033-8e07-4665-a4c5-ad917a4ed041 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:45:17.676Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a733d033-8e07-4665-a4c5-ad917a4ed041 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@48d84c6f
2021-06-04T00:45:17.676Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a733d033-8e07-4665-a4c5-ad917a4ed041 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:45:17.676Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a733d033-8e07-4665-a4c5-ad917a4ed041 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:45:18.676Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a733d033-8e07-4665-a4c5-ad917a4ed041 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:45:18.676Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a733d033-8e07-4665-a4c5-ad917a4ed041 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:45:20.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07a06a70-20be-43d9-a4e7-ad3369814d59 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:45:20.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07a06a70-20be-43d9-a4e7-ad3369814d59 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7373e351
2021-06-04T00:45:20.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07a06a70-20be-43d9-a4e7-ad3369814d59 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:45:20.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07a06a70-20be-43d9-a4e7-ad3369814d59 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:45:20.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:45:20.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:45:23.020Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=07a06a70-20be-43d9-a4e7-ad3369814d59 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:45:23.020Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=07a06a70-20be-43d9-a4e7-ad3369814d59 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:45:23.021Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=07a06a70-20be-43d9-a4e7-ad3369814d59 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:45:23.021Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=07a06a70-20be-43d9-a4e7-ad3369814d59 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:45:23.432Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abc89ff4-f5e3-4801-8c82-68d3fc94fa0f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:45:23.432Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abc89ff4-f5e3-4801-8c82-68d3fc94fa0f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@abdc4cf
2021-06-04T00:45:23.432Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abc89ff4-f5e3-4801-8c82-68d3fc94fa0f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:45:23.432Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abc89ff4-f5e3-4801-8c82-68d3fc94fa0f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:45:23.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:45:26.358Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=abc89ff4-f5e3-4801-8c82-68d3fc94fa0f ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:45:26.358Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=abc89ff4-f5e3-4801-8c82-68d3fc94fa0f ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:45:26.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:45:26.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e551f1e-8b6f-44e2-98bf-6c33138ab849 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:45:26.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e551f1e-8b6f-44e2-98bf-6c33138ab849 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d363a55
2021-06-04T00:45:26.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e551f1e-8b6f-44e2-98bf-6c33138ab849 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:45:26.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e551f1e-8b6f-44e2-98bf-6c33138ab849 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:45:29.262Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:45:29.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64c1807d-7f1c-462d-9ff8-afdac1b70319 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:45:29.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64c1807d-7f1c-462d-9ff8-afdac1b70319 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@67f49aa4
2021-06-04T00:45:29.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64c1807d-7f1c-462d-9ff8-afdac1b70319 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:45:29.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64c1807d-7f1c-462d-9ff8-afdac1b70319 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:45:30.373Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=64c1807d-7f1c-462d-9ff8-afdac1b70319 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:45:30.373Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=64c1807d-7f1c-462d-9ff8-afdac1b70319 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:45:31.477Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a27ae16-0a6e-409a-925a-26eae3982c29 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:45:31.477Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a27ae16-0a6e-409a-925a-26eae3982c29 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b2ce09d
2021-06-04T00:45:31.477Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a27ae16-0a6e-409a-925a-26eae3982c29 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:45:31.477Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a27ae16-0a6e-409a-925a-26eae3982c29 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:45:32.021Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:45:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8d6b156-7876-4a76-b79c-cd6cb4da5188 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:45:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8d6b156-7876-4a76-b79c-cd6cb4da5188 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23297750
2021-06-04T00:45:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8d6b156-7876-4a76-b79c-cd6cb4da5188 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:45:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8d6b156-7876-4a76-b79c-cd6cb4da5188 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:45:35.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:45:35.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:45:37.870Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:45:37.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=160bc363-41d6-4cf6-a178-15bc59c21775 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:45:37.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=160bc363-41d6-4cf6-a178-15bc59c21775 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4614d9db
2021-06-04T00:45:37.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=160bc363-41d6-4cf6-a178-15bc59c21775 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:45:37.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=160bc363-41d6-4cf6-a178-15bc59c21775 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:45:40.269Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=160bc363-41d6-4cf6-a178-15bc59c21775 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:45:40.270Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=160bc363-41d6-4cf6-a178-15bc59c21775 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:45:40.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10423608-f476-4b3a-a68c-ccda2b3ff18b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:45:40.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10423608-f476-4b3a-a68c-ccda2b3ff18b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f64a07
2021-06-04T00:45:40.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10423608-f476-4b3a-a68c-ccda2b3ff18b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:45:40.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10423608-f476-4b3a-a68c-ccda2b3ff18b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:45:41.484Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=10423608-f476-4b3a-a68c-ccda2b3ff18b ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:45:41.484Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=10423608-f476-4b3a-a68c-ccda2b3ff18b ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:45:43.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b66b57ae-2762-498f-a631-763a58d606d7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:45:43.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b66b57ae-2762-498f-a631-763a58d606d7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@39e27a2c
2021-06-04T00:45:43.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b66b57ae-2762-498f-a631-763a58d606d7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:45:43.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b66b57ae-2762-498f-a631-763a58d606d7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:45:46.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=796b4249-0cdf-4dbc-95cb-49bb739c383e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:45:46.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=796b4249-0cdf-4dbc-95cb-49bb739c383e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@519909b7
2021-06-04T00:45:46.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=796b4249-0cdf-4dbc-95cb-49bb739c383e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:45:46.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=796b4249-0cdf-4dbc-95cb-49bb739c383e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:45:48.961Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:45:48.962Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:45:48.962Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:45:49.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2930b7d9-0a1c-4db0-a265-56c3e1186377 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:45:49.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2930b7d9-0a1c-4db0-a265-56c3e1186377 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@31a3d85e
2021-06-04T00:45:49.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2930b7d9-0a1c-4db0-a265-56c3e1186377 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:45:49.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2930b7d9-0a1c-4db0-a265-56c3e1186377 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:45:50.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:45:50.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:45:52.920Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2930b7d9-0a1c-4db0-a265-56c3e1186377 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:45:52.920Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2930b7d9-0a1c-4db0-a265-56c3e1186377 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:45:52.920Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=2930b7d9-0a1c-4db0-a265-56c3e1186377 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:45:52.921Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=2930b7d9-0a1c-4db0-a265-56c3e1186377 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:45:53.334Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e613d396-2590-4067-9c5d-b93180f55826 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:45:53.334Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e613d396-2590-4067-9c5d-b93180f55826 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6321a1f
2021-06-04T00:45:53.334Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e613d396-2590-4067-9c5d-b93180f55826 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:45:53.334Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e613d396-2590-4067-9c5d-b93180f55826 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:45:53.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:45:56.388Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e613d396-2590-4067-9c5d-b93180f55826 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:45:56.388Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e613d396-2590-4067-9c5d-b93180f55826 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:45:56.389Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e613d396-2590-4067-9c5d-b93180f55826 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:45:56.389Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=e613d396-2590-4067-9c5d-b93180f55826 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:45:56.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:45:57.075Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=099b40d3-df9f-431b-b446-896dee81984b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:45:57.075Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=099b40d3-df9f-431b-b446-896dee81984b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35e6437c
2021-06-04T00:45:57.075Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=099b40d3-df9f-431b-b446-896dee81984b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:45:57.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=099b40d3-df9f-431b-b446-896dee81984b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:45:59.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:46:00.119Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=099b40d3-df9f-431b-b446-896dee81984b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:46:00.119Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=099b40d3-df9f-431b-b446-896dee81984b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:46:00.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a10f26b5-c1b7-4773-8cb3-5235cda41203 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:46:00.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a10f26b5-c1b7-4773-8cb3-5235cda41203 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@cdc1f0e
2021-06-04T00:46:00.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a10f26b5-c1b7-4773-8cb3-5235cda41203 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:46:00.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a10f26b5-c1b7-4773-8cb3-5235cda41203 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:46:01.159Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a10f26b5-c1b7-4773-8cb3-5235cda41203 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:46:01.159Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=a10f26b5-c1b7-4773-8cb3-5235cda41203 ErrorCategory=ERROR ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:46:01.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d86b2b08-e489-4bfb-af6b-7a9cb1d6c4cd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:46:01.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d86b2b08-e489-4bfb-af6b-7a9cb1d6c4cd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e67a0dd
2021-06-04T00:46:01.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d86b2b08-e489-4bfb-af6b-7a9cb1d6c4cd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:46:01.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d86b2b08-e489-4bfb-af6b-7a9cb1d6c4cd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:46:02.050Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:46:04.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31a17c9f-de05-47b2-abbf-782df18bb2a8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:46:04.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31a17c9f-de05-47b2-abbf-782df18bb2a8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@24f0de0b
2021-06-04T00:46:04.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31a17c9f-de05-47b2-abbf-782df18bb2a8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:46:04.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31a17c9f-de05-47b2-abbf-782df18bb2a8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:46:05.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:46:05.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:46:05.724Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=31a17c9f-de05-47b2-abbf-782df18bb2a8 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:46:05.724Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=31a17c9f-de05-47b2-abbf-782df18bb2a8 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:46:07.923Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:46:08.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61871c44-90a8-461b-8c31-408f061868c1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:46:08.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61871c44-90a8-461b-8c31-408f061868c1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@483881f4
2021-06-04T00:46:08.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61871c44-90a8-461b-8c31-408f061868c1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:46:08.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61871c44-90a8-461b-8c31-408f061868c1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:46:08.775Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=61871c44-90a8-461b-8c31-408f061868c1 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:46:08.775Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=61871c44-90a8-461b-8c31-408f061868c1 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:46:11.080Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abada82f-9e10-4e72-bb5b-d177c519ae68 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:46:11.080Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abada82f-9e10-4e72-bb5b-d177c519ae68 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e3ae52b
2021-06-04T00:46:11.080Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abada82f-9e10-4e72-bb5b-d177c519ae68 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:46:11.080Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abada82f-9e10-4e72-bb5b-d177c519ae68 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:46:11.461Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=abada82f-9e10-4e72-bb5b-d177c519ae68 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:46:11.461Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=abada82f-9e10-4e72-bb5b-d177c519ae68 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:46:13.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54739eb7-59cb-40f0-aac7-3d53f915d9c0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:46:13.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54739eb7-59cb-40f0-aac7-3d53f915d9c0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d98d779
2021-06-04T00:46:13.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54739eb7-59cb-40f0-aac7-3d53f915d9c0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:46:13.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54739eb7-59cb-40f0-aac7-3d53f915d9c0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:46:16.822Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=54739eb7-59cb-40f0-aac7-3d53f915d9c0 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:46:16.822Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=54739eb7-59cb-40f0-aac7-3d53f915d9c0 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:46:16.822Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=54739eb7-59cb-40f0-aac7-3d53f915d9c0 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:46:16.822Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=54739eb7-59cb-40f0-aac7-3d53f915d9c0 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:46:17.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a0c26ae-3139-4475-8bab-061f26e18fb4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:46:17.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a0c26ae-3139-4475-8bab-061f26e18fb4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3fba5247
2021-06-04T00:46:17.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a0c26ae-3139-4475-8bab-061f26e18fb4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:46:17.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a0c26ae-3139-4475-8bab-061f26e18fb4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:46:20.503Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3a0c26ae-3139-4475-8bab-061f26e18fb4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:46:20.503Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3a0c26ae-3139-4475-8bab-061f26e18fb4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:46:20.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2ce9be2-607f-4231-bf87-52ad7ffe1e39 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:46:20.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2ce9be2-607f-4231-bf87-52ad7ffe1e39 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a1bfb93
2021-06-04T00:46:20.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2ce9be2-607f-4231-bf87-52ad7ffe1e39 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:46:20.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2ce9be2-607f-4231-bf87-52ad7ffe1e39 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:46:21.365Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a2ce9be2-607f-4231-bf87-52ad7ffe1e39 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:46:21.365Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a2ce9be2-607f-4231-bf87-52ad7ffe1e39 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:46:22.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99e183d8-b431-4e85-afde-b050f6025623 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:46:22.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99e183d8-b431-4e85-afde-b050f6025623 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@c269ea7
2021-06-04T00:46:22.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99e183d8-b431-4e85-afde-b050f6025623 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:46:22.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99e183d8-b431-4e85-afde-b050f6025623 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:46:23.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:46:23.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:46:25.524Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=99e183d8-b431-4e85-afde-b050f6025623 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:46:25.524Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=99e183d8-b431-4e85-afde-b050f6025623 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:46:25.525Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=99e183d8-b431-4e85-afde-b050f6025623 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:46:25.525Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=99e183d8-b431-4e85-afde-b050f6025623 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:46:26.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d69aeb65-05f5-47da-b2f2-7274895447c5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:46:26.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d69aeb65-05f5-47da-b2f2-7274895447c5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3585fe2d
2021-06-04T00:46:26.173Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d69aeb65-05f5-47da-b2f2-7274895447c5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:46:26.173Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d69aeb65-05f5-47da-b2f2-7274895447c5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:46:26.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:46:29.219Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d69aeb65-05f5-47da-b2f2-7274895447c5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:46:29.219Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d69aeb65-05f5-47da-b2f2-7274895447c5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:46:29.220Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=d69aeb65-05f5-47da-b2f2-7274895447c5 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:46:29.220Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=d69aeb65-05f5-47da-b2f2-7274895447c5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:46:29.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:46:29.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=362fe07e-df45-4d56-9c68-33f779ac6790 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:46:29.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=362fe07e-df45-4d56-9c68-33f779ac6790 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f3e50bf
2021-06-04T00:46:29.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=362fe07e-df45-4d56-9c68-33f779ac6790 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:46:29.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=362fe07e-df45-4d56-9c68-33f779ac6790 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:46:32.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:46:32.914Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=362fe07e-df45-4d56-9c68-33f779ac6790 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:46:32.914Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=362fe07e-df45-4d56-9c68-33f779ac6790 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:46:33.524Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf7ef4db-fde0-476d-b169-5316ebdf46b8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:46:33.524Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf7ef4db-fde0-476d-b169-5316ebdf46b8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d3bd008
2021-06-04T00:46:33.524Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf7ef4db-fde0-476d-b169-5316ebdf46b8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:46:33.524Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf7ef4db-fde0-476d-b169-5316ebdf46b8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:46:36.561Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=bf7ef4db-fde0-476d-b169-5316ebdf46b8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:46:36.561Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=bf7ef4db-fde0-476d-b169-5316ebdf46b8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:46:37.271Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6fc4069-6061-429f-bfa8-f39cb87c7f71 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:46:37.272Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6fc4069-6061-429f-bfa8-f39cb87c7f71 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3af33e13
2021-06-04T00:46:37.272Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6fc4069-6061-429f-bfa8-f39cb87c7f71 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:46:37.272Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6fc4069-6061-429f-bfa8-f39cb87c7f71 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:46:40.316Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=b6fc4069-6061-429f-bfa8-f39cb87c7f71 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:46:40.317Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=b6fc4069-6061-429f-bfa8-f39cb87c7f71 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:46:40.771Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b744487e-d22f-4766-a841-4cb6054386d8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:46:40.771Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b744487e-d22f-4766-a841-4cb6054386d8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5772adf7
2021-06-04T00:46:40.771Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b744487e-d22f-4766-a841-4cb6054386d8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:46:40.771Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b744487e-d22f-4766-a841-4cb6054386d8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:46:43.805Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=b744487e-d22f-4766-a841-4cb6054386d8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:46:43.805Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=b744487e-d22f-4766-a841-4cb6054386d8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:46:44.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=850b6db5-50cc-4a68-9940-6de6afabc260 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:46:44.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=850b6db5-50cc-4a68-9940-6de6afabc260 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a869aff
2021-06-04T00:46:44.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=850b6db5-50cc-4a68-9940-6de6afabc260 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:46:44.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=850b6db5-50cc-4a68-9940-6de6afabc260 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:46:45.218Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=850b6db5-50cc-4a68-9940-6de6afabc260 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:46:45.218Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=850b6db5-50cc-4a68-9940-6de6afabc260 ErrorCategory=ERROR ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:46:45.462Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. Could not execute operation due to backend exception
2021-06-04T00:46:45.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f603b0db-d7f7-4d5a-b802-255ddc53fb34 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:46:45.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f603b0db-d7f7-4d5a-b802-255ddc53fb34 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28244388
2021-06-04T00:46:45.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f603b0db-d7f7-4d5a-b802-255ddc53fb34 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:46:45.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f603b0db-d7f7-4d5a-b802-255ddc53fb34 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:46:46.479Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:46:47.270Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de3b82b6-6330-4a71-b082-e1b4c86eb40f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:46:47.270Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de3b82b6-6330-4a71-b082-e1b4c86eb40f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@c9dfae
2021-06-04T00:46:47.270Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de3b82b6-6330-4a71-b082-e1b4c86eb40f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:46:47.270Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de3b82b6-6330-4a71-b082-e1b4c86eb40f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:46:48.078Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:46:48.078Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:46:50.275Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=de3b82b6-6330-4a71-b082-e1b4c86eb40f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:46:50.276Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=de3b82b6-6330-4a71-b082-e1b4c86eb40f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:46:50.276Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=de3b82b6-6330-4a71-b082-e1b4c86eb40f ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:46:50.276Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=de3b82b6-6330-4a71-b082-e1b4c86eb40f ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:46:50.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:46:50.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4da262e-fff7-4f9f-b608-a4025950a5af PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:46:50.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4da262e-fff7-4f9f-b608-a4025950a5af PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e16fc2a
2021-06-04T00:46:50.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4da262e-fff7-4f9f-b608-a4025950a5af PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:46:50.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4da262e-fff7-4f9f-b608-a4025950a5af PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:46:52.156Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://message-router.onap:3904: The target server failed to respond
2021-06-04T00:46:52.156Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:46:52.172Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://message-router.onap:3904: The target server failed to respond
2021-06-04T00:46:52.172Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:46:52.185Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:46:52.185Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:46:52.185Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:46:52.185Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:46:53.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:46:53.801Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f4da262e-fff7-4f9f-b608-a4025950a5af ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:46:53.802Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f4da262e-fff7-4f9f-b608-a4025950a5af ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:46:53.802Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f4da262e-fff7-4f9f-b608-a4025950a5af ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:46:53.802Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=f4da262e-fff7-4f9f-b608-a4025950a5af ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:46:54.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=002b807c-4c0c-4ec6-aed8-95973aec4f1c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:46:54.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=002b807c-4c0c-4ec6-aed8-95973aec4f1c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34def575
2021-06-04T00:46:54.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=002b807c-4c0c-4ec6-aed8-95973aec4f1c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:46:54.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=002b807c-4c0c-4ec6-aed8-95973aec4f1c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:46:56.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:46:57.266Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=002b807c-4c0c-4ec6-aed8-95973aec4f1c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:46:57.266Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=002b807c-4c0c-4ec6-aed8-95973aec4f1c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:46:57.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce5bb343-0e3c-42e2-b499-22fa2f89ad1a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:46:57.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce5bb343-0e3c-42e2-b499-22fa2f89ad1a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@436a2c2d
2021-06-04T00:46:57.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce5bb343-0e3c-42e2-b499-22fa2f89ad1a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:46:57.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce5bb343-0e3c-42e2-b499-22fa2f89ad1a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:46:59.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:47:00.903Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ce5bb343-0e3c-42e2-b499-22fa2f89ad1a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:47:00.903Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ce5bb343-0e3c-42e2-b499-22fa2f89ad1a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:47:01.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5fa3d98-0981-406d-8077-2dda2be9ddda PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:47:01.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5fa3d98-0981-406d-8077-2dda2be9ddda PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58a1fb78
2021-06-04T00:47:01.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5fa3d98-0981-406d-8077-2dda2be9ddda PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:47:01.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5fa3d98-0981-406d-8077-2dda2be9ddda PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:47:02.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:47:04.368Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a5fa3d98-0981-406d-8077-2dda2be9ddda ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:47:04.369Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a5fa3d98-0981-406d-8077-2dda2be9ddda ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:47:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5e9415b-36df-481b-82d9-b10ef105ceed PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:47:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5e9415b-36df-481b-82d9-b10ef105ceed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1302dcd9
2021-06-04T00:47:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5e9415b-36df-481b-82d9-b10ef105ceed PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:47:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5e9415b-36df-481b-82d9-b10ef105ceed PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:47:05.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:47:07.964Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a5e9415b-36df-481b-82d9-b10ef105ceed ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:47:07.965Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a5e9415b-36df-481b-82d9-b10ef105ceed ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:47:08.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:47:08.719Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df8258c3-3635-4ab0-8ea6-fae972bf6811 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:47:08.719Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df8258c3-3635-4ab0-8ea6-fae972bf6811 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@611cdf5e
2021-06-04T00:47:08.720Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df8258c3-3635-4ab0-8ea6-fae972bf6811 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:47:08.720Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df8258c3-3635-4ab0-8ea6-fae972bf6811 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:47:11.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:47:11.754Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=df8258c3-3635-4ab0-8ea6-fae972bf6811 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:47:11.755Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=df8258c3-3635-4ab0-8ea6-fae972bf6811 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:47:11.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a92bfbf1-7b0a-4668-9fb5-ad2924206953 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:47:11.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a92bfbf1-7b0a-4668-9fb5-ad2924206953 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@392738b0
2021-06-04T00:47:11.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a92bfbf1-7b0a-4668-9fb5-ad2924206953 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:47:11.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a92bfbf1-7b0a-4668-9fb5-ad2924206953 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:47:14.205Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation RequestID=null ErrorCategory=INFO ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=500 TargetEntity=ReplaceDataTypesCache Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177)
at org.apache.tinkerpop.gremlin.structure.Element.keys(Element.java:69)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getProperties(JanusGraphGenericDao.java:1491)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getByCriteria(JanusGraphGenericDao.java:759)
at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypeNodes(PropertyOperation.java:1566)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.findAllDataTypesLazy(ApplicationDataTypeCache.java:309)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.hasDataTypesChanged(ApplicationDataTypeCache.java:220)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:200)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T00:47:14.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:47:14.917Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a92bfbf1-7b0a-4668-9fb5-ad2924206953 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:47:14.917Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a92bfbf1-7b0a-4668-9fb5-ad2924206953 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:47:15.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86a5db4b-3769-4e51-80e4-4acb8e29ed57 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:47:15.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86a5db4b-3769-4e51-80e4-4acb8e29ed57 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@48bd103
2021-06-04T00:47:15.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86a5db4b-3769-4e51-80e4-4acb8e29ed57 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:47:15.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86a5db4b-3769-4e51-80e4-4acb8e29ed57 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:47:17.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:47:18.507Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=86a5db4b-3769-4e51-80e4-4acb8e29ed57 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:47:18.508Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=86a5db4b-3769-4e51-80e4-4acb8e29ed57 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:47:19.272Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae7b9474-7fdb-4499-8297-e775eda7b17a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:47:19.272Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae7b9474-7fdb-4499-8297-e775eda7b17a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e5a54cf
2021-06-04T00:47:19.272Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae7b9474-7fdb-4499-8297-e775eda7b17a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:47:19.272Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae7b9474-7fdb-4499-8297-e775eda7b17a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:47:20.148Z [JanusGraph-Health-Check-Thread] INFO o.j.d.util.BackendOperation Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.execute(VertexCentricQueryBuilder.java:73)
at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.properties(VertexCentricQueryBuilder.java:100)
at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177)
at org.apache.tinkerpop.gremlin.structure.Vertex.property(Vertex.java:70)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:341)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:336)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
... 4 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T00:47:20.148Z [cluster1-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T00:47:20.150Z [cluster1-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 2000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T00:47:20.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:47:21.493Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5e9f99d-f1bd-4108-9b52-ce9337ae648d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:47:21.494Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5e9f99d-f1bd-4108-9b52-ce9337ae648d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7fade85
2021-06-04T00:47:21.494Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5e9f99d-f1bd-4108-9b52-ce9337ae648d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:47:21.494Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5e9f99d-f1bd-4108-9b52-ce9337ae648d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:47:23.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:47:24.498Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f5e9f99d-f1bd-4108-9b52-ce9337ae648d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:47:24.499Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f5e9f99d-f1bd-4108-9b52-ce9337ae648d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:47:25.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e0b69b7-9e08-4bfe-b064-41e6559869fb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:47:25.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e0b69b7-9e08-4bfe-b064-41e6559869fb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49f411f5
2021-06-04T00:47:25.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e0b69b7-9e08-4bfe-b064-41e6559869fb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:47:25.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e0b69b7-9e08-4bfe-b064-41e6559869fb PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:47:26.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:47:28.153Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=9e0b69b7-9e08-4bfe-b064-41e6559869fb ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:47:28.154Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=9e0b69b7-9e08-4bfe-b064-41e6559869fb ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:47:28.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c37bfc6c-679d-474f-97ff-6d09b4969499 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:47:28.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c37bfc6c-679d-474f-97ff-6d09b4969499 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@504dc1ae
2021-06-04T00:47:28.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c37bfc6c-679d-474f-97ff-6d09b4969499 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:47:28.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c37bfc6c-679d-474f-97ff-6d09b4969499 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:47:29.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:47:31.809Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=c37bfc6c-679d-474f-97ff-6d09b4969499 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:47:31.809Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=c37bfc6c-679d-474f-97ff-6d09b4969499 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:47:31.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e10ad89a-0591-44d9-961c-1da451dfcc8f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:47:31.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e10ad89a-0591-44d9-961c-1da451dfcc8f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6800f1ba
2021-06-04T00:47:31.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e10ad89a-0591-44d9-961c-1da451dfcc8f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:47:31.939Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e10ad89a-0591-44d9-961c-1da451dfcc8f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:47:32.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:47:34.973Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e10ad89a-0591-44d9-961c-1da451dfcc8f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:47:34.974Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e10ad89a-0591-44d9-961c-1da451dfcc8f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:47:35.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f9a2110-635d-4e0e-849e-67b72b784582 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:47:35.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f9a2110-635d-4e0e-849e-67b72b784582 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65d80b61
2021-06-04T00:47:35.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f9a2110-635d-4e0e-849e-67b72b784582 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:47:35.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f9a2110-635d-4e0e-849e-67b72b784582 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:47:35.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:47:37.883Z [cluster1-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T00:47:37.884Z [cluster1-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 4000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T00:47:38.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:47:38.562Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=5f9a2110-635d-4e0e-849e-67b72b784582 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:47:38.562Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=5f9a2110-635d-4e0e-849e-67b72b784582 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:47:39.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ceef2f38-bec0-4282-975b-a55ec626d98c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:47:39.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ceef2f38-bec0-4282-975b-a55ec626d98c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a26aabe
2021-06-04T00:47:39.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ceef2f38-bec0-4282-975b-a55ec626d98c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:47:39.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ceef2f38-bec0-4282-975b-a55ec626d98c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:47:41.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:47:42.214Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ceef2f38-bec0-4282-975b-a55ec626d98c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:47:42.214Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ceef2f38-bec0-4282-975b-a55ec626d98c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:47:42.355Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abbc5de7-9717-45a7-924a-12353d6b4b80 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:47:42.355Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abbc5de7-9717-45a7-924a-12353d6b4b80 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5342a8ff
2021-06-04T00:47:42.355Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abbc5de7-9717-45a7-924a-12353d6b4b80 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:47:42.355Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abbc5de7-9717-45a7-924a-12353d6b4b80 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:47:44.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:47:45.389Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=abbc5de7-9717-45a7-924a-12353d6b4b80 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:47:45.390Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=abbc5de7-9717-45a7-924a-12353d6b4b80 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:47:45.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e169beed-b0e7-455e-8728-7e1b9e69e5c0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:47:45.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e169beed-b0e7-455e-8728-7e1b9e69e5c0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@294b6bcc
2021-06-04T00:47:45.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e169beed-b0e7-455e-8728-7e1b9e69e5c0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:47:45.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e169beed-b0e7-455e-8728-7e1b9e69e5c0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:47:47.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:47:49.011Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e169beed-b0e7-455e-8728-7e1b9e69e5c0 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:47:49.011Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e169beed-b0e7-455e-8728-7e1b9e69e5c0 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:47:49.777Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b92d4d3-7ee6-4028-94e9-9e668b0aaec1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:47:49.777Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b92d4d3-7ee6-4028-94e9-9e668b0aaec1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38094c6c
2021-06-04T00:47:49.777Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b92d4d3-7ee6-4028-94e9-9e668b0aaec1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:47:49.777Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b92d4d3-7ee6-4028-94e9-9e668b0aaec1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:47:50.541Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:47:51.637Z [BE-Health-Check-Task] INFO o.a.http.impl.execchain.RetryExec RequestID=2b92d4d3-7ee6-4028-94e9-9e668b0aaec1 PartnerName=SDC.BE I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {s}->https://sdc-onboarding-be.onap:8445: The target server failed to respond
2021-06-04T00:47:51.637Z [BE-Health-Check-Task] INFO o.a.http.impl.execchain.RetryExec RequestID=2b92d4d3-7ee6-4028-94e9-9e668b0aaec1 PartnerName=SDC.BE Retrying request to {s}->https://sdc-onboarding-be.onap:8445
2021-06-04T00:47:51.638Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2b92d4d3-7ee6-4028-94e9-9e668b0aaec1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T00:47:51.639Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2b92d4d3-7ee6-4028-94e9-9e668b0aaec1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:47:51.789Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc868002-23c9-4ddf-9805-d83e6e96c0db PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:47:51.789Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc868002-23c9-4ddf-9805-d83e6e96c0db PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5886e5c2
2021-06-04T00:47:51.789Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc868002-23c9-4ddf-9805-d83e6e96c0db PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:47:51.789Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc868002-23c9-4ddf-9805-d83e6e96c0db PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:47:51.791Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=dc868002-23c9-4ddf-9805-d83e6e96c0db ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T00:47:51.791Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=dc868002-23c9-4ddf-9805-d83e6e96c0db ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:47:51.961Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d00fade-f1b5-4519-bf1b-97dfe4db0233 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:47:51.961Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d00fade-f1b5-4519-bf1b-97dfe4db0233 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@c931b5
2021-06-04T00:47:51.961Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d00fade-f1b5-4519-bf1b-97dfe4db0233 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:47:51.961Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d00fade-f1b5-4519-bf1b-97dfe4db0233 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:47:51.962Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=5d00fade-f1b5-4519-bf1b-97dfe4db0233 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T00:47:51.963Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=5d00fade-f1b5-4519-bf1b-97dfe4db0233 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:47:52.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de56585d-090e-4699-8300-149e3684ef78 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:47:52.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de56585d-090e-4699-8300-149e3684ef78 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@f86ffb0
2021-06-04T00:47:52.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de56585d-090e-4699-8300-149e3684ef78 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:47:52.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de56585d-090e-4699-8300-149e3684ef78 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:47:52.089Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=de56585d-090e-4699-8300-149e3684ef78 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T00:47:52.089Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=de56585d-090e-4699-8300-149e3684ef78 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:47:52.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2a1428c-acec-4e79-af86-0880434b3611 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:47:52.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2a1428c-acec-4e79-af86-0880434b3611 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@190e4bd6
2021-06-04T00:47:52.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2a1428c-acec-4e79-af86-0880434b3611 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:47:52.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2a1428c-acec-4e79-af86-0880434b3611 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:47:52.519Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e2a1428c-acec-4e79-af86-0880434b3611 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T00:47:52.519Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e2a1428c-acec-4e79-af86-0880434b3611 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:47:53.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:47:55.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=287b3499-df60-4a97-9a31-684217a2e88c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:47:55.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=287b3499-df60-4a97-9a31-684217a2e88c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c9521fb
2021-06-04T00:47:55.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=287b3499-df60-4a97-9a31-684217a2e88c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:47:55.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=287b3499-df60-4a97-9a31-684217a2e88c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:47:55.916Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=287b3499-df60-4a97-9a31-684217a2e88c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T00:47:55.917Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=287b3499-df60-4a97-9a31-684217a2e88c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:47:56.543Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:47:58.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c0b4081-b062-4b15-8a29-8a7c423bc4a1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:47:58.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c0b4081-b062-4b15-8a29-8a7c423bc4a1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b86ab65
2021-06-04T00:47:58.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c0b4081-b062-4b15-8a29-8a7c423bc4a1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:47:58.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c0b4081-b062-4b15-8a29-8a7c423bc4a1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:47:59.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:47:59.864Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation RequestID=null ErrorCategory=INFO ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=500 TargetEntity=ReplaceDataTypesCache Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177)
at org.apache.tinkerpop.gremlin.structure.Element.keys(Element.java:69)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getProperties(JanusGraphGenericDao.java:1491)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getByCriteria(JanusGraphGenericDao.java:759)
at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypeNodes(PropertyOperation.java:1566)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.findAllDataTypesLazy(ApplicationDataTypeCache.java:309)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.hasDataTypesChanged(ApplicationDataTypeCache.java:220)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:200)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308)
at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 26 common frames omitted
2021-06-04T00:48:01.984Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=7c0b4081-b062-4b15-8a29-8a7c423bc4a1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T00:48:01.985Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=7c0b4081-b062-4b15-8a29-8a7c423bc4a1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:48:02.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be7077bd-e560-4db6-8540-7978bb288446 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:48:02.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be7077bd-e560-4db6-8540-7978bb288446 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b3780ab
2021-06-04T00:48:02.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be7077bd-e560-4db6-8540-7978bb288446 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:48:02.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be7077bd-e560-4db6-8540-7978bb288446 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:48:02.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:48:05.122Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=be7077bd-e560-4db6-8540-7978bb288446 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T00:48:05.122Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=be7077bd-e560-4db6-8540-7978bb288446 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:48:05.555Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:48:05.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89d83264-40ac-4728-a91f-bcee785e49d7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:48:05.673Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89d83264-40ac-4728-a91f-bcee785e49d7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d6304f0
2021-06-04T00:48:05.673Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89d83264-40ac-4728-a91f-bcee785e49d7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:48:05.673Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89d83264-40ac-4728-a91f-bcee785e49d7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:48:07.755Z [cluster1-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T00:48:07.756Z [cluster1-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 8000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T00:48:07.765Z [pool-8-thread-1] WARN o.j.diskstorage.log.kcvs.KCVSLog Could not read messages for timestamp [2021-06-04T00:47:51.371156Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:56)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:158)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:726)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:100)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
... 8 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:792)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:789)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:147)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:161)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
... 9 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T00:48:07.766Z [ApplicationDataTypeCacheThread-1] ERROR o.o.s.b.m.c.ApplicationDataTypeCache RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=900 TargetEntity=null Failed to fetch data types from database. Status is GENERAL_ERROR
2021-06-04T00:48:07.767Z [ApplicationDataTypeCacheThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=ApplicationDataTypesCache Internal Connection problem. Description: Failed to fetch data types from database. Status is GENERAL_ERROR
2021-06-04T00:48:07.767Z [ApplicationDataTypeCacheThread-1] INFO o.o.s.b.m.c.ApplicationDataTypeCache RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=ApplicationDataTypesCache Detected changes in the data types, updating the data type cache.
2021-06-04T00:48:08.541Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:48:08.684Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=89d83264-40ac-4728-a91f-bcee785e49d7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T00:48:08.684Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=89d83264-40ac-4728-a91f-bcee785e49d7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:48:09.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4574c8e-2a70-4b67-af66-ea915e3ac538 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:48:09.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4574c8e-2a70-4b67-af66-ea915e3ac538 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@63b4fe37
2021-06-04T00:48:09.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4574c8e-2a70-4b67-af66-ea915e3ac538 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:48:09.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4574c8e-2a70-4b67-af66-ea915e3ac538 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:48:11.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:48:12.329Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f4574c8e-2a70-4b67-af66-ea915e3ac538 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T00:48:12.329Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f4574c8e-2a70-4b67-af66-ea915e3ac538 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:48:12.462Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3166ec3d-5eaa-4598-a782-398fcd89bf3f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:48:12.462Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3166ec3d-5eaa-4598-a782-398fcd89bf3f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27a72781
2021-06-04T00:48:12.462Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3166ec3d-5eaa-4598-a782-398fcd89bf3f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:48:12.462Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3166ec3d-5eaa-4598-a782-398fcd89bf3f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:48:14.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:48:15.472Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3166ec3d-5eaa-4598-a782-398fcd89bf3f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T00:48:15.472Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3166ec3d-5eaa-4598-a782-398fcd89bf3f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:48:16.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6686c8a9-745c-473d-9b0b-4d234cae72ae PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:48:16.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6686c8a9-745c-473d-9b0b-4d234cae72ae PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ffdb6f7
2021-06-04T00:48:16.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6686c8a9-745c-473d-9b0b-4d234cae72ae PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:48:16.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6686c8a9-745c-473d-9b0b-4d234cae72ae PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:48:17.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:48:19.181Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=6686c8a9-745c-473d-9b0b-4d234cae72ae ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T00:48:19.181Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=6686c8a9-745c-473d-9b0b-4d234cae72ae ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:48:19.397Z [ApplicationDataTypeCacheThread-1] ERROR o.o.s.b.m.c.ApplicationDataTypeCache RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=900 TargetEntity=null Failed to fetch data types from database. Status is GENERAL_ERROR
2021-06-04T00:48:19.397Z [ApplicationDataTypeCacheThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=ApplicationDataTypesCache Internal Connection problem. Description: Failed to fetch data types from database. Status is GENERAL_ERROR
2021-06-04T00:48:19.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=888fa8ad-635a-460c-b169-b1260694168e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:48:19.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=888fa8ad-635a-460c-b169-b1260694168e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1476b01a
2021-06-04T00:48:19.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=888fa8ad-635a-460c-b169-b1260694168e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:48:19.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=888fa8ad-635a-460c-b169-b1260694168e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:48:20.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:48:20.676Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node08br181n47uyk1vro3anvfvd05561
2021-06-04T00:48:20.676Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0ksc5g6gibs00vw5lhqmqjyze557
2021-06-04T00:48:20.676Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0t9m0yz9fh0ybxbh30unxzr8b560
2021-06-04T00:48:20.676Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01eqjawwyutcbu19ksw3llxs3pd559
2021-06-04T00:48:20.677Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01xfrr21ptvgr213scock4ne1db554
2021-06-04T00:48:20.677Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0mhd3w5ztktf6il44e2cwr7ys555
2021-06-04T00:48:20.677Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01bnxbke3pui7jij5wyqemozks556
2021-06-04T00:48:20.677Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01ivibo8x75yekkhdd1gcnxob6562
2021-06-04T00:48:20.677Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0ll6nijnyfuklbyoy7pklj1fl558
2021-06-04T00:48:20.677Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01qsl53nv57zne1cv6n8r9sid0q553
2021-06-04T00:48:22.831Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=888fa8ad-635a-460c-b169-b1260694168e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T00:48:22.831Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=888fa8ad-635a-460c-b169-b1260694168e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:48:23.240Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92effd57-5fb2-41f6-bd30-3b91541b73f6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:48:23.240Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92effd57-5fb2-41f6-bd30-3b91541b73f6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@589b7ea6
2021-06-04T00:48:23.240Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92effd57-5fb2-41f6-bd30-3b91541b73f6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:48:23.240Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92effd57-5fb2-41f6-bd30-3b91541b73f6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:48:23.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:48:26.249Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=92effd57-5fb2-41f6-bd30-3b91541b73f6 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T00:48:26.250Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=92effd57-5fb2-41f6-bd30-3b91541b73f6 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:48:26.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:48:27.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a274634-afa3-498e-b8a7-ce5a3c91f57f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:48:27.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a274634-afa3-498e-b8a7-ce5a3c91f57f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b82732a
2021-06-04T00:48:27.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a274634-afa3-498e-b8a7-ce5a3c91f57f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:48:27.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a274634-afa3-498e-b8a7-ce5a3c91f57f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:48:29.542Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:48:30.290Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=9a274634-afa3-498e-b8a7-ce5a3c91f57f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T00:48:30.290Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=9a274634-afa3-498e-b8a7-ce5a3c91f57f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T00:48:30.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fd6513a-c700-49ff-b16f-6ddb367aae90 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:48:30.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fd6513a-c700-49ff-b16f-6ddb367aae90 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3b6709af
2021-06-04T00:48:30.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fd6513a-c700-49ff-b16f-6ddb367aae90 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:48:30.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fd6513a-c700-49ff-b16f-6ddb367aae90 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:48:32.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:48:34.279Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0fd6513a-c700-49ff-b16f-6ddb367aae90 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:48:34.279Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0fd6513a-c700-49ff-b16f-6ddb367aae90 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:48:34.680Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9b0891e-25fe-458f-98bf-db331f57c226 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:48:34.680Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9b0891e-25fe-458f-98bf-db331f57c226 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2654a4aa
2021-06-04T00:48:34.680Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9b0891e-25fe-458f-98bf-db331f57c226 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:48:34.680Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9b0891e-25fe-458f-98bf-db331f57c226 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:48:35.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:48:37.728Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=c9b0891e-25fe-458f-98bf-db331f57c226 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:48:37.728Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=c9b0891e-25fe-458f-98bf-db331f57c226 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:48:38.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:48:38.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5be5d768-9185-4967-bd62-6992c454c774 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:48:38.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5be5d768-9185-4967-bd62-6992c454c774 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c6c948e
2021-06-04T00:48:38.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5be5d768-9185-4967-bd62-6992c454c774 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:48:38.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5be5d768-9185-4967-bd62-6992c454c774 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:48:41.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:48:41.611Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=5be5d768-9185-4967-bd62-6992c454c774 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:48:41.612Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=5be5d768-9185-4967-bd62-6992c454c774 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:48:41.751Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2fb6dfc8-8abb-447b-90ea-778abc260637 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:48:41.751Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2fb6dfc8-8abb-447b-90ea-778abc260637 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d70be57
2021-06-04T00:48:41.751Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2fb6dfc8-8abb-447b-90ea-778abc260637 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:48:41.751Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2fb6dfc8-8abb-447b-90ea-778abc260637 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:48:44.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:48:44.796Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2fb6dfc8-8abb-447b-90ea-778abc260637 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:48:44.796Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2fb6dfc8-8abb-447b-90ea-778abc260637 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:48:45.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a0ebbde-16d1-4c23-8f74-e5c98ef41540 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:48:45.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a0ebbde-16d1-4c23-8f74-e5c98ef41540 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@64016831
2021-06-04T00:48:45.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a0ebbde-16d1-4c23-8f74-e5c98ef41540 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:48:45.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a0ebbde-16d1-4c23-8f74-e5c98ef41540 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:48:47.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:48:48.252Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=6a0ebbde-16d1-4c23-8f74-e5c98ef41540 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:48:48.252Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=6a0ebbde-16d1-4c23-8f74-e5c98ef41540 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:48:49.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d29957ad-486f-4187-9500-1782004e70cf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:48:49.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d29957ad-486f-4187-9500-1782004e70cf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@73e06926
2021-06-04T00:48:49.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d29957ad-486f-4187-9500-1782004e70cf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:48:49.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d29957ad-486f-4187-9500-1782004e70cf PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:48:50.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:48:51.090Z [JanusGraph-Health-Check-Thread] INFO o.j.d.util.BackendOperation Temporary exception during backend operation [VertexIndexQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:399)
at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:396)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.indexQuery(BackendTransaction.java:396)
at org.janusgraph.graphdb.query.graph.MultiKeySliceQuery.execute(MultiKeySliceQuery.java:51)
at org.janusgraph.graphdb.database.IndexSerializer.query(IndexSerializer.java:512)
at org.janusgraph.graphdb.util.SubqueryIterator.(SubqueryIterator.java:66)
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1295)
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1190)
at org.janusgraph.graphdb.query.QueryProcessor$LimitAdjustingIterator.getNewIterator(QueryProcessor.java:194)
at org.janusgraph.graphdb.query.LimitAdjustingIterator.hasNext(LimitAdjustingIterator.java:68)
at org.janusgraph.graphdb.query.ResultSetIterator.nextInternal(ResultSetIterator.java:54)
at org.janusgraph.graphdb.query.ResultSetIterator.(ResultSetIterator.java:44)
at org.janusgraph.graphdb.query.QueryProcessor.iterator(QueryProcessor.java:66)
at com.google.common.collect.Iterables$4.iterator(Iterables.java:559)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:340)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:336)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
... 4 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T00:48:51.476Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=ApplicationDataTypesCache Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177)
at org.apache.tinkerpop.gremlin.structure.Element.keys(Element.java:69)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getProperties(JanusGraphGenericDao.java:1491)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getByCriteria(JanusGraphGenericDao.java:759)
at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypeNodes(PropertyOperation.java:1566)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.findAllDataTypesLazy(ApplicationDataTypeCache.java:309)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.hasDataTypesChanged(ApplicationDataTypeCache.java:220)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:200)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308)
at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 26 common frames omitted
2021-06-04T00:48:52.130Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d29957ad-486f-4187-9500-1782004e70cf ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:48:52.130Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d29957ad-486f-4187-9500-1782004e70cf ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:48:52.254Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0002700c-305a-4a86-8156-6c36601f07f7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:48:52.254Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0002700c-305a-4a86-8156-6c36601f07f7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a86bb8c
2021-06-04T00:48:52.254Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0002700c-305a-4a86-8156-6c36601f07f7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:48:52.254Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0002700c-305a-4a86-8156-6c36601f07f7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:48:53.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:48:55.452Z [cluster1-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
2021-06-04T00:48:55.453Z [cluster1-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 32000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T00:48:55.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=544de43e-a029-4f66-97a8-389537490884 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:48:55.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=544de43e-a029-4f66-97a8-389537490884 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@26a9a6e5
2021-06-04T00:48:55.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=544de43e-a029-4f66-97a8-389537490884 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:48:55.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=544de43e-a029-4f66-97a8-389537490884 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:48:56.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:48:56.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07a5e07a-53db-4cad-8610-e6fe6d6439f9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:48:56.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07a5e07a-53db-4cad-8610-e6fe6d6439f9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b123905
2021-06-04T00:48:56.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07a5e07a-53db-4cad-8610-e6fe6d6439f9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:48:56.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07a5e07a-53db-4cad-8610-e6fe6d6439f9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:48:57.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6696b9e1-90c4-4c75-92cb-36527886e1a8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:48:57.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6696b9e1-90c4-4c75-92cb-36527886e1a8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3427b330
2021-06-04T00:48:57.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6696b9e1-90c4-4c75-92cb-36527886e1a8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:48:57.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6696b9e1-90c4-4c75-92cb-36527886e1a8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:48:59.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af280b0c-d1ae-4875-ba20-80245b33d30b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:48:59.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af280b0c-d1ae-4875-ba20-80245b33d30b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60614b0c
2021-06-04T00:48:59.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af280b0c-d1ae-4875-ba20-80245b33d30b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:48:59.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af280b0c-d1ae-4875-ba20-80245b33d30b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:48:59.114Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:49:00.180Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa54bde1-8f79-46fe-882b-1781b0cf002d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:49:00.180Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa54bde1-8f79-46fe-882b-1781b0cf002d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b14576b
2021-06-04T00:49:00.180Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa54bde1-8f79-46fe-882b-1781b0cf002d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:49:00.180Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa54bde1-8f79-46fe-882b-1781b0cf002d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:49:00.678Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fa54bde1-8f79-46fe-882b-1781b0cf002d ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:49:00.678Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fa54bde1-8f79-46fe-882b-1781b0cf002d ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:49:01.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ad93ca4-1f81-4eea-b7a8-81373f1f42ec PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:49:01.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ad93ca4-1f81-4eea-b7a8-81373f1f42ec PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41048d1d
2021-06-04T00:49:01.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ad93ca4-1f81-4eea-b7a8-81373f1f42ec PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:49:01.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ad93ca4-1f81-4eea-b7a8-81373f1f42ec PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:49:04.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=749c20cd-fe73-4276-84cf-30e0ecd187cb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:49:04.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=749c20cd-fe73-4276-84cf-30e0ecd187cb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@48b3083e
2021-06-04T00:49:04.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=749c20cd-fe73-4276-84cf-30e0ecd187cb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:49:04.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=749c20cd-fe73-4276-84cf-30e0ecd187cb PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:49:08.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4269f79f-394f-4190-b972-99f2afdbd011 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:49:08.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4269f79f-394f-4190-b972-99f2afdbd011 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22e0130f
2021-06-04T00:49:08.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4269f79f-394f-4190-b972-99f2afdbd011 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:49:08.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4269f79f-394f-4190-b972-99f2afdbd011 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:49:10.771Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a79ecf1f-02e9-4f27-8a15-4c6f55015b9b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:49:10.771Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a79ecf1f-02e9-4f27-8a15-4c6f55015b9b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b66b737
2021-06-04T00:49:10.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a79ecf1f-02e9-4f27-8a15-4c6f55015b9b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:49:10.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a79ecf1f-02e9-4f27-8a15-4c6f55015b9b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:49:13.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ab4280a-3b54-4a62-8d1f-bdbb306e26a2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:49:13.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ab4280a-3b54-4a62-8d1f-bdbb306e26a2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e6fbf23
2021-06-04T00:49:13.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ab4280a-3b54-4a62-8d1f-bdbb306e26a2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:49:13.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ab4280a-3b54-4a62-8d1f-bdbb306e26a2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:49:17.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7202b171-026c-4a72-8c18-c18d67bd39fe PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:49:17.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7202b171-026c-4a72-8c18-c18d67bd39fe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e4db828
2021-06-04T00:49:17.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7202b171-026c-4a72-8c18-c18d67bd39fe PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:49:17.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7202b171-026c-4a72-8c18-c18d67bd39fe PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:49:19.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4417a663-29c4-445c-8b5f-627719b5364f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:49:19.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4417a663-29c4-445c-8b5f-627719b5364f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c17bc85
2021-06-04T00:49:19.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4417a663-29c4-445c-8b5f-627719b5364f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:49:19.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4417a663-29c4-445c-8b5f-627719b5364f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:49:22.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91a47a54-b1aa-416d-a0c6-98bf7db561e7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:49:22.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91a47a54-b1aa-416d-a0c6-98bf7db561e7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22f67f3f
2021-06-04T00:49:22.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91a47a54-b1aa-416d-a0c6-98bf7db561e7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:49:22.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91a47a54-b1aa-416d-a0c6-98bf7db561e7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:49:25.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00cd45ac-12f8-4740-a4e2-68741776d23c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:49:25.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00cd45ac-12f8-4740-a4e2-68741776d23c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@31735ae5
2021-06-04T00:49:25.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00cd45ac-12f8-4740-a4e2-68741776d23c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:49:25.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00cd45ac-12f8-4740-a4e2-68741776d23c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:49:28.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44ba992a-dfc8-401f-a16c-c602c91d3ccc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:49:28.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44ba992a-dfc8-401f-a16c-c602c91d3ccc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@622c381b
2021-06-04T00:49:28.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44ba992a-dfc8-401f-a16c-c602c91d3ccc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:49:28.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44ba992a-dfc8-401f-a16c-c602c91d3ccc PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:49:31.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc0aceb0-bef3-431a-864a-0b7015fcf04d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:49:31.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc0aceb0-bef3-431a-864a-0b7015fcf04d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43fe534f
2021-06-04T00:49:31.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc0aceb0-bef3-431a-864a-0b7015fcf04d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:49:31.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc0aceb0-bef3-431a-864a-0b7015fcf04d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:49:31.660Z [cluster1-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
2021-06-04T00:49:31.661Z [cluster1-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 64000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T00:49:34.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c541085-3b7f-4768-8d3e-dc6529dcb813 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:49:34.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c541085-3b7f-4768-8d3e-dc6529dcb813 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@52e0d388
2021-06-04T00:49:34.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c541085-3b7f-4768-8d3e-dc6529dcb813 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:49:34.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c541085-3b7f-4768-8d3e-dc6529dcb813 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:49:35.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:49:35.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:49:38.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e72cd05-4499-49fc-a456-8bead4dff7e6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:49:38.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e72cd05-4499-49fc-a456-8bead4dff7e6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@796f0f43
2021-06-04T00:49:38.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e72cd05-4499-49fc-a456-8bead4dff7e6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:49:38.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e72cd05-4499-49fc-a456-8bead4dff7e6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:49:38.219Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0e72cd05-4499-49fc-a456-8bead4dff7e6 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:49:38.219Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=0e72cd05-4499-49fc-a456-8bead4dff7e6 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:49:38.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:49:40.677Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=586f3dff-91fc-4e39-8580-46fb18c08554 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:49:40.677Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=586f3dff-91fc-4e39-8580-46fb18c08554 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a800c95
2021-06-04T00:49:40.677Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=586f3dff-91fc-4e39-8580-46fb18c08554 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:49:40.677Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=586f3dff-91fc-4e39-8580-46fb18c08554 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:49:41.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:49:43.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3631547-505c-4696-b2ff-96a06bb5b155 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:49:43.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3631547-505c-4696-b2ff-96a06bb5b155 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b554ca1
2021-06-04T00:49:43.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3631547-505c-4696-b2ff-96a06bb5b155 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:49:43.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3631547-505c-4696-b2ff-96a06bb5b155 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:49:44.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:49:46.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a480873-e84b-4f7f-ab04-830bc72ddece PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:49:46.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a480873-e84b-4f7f-ab04-830bc72ddece PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f7dbad0
2021-06-04T00:49:46.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a480873-e84b-4f7f-ab04-830bc72ddece PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:49:46.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a480873-e84b-4f7f-ab04-830bc72ddece PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:49:47.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:49:49.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7eb21596-9c17-479c-8d40-e03443a28d8d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:49:49.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7eb21596-9c17-479c-8d40-e03443a28d8d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e69ab6b
2021-06-04T00:49:49.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7eb21596-9c17-479c-8d40-e03443a28d8d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:49:49.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7eb21596-9c17-479c-8d40-e03443a28d8d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:49:49.914Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:49:52.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abff5ee4-915e-45a8-b7df-7326d25e7b5d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:49:52.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abff5ee4-915e-45a8-b7df-7326d25e7b5d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@64f7f897
2021-06-04T00:49:52.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abff5ee4-915e-45a8-b7df-7326d25e7b5d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:49:52.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abff5ee4-915e-45a8-b7df-7326d25e7b5d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:49:52.539Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=abff5ee4-915e-45a8-b7df-7326d25e7b5d ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:49:52.539Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=abff5ee4-915e-45a8-b7df-7326d25e7b5d ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:49:55.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75e4eb16-c03f-49d6-835d-76e3228ec953 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:49:55.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75e4eb16-c03f-49d6-835d-76e3228ec953 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a690ec
2021-06-04T00:49:55.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75e4eb16-c03f-49d6-835d-76e3228ec953 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:49:55.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75e4eb16-c03f-49d6-835d-76e3228ec953 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:49:58.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bfe99d31-d915-4b8e-acdc-205cf943111f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:49:58.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bfe99d31-d915-4b8e-acdc-205cf943111f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@777f11b2
2021-06-04T00:49:58.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bfe99d31-d915-4b8e-acdc-205cf943111f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:49:58.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bfe99d31-d915-4b8e-acdc-205cf943111f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:49:59.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:49:59.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:50:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b6d21b5-6621-476a-8a75-f1f38c4eeee5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:50:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b6d21b5-6621-476a-8a75-f1f38c4eeee5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@249ecec5
2021-06-04T00:50:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b6d21b5-6621-476a-8a75-f1f38c4eeee5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:50:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b6d21b5-6621-476a-8a75-f1f38c4eeee5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:50:01.498Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=2b6d21b5-6621-476a-8a75-f1f38c4eeee5 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:50:01.499Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=2b6d21b5-6621-476a-8a75-f1f38c4eeee5 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:50:02.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:50:04.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3b0c367-45d3-4df0-b7e7-7648f5bfe182 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:50:04.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3b0c367-45d3-4df0-b7e7-7648f5bfe182 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ff6b981
2021-06-04T00:50:04.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3b0c367-45d3-4df0-b7e7-7648f5bfe182 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:50:04.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3b0c367-45d3-4df0-b7e7-7648f5bfe182 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:50:05.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:50:07.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=541db046-9cf0-4b19-9362-072d5df65f69 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:50:07.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=541db046-9cf0-4b19-9362-072d5df65f69 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e666763
2021-06-04T00:50:07.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=541db046-9cf0-4b19-9362-072d5df65f69 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:50:07.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=541db046-9cf0-4b19-9362-072d5df65f69 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:50:08.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:50:10.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eae0ea95-74f5-4f6d-96d7-8c6fba9e3db2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:50:10.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eae0ea95-74f5-4f6d-96d7-8c6fba9e3db2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@419b0d9c
2021-06-04T00:50:10.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eae0ea95-74f5-4f6d-96d7-8c6fba9e3db2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:50:10.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eae0ea95-74f5-4f6d-96d7-8c6fba9e3db2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:50:11.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:50:13.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75c9e2d7-4c9b-47a1-9a14-e91ab0b2e825 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:50:13.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75c9e2d7-4c9b-47a1-9a14-e91ab0b2e825 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@13a11b8c
2021-06-04T00:50:13.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75c9e2d7-4c9b-47a1-9a14-e91ab0b2e825 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:50:13.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75c9e2d7-4c9b-47a1-9a14-e91ab0b2e825 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:50:14.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:50:17.074Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad03a432-b7c0-48fd-a44e-0e3257e03357 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:50:17.074Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad03a432-b7c0-48fd-a44e-0e3257e03357 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@595192c8
2021-06-04T00:50:17.074Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad03a432-b7c0-48fd-a44e-0e3257e03357 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:50:17.074Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad03a432-b7c0-48fd-a44e-0e3257e03357 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:50:17.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:50:19.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=685971b5-8be6-47b4-9f1d-0c07041dafd1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:50:19.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=685971b5-8be6-47b4-9f1d-0c07041dafd1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@24f1abfe
2021-06-04T00:50:19.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=685971b5-8be6-47b4-9f1d-0c07041dafd1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:50:19.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=685971b5-8be6-47b4-9f1d-0c07041dafd1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:50:20.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:50:22.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb426344-8695-4e39-97f2-d608a7546c6f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:50:22.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb426344-8695-4e39-97f2-d608a7546c6f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d1fb511
2021-06-04T00:50:22.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb426344-8695-4e39-97f2-d608a7546c6f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:50:22.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb426344-8695-4e39-97f2-d608a7546c6f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:50:23.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:50:25.972Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:50:26.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aea797cd-d9de-485a-8b48-01a085637ddb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:50:26.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aea797cd-d9de-485a-8b48-01a085637ddb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2679b445
2021-06-04T00:50:26.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aea797cd-d9de-485a-8b48-01a085637ddb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:50:26.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aea797cd-d9de-485a-8b48-01a085637ddb PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:50:28.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=826fa014-0973-4ba6-8518-e6d15811e392 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:50:28.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=826fa014-0973-4ba6-8518-e6d15811e392 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@73eba590
2021-06-04T00:50:28.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=826fa014-0973-4ba6-8518-e6d15811e392 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:50:28.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=826fa014-0973-4ba6-8518-e6d15811e392 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:50:29.220Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=826fa014-0973-4ba6-8518-e6d15811e392 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:50:29.220Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=826fa014-0973-4ba6-8518-e6d15811e392 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:50:31.457Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac28eb17-dc67-42e6-9333-21271c39af55 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:50:31.457Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac28eb17-dc67-42e6-9333-21271c39af55 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5aec5e48
2021-06-04T00:50:31.457Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac28eb17-dc67-42e6-9333-21271c39af55 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:50:31.457Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac28eb17-dc67-42e6-9333-21271c39af55 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:50:32.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:50:32.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:50:35.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b606404-e727-4902-88ae-e61036949203 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:50:35.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b606404-e727-4902-88ae-e61036949203 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a9bcf39
2021-06-04T00:50:35.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b606404-e727-4902-88ae-e61036949203 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:50:35.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b606404-e727-4902-88ae-e61036949203 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:50:35.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:50:35.574Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=5b606404-e727-4902-88ae-e61036949203 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:50:35.574Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=5b606404-e727-4902-88ae-e61036949203 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:50:37.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfebefa5-297d-4b2d-b0fa-2d41f8c195a6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:50:37.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfebefa5-297d-4b2d-b0fa-2d41f8c195a6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71ab8bb3
2021-06-04T00:50:37.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfebefa5-297d-4b2d-b0fa-2d41f8c195a6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:50:37.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfebefa5-297d-4b2d-b0fa-2d41f8c195a6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:50:38.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:50:40.771Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fa39a30-f2bf-47e2-ab98-0441c4416ccc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:50:40.771Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fa39a30-f2bf-47e2-ab98-0441c4416ccc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f427733
2021-06-04T00:50:40.771Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fa39a30-f2bf-47e2-ab98-0441c4416ccc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:50:40.771Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fa39a30-f2bf-47e2-ab98-0441c4416ccc PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:50:41.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:50:43.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea9b3eca-e13a-4d0f-84fd-c8ab3b8a6292 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:50:43.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea9b3eca-e13a-4d0f-84fd-c8ab3b8a6292 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@67e46c8d
2021-06-04T00:50:43.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea9b3eca-e13a-4d0f-84fd-c8ab3b8a6292 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:50:43.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea9b3eca-e13a-4d0f-84fd-c8ab3b8a6292 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:50:44.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:50:46.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a769f615-75ae-4f47-9a52-75f4c092723b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:50:46.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a769f615-75ae-4f47-9a52-75f4c092723b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23c2854f
2021-06-04T00:50:46.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a769f615-75ae-4f47-9a52-75f4c092723b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:50:46.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a769f615-75ae-4f47-9a52-75f4c092723b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:50:47.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:50:49.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdba3f40-c353-4e2b-a01e-e32f4d9048bb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:50:49.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdba3f40-c353-4e2b-a01e-e32f4d9048bb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e997497
2021-06-04T00:50:49.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdba3f40-c353-4e2b-a01e-e32f4d9048bb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:50:49.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdba3f40-c353-4e2b-a01e-e32f4d9048bb PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:50:50.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:50:52.166Z [cluster1-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
2021-06-04T00:50:52.167Z [cluster1-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 128000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T00:50:52.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=728c96ec-80f4-4aab-902f-bc7aa9e0cd9c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:50:52.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=728c96ec-80f4-4aab-902f-bc7aa9e0cd9c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42ae6198
2021-06-04T00:50:52.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=728c96ec-80f4-4aab-902f-bc7aa9e0cd9c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:50:52.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=728c96ec-80f4-4aab-902f-bc7aa9e0cd9c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:50:52.548Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:50:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b0b6afb-7e61-4743-8b14-8d7f10cbc90c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:50:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b0b6afb-7e61-4743-8b14-8d7f10cbc90c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@66afd44
2021-06-04T00:50:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b0b6afb-7e61-4743-8b14-8d7f10cbc90c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:50:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b0b6afb-7e61-4743-8b14-8d7f10cbc90c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:50:56.182Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=7b0b6afb-7e61-4743-8b14-8d7f10cbc90c ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:50:56.182Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=7b0b6afb-7e61-4743-8b14-8d7f10cbc90c ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:50:59.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d8a19a8-3c98-480d-93d2-621ce41d1258 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:50:59.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d8a19a8-3c98-480d-93d2-621ce41d1258 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3135f83b
2021-06-04T00:50:59.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d8a19a8-3c98-480d-93d2-621ce41d1258 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:50:59.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d8a19a8-3c98-480d-93d2-621ce41d1258 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:50:59.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:50:59.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:51:01.452Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7da93a31-0097-466b-85e9-8ae8039d3905 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:51:01.452Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7da93a31-0097-466b-85e9-8ae8039d3905 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74cd0f46
2021-06-04T00:51:01.452Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7da93a31-0097-466b-85e9-8ae8039d3905 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:51:01.453Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7da93a31-0097-466b-85e9-8ae8039d3905 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:51:01.485Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=7da93a31-0097-466b-85e9-8ae8039d3905 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:51:01.485Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=7da93a31-0097-466b-85e9-8ae8039d3905 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:51:02.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:51:04.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8026e70b-daec-4bb7-9687-f9488d9d24ce PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:51:04.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8026e70b-daec-4bb7-9687-f9488d9d24ce PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45de12e6
2021-06-04T00:51:04.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8026e70b-daec-4bb7-9687-f9488d9d24ce PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:51:04.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8026e70b-daec-4bb7-9687-f9488d9d24ce PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:51:07.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f88fb6c-62b0-4891-8834-d5f80eeae981 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:51:07.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f88fb6c-62b0-4891-8834-d5f80eeae981 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@148f47c4
2021-06-04T00:51:07.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f88fb6c-62b0-4891-8834-d5f80eeae981 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:51:07.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f88fb6c-62b0-4891-8834-d5f80eeae981 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:51:10.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef5e87a3-672f-4ce0-b24f-b0c7d12163e6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:51:10.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef5e87a3-672f-4ce0-b24f-b0c7d12163e6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ae5814e
2021-06-04T00:51:10.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef5e87a3-672f-4ce0-b24f-b0c7d12163e6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:51:10.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef5e87a3-672f-4ce0-b24f-b0c7d12163e6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:51:13.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1fd5d85f-e7ee-44e3-afde-223651c2a99c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:51:13.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1fd5d85f-e7ee-44e3-afde-223651c2a99c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@16ce086b
2021-06-04T00:51:13.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1fd5d85f-e7ee-44e3-afde-223651c2a99c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:51:13.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1fd5d85f-e7ee-44e3-afde-223651c2a99c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:51:15.673Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:51:16.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c934a892-2ae1-46f9-a848-e80dbdb90a6e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:51:16.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c934a892-2ae1-46f9-a848-e80dbdb90a6e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23327176
2021-06-04T00:51:16.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c934a892-2ae1-46f9-a848-e80dbdb90a6e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:51:16.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c934a892-2ae1-46f9-a848-e80dbdb90a6e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:51:16.976Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:51:16.976Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:51:16.983Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c934a892-2ae1-46f9-a848-e80dbdb90a6e ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:51:16.984Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c934a892-2ae1-46f9-a848-e80dbdb90a6e ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:51:17.976Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:51:18.977Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:51:20.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67c25ff8-1314-445c-93a4-ba0f3a2758e7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:51:20.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67c25ff8-1314-445c-93a4-ba0f3a2758e7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4d6da3b3
2021-06-04T00:51:20.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67c25ff8-1314-445c-93a4-ba0f3a2758e7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:51:20.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67c25ff8-1314-445c-93a4-ba0f3a2758e7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:51:20.182Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=67c25ff8-1314-445c-93a4-ba0f3a2758e7 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:51:20.182Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=67c25ff8-1314-445c-93a4-ba0f3a2758e7 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:51:20.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:51:22.477Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bc33fdd-b2f0-4a96-86f7-773d3a88440b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:51:22.477Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bc33fdd-b2f0-4a96-86f7-773d3a88440b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ba4a4a1
2021-06-04T00:51:22.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bc33fdd-b2f0-4a96-86f7-773d3a88440b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:51:22.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bc33fdd-b2f0-4a96-86f7-773d3a88440b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:51:23.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:51:25.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=544f8c88-a252-4d48-80d7-ebb0ca6be364 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:51:25.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=544f8c88-a252-4d48-80d7-ebb0ca6be364 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@dcf64ee
2021-06-04T00:51:25.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=544f8c88-a252-4d48-80d7-ebb0ca6be364 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:51:25.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=544f8c88-a252-4d48-80d7-ebb0ca6be364 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:51:26.070Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:51:28.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1af60cec-80c6-446a-9b13-3faaf6b88fe1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:51:28.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1af60cec-80c6-446a-9b13-3faaf6b88fe1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3dc61de0
2021-06-04T00:51:28.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1af60cec-80c6-446a-9b13-3faaf6b88fe1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:51:28.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1af60cec-80c6-446a-9b13-3faaf6b88fe1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:51:29.180Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=1af60cec-80c6-446a-9b13-3faaf6b88fe1 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:51:29.180Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=1af60cec-80c6-446a-9b13-3faaf6b88fe1 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:51:31.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7472b539-ae7e-46c2-b73b-b6a151794ca0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:51:31.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7472b539-ae7e-46c2-b73b-b6a151794ca0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d1641d0
2021-06-04T00:51:31.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7472b539-ae7e-46c2-b73b-b6a151794ca0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:51:31.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7472b539-ae7e-46c2-b73b-b6a151794ca0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:51:32.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:51:32.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:51:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80b91c37-d59c-449e-b814-ffa854cfa910 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:51:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80b91c37-d59c-449e-b814-ffa854cfa910 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53596f7f
2021-06-04T00:51:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80b91c37-d59c-449e-b814-ffa854cfa910 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:51:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80b91c37-d59c-449e-b814-ffa854cfa910 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:51:35.177Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=80b91c37-d59c-449e-b814-ffa854cfa910 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:51:35.177Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=80b91c37-d59c-449e-b814-ffa854cfa910 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:51:35.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:51:37.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=309bba63-61e8-4e49-bdcd-4a240f6f52fe PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:51:37.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=309bba63-61e8-4e49-bdcd-4a240f6f52fe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@25c789ee
2021-06-04T00:51:37.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=309bba63-61e8-4e49-bdcd-4a240f6f52fe PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:51:37.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=309bba63-61e8-4e49-bdcd-4a240f6f52fe PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:51:38.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:51:40.687Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0cde3676-31c6-461a-9a87-58ff08006bec PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:51:40.687Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0cde3676-31c6-461a-9a87-58ff08006bec PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2863a9ab
2021-06-04T00:51:40.687Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0cde3676-31c6-461a-9a87-58ff08006bec PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:51:40.687Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0cde3676-31c6-461a-9a87-58ff08006bec PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:51:40.978Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:51:43.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46a4ebf1-3947-42dd-bca7-8f3a588a8aab PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:51:43.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46a4ebf1-3947-42dd-bca7-8f3a588a8aab PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d475b6
2021-06-04T00:51:43.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46a4ebf1-3947-42dd-bca7-8f3a588a8aab PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:51:43.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46a4ebf1-3947-42dd-bca7-8f3a588a8aab PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:51:43.931Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=46a4ebf1-3947-42dd-bca7-8f3a588a8aab ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:51:43.931Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=46a4ebf1-3947-42dd-bca7-8f3a588a8aab ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:51:44.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:51:44.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:51:46.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33b7405d-632c-42b6-a10b-8a6a3a2195c4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:51:46.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33b7405d-632c-42b6-a10b-8a6a3a2195c4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1feed0a4
2021-06-04T00:51:46.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33b7405d-632c-42b6-a10b-8a6a3a2195c4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:51:46.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33b7405d-632c-42b6-a10b-8a6a3a2195c4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:51:47.118Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=33b7405d-632c-42b6-a10b-8a6a3a2195c4 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:51:47.118Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=33b7405d-632c-42b6-a10b-8a6a3a2195c4 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:51:47.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:51:49.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44f61aa4-4ba6-4625-9824-ba77b5357506 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:51:49.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44f61aa4-4ba6-4625-9824-ba77b5357506 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ffb24e
2021-06-04T00:51:49.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44f61aa4-4ba6-4625-9824-ba77b5357506 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:51:49.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44f61aa4-4ba6-4625-9824-ba77b5357506 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:51:50.071Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:51:52.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3af00a8a-6593-4b86-a034-decc0b5c5c90 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:51:52.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3af00a8a-6593-4b86-a034-decc0b5c5c90 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@33e46dcb
2021-06-04T00:51:52.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3af00a8a-6593-4b86-a034-decc0b5c5c90 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:51:52.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3af00a8a-6593-4b86-a034-decc0b5c5c90 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:51:52.539Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3af00a8a-6593-4b86-a034-decc0b5c5c90 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:51:52.539Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3af00a8a-6593-4b86-a034-decc0b5c5c90 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:51:56.077Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e07345e5-cbe9-4623-93f2-cd35c4484c6c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:51:56.077Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e07345e5-cbe9-4623-93f2-cd35c4484c6c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17b9d7c4
2021-06-04T00:51:56.077Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e07345e5-cbe9-4623-93f2-cd35c4484c6c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:51:56.077Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e07345e5-cbe9-4623-93f2-cd35c4484c6c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:51:59.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a1220ea-0cfa-4591-a79c-aca4ec937f5b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:51:59.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a1220ea-0cfa-4591-a79c-aca4ec937f5b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e3b4e67
2021-06-04T00:51:59.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a1220ea-0cfa-4591-a79c-aca4ec937f5b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:51:59.079Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a1220ea-0cfa-4591-a79c-aca4ec937f5b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:52:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d9ab8f1-df4c-437c-a784-c1460ab86df8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:52:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d9ab8f1-df4c-437c-a784-c1460ab86df8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5adfe2c
2021-06-04T00:52:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d9ab8f1-df4c-437c-a784-c1460ab86df8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:52:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d9ab8f1-df4c-437c-a784-c1460ab86df8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:52:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57f06284-1c94-4af8-b0bc-620ca31f99dd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:52:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57f06284-1c94-4af8-b0bc-620ca31f99dd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15374167
2021-06-04T00:52:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57f06284-1c94-4af8-b0bc-620ca31f99dd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:52:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57f06284-1c94-4af8-b0bc-620ca31f99dd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:52:07.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=689671b2-5f48-4ef7-b356-a8b934c0269e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:52:07.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=689671b2-5f48-4ef7-b356-a8b934c0269e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ce9b3f2
2021-06-04T00:52:07.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=689671b2-5f48-4ef7-b356-a8b934c0269e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:52:07.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=689671b2-5f48-4ef7-b356-a8b934c0269e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:52:10.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1380740c-b958-4a54-a9f0-fcc2840b4bac PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:52:10.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1380740c-b958-4a54-a9f0-fcc2840b4bac PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6885947e
2021-06-04T00:52:10.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1380740c-b958-4a54-a9f0-fcc2840b4bac PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:52:10.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1380740c-b958-4a54-a9f0-fcc2840b4bac PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:52:13.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a06139b9-cd8e-4c41-8f6f-2c85fe857382 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:52:13.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a06139b9-cd8e-4c41-8f6f-2c85fe857382 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b34bdc
2021-06-04T00:52:13.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a06139b9-cd8e-4c41-8f6f-2c85fe857382 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:52:13.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a06139b9-cd8e-4c41-8f6f-2c85fe857382 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:52:17.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b08ea5ce-6cbd-4628-b333-3a33c31e1041 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:52:17.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b08ea5ce-6cbd-4628-b333-3a33c31e1041 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d201e94
2021-06-04T00:52:17.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b08ea5ce-6cbd-4628-b333-3a33c31e1041 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:52:17.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b08ea5ce-6cbd-4628-b333-3a33c31e1041 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:52:20.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bfdc651-26fb-4d56-9fc7-e0e77790ebe0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:52:20.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bfdc651-26fb-4d56-9fc7-e0e77790ebe0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2cd74ee1
2021-06-04T00:52:20.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bfdc651-26fb-4d56-9fc7-e0e77790ebe0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:52:20.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bfdc651-26fb-4d56-9fc7-e0e77790ebe0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:52:22.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=989a3da5-7ae6-4199-aea7-7b1119444d9f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:52:22.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=989a3da5-7ae6-4199-aea7-7b1119444d9f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68351961
2021-06-04T00:52:22.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=989a3da5-7ae6-4199-aea7-7b1119444d9f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:52:22.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=989a3da5-7ae6-4199-aea7-7b1119444d9f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:52:23.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:52:23.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:52:25.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eff07ece-d780-4182-a226-11521ed532e9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:52:25.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eff07ece-d780-4182-a226-11521ed532e9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@70c05210
2021-06-04T00:52:25.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eff07ece-d780-4182-a226-11521ed532e9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:52:25.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eff07ece-d780-4182-a226-11521ed532e9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:52:26.275Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=eff07ece-d780-4182-a226-11521ed532e9 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:52:26.275Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=eff07ece-d780-4182-a226-11521ed532e9 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:52:26.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:52:28.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d7f1860-5234-41f6-8a20-3443f0ed5f13 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:52:28.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d7f1860-5234-41f6-8a20-3443f0ed5f13 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d393622
2021-06-04T00:52:28.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d7f1860-5234-41f6-8a20-3443f0ed5f13 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:52:28.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d7f1860-5234-41f6-8a20-3443f0ed5f13 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:52:29.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:52:31.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53162392-bcd8-4bc1-ab52-b54e75a005bf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:52:31.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53162392-bcd8-4bc1-ab52-b54e75a005bf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b8fdb22
2021-06-04T00:52:31.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53162392-bcd8-4bc1-ab52-b54e75a005bf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:52:31.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53162392-bcd8-4bc1-ab52-b54e75a005bf PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:52:32.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:52:34.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cc46649-d7d8-4e0d-8422-01c982dc7a70 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:52:34.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cc46649-d7d8-4e0d-8422-01c982dc7a70 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@bb13d23
2021-06-04T00:52:34.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cc46649-d7d8-4e0d-8422-01c982dc7a70 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:52:34.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cc46649-d7d8-4e0d-8422-01c982dc7a70 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:52:34.914Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:52:37.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e67464c7-a511-4a93-a0f7-2bccec1c0471 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:52:37.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e67464c7-a511-4a93-a0f7-2bccec1c0471 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7993ae97
2021-06-04T00:52:37.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e67464c7-a511-4a93-a0f7-2bccec1c0471 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:52:37.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e67464c7-a511-4a93-a0f7-2bccec1c0471 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:52:38.218Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e67464c7-a511-4a93-a0f7-2bccec1c0471 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:52:38.218Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e67464c7-a511-4a93-a0f7-2bccec1c0471 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:52:40.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb19aab9-7650-4789-ad6c-1c07cc9cce2f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:52:40.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb19aab9-7650-4789-ad6c-1c07cc9cce2f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d8f1fa1
2021-06-04T00:52:40.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb19aab9-7650-4789-ad6c-1c07cc9cce2f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:52:40.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb19aab9-7650-4789-ad6c-1c07cc9cce2f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:52:41.161Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=bb19aab9-7650-4789-ad6c-1c07cc9cce2f ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:52:41.161Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=bb19aab9-7650-4789-ad6c-1c07cc9cce2f ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:52:42.220Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 500 Server Error
2021-06-04T00:52:42.227Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:42.329Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:42.331Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:42.800Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 503 Service Unavailable
2021-06-04T00:52:42.801Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 503
2021-06-04T00:52:42.801Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=503, variables=[]]
2021-06-04T00:52:42.801Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:52:42.801Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:52:42.802Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:52:42.802Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:52:42.839Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:42.840Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:42.867Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 503 Service Unavailable
2021-06-04T00:52:42.868Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 503
2021-06-04T00:52:42.868Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=503, variables=[]]
2021-06-04T00:52:42.868Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:52:42.868Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:52:42.868Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:52:42.868Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:52:42.882Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:42.884Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:42.908Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:42.909Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:42.965Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:42.967Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:42.983Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:42.984Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.000Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.001Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.015Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.016Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.030Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.031Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.039Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.040Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.079Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.080Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.095Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.096Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.114Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.115Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.161Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.162Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.174Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.175Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.199Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.200Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.216Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.217Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.226Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.227Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.244Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.245Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.268Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.269Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.320Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.321Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.331Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.331Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.346Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.347Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.369Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.369Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.374Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.375Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.392Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.393Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.403Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.404Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.415Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.416Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.427Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.427Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.440Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.440Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.467Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.467Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.487Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.488Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.506Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.507Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.540Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.541Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.595Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.596Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.603Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.603Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.611Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.611Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.659Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.660Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.691Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.692Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.700Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.701Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.717Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.718Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.735Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.736Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.763Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.764Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.786Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.787Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.805Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.807Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=207d2552-87ae-4c1b-a33a-0fd28e353000 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:52:43.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=207d2552-87ae-4c1b-a33a-0fd28e353000 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58ec8ff9
2021-06-04T00:52:43.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=207d2552-87ae-4c1b-a33a-0fd28e353000 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:52:43.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=207d2552-87ae-4c1b-a33a-0fd28e353000 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:52:43.830Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.831Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.854Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.855Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.876Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.876Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.901Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.901Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.927Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.928Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.953Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.954Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.982Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.983Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:43.995Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:43.996Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:44.032Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:44.033Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:44.057Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:44.058Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:44.074Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:44.075Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:44.083Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:44.084Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:44.095Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:44.097Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:44.103Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:44.105Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:44.118Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:44.120Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:44.138Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:44.139Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:44.162Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:44.162Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:44.170Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:47.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7c98989-bab7-41fc-8373-d4c354c67faf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:52:47.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7c98989-bab7-41fc-8373-d4c354c67faf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ab6f9e2
2021-06-04T00:52:47.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7c98989-bab7-41fc-8373-d4c354c67faf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:52:47.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7c98989-bab7-41fc-8373-d4c354c67faf PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:52:47.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:52:47.966Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:52:47.966Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T00:52:50.080Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4cb864f5-04d1-4a92-862d-f884146ced33 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:52:50.080Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4cb864f5-04d1-4a92-862d-f884146ced33 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e350335
2021-06-04T00:52:50.080Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4cb864f5-04d1-4a92-862d-f884146ced33 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:52:50.080Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4cb864f5-04d1-4a92-862d-f884146ced33 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:52:50.280Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=4cb864f5-04d1-4a92-862d-f884146ced33 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:52:50.280Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=4cb864f5-04d1-4a92-862d-f884146ced33 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:52:52.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3081bf3b-0a75-48f8-a7ee-a6816066ff00 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:52:52.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3081bf3b-0a75-48f8-a7ee-a6816066ff00 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b526145
2021-06-04T00:52:52.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3081bf3b-0a75-48f8-a7ee-a6816066ff00 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:52:52.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3081bf3b-0a75-48f8-a7ee-a6816066ff00 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:52:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bdaaea7-fafc-4366-bf53-70b0392f6ba0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:52:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bdaaea7-fafc-4366-bf53-70b0392f6ba0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17fdb091
2021-06-04T00:52:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bdaaea7-fafc-4366-bf53-70b0392f6ba0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:52:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bdaaea7-fafc-4366-bf53-70b0392f6ba0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:52:58.197Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:52:58.197Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:52:58.197Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:52:58.197Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:52:59.077Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9f8be48-61f2-4ec9-bd6d-c085cb3c1f84 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:52:59.077Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9f8be48-61f2-4ec9-bd6d-c085cb3c1f84 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a692265
2021-06-04T00:52:59.077Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9f8be48-61f2-4ec9-bd6d-c085cb3c1f84 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:52:59.077Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9f8be48-61f2-4ec9-bd6d-c085cb3c1f84 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:53:01.506Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db92bfb3-c1b4-4bb7-a1f6-9a0e261d4cb3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:53:01.506Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db92bfb3-c1b4-4bb7-a1f6-9a0e261d4cb3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6cd3bab6
2021-06-04T00:53:01.506Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db92bfb3-c1b4-4bb7-a1f6-9a0e261d4cb3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:53:01.506Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db92bfb3-c1b4-4bb7-a1f6-9a0e261d4cb3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:53:02.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:53:02.963Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:53:05.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b53cf33b-3371-47aa-aa64-d90632099fba PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:53:05.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b53cf33b-3371-47aa-aa64-d90632099fba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5433a620
2021-06-04T00:53:05.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b53cf33b-3371-47aa-aa64-d90632099fba PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:53:05.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b53cf33b-3371-47aa-aa64-d90632099fba PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:53:08.079Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a13a397-6d60-4cd6-9a6e-f31c565c7208 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:53:08.079Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a13a397-6d60-4cd6-9a6e-f31c565c7208 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2eb0fd0f
2021-06-04T00:53:08.079Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a13a397-6d60-4cd6-9a6e-f31c565c7208 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:53:08.079Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a13a397-6d60-4cd6-9a6e-f31c565c7208 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:53:10.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5012f7a-d68a-4928-bedb-b514096d79a3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:53:10.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5012f7a-d68a-4928-bedb-b514096d79a3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d7988b6
2021-06-04T00:53:10.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5012f7a-d68a-4928-bedb-b514096d79a3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:53:10.779Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5012f7a-d68a-4928-bedb-b514096d79a3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:53:13.149Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:53:13.149Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:53:13.149Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:53:13.149Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:53:13.824Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=714b2d01-ca11-4d1c-9a16-1f26b381ec84 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:53:13.824Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=714b2d01-ca11-4d1c-9a16-1f26b381ec84 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c8e97a5
2021-06-04T00:53:13.824Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=714b2d01-ca11-4d1c-9a16-1f26b381ec84 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:53:13.824Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=714b2d01-ca11-4d1c-9a16-1f26b381ec84 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:53:16.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3123cad-2066-46fb-9b74-0a87183dc70e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:53:16.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3123cad-2066-46fb-9b74-0a87183dc70e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@25c53eb2
2021-06-04T00:53:16.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3123cad-2066-46fb-9b74-0a87183dc70e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:53:16.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3123cad-2066-46fb-9b74-0a87183dc70e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:53:17.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:53:17.973Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:53:20.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca1ab3d0-f68e-44b8-9472-27f86310fbbb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:53:20.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca1ab3d0-f68e-44b8-9472-27f86310fbbb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@c34e780
2021-06-04T00:53:20.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca1ab3d0-f68e-44b8-9472-27f86310fbbb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:53:20.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca1ab3d0-f68e-44b8-9472-27f86310fbbb PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:53:22.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23fe0b46-ee26-4179-85dd-44096bc5d108 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:53:22.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23fe0b46-ee26-4179-85dd-44096bc5d108 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d59f288
2021-06-04T00:53:22.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23fe0b46-ee26-4179-85dd-44096bc5d108 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:53:22.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23fe0b46-ee26-4179-85dd-44096bc5d108 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:53:25.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=512441d4-ae92-4f88-88dd-2387d0d4fa56 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:53:25.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=512441d4-ae92-4f88-88dd-2387d0d4fa56 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45726539
2021-06-04T00:53:25.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=512441d4-ae92-4f88-88dd-2387d0d4fa56 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:53:25.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=512441d4-ae92-4f88-88dd-2387d0d4fa56 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:53:27.737Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:53:27.738Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:53:27.739Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:53:27.739Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:53:29.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a8e7806-f260-41ff-8038-ecdf29f234ab PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:53:29.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a8e7806-f260-41ff-8038-ecdf29f234ab PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@494ee38b
2021-06-04T00:53:29.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a8e7806-f260-41ff-8038-ecdf29f234ab PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:53:29.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a8e7806-f260-41ff-8038-ecdf29f234ab PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:53:31.452Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62fe5e79-6202-402d-ab0b-460886a6cdbe PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:53:31.452Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62fe5e79-6202-402d-ab0b-460886a6cdbe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@626d15c5
2021-06-04T00:53:31.452Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62fe5e79-6202-402d-ab0b-460886a6cdbe PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:53:31.452Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62fe5e79-6202-402d-ab0b-460886a6cdbe PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:53:32.953Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:53:32.981Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:53:35.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=499cb523-b520-4b70-9192-f76645f98242 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:53:35.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=499cb523-b520-4b70-9192-f76645f98242 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@70b276b2
2021-06-04T00:53:35.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=499cb523-b520-4b70-9192-f76645f98242 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:53:35.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=499cb523-b520-4b70-9192-f76645f98242 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:53:37.879Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52988751-78d8-4039-a598-14124ccd0f24 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:53:37.879Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52988751-78d8-4039-a598-14124ccd0f24 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@26bf9e30
2021-06-04T00:53:37.879Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52988751-78d8-4039-a598-14124ccd0f24 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:53:37.879Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52988751-78d8-4039-a598-14124ccd0f24 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:53:40.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53088931-fe81-4dce-9fa6-6d5c7cde90df PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:53:40.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53088931-fe81-4dce-9fa6-6d5c7cde90df PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@185363d7
2021-06-04T00:53:40.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53088931-fe81-4dce-9fa6-6d5c7cde90df PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:53:40.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53088931-fe81-4dce-9fa6-6d5c7cde90df PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:53:42.475Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:53:42.475Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:53:42.476Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:53:42.476Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:53:43.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d9fa8c7-d2e4-469a-a965-364a53b6433f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:53:43.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d9fa8c7-d2e4-469a-a965-364a53b6433f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@121a9e25
2021-06-04T00:53:43.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d9fa8c7-d2e4-469a-a965-364a53b6433f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:53:43.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d9fa8c7-d2e4-469a-a965-364a53b6433f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:53:46.875Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=deb451c0-a6a2-4c61-a3d6-b03ecdae11aa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:53:46.875Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=deb451c0-a6a2-4c61-a3d6-b03ecdae11aa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@717e6d32
2021-06-04T00:53:46.875Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=deb451c0-a6a2-4c61-a3d6-b03ecdae11aa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:53:46.875Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=deb451c0-a6a2-4c61-a3d6-b03ecdae11aa PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:53:47.951Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:53:47.990Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:53:49.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44120a24-01b1-44b8-9bdb-577f316506a5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:53:49.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44120a24-01b1-44b8-9bdb-577f316506a5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b6a2333
2021-06-04T00:53:49.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44120a24-01b1-44b8-9bdb-577f316506a5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:53:49.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44120a24-01b1-44b8-9bdb-577f316506a5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:53:52.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0c14e6a-9ba7-41bf-81b9-eec6206c37f4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:53:52.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0c14e6a-9ba7-41bf-81b9-eec6206c37f4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28a4a052
2021-06-04T00:53:52.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0c14e6a-9ba7-41bf-81b9-eec6206c37f4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:53:52.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0c14e6a-9ba7-41bf-81b9-eec6206c37f4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:53:55.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9a0009e-7189-4437-aab2-924508b8aaa4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:53:55.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9a0009e-7189-4437-aab2-924508b8aaa4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e09f8d5
2021-06-04T00:53:55.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9a0009e-7189-4437-aab2-924508b8aaa4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:53:55.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9a0009e-7189-4437-aab2-924508b8aaa4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:53:58.923Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:53:58.924Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:53:58.924Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:53:58.924Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:53:59.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b05bf6db-f705-46e4-85f7-3b27b94a7f96 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:53:59.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b05bf6db-f705-46e4-85f7-3b27b94a7f96 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c1c1fdb
2021-06-04T00:53:59.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b05bf6db-f705-46e4-85f7-3b27b94a7f96 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:53:59.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b05bf6db-f705-46e4-85f7-3b27b94a7f96 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:54:01.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18461122-2bc7-4717-97da-8d1df9b3ff87 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:54:01.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18461122-2bc7-4717-97da-8d1df9b3ff87 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1695dad0
2021-06-04T00:54:01.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18461122-2bc7-4717-97da-8d1df9b3ff87 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:54:01.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18461122-2bc7-4717-97da-8d1df9b3ff87 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:54:02.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:54:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f11ce673-cfd3-43dd-b507-716d02492d24 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:54:04.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f11ce673-cfd3-43dd-b507-716d02492d24 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b3e5e60
2021-06-04T00:54:04.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f11ce673-cfd3-43dd-b507-716d02492d24 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:54:04.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f11ce673-cfd3-43dd-b507-716d02492d24 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:54:07.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7982a1af-f28d-4ce2-9443-dbf35383c8cd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:54:07.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7982a1af-f28d-4ce2-9443-dbf35383c8cd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ad0d282
2021-06-04T00:54:07.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7982a1af-f28d-4ce2-9443-dbf35383c8cd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:54:07.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7982a1af-f28d-4ce2-9443-dbf35383c8cd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:54:08.538Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:54:08.540Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:54:10.780Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35afa54f-969c-4e50-bdbf-6bf7321522cc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:54:10.780Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35afa54f-969c-4e50-bdbf-6bf7321522cc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@36bee0c4
2021-06-04T00:54:10.780Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35afa54f-969c-4e50-bdbf-6bf7321522cc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:54:10.780Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35afa54f-969c-4e50-bdbf-6bf7321522cc PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:54:10.950Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T00:54:13.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07225897-3049-46af-8eeb-12a4778cb8f4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:54:13.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07225897-3049-46af-8eeb-12a4778cb8f4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ec5ff99
2021-06-04T00:54:13.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07225897-3049-46af-8eeb-12a4778cb8f4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:54:13.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07225897-3049-46af-8eeb-12a4778cb8f4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:54:14.619Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=07225897-3049-46af-8eeb-12a4778cb8f4 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:54:14.619Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=07225897-3049-46af-8eeb-12a4778cb8f4 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:54:16.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=184a526d-84d0-40fc-ac9f-d626c87dc77e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:54:16.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=184a526d-84d0-40fc-ac9f-d626c87dc77e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@67616d7f
2021-06-04T00:54:16.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=184a526d-84d0-40fc-ac9f-d626c87dc77e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:54:16.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=184a526d-84d0-40fc-ac9f-d626c87dc77e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:54:20.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd2ee74e-45c6-4fe1-b56f-45c073507854 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:54:20.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd2ee74e-45c6-4fe1-b56f-45c073507854 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b19e7d3
2021-06-04T00:54:20.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd2ee74e-45c6-4fe1-b56f-45c073507854 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:54:20.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd2ee74e-45c6-4fe1-b56f-45c073507854 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:54:22.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b770a0a-048d-4034-95e5-259b5ab275b1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:54:22.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b770a0a-048d-4034-95e5-259b5ab275b1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a6094b4
2021-06-04T00:54:22.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b770a0a-048d-4034-95e5-259b5ab275b1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:54:22.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b770a0a-048d-4034-95e5-259b5ab275b1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:54:24.720Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:54:24.721Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:54:24.721Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:54:24.721Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:54:25.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3db612c9-a32d-44fb-9da0-8b0638a4f638 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:54:25.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3db612c9-a32d-44fb-9da0-8b0638a4f638 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3b788956
2021-06-04T00:54:25.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3db612c9-a32d-44fb-9da0-8b0638a4f638 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:54:25.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3db612c9-a32d-44fb-9da0-8b0638a4f638 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:54:28.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c62ecf3a-8182-4b8c-890d-c28f207b3c0d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:54:28.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c62ecf3a-8182-4b8c-890d-c28f207b3c0d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@571e01d3
2021-06-04T00:54:28.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c62ecf3a-8182-4b8c-890d-c28f207b3c0d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:54:28.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c62ecf3a-8182-4b8c-890d-c28f207b3c0d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:54:31.467Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04cb8a3a-11cd-4c4f-a38d-81308d4c36a4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:54:31.467Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04cb8a3a-11cd-4c4f-a38d-81308d4c36a4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43ad439c
2021-06-04T00:54:31.467Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04cb8a3a-11cd-4c4f-a38d-81308d4c36a4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:54:31.467Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04cb8a3a-11cd-4c4f-a38d-81308d4c36a4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:54:34.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ce3e486-c646-4a34-bf02-20f10144b5c3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:54:34.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ce3e486-c646-4a34-bf02-20f10144b5c3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5df6ba69
2021-06-04T00:54:34.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ce3e486-c646-4a34-bf02-20f10144b5c3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:54:34.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ce3e486-c646-4a34-bf02-20f10144b5c3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:54:37.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b513f6aa-8640-458c-839e-0d92465ec380 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:54:37.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b513f6aa-8640-458c-839e-0d92465ec380 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22bbaab8
2021-06-04T00:54:37.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b513f6aa-8640-458c-839e-0d92465ec380 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:54:37.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b513f6aa-8640-458c-839e-0d92465ec380 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:54:40.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f81d467f-58c9-4a75-bdd4-cdbf76ac2e1f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:54:40.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f81d467f-58c9-4a75-bdd4-cdbf76ac2e1f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58c37a5
2021-06-04T00:54:40.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f81d467f-58c9-4a75-bdd4-cdbf76ac2e1f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:54:40.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f81d467f-58c9-4a75-bdd4-cdbf76ac2e1f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:54:43.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95a1c94e-0609-4443-93b7-d69918c0a743 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:54:43.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95a1c94e-0609-4443-93b7-d69918c0a743 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c14352b
2021-06-04T00:54:43.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95a1c94e-0609-4443-93b7-d69918c0a743 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:54:43.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95a1c94e-0609-4443-93b7-d69918c0a743 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:54:46.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cd7f61f-25a8-42e4-a0fd-baa01d5b2a85 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:54:46.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cd7f61f-25a8-42e4-a0fd-baa01d5b2a85 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4459f732
2021-06-04T00:54:46.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cd7f61f-25a8-42e4-a0fd-baa01d5b2a85 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:54:46.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cd7f61f-25a8-42e4-a0fd-baa01d5b2a85 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:54:50.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f346253b-9c92-4586-99bc-157537286446 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:54:50.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f346253b-9c92-4586-99bc-157537286446 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3bc86b6b
2021-06-04T00:54:50.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f346253b-9c92-4586-99bc-157537286446 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:54:50.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f346253b-9c92-4586-99bc-157537286446 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:54:52.527Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aff279ad-3da1-434b-9b82-43590585c7c7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:54:52.527Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aff279ad-3da1-434b-9b82-43590585c7c7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f1d52a8
2021-06-04T00:54:52.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aff279ad-3da1-434b-9b82-43590585c7c7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:54:52.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aff279ad-3da1-434b-9b82-43590585c7c7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:54:55.530Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=aff279ad-3da1-434b-9b82-43590585c7c7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:54:55.531Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=aff279ad-3da1-434b-9b82-43590585c7c7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:54:55.531Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=aff279ad-3da1-434b-9b82-43590585c7c7 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:54:55.531Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=aff279ad-3da1-434b-9b82-43590585c7c7 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:54:56.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d11d31c3-40a7-46ff-ba3c-ab0b4bcf6611 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:54:56.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d11d31c3-40a7-46ff-ba3c-ab0b4bcf6611 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@52ad890d
2021-06-04T00:54:56.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d11d31c3-40a7-46ff-ba3c-ab0b4bcf6611 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:54:56.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d11d31c3-40a7-46ff-ba3c-ab0b4bcf6611 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:54:56.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:54:56.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:54:59.237Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d11d31c3-40a7-46ff-ba3c-ab0b4bcf6611 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:54:59.237Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d11d31c3-40a7-46ff-ba3c-ab0b4bcf6611 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:54:59.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:54:59.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67dd8457-be65-460d-9449-0086d81ae9bd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:54:59.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67dd8457-be65-460d-9449-0086d81ae9bd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@212daf7d
2021-06-04T00:54:59.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67dd8457-be65-460d-9449-0086d81ae9bd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:54:59.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67dd8457-be65-460d-9449-0086d81ae9bd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:55:02.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:55:02.856Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=67dd8457-be65-460d-9449-0086d81ae9bd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:55:02.856Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=67dd8457-be65-460d-9449-0086d81ae9bd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:55:02.857Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=67dd8457-be65-460d-9449-0086d81ae9bd ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:55:02.857Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=67dd8457-be65-460d-9449-0086d81ae9bd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:55:03.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f38701b5-ae15-477c-9212-b115ab8023ed PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:55:03.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f38701b5-ae15-477c-9212-b115ab8023ed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2acb278c
2021-06-04T00:55:03.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f38701b5-ae15-477c-9212-b115ab8023ed PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:55:03.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f38701b5-ae15-477c-9212-b115ab8023ed PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:55:04.161Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:55:04.163Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:55:05.271Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:55:05.484Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f38701b5-ae15-477c-9212-b115ab8023ed ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:55:05.484Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=f38701b5-ae15-477c-9212-b115ab8023ed ErrorCategory=ERROR ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:55:06.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1b25e85-31cb-45d2-ac17-ae21558f32c2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:55:06.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1b25e85-31cb-45d2-ac17-ae21558f32c2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@f5e31f6
2021-06-04T00:55:06.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1b25e85-31cb-45d2-ac17-ae21558f32c2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:55:06.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1b25e85-31cb-45d2-ac17-ae21558f32c2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:55:08.401Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:55:08.401Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:55:08.674Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a1b25e85-31cb-45d2-ac17-ae21558f32c2 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:55:08.674Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a1b25e85-31cb-45d2-ac17-ae21558f32c2 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:55:09.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa78c593-cfcb-4865-92b9-c3a4907b10aa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:55:09.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa78c593-cfcb-4865-92b9-c3a4907b10aa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ad40ece
2021-06-04T00:55:09.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa78c593-cfcb-4865-92b9-c3a4907b10aa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:55:09.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa78c593-cfcb-4865-92b9-c3a4907b10aa PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:55:10.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=082f8f1c-f842-4ec3-a422-0e618b65c12b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:55:10.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=082f8f1c-f842-4ec3-a422-0e618b65c12b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6950bd5f
2021-06-04T00:55:10.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=082f8f1c-f842-4ec3-a422-0e618b65c12b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:55:10.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=082f8f1c-f842-4ec3-a422-0e618b65c12b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:55:13.742Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5c1781d-79fc-445b-9388-4276a40a59bd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:55:13.742Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5c1781d-79fc-445b-9388-4276a40a59bd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@bb3b949
2021-06-04T00:55:13.742Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5c1781d-79fc-445b-9388-4276a40a59bd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:55:13.742Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5c1781d-79fc-445b-9388-4276a40a59bd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:55:17.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=032a9da4-3023-4df4-826c-938b942d6a37 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:55:17.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=032a9da4-3023-4df4-826c-938b942d6a37 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@751ce848
2021-06-04T00:55:17.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=032a9da4-3023-4df4-826c-938b942d6a37 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:55:17.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=032a9da4-3023-4df4-826c-938b942d6a37 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:55:20.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0e7b39c-b2f3-4554-8fef-1b6ae44aa700 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:55:20.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0e7b39c-b2f3-4554-8fef-1b6ae44aa700 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f043a5b
2021-06-04T00:55:20.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0e7b39c-b2f3-4554-8fef-1b6ae44aa700 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:55:20.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0e7b39c-b2f3-4554-8fef-1b6ae44aa700 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:55:21.972Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T00:55:21.972Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:55:21.973Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:55:21.973Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:55:22.540Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b7435b9-85a9-4e8d-9a64-7b5febff4349 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:55:22.540Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b7435b9-85a9-4e8d-9a64-7b5febff4349 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2352dca1
2021-06-04T00:55:22.540Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b7435b9-85a9-4e8d-9a64-7b5febff4349 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:55:22.540Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b7435b9-85a9-4e8d-9a64-7b5febff4349 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:55:25.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a261790c-d937-4078-8e79-211af0e18d45 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:55:25.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a261790c-d937-4078-8e79-211af0e18d45 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35bd5073
2021-06-04T00:55:25.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a261790c-d937-4078-8e79-211af0e18d45 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:55:25.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a261790c-d937-4078-8e79-211af0e18d45 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:55:28.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e5e7c91-0d21-4916-a64a-0dd4ee8e4e59 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:55:28.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e5e7c91-0d21-4916-a64a-0dd4ee8e4e59 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2771b024
2021-06-04T00:55:28.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e5e7c91-0d21-4916-a64a-0dd4ee8e4e59 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:55:28.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e5e7c91-0d21-4916-a64a-0dd4ee8e4e59 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:55:31.467Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7112906-5115-40c6-a12c-b7b3c5b15b25 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:55:31.467Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7112906-5115-40c6-a12c-b7b3c5b15b25 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49498073
2021-06-04T00:55:31.467Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7112906-5115-40c6-a12c-b7b3c5b15b25 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:55:31.467Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7112906-5115-40c6-a12c-b7b3c5b15b25 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:55:35.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e750a39-45d4-42f8-9b65-0249ddd31638 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:55:35.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e750a39-45d4-42f8-9b65-0249ddd31638 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7c4bfa2f
2021-06-04T00:55:35.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e750a39-45d4-42f8-9b65-0249ddd31638 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:55:35.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e750a39-45d4-42f8-9b65-0249ddd31638 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:55:38.075Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4b6d16c-ad54-4a33-befb-2eac27e08147 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:55:38.075Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4b6d16c-ad54-4a33-befb-2eac27e08147 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@232a031d
2021-06-04T00:55:38.075Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4b6d16c-ad54-4a33-befb-2eac27e08147 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:55:38.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4b6d16c-ad54-4a33-befb-2eac27e08147 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:55:40.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d6a702a-aceb-4c1f-a4ac-cee1d60aa6a4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:55:40.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d6a702a-aceb-4c1f-a4ac-cee1d60aa6a4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@97067cc
2021-06-04T00:55:40.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d6a702a-aceb-4c1f-a4ac-cee1d60aa6a4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:55:40.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d6a702a-aceb-4c1f-a4ac-cee1d60aa6a4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:55:43.947Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e10a287-dbca-4f3c-a24a-1e11e3982985 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:55:43.947Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e10a287-dbca-4f3c-a24a-1e11e3982985 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@cbf2489
2021-06-04T00:55:43.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e10a287-dbca-4f3c-a24a-1e11e3982985 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:55:43.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e10a287-dbca-4f3c-a24a-1e11e3982985 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:55:46.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b818fcf6-8b13-4be4-ab0d-465cd7039150 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:55:46.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b818fcf6-8b13-4be4-ab0d-465cd7039150 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f063db3
2021-06-04T00:55:46.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b818fcf6-8b13-4be4-ab0d-465cd7039150 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:55:46.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b818fcf6-8b13-4be4-ab0d-465cd7039150 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:55:50.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=90b8aee9-5d54-49c8-9952-66466b23d487 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:55:50.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=90b8aee9-5d54-49c8-9952-66466b23d487 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c47e1a5
2021-06-04T00:55:50.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=90b8aee9-5d54-49c8-9952-66466b23d487 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:55:50.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=90b8aee9-5d54-49c8-9952-66466b23d487 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:55:52.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c7ee2ce-bc1f-48a1-9d0b-1682b160ea93 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:55:52.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c7ee2ce-bc1f-48a1-9d0b-1682b160ea93 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5603a3e6
2021-06-04T00:55:52.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c7ee2ce-bc1f-48a1-9d0b-1682b160ea93 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:55:52.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c7ee2ce-bc1f-48a1-9d0b-1682b160ea93 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:55:56.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c9d5bd6-6744-4264-8abf-9d4c987eabc5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:55:56.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c9d5bd6-6744-4264-8abf-9d4c987eabc5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@236d5ec3
2021-06-04T00:55:56.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c9d5bd6-6744-4264-8abf-9d4c987eabc5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:55:56.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c9d5bd6-6744-4264-8abf-9d4c987eabc5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:55:59.176Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99243f18-78bf-40cc-8917-940115c75452 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:55:59.176Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99243f18-78bf-40cc-8917-940115c75452 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d9804b8
2021-06-04T00:55:59.176Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99243f18-78bf-40cc-8917-940115c75452 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:55:59.176Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99243f18-78bf-40cc-8917-940115c75452 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:56:01.779Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8db8eb8a-9866-47e7-8879-e6f21667c53c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:56:01.779Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8db8eb8a-9866-47e7-8879-e6f21667c53c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5eb19067
2021-06-04T00:56:01.779Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8db8eb8a-9866-47e7-8879-e6f21667c53c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:56:01.779Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8db8eb8a-9866-47e7-8879-e6f21667c53c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:56:04.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d080aac6-5d4b-44b2-a951-ed0a250a6f77 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:56:04.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d080aac6-5d4b-44b2-a951-ed0a250a6f77 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15e604c4
2021-06-04T00:56:04.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d080aac6-5d4b-44b2-a951-ed0a250a6f77 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:56:04.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d080aac6-5d4b-44b2-a951-ed0a250a6f77 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:56:07.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d49f696c-4698-4722-ba28-0e04aa8efc87 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:56:07.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d49f696c-4698-4722-ba28-0e04aa8efc87 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5cb4cbfd
2021-06-04T00:56:07.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d49f696c-4698-4722-ba28-0e04aa8efc87 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:56:07.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d49f696c-4698-4722-ba28-0e04aa8efc87 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:56:09.750Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T00:56:09.755Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T00:56:10.789Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cb94a7f-a2b9-4c2a-899f-0713c9058de6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:56:10.789Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cb94a7f-a2b9-4c2a-899f-0713c9058de6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2174b917
2021-06-04T00:56:10.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cb94a7f-a2b9-4c2a-899f-0713c9058de6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:56:10.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cb94a7f-a2b9-4c2a-899f-0713c9058de6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:56:13.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c64b7e61-7169-4c89-9a91-5ca8c4bfe2f3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:56:13.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c64b7e61-7169-4c89-9a91-5ca8c4bfe2f3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@731427f6
2021-06-04T00:56:13.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c64b7e61-7169-4c89-9a91-5ca8c4bfe2f3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:56:13.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c64b7e61-7169-4c89-9a91-5ca8c4bfe2f3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:56:15.973Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:56:15.973Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:56:16.062Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:56:16.062Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:56:16.070Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T00:56:16.070Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T00:56:16.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c7aa93e-9263-4fb0-8fbb-24ec03177e37 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:56:16.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c7aa93e-9263-4fb0-8fbb-24ec03177e37 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5671cd74
2021-06-04T00:56:16.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c7aa93e-9263-4fb0-8fbb-24ec03177e37 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:56:16.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c7aa93e-9263-4fb0-8fbb-24ec03177e37 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:56:20.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9115e810-3bf4-4c41-8eae-d1955b3445f0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:56:20.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9115e810-3bf4-4c41-8eae-d1955b3445f0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c601f64
2021-06-04T00:56:20.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9115e810-3bf4-4c41-8eae-d1955b3445f0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:56:20.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9115e810-3bf4-4c41-8eae-d1955b3445f0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:56:22.461Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc5e10a0-9eb1-44b2-a595-9f082cf2678d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:56:22.461Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc5e10a0-9eb1-44b2-a595-9f082cf2678d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2858a7fe
2021-06-04T00:56:22.461Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc5e10a0-9eb1-44b2-a595-9f082cf2678d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:56:22.461Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc5e10a0-9eb1-44b2-a595-9f082cf2678d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:56:26.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1bde24d-7fb3-4e89-a538-4b78e53c72e3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:56:26.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1bde24d-7fb3-4e89-a538-4b78e53c72e3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7aa10e94
2021-06-04T00:56:26.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1bde24d-7fb3-4e89-a538-4b78e53c72e3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:56:26.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1bde24d-7fb3-4e89-a538-4b78e53c72e3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:56:28.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cec16db2-af5f-4581-95f7-9f2f8f422c78 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:56:28.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cec16db2-af5f-4581-95f7-9f2f8f422c78 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22e376d9
2021-06-04T00:56:28.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cec16db2-af5f-4581-95f7-9f2f8f422c78 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:56:28.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cec16db2-af5f-4581-95f7-9f2f8f422c78 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:56:31.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83f21c0d-09e1-40fc-bc89-2133604bf1c8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:56:31.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83f21c0d-09e1-40fc-bc89-2133604bf1c8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e54d6de
2021-06-04T00:56:31.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83f21c0d-09e1-40fc-bc89-2133604bf1c8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:56:31.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83f21c0d-09e1-40fc-bc89-2133604bf1c8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:56:34.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17cb10a9-27ad-424c-8b52-44026b0f47dd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:56:34.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17cb10a9-27ad-424c-8b52-44026b0f47dd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@635ee7bd
2021-06-04T00:56:34.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17cb10a9-27ad-424c-8b52-44026b0f47dd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:56:34.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17cb10a9-27ad-424c-8b52-44026b0f47dd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:56:38.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f35d04a-cf66-48b4-8633-d104df01d930 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:56:38.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f35d04a-cf66-48b4-8633-d104df01d930 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@11f990ec
2021-06-04T00:56:38.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f35d04a-cf66-48b4-8633-d104df01d930 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:56:38.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f35d04a-cf66-48b4-8633-d104df01d930 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:56:39.328Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 503 Service Unavailable
2021-06-04T00:56:39.329Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 503
2021-06-04T00:56:39.330Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=503, variables=[]]
2021-06-04T00:56:39.330Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T00:56:39.330Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T00:56:39.331Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T00:56:39.331Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T00:56:40.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bf27901-6034-489a-982f-536d79881846 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:56:40.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bf27901-6034-489a-982f-536d79881846 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@289579b4
2021-06-04T00:56:40.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bf27901-6034-489a-982f-536d79881846 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:56:40.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bf27901-6034-489a-982f-536d79881846 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:56:43.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96360418-c62c-4a91-b051-6d70663c8100 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:56:43.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96360418-c62c-4a91-b051-6d70663c8100 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@dfb85e
2021-06-04T00:56:43.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96360418-c62c-4a91-b051-6d70663c8100 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:56:43.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96360418-c62c-4a91-b051-6d70663c8100 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:56:46.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68396fc1-ef11-4072-9645-d66024212ab1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:56:46.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68396fc1-ef11-4072-9645-d66024212ab1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1428c4f7
2021-06-04T00:56:46.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68396fc1-ef11-4072-9645-d66024212ab1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:56:46.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68396fc1-ef11-4072-9645-d66024212ab1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:56:49.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ffe589e9-cbbc-42ae-b685-6e404b18d290 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:56:49.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ffe589e9-cbbc-42ae-b685-6e404b18d290 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@498b486e
2021-06-04T00:56:49.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ffe589e9-cbbc-42ae-b685-6e404b18d290 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:56:49.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ffe589e9-cbbc-42ae-b685-6e404b18d290 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:56:52.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=423852f1-d8a5-4f5c-917e-117a0c26bf4e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:56:52.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=423852f1-d8a5-4f5c-917e-117a0c26bf4e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a50d032
2021-06-04T00:56:52.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=423852f1-d8a5-4f5c-917e-117a0c26bf4e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:56:52.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=423852f1-d8a5-4f5c-917e-117a0c26bf4e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:56:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f963ebf-ece9-475c-9f2a-3574715b434e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:56:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f963ebf-ece9-475c-9f2a-3574715b434e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@37308c6e
2021-06-04T00:56:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f963ebf-ece9-475c-9f2a-3574715b434e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:56:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f963ebf-ece9-475c-9f2a-3574715b434e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:56:59.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1dcbc191-06e2-4d88-a118-3dfbef6d2eb2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:56:59.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1dcbc191-06e2-4d88-a118-3dfbef6d2eb2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@656df903
2021-06-04T00:56:59.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1dcbc191-06e2-4d88-a118-3dfbef6d2eb2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:56:59.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1dcbc191-06e2-4d88-a118-3dfbef6d2eb2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:57:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c7bdbdf-230f-4548-a0fd-34a5c3824093 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:57:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c7bdbdf-230f-4548-a0fd-34a5c3824093 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@763605f8
2021-06-04T00:57:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c7bdbdf-230f-4548-a0fd-34a5c3824093 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:57:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c7bdbdf-230f-4548-a0fd-34a5c3824093 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:57:04.477Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3c7bdbdf-230f-4548-a0fd-34a5c3824093 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:57:04.478Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3c7bdbdf-230f-4548-a0fd-34a5c3824093 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:57:04.478Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3c7bdbdf-230f-4548-a0fd-34a5c3824093 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:57:04.478Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3c7bdbdf-230f-4548-a0fd-34a5c3824093 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:57:05.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55aebb3e-2ae7-4310-90ff-45352c17b822 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:57:05.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55aebb3e-2ae7-4310-90ff-45352c17b822 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a2b8a4c
2021-06-04T00:57:05.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55aebb3e-2ae7-4310-90ff-45352c17b822 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:57:05.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55aebb3e-2ae7-4310-90ff-45352c17b822 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:57:08.172Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=55aebb3e-2ae7-4310-90ff-45352c17b822 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:57:08.172Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=55aebb3e-2ae7-4310-90ff-45352c17b822 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:57:08.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e3d5721-b58e-4740-a99e-f9cb9168397c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:57:08.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e3d5721-b58e-4740-a99e-f9cb9168397c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3647740
2021-06-04T00:57:08.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e3d5721-b58e-4740-a99e-f9cb9168397c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:57:08.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e3d5721-b58e-4740-a99e-f9cb9168397c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:57:11.059Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9e3d5721-b58e-4740-a99e-f9cb9168397c ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:57:11.059Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9e3d5721-b58e-4740-a99e-f9cb9168397c ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:57:11.188Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7e30105-18f2-4727-bcdf-d88302cdbc12 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:57:11.188Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7e30105-18f2-4727-bcdf-d88302cdbc12 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23243010
2021-06-04T00:57:11.188Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7e30105-18f2-4727-bcdf-d88302cdbc12 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:57:11.188Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7e30105-18f2-4727-bcdf-d88302cdbc12 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:57:13.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f0dc868-8202-4c0f-a0d4-57b72b4c0990 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:57:13.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f0dc868-8202-4c0f-a0d4-57b72b4c0990 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@732b0115
2021-06-04T00:57:13.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f0dc868-8202-4c0f-a0d4-57b72b4c0990 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:57:13.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f0dc868-8202-4c0f-a0d4-57b72b4c0990 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:57:16.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35a95a0b-6e6f-4012-b2ce-133d4366d335 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:57:16.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35a95a0b-6e6f-4012-b2ce-133d4366d335 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5355a647
2021-06-04T00:57:16.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35a95a0b-6e6f-4012-b2ce-133d4366d335 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:57:16.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35a95a0b-6e6f-4012-b2ce-133d4366d335 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:57:17.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:57:17.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:57:19.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=734125ec-6f8d-4ff4-962d-4f22ac39631c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:57:19.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=734125ec-6f8d-4ff4-962d-4f22ac39631c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4bae6c0f
2021-06-04T00:57:19.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=734125ec-6f8d-4ff4-962d-4f22ac39631c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:57:19.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=734125ec-6f8d-4ff4-962d-4f22ac39631c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:57:19.976Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:57:20.254Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=734125ec-6f8d-4ff4-962d-4f22ac39631c ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:57:20.254Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=734125ec-6f8d-4ff4-962d-4f22ac39631c ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:57:22.455Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95662bfd-36bf-4276-8be6-83f538b4515c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:57:22.455Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95662bfd-36bf-4276-8be6-83f538b4515c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@498861da
2021-06-04T00:57:22.455Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95662bfd-36bf-4276-8be6-83f538b4515c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:57:22.455Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95662bfd-36bf-4276-8be6-83f538b4515c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:57:23.386Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=95662bfd-36bf-4276-8be6-83f538b4515c ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:57:23.386Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=95662bfd-36bf-4276-8be6-83f538b4515c ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:57:26.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62e73361-269a-45e6-9b03-905823e89580 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:57:26.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62e73361-269a-45e6-9b03-905823e89580 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6280e257
2021-06-04T00:57:26.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62e73361-269a-45e6-9b03-905823e89580 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:57:26.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62e73361-269a-45e6-9b03-905823e89580 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:57:28.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d6f0453-3062-4d4b-ad13-81eefcb1da7f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:57:28.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d6f0453-3062-4d4b-ad13-81eefcb1da7f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c9917de
2021-06-04T00:57:28.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d6f0453-3062-4d4b-ad13-81eefcb1da7f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:57:28.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d6f0453-3062-4d4b-ad13-81eefcb1da7f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:57:31.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf1f2eae-81c5-4096-ad47-d826e8390b31 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:57:31.449Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf1f2eae-81c5-4096-ad47-d826e8390b31 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@24efce56
2021-06-04T00:57:31.449Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf1f2eae-81c5-4096-ad47-d826e8390b31 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:57:31.449Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf1f2eae-81c5-4096-ad47-d826e8390b31 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:57:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=770719e6-4148-4002-acf8-4e14211edb5c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:57:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=770719e6-4148-4002-acf8-4e14211edb5c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e63eda0
2021-06-04T00:57:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=770719e6-4148-4002-acf8-4e14211edb5c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:57:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=770719e6-4148-4002-acf8-4e14211edb5c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:57:38.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e205daf-d340-4012-9013-c0c482ef5b0e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:57:38.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e205daf-d340-4012-9013-c0c482ef5b0e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b943061
2021-06-04T00:57:38.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e205daf-d340-4012-9013-c0c482ef5b0e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:57:38.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e205daf-d340-4012-9013-c0c482ef5b0e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:57:40.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cffb8e46-6ad0-4eee-acb4-69ed70138ac7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:57:40.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cffb8e46-6ad0-4eee-acb4-69ed70138ac7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f67e92a
2021-06-04T00:57:40.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cffb8e46-6ad0-4eee-acb4-69ed70138ac7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:57:40.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cffb8e46-6ad0-4eee-acb4-69ed70138ac7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:57:43.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc4d0bb3-a5c3-4673-a9b5-94113b4b2287 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:57:43.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc4d0bb3-a5c3-4673-a9b5-94113b4b2287 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@452009ee
2021-06-04T00:57:43.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc4d0bb3-a5c3-4673-a9b5-94113b4b2287 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:57:43.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc4d0bb3-a5c3-4673-a9b5-94113b4b2287 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:57:46.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80763d4b-c17c-488d-bcc6-e00fecd89507 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:57:46.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80763d4b-c17c-488d-bcc6-e00fecd89507 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@749ff207
2021-06-04T00:57:46.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80763d4b-c17c-488d-bcc6-e00fecd89507 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:57:46.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80763d4b-c17c-488d-bcc6-e00fecd89507 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:57:50.089Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a46ebef2-c0b0-4fed-bb73-30618d463e17 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:57:50.089Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a46ebef2-c0b0-4fed-bb73-30618d463e17 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ee2d3cd
2021-06-04T00:57:50.089Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a46ebef2-c0b0-4fed-bb73-30618d463e17 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:57:50.089Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a46ebef2-c0b0-4fed-bb73-30618d463e17 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:57:52.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=769405ba-1f67-4843-b123-170215d75d16 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:57:52.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=769405ba-1f67-4843-b123-170215d75d16 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3eec4782
2021-06-04T00:57:52.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=769405ba-1f67-4843-b123-170215d75d16 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:57:52.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=769405ba-1f67-4843-b123-170215d75d16 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:57:55.519Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=769405ba-1f67-4843-b123-170215d75d16 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:57:55.520Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=769405ba-1f67-4843-b123-170215d75d16 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:57:55.520Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=769405ba-1f67-4843-b123-170215d75d16 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:57:55.520Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=769405ba-1f67-4843-b123-170215d75d16 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:57:56.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55b0fcfd-1f8a-4be0-b5bd-83ba1beb691c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:57:56.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55b0fcfd-1f8a-4be0-b5bd-83ba1beb691c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b4656c8
2021-06-04T00:57:56.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55b0fcfd-1f8a-4be0-b5bd-83ba1beb691c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:57:56.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55b0fcfd-1f8a-4be0-b5bd-83ba1beb691c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:57:56.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:57:56.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:57:59.220Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=55b0fcfd-1f8a-4be0-b5bd-83ba1beb691c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:57:59.220Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=55b0fcfd-1f8a-4be0-b5bd-83ba1beb691c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:57:59.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:57:59.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=595bdcea-8796-4f57-9e65-f14ed21fed73 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:57:59.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=595bdcea-8796-4f57-9e65-f14ed21fed73 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@78b64503
2021-06-04T00:57:59.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=595bdcea-8796-4f57-9e65-f14ed21fed73 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:57:59.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=595bdcea-8796-4f57-9e65-f14ed21fed73 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:58:02.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:58:02.868Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=595bdcea-8796-4f57-9e65-f14ed21fed73 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:58:02.868Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=595bdcea-8796-4f57-9e65-f14ed21fed73 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:58:03.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=130e5bfb-5a3e-4cc3-a0c6-303151cef758 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:58:03.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=130e5bfb-5a3e-4cc3-a0c6-303151cef758 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d032f99
2021-06-04T00:58:03.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=130e5bfb-5a3e-4cc3-a0c6-303151cef758 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:58:03.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=130e5bfb-5a3e-4cc3-a0c6-303151cef758 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:58:05.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e7ddcae-d35e-46f1-91ac-7ec2f7a77927 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:58:05.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e7ddcae-d35e-46f1-91ac-7ec2f7a77927 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9c677b0
2021-06-04T00:58:05.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e7ddcae-d35e-46f1-91ac-7ec2f7a77927 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:58:05.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e7ddcae-d35e-46f1-91ac-7ec2f7a77927 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:58:08.023Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=7e7ddcae-d35e-46f1-91ac-7ec2f7a77927 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:58:08.024Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=7e7ddcae-d35e-46f1-91ac-7ec2f7a77927 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:58:08.024Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=7e7ddcae-d35e-46f1-91ac-7ec2f7a77927 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:58:08.024Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=7e7ddcae-d35e-46f1-91ac-7ec2f7a77927 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:58:08.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=008f24c3-bc10-48f4-b6c7-6f5a76090b17 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:58:08.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=008f24c3-bc10-48f4-b6c7-6f5a76090b17 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4392a5d6
2021-06-04T00:58:08.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=008f24c3-bc10-48f4-b6c7-6f5a76090b17 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:58:08.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=008f24c3-bc10-48f4-b6c7-6f5a76090b17 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:58:11.813Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=008f24c3-bc10-48f4-b6c7-6f5a76090b17 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:58:11.813Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=008f24c3-bc10-48f4-b6c7-6f5a76090b17 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:58:11.963Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdc875e4-2939-49cc-8d43-55166bd9c59b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:58:11.963Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdc875e4-2939-49cc-8d43-55166bd9c59b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45bfbaf1
2021-06-04T00:58:11.963Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdc875e4-2939-49cc-8d43-55166bd9c59b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:58:11.963Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdc875e4-2939-49cc-8d43-55166bd9c59b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:58:14.997Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=cdc875e4-2939-49cc-8d43-55166bd9c59b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:58:14.997Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=cdc875e4-2939-49cc-8d43-55166bd9c59b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:58:15.675Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e12c618-7953-4396-935f-26659d65f4d9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:58:15.675Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e12c618-7953-4396-935f-26659d65f4d9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2914882d
2021-06-04T00:58:15.675Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e12c618-7953-4396-935f-26659d65f4d9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:58:15.675Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e12c618-7953-4396-935f-26659d65f4d9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:58:15.870Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. Could not execute operation due to backend exception
2021-06-04T00:58:16.474Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:58:18.053Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=6e12c618-7953-4396-935f-26659d65f4d9 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:58:18.053Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=6e12c618-7953-4396-935f-26659d65f4d9 ErrorCategory=ERROR ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:58:18.685Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f49f48c1-45a8-430b-a95b-a56613cab6f7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:58:18.685Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f49f48c1-45a8-430b-a95b-a56613cab6f7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1453d2b
2021-06-04T00:58:18.685Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f49f48c1-45a8-430b-a95b-a56613cab6f7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:58:18.685Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f49f48c1-45a8-430b-a95b-a56613cab6f7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:58:19.699Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f49f48c1-45a8-430b-a95b-a56613cab6f7 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:58:19.699Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f49f48c1-45a8-430b-a95b-a56613cab6f7 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:58:20.373Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=087cd92b-a855-4a82-a450-5a7653c48093 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:58:20.373Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=087cd92b-a855-4a82-a450-5a7653c48093 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@fc59534
2021-06-04T00:58:20.373Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=087cd92b-a855-4a82-a450-5a7653c48093 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:58:20.373Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=087cd92b-a855-4a82-a450-5a7653c48093 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:58:20.678Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01nxm2gu8lqn1a1njtvdgdij0vu566
2021-06-04T00:58:20.678Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node017misv9p2igbq13cdr6cfo1ixu571
2021-06-04T00:58:20.678Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0capxaet1m8kz1fi1w9sljz7eu563
2021-06-04T00:58:20.678Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0tbx5oinaxb4711pb8t958emn3568
2021-06-04T00:58:20.679Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01tljrunimen8jsom6te6o1va1570
2021-06-04T00:58:20.679Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node07jg3jddn6udo19w6an7pnn8tc565
2021-06-04T00:58:20.679Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0ojwblcouf7lk16twrfmfzu915567
2021-06-04T00:58:20.679Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0t0k00rzfnr3wk3wy6zfr1eod564
2021-06-04T00:58:20.679Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01mymqkrj0pfojjj6sxwfdjgd8572
2021-06-04T00:58:20.679Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0uqyx8wvz7bpnlu7rneuo04gy569
2021-06-04T00:58:22.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d4982db-9593-4a30-89ce-8dee3eedbb39 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:58:22.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d4982db-9593-4a30-89ce-8dee3eedbb39 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@21d3101
2021-06-04T00:58:22.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d4982db-9593-4a30-89ce-8dee3eedbb39 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:58:22.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d4982db-9593-4a30-89ce-8dee3eedbb39 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:58:26.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=395e78ae-dbdc-4554-ad36-d3ecaf84207d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:58:26.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=395e78ae-dbdc-4554-ad36-d3ecaf84207d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@101c1228
2021-06-04T00:58:26.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=395e78ae-dbdc-4554-ad36-d3ecaf84207d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:58:26.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=395e78ae-dbdc-4554-ad36-d3ecaf84207d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:58:29.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e8d0732-aa54-475b-bd2c-9f917bb797ac PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:58:29.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e8d0732-aa54-475b-bd2c-9f917bb797ac PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3818c965
2021-06-04T00:58:29.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e8d0732-aa54-475b-bd2c-9f917bb797ac PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:58:29.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e8d0732-aa54-475b-bd2c-9f917bb797ac PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:58:32.079Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=9e8d0732-aa54-475b-bd2c-9f917bb797ac ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:58:32.080Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=9e8d0732-aa54-475b-bd2c-9f917bb797ac ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:58:32.081Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9e8d0732-aa54-475b-bd2c-9f917bb797ac ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:58:32.081Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9e8d0732-aa54-475b-bd2c-9f917bb797ac ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:58:32.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4280236-1b31-4d00-9245-ef7b87700d7e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:58:32.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4280236-1b31-4d00-9245-ef7b87700d7e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1bd79767
2021-06-04T00:58:32.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4280236-1b31-4d00-9245-ef7b87700d7e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:58:32.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4280236-1b31-4d00-9245-ef7b87700d7e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:58:35.271Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e4280236-1b31-4d00-9245-ef7b87700d7e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:58:35.271Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e4280236-1b31-4d00-9245-ef7b87700d7e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:58:35.776Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e5a6bd5-01e1-4843-9f9a-b0efdb77b05e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:58:35.777Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e5a6bd5-01e1-4843-9f9a-b0efdb77b05e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54f94a
2021-06-04T00:58:35.777Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e5a6bd5-01e1-4843-9f9a-b0efdb77b05e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:58:35.777Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e5a6bd5-01e1-4843-9f9a-b0efdb77b05e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:58:38.824Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=9e5a6bd5-01e1-4843-9f9a-b0efdb77b05e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:58:38.824Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=9e5a6bd5-01e1-4843-9f9a-b0efdb77b05e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:58:39.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77af22f5-2f7d-4da7-85e4-1f9cd923f3d4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:58:39.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77af22f5-2f7d-4da7-85e4-1f9cd923f3d4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@59b297d3
2021-06-04T00:58:39.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77af22f5-2f7d-4da7-85e4-1f9cd923f3d4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:58:39.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77af22f5-2f7d-4da7-85e4-1f9cd923f3d4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:58:41.550Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=77af22f5-2f7d-4da7-85e4-1f9cd923f3d4 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:58:41.550Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=77af22f5-2f7d-4da7-85e4-1f9cd923f3d4 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:58:41.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19620c44-961d-4a39-8026-7ae11425f12b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:58:41.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19620c44-961d-4a39-8026-7ae11425f12b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@475a4f2f
2021-06-04T00:58:41.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19620c44-961d-4a39-8026-7ae11425f12b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:58:41.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19620c44-961d-4a39-8026-7ae11425f12b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:58:43.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c67129f1-fdf9-45bd-a5ee-2676b060d51a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:58:43.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c67129f1-fdf9-45bd-a5ee-2676b060d51a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@73c98b6b
2021-06-04T00:58:43.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c67129f1-fdf9-45bd-a5ee-2676b060d51a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:58:43.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c67129f1-fdf9-45bd-a5ee-2676b060d51a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:58:47.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f1f069b-7f04-457f-824d-4b2519939dd9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:58:47.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f1f069b-7f04-457f-824d-4b2519939dd9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e8886ce
2021-06-04T00:58:47.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f1f069b-7f04-457f-824d-4b2519939dd9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:58:47.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f1f069b-7f04-457f-824d-4b2519939dd9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:58:50.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1ef954d-4ede-45aa-b218-9c5942d96332 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:58:50.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1ef954d-4ede-45aa-b218-9c5942d96332 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4536a0bb
2021-06-04T00:58:50.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1ef954d-4ede-45aa-b218-9c5942d96332 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:58:50.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1ef954d-4ede-45aa-b218-9c5942d96332 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:58:52.622Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48a6fc80-d7a5-44fe-b078-61b70592020e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:58:52.622Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48a6fc80-d7a5-44fe-b078-61b70592020e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5080ac05
2021-06-04T00:58:52.622Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48a6fc80-d7a5-44fe-b078-61b70592020e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:58:52.622Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48a6fc80-d7a5-44fe-b078-61b70592020e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:58:55.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1ca7f0f-4e38-4307-84ab-75480aa08d95 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:58:55.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1ca7f0f-4e38-4307-84ab-75480aa08d95 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f2de7ad
2021-06-04T00:58:55.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1ca7f0f-4e38-4307-84ab-75480aa08d95 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:58:55.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1ca7f0f-4e38-4307-84ab-75480aa08d95 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:58:59.080Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e731e03-63e4-40d3-8383-a43363ee6f6e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:58:59.080Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e731e03-63e4-40d3-8383-a43363ee6f6e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15e9a270
2021-06-04T00:58:59.080Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e731e03-63e4-40d3-8383-a43363ee6f6e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:58:59.080Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e731e03-63e4-40d3-8383-a43363ee6f6e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:59:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f04eff34-eee5-462e-93ee-e8d02ea3a4af PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:59:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f04eff34-eee5-462e-93ee-e8d02ea3a4af PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65aaeb0e
2021-06-04T00:59:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f04eff34-eee5-462e-93ee-e8d02ea3a4af PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:59:01.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f04eff34-eee5-462e-93ee-e8d02ea3a4af PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:59:04.478Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f04eff34-eee5-462e-93ee-e8d02ea3a4af ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:59:04.478Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f04eff34-eee5-462e-93ee-e8d02ea3a4af ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:59:04.478Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f04eff34-eee5-462e-93ee-e8d02ea3a4af ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:59:04.478Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f04eff34-eee5-462e-93ee-e8d02ea3a4af ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:59:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c3b2333-5e6d-4c77-ba7a-68e8daa3b97c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:59:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c3b2333-5e6d-4c77-ba7a-68e8daa3b97c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@301f833a
2021-06-04T00:59:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c3b2333-5e6d-4c77-ba7a-68e8daa3b97c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:59:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c3b2333-5e6d-4c77-ba7a-68e8daa3b97c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:59:07.965Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=5c3b2333-5e6d-4c77-ba7a-68e8daa3b97c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:59:07.965Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=5c3b2333-5e6d-4c77-ba7a-68e8daa3b97c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:59:08.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4b191ee-01c9-45f6-b9ba-0a5a54583df7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:59:08.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4b191ee-01c9-45f6-b9ba-0a5a54583df7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68adc448
2021-06-04T00:59:08.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4b191ee-01c9-45f6-b9ba-0a5a54583df7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:59:08.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4b191ee-01c9-45f6-b9ba-0a5a54583df7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:59:09.620Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b4b191ee-01c9-45f6-b9ba-0a5a54583df7 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:59:09.620Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b4b191ee-01c9-45f6-b9ba-0a5a54583df7 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:59:10.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d667b826-52ae-47d8-b59b-bba4fa24f47e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:59:10.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d667b826-52ae-47d8-b59b-bba4fa24f47e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@16a7feec
2021-06-04T00:59:10.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d667b826-52ae-47d8-b59b-bba4fa24f47e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:59:10.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d667b826-52ae-47d8-b59b-bba4fa24f47e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:59:13.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e18900f8-30a1-4f70-9698-0927ff87b6cd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:59:13.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e18900f8-30a1-4f70-9698-0927ff87b6cd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e30f1e1
2021-06-04T00:59:13.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e18900f8-30a1-4f70-9698-0927ff87b6cd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:59:13.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e18900f8-30a1-4f70-9698-0927ff87b6cd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:59:16.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d16932c-ff0d-409c-805d-db8d0ad634fc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:59:16.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d16932c-ff0d-409c-805d-db8d0ad634fc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58b9e1eb
2021-06-04T00:59:16.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d16932c-ff0d-409c-805d-db8d0ad634fc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:59:16.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d16932c-ff0d-409c-805d-db8d0ad634fc PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:59:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91f5a24d-ded3-43a7-9847-3406d775c21b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:59:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91f5a24d-ded3-43a7-9847-3406d775c21b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6fe571d4
2021-06-04T00:59:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91f5a24d-ded3-43a7-9847-3406d775c21b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:59:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91f5a24d-ded3-43a7-9847-3406d775c21b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:59:22.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce0a0cce-36fa-424f-8730-5e180bfe68b3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:59:22.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce0a0cce-36fa-424f-8730-5e180bfe68b3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@461ca25a
2021-06-04T00:59:22.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce0a0cce-36fa-424f-8730-5e180bfe68b3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:59:22.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce0a0cce-36fa-424f-8730-5e180bfe68b3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:59:25.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7236386c-2668-4b5f-81c3-7fe46b9ee8c9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:59:25.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7236386c-2668-4b5f-81c3-7fe46b9ee8c9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4cf45b22
2021-06-04T00:59:25.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7236386c-2668-4b5f-81c3-7fe46b9ee8c9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:59:25.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7236386c-2668-4b5f-81c3-7fe46b9ee8c9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:59:29.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0acd5ca4-f7be-4f9f-aeaa-5e3d5d5bf9d2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:59:29.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0acd5ca4-f7be-4f9f-aeaa-5e3d5d5bf9d2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f593e94
2021-06-04T00:59:29.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0acd5ca4-f7be-4f9f-aeaa-5e3d5d5bf9d2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:59:29.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0acd5ca4-f7be-4f9f-aeaa-5e3d5d5bf9d2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:59:31.453Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6c11e3c-893f-4b69-8718-109b751c8e77 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:59:31.454Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6c11e3c-893f-4b69-8718-109b751c8e77 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@270f491a
2021-06-04T00:59:31.454Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6c11e3c-893f-4b69-8718-109b751c8e77 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:59:31.454Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6c11e3c-893f-4b69-8718-109b751c8e77 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:59:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a28f7be4-7f4d-41a6-9026-c0570bacc103 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:59:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a28f7be4-7f4d-41a6-9026-c0570bacc103 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@70828757
2021-06-04T00:59:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a28f7be4-7f4d-41a6-9026-c0570bacc103 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:59:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a28f7be4-7f4d-41a6-9026-c0570bacc103 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:59:37.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41fcf7ac-b2fb-4fcd-a5c3-bef531d0149a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:59:37.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41fcf7ac-b2fb-4fcd-a5c3-bef531d0149a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ec1ef2e
2021-06-04T00:59:37.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41fcf7ac-b2fb-4fcd-a5c3-bef531d0149a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:59:37.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41fcf7ac-b2fb-4fcd-a5c3-bef531d0149a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:59:40.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6343084-611b-41b5-9f48-feae9b0b72d9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:59:40.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6343084-611b-41b5-9f48-feae9b0b72d9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38cadffc
2021-06-04T00:59:40.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6343084-611b-41b5-9f48-feae9b0b72d9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:59:40.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6343084-611b-41b5-9f48-feae9b0b72d9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:59:43.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67a201aa-ce0d-408b-adde-3fd720b7bc52 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:59:43.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67a201aa-ce0d-408b-adde-3fd720b7bc52 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65501666
2021-06-04T00:59:43.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67a201aa-ce0d-408b-adde-3fd720b7bc52 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:59:43.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67a201aa-ce0d-408b-adde-3fd720b7bc52 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:59:46.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fcd8cc4-fbdc-4a26-8de1-c45807646d6d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:59:46.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fcd8cc4-fbdc-4a26-8de1-c45807646d6d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@18c9da4
2021-06-04T00:59:46.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fcd8cc4-fbdc-4a26-8de1-c45807646d6d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:59:46.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fcd8cc4-fbdc-4a26-8de1-c45807646d6d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:59:49.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=328610f8-1cf8-424f-9d63-320142e7a66c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:59:49.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=328610f8-1cf8-424f-9d63-320142e7a66c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1025ba24
2021-06-04T00:59:49.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=328610f8-1cf8-424f-9d63-320142e7a66c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:59:49.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=328610f8-1cf8-424f-9d63-320142e7a66c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:59:50.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T00:59:50.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T00:59:52.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae2e22d8-30db-41f4-ba55-318a6a924409 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:59:52.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae2e22d8-30db-41f4-ba55-318a6a924409 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7efeb2e3
2021-06-04T00:59:52.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae2e22d8-30db-41f4-ba55-318a6a924409 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:59:52.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae2e22d8-30db-41f4-ba55-318a6a924409 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:59:52.720Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T00:59:52.818Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ae2e22d8-30db-41f4-ba55-318a6a924409 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:59:52.818Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=ae2e22d8-30db-41f4-ba55-318a6a924409 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T00:59:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=138d72ee-0b69-4150-8885-1dd6f00ad1d1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:59:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=138d72ee-0b69-4150-8885-1dd6f00ad1d1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1bf8687c
2021-06-04T00:59:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=138d72ee-0b69-4150-8885-1dd6f00ad1d1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:59:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=138d72ee-0b69-4150-8885-1dd6f00ad1d1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T00:59:59.022Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=138d72ee-0b69-4150-8885-1dd6f00ad1d1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T00:59:59.022Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=138d72ee-0b69-4150-8885-1dd6f00ad1d1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T00:59:59.022Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=138d72ee-0b69-4150-8885-1dd6f00ad1d1 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:59:59.022Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=138d72ee-0b69-4150-8885-1dd6f00ad1d1 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T00:59:59.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8339f7d2-638d-4f56-a2fe-a4e6efcb25c2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T00:59:59.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8339f7d2-638d-4f56-a2fe-a4e6efcb25c2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7efcb71a
2021-06-04T00:59:59.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8339f7d2-638d-4f56-a2fe-a4e6efcb25c2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T00:59:59.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8339f7d2-638d-4f56-a2fe-a4e6efcb25c2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:00:02.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:00:02.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:00:02.652Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8339f7d2-638d-4f56-a2fe-a4e6efcb25c2 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:00:02.652Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8339f7d2-638d-4f56-a2fe-a4e6efcb25c2 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:00:03.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b1184e6-10ae-4871-8868-80e2377b18a9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:00:03.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b1184e6-10ae-4871-8868-80e2377b18a9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@48571d54
2021-06-04T01:00:03.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b1184e6-10ae-4871-8868-80e2377b18a9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:00:03.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b1184e6-10ae-4871-8868-80e2377b18a9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:00:05.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:00:06.153Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3b1184e6-10ae-4871-8868-80e2377b18a9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:00:06.153Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3b1184e6-10ae-4871-8868-80e2377b18a9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:00:06.153Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3b1184e6-10ae-4871-8868-80e2377b18a9 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:00:06.153Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=3b1184e6-10ae-4871-8868-80e2377b18a9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T01:00:06.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55f5a58e-5b58-4891-9394-2e6298b18adc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:00:06.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55f5a58e-5b58-4891-9394-2e6298b18adc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@beb16d1
2021-06-04T01:00:06.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55f5a58e-5b58-4891-9394-2e6298b18adc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:00:06.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55f5a58e-5b58-4891-9394-2e6298b18adc PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:00:08.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:00:10.036Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=55f5a58e-5b58-4891-9394-2e6298b18adc ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:00:10.037Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=55f5a58e-5b58-4891-9394-2e6298b18adc ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:00:10.391Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f955601-075d-4883-b5e9-eb0dde571c82 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:00:10.391Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f955601-075d-4883-b5e9-eb0dde571c82 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@16cd83e0
2021-06-04T01:00:10.391Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f955601-075d-4883-b5e9-eb0dde571c82 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:00:10.391Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f955601-075d-4883-b5e9-eb0dde571c82 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:00:11.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:00:13.432Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=6f955601-075d-4883-b5e9-eb0dde571c82 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:00:13.433Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=6f955601-075d-4883-b5e9-eb0dde571c82 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:00:13.839Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d51bf86b-1321-4edb-8b3c-19ce4dd5ac83 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:00:13.839Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d51bf86b-1321-4edb-8b3c-19ce4dd5ac83 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74fb3855
2021-06-04T01:00:13.839Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d51bf86b-1321-4edb-8b3c-19ce4dd5ac83 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:00:13.839Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d51bf86b-1321-4edb-8b3c-19ce4dd5ac83 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:00:14.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:00:16.876Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d51bf86b-1321-4edb-8b3c-19ce4dd5ac83 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:00:16.877Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d51bf86b-1321-4edb-8b3c-19ce4dd5ac83 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:00:17.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:00:17.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=673cb012-034a-44d8-a9df-3ac37bb0ec52 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:00:17.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=673cb012-034a-44d8-a9df-3ac37bb0ec52 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ccf5ceb
2021-06-04T01:00:17.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=673cb012-034a-44d8-a9df-3ac37bb0ec52 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:00:17.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=673cb012-034a-44d8-a9df-3ac37bb0ec52 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:00:20.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:00:20.718Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=673cb012-034a-44d8-a9df-3ac37bb0ec52 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:00:20.718Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=673cb012-034a-44d8-a9df-3ac37bb0ec52 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:00:20.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7127730a-47a8-468d-83c6-7bbcad89d911 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:00:20.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7127730a-47a8-468d-83c6-7bbcad89d911 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49d93105
2021-06-04T01:00:20.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7127730a-47a8-468d-83c6-7bbcad89d911 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:00:20.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7127730a-47a8-468d-83c6-7bbcad89d911 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:00:23.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:00:23.874Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=7127730a-47a8-468d-83c6-7bbcad89d911 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:00:23.874Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=7127730a-47a8-468d-83c6-7bbcad89d911 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:00:24.414Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8e76ff4-fa43-4729-a5c4-e171f9e7e7bd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:00:24.414Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8e76ff4-fa43-4729-a5c4-e171f9e7e7bd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7154aa57
2021-06-04T01:00:24.414Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8e76ff4-fa43-4729-a5c4-e171f9e7e7bd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:00:24.414Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8e76ff4-fa43-4729-a5c4-e171f9e7e7bd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:00:26.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:00:27.458Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f8e76ff4-fa43-4729-a5c4-e171f9e7e7bd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:00:27.458Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f8e76ff4-fa43-4729-a5c4-e171f9e7e7bd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:00:28.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f09aee39-5606-490c-b031-cf5a38021e02 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:00:28.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f09aee39-5606-490c-b031-cf5a38021e02 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79e2d0c2
2021-06-04T01:00:28.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f09aee39-5606-490c-b031-cf5a38021e02 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:00:28.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f09aee39-5606-490c-b031-cf5a38021e02 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:00:29.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:00:31.159Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f09aee39-5606-490c-b031-cf5a38021e02 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:00:31.159Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f09aee39-5606-490c-b031-cf5a38021e02 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:00:31.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4423b93f-d8ac-4e37-980a-695e829c2601 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:00:31.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4423b93f-d8ac-4e37-980a-695e829c2601 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e3bd811
2021-06-04T01:00:31.281Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4423b93f-d8ac-4e37-980a-695e829c2601 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:00:31.281Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4423b93f-d8ac-4e37-980a-695e829c2601 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:00:32.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:00:34.332Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=4423b93f-d8ac-4e37-980a-695e829c2601 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:00:34.332Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=4423b93f-d8ac-4e37-980a-695e829c2601 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:00:34.777Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3c7cb79-a5c1-46eb-bc66-3e3c438e2874 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:00:34.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3c7cb79-a5c1-46eb-bc66-3e3c438e2874 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@14593b81
2021-06-04T01:00:34.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3c7cb79-a5c1-46eb-bc66-3e3c438e2874 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:00:34.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3c7cb79-a5c1-46eb-bc66-3e3c438e2874 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:00:35.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:00:37.808Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a3c7cb79-a5c1-46eb-bc66-3e3c438e2874 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:00:37.808Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a3c7cb79-a5c1-46eb-bc66-3e3c438e2874 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:00:38.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:00:38.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ae30dd7-4b10-4dfa-b7b7-ed3e3ef52c42 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:00:38.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ae30dd7-4b10-4dfa-b7b7-ed3e3ef52c42 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50a75c4c
2021-06-04T01:00:38.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ae30dd7-4b10-4dfa-b7b7-ed3e3ef52c42 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:00:38.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ae30dd7-4b10-4dfa-b7b7-ed3e3ef52c42 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:00:41.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:00:41.618Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=5ae30dd7-4b10-4dfa-b7b7-ed3e3ef52c42 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:00:41.618Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=5ae30dd7-4b10-4dfa-b7b7-ed3e3ef52c42 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:00:41.743Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee7a21f1-f119-4bcb-aa08-aeb23215afe2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:00:41.743Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee7a21f1-f119-4bcb-aa08-aeb23215afe2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@62457ab8
2021-06-04T01:00:41.743Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee7a21f1-f119-4bcb-aa08-aeb23215afe2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:00:41.743Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee7a21f1-f119-4bcb-aa08-aeb23215afe2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:00:43.887Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=ApplicationDataTypesCache Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177)
at org.apache.tinkerpop.gremlin.structure.Element.keys(Element.java:69)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getProperties(JanusGraphGenericDao.java:1491)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getByCriteria(JanusGraphGenericDao.java:759)
at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypeNodes(PropertyOperation.java:1566)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.findAllDataTypesLazy(ApplicationDataTypeCache.java:309)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.hasDataTypesChanged(ApplicationDataTypeCache.java:220)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:200)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T01:00:43.895Z [JanusGraph-Health-Check-Thread] INFO o.j.d.util.BackendOperation Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.execute(VertexCentricQueryBuilder.java:73)
at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.properties(VertexCentricQueryBuilder.java:100)
at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177)
at org.apache.tinkerpop.gremlin.structure.Vertex.property(Vertex.java:70)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:341)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:336)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
... 4 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T01:00:44.072Z [cluster1-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T01:00:44.073Z [cluster1-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 2000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:00:44.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:00:44.779Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ee7a21f1-f119-4bcb-aa08-aeb23215afe2 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:00:44.779Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ee7a21f1-f119-4bcb-aa08-aeb23215afe2 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:00:45.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1987f837-2e79-49de-99be-325eb5dce5a7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:00:45.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1987f837-2e79-49de-99be-325eb5dce5a7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7fa9acbb
2021-06-04T01:00:45.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1987f837-2e79-49de-99be-325eb5dce5a7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:00:45.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1987f837-2e79-49de-99be-325eb5dce5a7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:00:47.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:00:48.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aee6ffec-c3fc-4cdb-84a7-a04a2c6ed6fd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:00:48.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aee6ffec-c3fc-4cdb-84a7-a04a2c6ed6fd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@67e3ddf1
2021-06-04T01:00:48.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aee6ffec-c3fc-4cdb-84a7-a04a2c6ed6fd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:00:48.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aee6ffec-c3fc-4cdb-84a7-a04a2c6ed6fd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:00:50.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:00:51.074Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=aee6ffec-c3fc-4cdb-84a7-a04a2c6ed6fd ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:00:51.074Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=aee6ffec-c3fc-4cdb-84a7-a04a2c6ed6fd ErrorCategory=ERROR ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T01:00:51.858Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80f81d2d-f20e-45e3-9a60-4a903dab756b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:00:51.858Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80f81d2d-f20e-45e3-9a60-4a903dab756b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@447df3e9
2021-06-04T01:00:51.859Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80f81d2d-f20e-45e3-9a60-4a903dab756b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:00:51.859Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80f81d2d-f20e-45e3-9a60-4a903dab756b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:00:52.263Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce97584f-55fe-4b9f-b629-a6dc7eee253b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:00:52.263Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce97584f-55fe-4b9f-b629-a6dc7eee253b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@760353a9
2021-06-04T01:00:52.263Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce97584f-55fe-4b9f-b629-a6dc7eee253b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:00:52.263Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce97584f-55fe-4b9f-b629-a6dc7eee253b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:00:52.820Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:00:53.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31ba62e0-40ef-4594-ac8a-74bd9a9570a8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:00:53.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31ba62e0-40ef-4594-ac8a-74bd9a9570a8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@f51341f
2021-06-04T01:00:53.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31ba62e0-40ef-4594-ac8a-74bd9a9570a8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:00:53.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31ba62e0-40ef-4594-ac8a-74bd9a9570a8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:00:53.789Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=31ba62e0-40ef-4594-ac8a-74bd9a9570a8 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:00:53.789Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=31ba62e0-40ef-4594-ac8a-74bd9a9570a8 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:00:54.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4ff1e08-9eb2-43b9-9eae-d0bf7488f7bc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:00:54.135Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4ff1e08-9eb2-43b9-9eae-d0bf7488f7bc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@76a46c51
2021-06-04T01:00:54.135Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4ff1e08-9eb2-43b9-9eae-d0bf7488f7bc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:00:54.135Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4ff1e08-9eb2-43b9-9eae-d0bf7488f7bc PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:00:55.778Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:00:55.783Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:00:55.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27fe7f9f-ef87-4089-8f91-2e1aa1e92c6b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:00:55.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27fe7f9f-ef87-4089-8f91-2e1aa1e92c6b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d6d2bd7
2021-06-04T01:00:55.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27fe7f9f-ef87-4089-8f91-2e1aa1e92c6b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:00:55.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27fe7f9f-ef87-4089-8f91-2e1aa1e92c6b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:00:58.883Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=27fe7f9f-ef87-4089-8f91-2e1aa1e92c6b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:00:58.884Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=27fe7f9f-ef87-4089-8f91-2e1aa1e92c6b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:00:58.884Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=27fe7f9f-ef87-4089-8f91-2e1aa1e92c6b ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:00:58.884Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=27fe7f9f-ef87-4089-8f91-2e1aa1e92c6b ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:00:59.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:00:59.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:01:01.591Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:01:02.766Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa9cdd55-85b4-4c99-a203-0369e0612c29 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:01:02.766Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa9cdd55-85b4-4c99-a203-0369e0612c29 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@319fb5c8
2021-06-04T01:01:02.766Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa9cdd55-85b4-4c99-a203-0369e0612c29 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:01:02.766Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa9cdd55-85b4-4c99-a203-0369e0612c29 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:01:03.024Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fa9cdd55-85b4-4c99-a203-0369e0612c29 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:01:03.024Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fa9cdd55-85b4-4c99-a203-0369e0612c29 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:01:03.529Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2c0b06d-135f-4b8e-b617-ba053d4e4131 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:01:03.529Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2c0b06d-135f-4b8e-b617-ba053d4e4131 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@62fbba60
2021-06-04T01:01:03.529Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2c0b06d-135f-4b8e-b617-ba053d4e4131 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:01:03.529Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2c0b06d-135f-4b8e-b617-ba053d4e4131 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:01:03.698Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 503 Service Unavailable
2021-06-04T01:01:03.699Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 503
2021-06-04T01:01:03.700Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=503, variables=[]]
2021-06-04T01:01:03.700Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T01:01:03.700Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T01:01:03.701Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T01:01:03.701Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T01:01:04.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9faf1ebd-ad7f-48a7-b53e-82c9f18aa02f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:01:04.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9faf1ebd-ad7f-48a7-b53e-82c9f18aa02f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@567c067b
2021-06-04T01:01:04.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9faf1ebd-ad7f-48a7-b53e-82c9f18aa02f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:01:04.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9faf1ebd-ad7f-48a7-b53e-82c9f18aa02f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:01:05.852Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 503 Service Unavailable
2021-06-04T01:01:05.852Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 503
2021-06-04T01:01:05.852Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=503, variables=[]]
2021-06-04T01:01:05.852Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T01:01:05.852Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T01:01:05.852Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T01:01:05.852Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T01:01:05.902Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:01:05.903Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:01:08.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51e4b637-c1a3-409b-b1d5-1c9886d11bed PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:01:08.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51e4b637-c1a3-409b-b1d5-1c9886d11bed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a01c889
2021-06-04T01:01:08.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51e4b637-c1a3-409b-b1d5-1c9886d11bed PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:01:08.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51e4b637-c1a3-409b-b1d5-1c9886d11bed PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:01:10.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d80dcbe2-853e-44bb-815d-16c80b7265a4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:01:10.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d80dcbe2-853e-44bb-815d-16c80b7265a4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@696b0c3f
2021-06-04T01:01:10.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d80dcbe2-853e-44bb-815d-16c80b7265a4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:01:10.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d80dcbe2-853e-44bb-815d-16c80b7265a4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:01:13.831Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:01:13.832Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:01:14.683Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=526efa39-6bd1-4407-8595-f905fd34fdfa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:01:14.683Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=526efa39-6bd1-4407-8595-f905fd34fdfa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@567c93c8
2021-06-04T01:01:14.683Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=526efa39-6bd1-4407-8595-f905fd34fdfa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:01:14.683Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=526efa39-6bd1-4407-8595-f905fd34fdfa PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:01:15.707Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:01:15.709Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:01:15.723Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 503 Service Unavailable
2021-06-04T01:01:15.724Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 503
2021-06-04T01:01:15.725Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=503, variables=[]]
2021-06-04T01:01:15.725Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T01:01:15.725Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T01:01:15.725Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T01:01:15.725Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T01:01:16.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fe737a9-0943-4c53-b6ae-c5053dd774b8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:01:16.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fe737a9-0943-4c53-b6ae-c5053dd774b8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@608508a2
2021-06-04T01:01:16.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fe737a9-0943-4c53-b6ae-c5053dd774b8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:01:16.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fe737a9-0943-4c53-b6ae-c5053dd774b8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:01:19.663Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:01:19.664Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:01:19.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80955662-6be9-4a2a-aa08-5fd638b3498c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:01:19.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80955662-6be9-4a2a-aa08-5fd638b3498c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74d4d1bb
2021-06-04T01:01:19.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80955662-6be9-4a2a-aa08-5fd638b3498c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:01:19.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80955662-6be9-4a2a-aa08-5fd638b3498c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:01:19.819Z [BE-Health-Check-Task] INFO o.a.http.impl.execchain.RetryExec RequestID=80955662-6be9-4a2a-aa08-5fd638b3498c PartnerName=SDC.BE I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {s}->https://sdc-onboarding-be.onap:8445: The target server failed to respond
2021-06-04T01:01:19.819Z [BE-Health-Check-Task] INFO o.a.http.impl.execchain.RetryExec RequestID=80955662-6be9-4a2a-aa08-5fd638b3498c PartnerName=SDC.BE Retrying request to {s}->https://sdc-onboarding-be.onap:8445
2021-06-04T01:01:19.820Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=80955662-6be9-4a2a-aa08-5fd638b3498c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T01:01:19.821Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=80955662-6be9-4a2a-aa08-5fd638b3498c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:01:19.821Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=80955662-6be9-4a2a-aa08-5fd638b3498c ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:01:19.821Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=80955662-6be9-4a2a-aa08-5fd638b3498c ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:01:22.531Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72b05e0c-5289-462a-a054-3763aa159b62 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:01:22.531Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72b05e0c-5289-462a-a054-3763aa159b62 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@77bf184c
2021-06-04T01:01:22.531Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72b05e0c-5289-462a-a054-3763aa159b62 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:01:22.531Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72b05e0c-5289-462a-a054-3763aa159b62 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:01:22.532Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=72b05e0c-5289-462a-a054-3763aa159b62 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T01:01:22.532Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=72b05e0c-5289-462a-a054-3763aa159b62 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:01:25.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=faefb680-25e8-48ed-a07e-4ad588fabfcc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:01:25.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=faefb680-25e8-48ed-a07e-4ad588fabfcc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6dbc8945
2021-06-04T01:01:25.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=faefb680-25e8-48ed-a07e-4ad588fabfcc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:01:25.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=faefb680-25e8-48ed-a07e-4ad588fabfcc PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:01:26.581Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 503 Service Unavailable
2021-06-04T01:01:26.581Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 503
2021-06-04T01:01:26.581Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=503, variables=[]]
2021-06-04T01:01:26.582Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T01:01:26.582Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T01:01:26.582Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T01:01:26.582Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T01:01:28.984Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=faefb680-25e8-48ed-a07e-4ad588fabfcc ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:01:28.984Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=faefb680-25e8-48ed-a07e-4ad588fabfcc ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:01:29.068Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:01:29.069Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:01:29.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c81217a-8b40-47e7-a9f8-a68532def9e2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:01:29.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c81217a-8b40-47e7-a9f8-a68532def9e2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e929a61
2021-06-04T01:01:29.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c81217a-8b40-47e7-a9f8-a68532def9e2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:01:29.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c81217a-8b40-47e7-a9f8-a68532def9e2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:01:32.524Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2c81217a-8b40-47e7-a9f8-a68532def9e2 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:01:32.524Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2c81217a-8b40-47e7-a9f8-a68532def9e2 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:01:33.286Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77cc5a52-6bcb-47f0-8662-8adfeedf3f11 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:01:33.286Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77cc5a52-6bcb-47f0-8662-8adfeedf3f11 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@56abcc7a
2021-06-04T01:01:33.286Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77cc5a52-6bcb-47f0-8662-8adfeedf3f11 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:01:33.286Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77cc5a52-6bcb-47f0-8662-8adfeedf3f11 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:01:33.312Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:01:33.313Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:01:36.296Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=77cc5a52-6bcb-47f0-8662-8adfeedf3f11 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:01:36.296Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=77cc5a52-6bcb-47f0-8662-8adfeedf3f11 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:01:36.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40674adb-ba5b-435b-96c3-9e21f9c3b66a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:01:36.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40674adb-ba5b-435b-96c3-9e21f9c3b66a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@493e831e
2021-06-04T01:01:36.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40674adb-ba5b-435b-96c3-9e21f9c3b66a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:01:36.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40674adb-ba5b-435b-96c3-9e21f9c3b66a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:01:39.402Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 503 Service Unavailable
2021-06-04T01:01:39.403Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 503
2021-06-04T01:01:39.403Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=503, variables=[]]
2021-06-04T01:01:39.403Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T01:01:39.403Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T01:01:39.403Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T01:01:39.403Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T01:01:39.410Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:01:39.410Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:01:39.888Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=40674adb-ba5b-435b-96c3-9e21f9c3b66a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:01:39.889Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=40674adb-ba5b-435b-96c3-9e21f9c3b66a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:01:39.960Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 503 Service Unavailable
2021-06-04T01:01:39.960Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 503
2021-06-04T01:01:39.960Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=503, variables=[]]
2021-06-04T01:01:40.376Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d61179b7-dc72-482c-9f6c-49bdd4cd86d3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:01:40.376Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d61179b7-dc72-482c-9f6c-49bdd4cd86d3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a522f49
2021-06-04T01:01:40.377Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d61179b7-dc72-482c-9f6c-49bdd4cd86d3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:01:40.377Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d61179b7-dc72-482c-9f6c-49bdd4cd86d3 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:01:41.518Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:01:41.520Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:01:41.579Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:01:41.581Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:01:41.636Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:01:41.637Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:01:41.966Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:01:41.968Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:01:43.299Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:01:43.300Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:01:43.384Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d61179b7-dc72-482c-9f6c-49bdd4cd86d3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:01:43.384Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d61179b7-dc72-482c-9f6c-49bdd4cd86d3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:01:43.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff92f000-692a-4d15-adaf-51402faf67a5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:01:43.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff92f000-692a-4d15-adaf-51402faf67a5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e515694
2021-06-04T01:01:43.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff92f000-692a-4d15-adaf-51402faf67a5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:01:43.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff92f000-692a-4d15-adaf-51402faf67a5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:01:44.491Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:01:44.493Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:01:44.573Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:01:44.575Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:01:45.791Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:01:45.792Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:01:46.202Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:01:46.203Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:01:48.961Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T01:01:48.962Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T01:01:48.962Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T01:01:49.818Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ff92f000-692a-4d15-adaf-51402faf67a5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:01:49.818Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ff92f000-692a-4d15-adaf-51402faf67a5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:01:50.621Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f23c3207-cac1-4aeb-b1cd-a597ee8ac5fe PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:01:50.622Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f23c3207-cac1-4aeb-b1cd-a597ee8ac5fe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@208ee1f9
2021-06-04T01:01:50.622Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f23c3207-cac1-4aeb-b1cd-a597ee8ac5fe PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:01:50.622Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f23c3207-cac1-4aeb-b1cd-a597ee8ac5fe PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:01:51.022Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f23c3207-cac1-4aeb-b1cd-a597ee8ac5fe ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:01:51.022Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f23c3207-cac1-4aeb-b1cd-a597ee8ac5fe ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:01:51.258Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75cee5e6-8b9b-4439-ac52-6ebdee01c9ac PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:01:51.258Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75cee5e6-8b9b-4439-ac52-6ebdee01c9ac PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47ca3dea
2021-06-04T01:01:51.258Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75cee5e6-8b9b-4439-ac52-6ebdee01c9ac PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:01:51.258Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75cee5e6-8b9b-4439-ac52-6ebdee01c9ac PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:01:53.825Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ec98748-96aa-44c5-9571-cb71b208e297 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:01:53.825Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ec98748-96aa-44c5-9571-cb71b208e297 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@21dc5aba
2021-06-04T01:01:53.826Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ec98748-96aa-44c5-9571-cb71b208e297 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:01:53.826Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ec98748-96aa-44c5-9571-cb71b208e297 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:01:54.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4fb25f3-854d-4425-b20b-232bee6d533a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:01:54.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4fb25f3-854d-4425-b20b-232bee6d533a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@768af651
2021-06-04T01:01:54.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4fb25f3-854d-4425-b20b-232bee6d533a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:01:54.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4fb25f3-854d-4425-b20b-232bee6d533a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:01:55.064Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:01:55.065Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:01:55.307Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:01:55.308Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:01:55.601Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:01:55.602Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:01:55.654Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:01:55.655Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:01:55.686Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:01:55.687Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:01:55.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=799e4b9a-9152-4b11-916a-fcf5b12c019b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:01:55.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=799e4b9a-9152-4b11-916a-fcf5b12c019b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c2c0e83
2021-06-04T01:01:55.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=799e4b9a-9152-4b11-916a-fcf5b12c019b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:01:55.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=799e4b9a-9152-4b11-916a-fcf5b12c019b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:01:59.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd9171aa-7e17-4587-8aa2-6fc38677e24d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:01:59.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd9171aa-7e17-4587-8aa2-6fc38677e24d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a1f4f81
2021-06-04T01:01:59.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd9171aa-7e17-4587-8aa2-6fc38677e24d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:01:59.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd9171aa-7e17-4587-8aa2-6fc38677e24d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:02:03.187Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b808409a-cb28-4f0e-a907-3b0e21dd7694 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:02:03.187Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b808409a-cb28-4f0e-a907-3b0e21dd7694 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@19d5c7f2
2021-06-04T01:02:03.187Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b808409a-cb28-4f0e-a907-3b0e21dd7694 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:02:03.187Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b808409a-cb28-4f0e-a907-3b0e21dd7694 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:02:05.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de477874-789f-4b70-9fcf-123563739b32 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:02:05.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de477874-789f-4b70-9fcf-123563739b32 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@384c92e7
2021-06-04T01:02:05.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de477874-789f-4b70-9fcf-123563739b32 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:02:05.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de477874-789f-4b70-9fcf-123563739b32 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:02:07.954Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e78f338-84b5-4cc2-aa18-b77f3f77f9cb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:02:07.954Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e78f338-84b5-4cc2-aa18-b77f3f77f9cb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1438db7b
2021-06-04T01:02:07.954Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e78f338-84b5-4cc2-aa18-b77f3f77f9cb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:02:07.955Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e78f338-84b5-4cc2-aa18-b77f3f77f9cb PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:02:10.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16e2d70a-202c-478f-8ab9-83ac4407248d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:02:10.773Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16e2d70a-202c-478f-8ab9-83ac4407248d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34fbfd3a
2021-06-04T01:02:10.773Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16e2d70a-202c-478f-8ab9-83ac4407248d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:02:10.773Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16e2d70a-202c-478f-8ab9-83ac4407248d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:02:12.925Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:02:12.927Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:14.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0fc5428-09fa-48c9-ac7a-42cd9aa99d42 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:02:14.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0fc5428-09fa-48c9-ac7a-42cd9aa99d42 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3265600
2021-06-04T01:02:14.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0fc5428-09fa-48c9-ac7a-42cd9aa99d42 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:02:14.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0fc5428-09fa-48c9-ac7a-42cd9aa99d42 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:02:16.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e78d32db-0b46-4cfe-9039-60bc6cb329a1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:02:16.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e78d32db-0b46-4cfe-9039-60bc6cb329a1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5fa13729
2021-06-04T01:02:16.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e78d32db-0b46-4cfe-9039-60bc6cb329a1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:02:16.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e78d32db-0b46-4cfe-9039-60bc6cb329a1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:02:19.977Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e78d32db-0b46-4cfe-9039-60bc6cb329a1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:02:19.977Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e78d32db-0b46-4cfe-9039-60bc6cb329a1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:02:19.978Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e78d32db-0b46-4cfe-9039-60bc6cb329a1 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:02:19.978Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e78d32db-0b46-4cfe-9039-60bc6cb329a1 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:02:20.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89cf0a0e-2607-4032-8434-514a74dc4e8a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:02:20.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89cf0a0e-2607-4032-8434-514a74dc4e8a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d90cca5
2021-06-04T01:02:20.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89cf0a0e-2607-4032-8434-514a74dc4e8a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:02:20.588Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89cf0a0e-2607-4032-8434-514a74dc4e8a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:02:20.779Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=89cf0a0e-2607-4032-8434-514a74dc4e8a ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:02:20.779Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=89cf0a0e-2607-4032-8434-514a74dc4e8a ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:02:22.117Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:22.117Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:22.611Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fae9ba82-283b-4a0f-96e7-552f3c25ee4b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:02:22.611Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fae9ba82-283b-4a0f-96e7-552f3c25ee4b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57ce3e8b
2021-06-04T01:02:22.612Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fae9ba82-283b-4a0f-96e7-552f3c25ee4b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:02:22.612Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fae9ba82-283b-4a0f-96e7-552f3c25ee4b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:02:25.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=806201fd-921f-4440-a93b-aa8c5983f9d9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:02:25.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=806201fd-921f-4440-a93b-aa8c5983f9d9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1004324
2021-06-04T01:02:25.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=806201fd-921f-4440-a93b-aa8c5983f9d9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:02:25.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=806201fd-921f-4440-a93b-aa8c5983f9d9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:02:29.294Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb7e430d-396f-4f4a-a345-f6dc8355c0a4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:02:29.294Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb7e430d-396f-4f4a-a345-f6dc8355c0a4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a7e5245
2021-06-04T01:02:29.294Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb7e430d-396f-4f4a-a345-f6dc8355c0a4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:02:29.294Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb7e430d-396f-4f4a-a345-f6dc8355c0a4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:02:31.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3c58345-c503-4931-85d8-0a10a6ae0323 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:02:31.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3c58345-c503-4931-85d8-0a10a6ae0323 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@232ec8f8
2021-06-04T01:02:31.647Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3c58345-c503-4931-85d8-0a10a6ae0323 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:02:31.647Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3c58345-c503-4931-85d8-0a10a6ae0323 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:02:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=888b37d0-3305-4572-aa52-7cd9c51a3476 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:02:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=888b37d0-3305-4572-aa52-7cd9c51a3476 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b28070
2021-06-04T01:02:34.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=888b37d0-3305-4572-aa52-7cd9c51a3476 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:02:34.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=888b37d0-3305-4572-aa52-7cd9c51a3476 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:02:38.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13d748a6-a8e1-46ec-8a27-4909053e1b3c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:02:38.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13d748a6-a8e1-46ec-8a27-4909053e1b3c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6a8fa81
2021-06-04T01:02:38.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13d748a6-a8e1-46ec-8a27-4909053e1b3c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:02:38.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13d748a6-a8e1-46ec-8a27-4909053e1b3c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:02:40.689Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32137d82-5035-4c8c-b4ae-20eb6925779f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:02:40.689Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32137d82-5035-4c8c-b4ae-20eb6925779f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e3c6c6b
2021-06-04T01:02:40.690Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32137d82-5035-4c8c-b4ae-20eb6925779f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:02:40.690Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32137d82-5035-4c8c-b4ae-20eb6925779f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:02:42.452Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:42.452Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:42.462Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:42.462Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:42.470Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:42.471Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:42.494Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:42.494Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:42.497Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:42.497Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:42.516Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:42.516Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:42.538Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:42.541Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:42.566Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:42.566Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:42.590Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:42.590Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:42.614Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:42.614Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:42.634Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:42.635Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:42.698Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:42.698Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:42.710Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:42.710Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:42.736Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:42.736Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:42.834Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:42.837Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:42.854Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:42.854Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:42.870Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:42.870Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:42.882Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:42.882Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:42.946Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:42.949Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:42.960Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:42.960Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:42.966Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:42.966Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:42.979Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:42.979Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.007Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:43.008Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:43.026Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.026Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.034Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.034Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.051Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.051Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.064Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:43.066Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:43.082Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.082Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.098Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.098Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.119Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.119Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.135Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:43.136Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:43.168Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.168Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.186Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.186Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.190Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.190Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.206Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:43.207Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:43.266Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.266Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.309Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.309Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.327Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.327Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.334Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:43.336Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:43.354Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.354Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.362Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.362Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.366Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.366Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.378Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:43.379Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:43.462Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.462Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.570Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.570Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.578Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.578Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.594Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:43.595Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:43.597Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.597Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.610Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.610Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.626Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.626Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.634Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:43.635Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:43.650Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.650Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.666Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.666Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.674Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.674Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.686Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:43.687Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:43.702Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.702Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.711Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.712Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.726Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.726Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.738Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:43.739Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:43.750Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.750Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.758Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.758Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.766Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.766Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.778Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:43.779Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:43.783Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.783Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.806Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.806Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.826Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.826Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.836Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:43.837Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:43.846Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.846Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.850Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.850Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.866Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.866Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.878Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:43.879Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:43.894Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.894Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.898Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.898Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.922Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.922Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.934Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:43.935Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:43.937Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.937Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.958Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.958Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.970Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.970Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.978Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:43.979Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:43.986Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.986Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:43.990Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:43.990Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.002Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.002Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.014Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:44.015Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:44.042Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.042Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.053Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.053Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.062Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.062Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.078Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:44.079Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:44.102Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.102Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.122Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.122Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.142Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.142Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.178Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:44.179Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:44.206Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.206Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.210Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.210Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.218Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.218Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.234Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:44.235Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:44.240Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.241Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.254Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.254Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.262Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.262Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.270Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:44.271Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:44.282Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.282Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.290Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.290Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.302Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.302Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.320Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:44.321Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:44.326Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.326Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.334Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.334Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.358Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.358Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.379Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:44.380Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:44.382Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.382Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.384Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.384Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.390Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.390Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.401Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:44.402Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:44.405Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.405Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.430Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.430Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.442Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.442Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.446Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:44.447Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:44.454Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.454Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.458Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.458Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.474Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.474Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.478Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:44.478Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:44.482Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.482Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.486Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.486Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.491Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.491Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.498Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:44.498Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:44.502Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.502Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.518Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.518Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.530Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.530Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.534Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:44.535Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:44.546Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.546Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.558Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.558Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.584Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.584Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.598Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:44.599Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:44.610Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.610Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.614Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.614Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.618Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.618Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.624Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:44.625Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:44.634Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.634Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.638Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.638Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.650Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.650Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.654Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:44.656Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:44.658Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.658Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.666Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.666Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.670Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.670Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.683Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:44.684Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:44.686Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.686Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.699Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.699Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.705Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.705Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.722Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:44.723Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:44.726Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.726Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.734Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.734Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.738Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.738Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.750Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:44.751Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:44.754Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.754Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.762Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.762Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.773Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.773Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.778Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:44.779Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:44.782Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.782Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.790Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.790Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.806Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.806Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.814Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:44.815Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:44.818Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.818Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.826Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.826Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.830Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.830Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.838Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:44.839Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:44.842Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.842Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.854Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.854Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.862Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.862Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.866Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:44.867Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:44.874Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.874Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.878Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.878Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.887Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.887Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.889Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:44.889Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:44.892Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.892Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.926Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.926Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.930Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:44.930Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:44.946Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:46.190Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c90a1eef-a8a2-4694-bff4-867651f6fd99 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:02:46.190Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c90a1eef-a8a2-4694-bff4-867651f6fd99 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b80025c
2021-06-04T01:02:46.190Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c90a1eef-a8a2-4694-bff4-867651f6fd99 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:02:46.190Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c90a1eef-a8a2-4694-bff4-867651f6fd99 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:02:47.279Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c29562d-56a2-465b-970a-13e50619959a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:02:47.279Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c29562d-56a2-465b-970a-13e50619959a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3aa0a65c
2021-06-04T01:02:47.279Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c29562d-56a2-465b-970a-13e50619959a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:02:47.279Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c29562d-56a2-465b-970a-13e50619959a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:02:47.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:50.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4546a93e-ed9d-48e7-b0a4-14632f44fedb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:02:50.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4546a93e-ed9d-48e7-b0a4-14632f44fedb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b9d2f7b
2021-06-04T01:02:50.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4546a93e-ed9d-48e7-b0a4-14632f44fedb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:02:50.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4546a93e-ed9d-48e7-b0a4-14632f44fedb PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:02:53.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0d4fbdb-f4a2-44bd-852c-06873719d4c9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:02:53.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0d4fbdb-f4a2-44bd-852c-06873719d4c9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@665f4b57
2021-06-04T01:02:53.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0d4fbdb-f4a2-44bd-852c-06873719d4c9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:02:53.220Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0d4fbdb-f4a2-44bd-852c-06873719d4c9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:02:56.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e6a8fb5-950d-48f9-8893-96047ae8f417 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:02:56.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e6a8fb5-950d-48f9-8893-96047ae8f417 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4d662722
2021-06-04T01:02:56.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e6a8fb5-950d-48f9-8893-96047ae8f417 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:02:56.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e6a8fb5-950d-48f9-8893-96047ae8f417 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:02:56.232Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:02:56.234Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:02:56.270Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:56.270Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:56.277Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:56.277Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:56.298Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:02:56.298Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:02:56.301Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:02:59.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55b30e72-0aad-4fe1-bf04-4e688d0d8c99 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:02:59.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55b30e72-0aad-4fe1-bf04-4e688d0d8c99 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@72cbfa94
2021-06-04T01:02:59.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55b30e72-0aad-4fe1-bf04-4e688d0d8c99 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:02:59.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55b30e72-0aad-4fe1-bf04-4e688d0d8c99 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:03:01.599Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64b2fb3d-984b-4fd0-a849-cae1e6820ded PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:03:01.599Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64b2fb3d-984b-4fd0-a849-cae1e6820ded PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60bfe541
2021-06-04T01:03:01.599Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64b2fb3d-984b-4fd0-a849-cae1e6820ded PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:03:01.599Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64b2fb3d-984b-4fd0-a849-cae1e6820ded PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:03:02.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:03:04.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4fc4a6d-b2d4-4c08-b06a-b1e3f6a325a4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:03:04.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4fc4a6d-b2d4-4c08-b06a-b1e3f6a325a4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ca60ff2
2021-06-04T01:03:04.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4fc4a6d-b2d4-4c08-b06a-b1e3f6a325a4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:03:04.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4fc4a6d-b2d4-4c08-b06a-b1e3f6a325a4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:03:07.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30eef728-06c1-476e-85eb-80b8870b524f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:03:07.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30eef728-06c1-476e-85eb-80b8870b524f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@857873
2021-06-04T01:03:07.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30eef728-06c1-476e-85eb-80b8870b524f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:03:07.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30eef728-06c1-476e-85eb-80b8870b524f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:03:10.806Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=226c294a-909b-4fdb-9aa7-5afb0cf1135c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:03:10.806Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=226c294a-909b-4fdb-9aa7-5afb0cf1135c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2db72dad
2021-06-04T01:03:10.806Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=226c294a-909b-4fdb-9aa7-5afb0cf1135c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:03:10.806Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=226c294a-909b-4fdb-9aa7-5afb0cf1135c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:03:14.148Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85d9eebe-2d25-423f-86b1-b69e9ce72938 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:03:14.148Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85d9eebe-2d25-423f-86b1-b69e9ce72938 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@323d40b7
2021-06-04T01:03:14.148Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85d9eebe-2d25-423f-86b1-b69e9ce72938 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:03:14.148Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85d9eebe-2d25-423f-86b1-b69e9ce72938 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:03:17.780Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2407930a-176e-436d-bdf1-3bee32365e39 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:03:17.780Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2407930a-176e-436d-bdf1-3bee32365e39 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e28109d
2021-06-04T01:03:17.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2407930a-176e-436d-bdf1-3bee32365e39 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:03:17.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2407930a-176e-436d-bdf1-3bee32365e39 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:03:20.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c69dc01d-78c9-4e05-b7ab-2c8038454b69 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:03:20.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c69dc01d-78c9-4e05-b7ab-2c8038454b69 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@55c5b9cb
2021-06-04T01:03:20.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c69dc01d-78c9-4e05-b7ab-2c8038454b69 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:03:20.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c69dc01d-78c9-4e05-b7ab-2c8038454b69 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:03:23.021Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=c69dc01d-78c9-4e05-b7ab-2c8038454b69 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:03:23.022Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=c69dc01d-78c9-4e05-b7ab-2c8038454b69 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:03:23.022Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c69dc01d-78c9-4e05-b7ab-2c8038454b69 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:03:23.022Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c69dc01d-78c9-4e05-b7ab-2c8038454b69 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:03:28.179Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edad35a5-1d5e-4605-aaab-f5bf64ce2231 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:03:28.179Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edad35a5-1d5e-4605-aaab-f5bf64ce2231 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@410b3c9b
2021-06-04T01:03:28.179Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edad35a5-1d5e-4605-aaab-f5bf64ce2231 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:03:28.179Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edad35a5-1d5e-4605-aaab-f5bf64ce2231 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:03:29.620Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=edad35a5-1d5e-4605-aaab-f5bf64ce2231 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:03:29.620Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=edad35a5-1d5e-4605-aaab-f5bf64ce2231 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:03:30.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ad600cc-76c5-4141-adbd-52e1821c12a1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:03:30.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ad600cc-76c5-4141-adbd-52e1821c12a1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27f9a3bd
2021-06-04T01:03:30.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ad600cc-76c5-4141-adbd-52e1821c12a1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:03:30.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ad600cc-76c5-4141-adbd-52e1821c12a1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:03:31.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cfd8feb9-9ed0-4402-91d9-979d06b1bd8b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:03:31.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cfd8feb9-9ed0-4402-91d9-979d06b1bd8b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f0a5d68
2021-06-04T01:03:31.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cfd8feb9-9ed0-4402-91d9-979d06b1bd8b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:03:31.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cfd8feb9-9ed0-4402-91d9-979d06b1bd8b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:03:46.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=271c231c-9ed0-4ae3-a58a-9a2a4570f809 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:03:46.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=271c231c-9ed0-4ae3-a58a-9a2a4570f809 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@477d5df6
2021-06-04T01:03:46.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=271c231c-9ed0-4ae3-a58a-9a2a4570f809 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:03:46.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=271c231c-9ed0-4ae3-a58a-9a2a4570f809 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:03:47.871Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:03:47.871Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:03:48.872Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:03:49.762Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=271c231c-9ed0-4ae3-a58a-9a2a4570f809 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:03:49.762Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=271c231c-9ed0-4ae3-a58a-9a2a4570f809 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:03:49.763Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=271c231c-9ed0-4ae3-a58a-9a2a4570f809 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:03:49.763Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=271c231c-9ed0-4ae3-a58a-9a2a4570f809 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:03:49.872Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:03:50.872Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:03:51.873Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:03:53.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:03:55.863Z [JanusGraph-Health-Check-Thread] INFO o.j.d.util.BackendOperation Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.execute(VertexCentricQueryBuilder.java:73)
at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.properties(VertexCentricQueryBuilder.java:100)
at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177)
at org.apache.tinkerpop.gremlin.structure.Vertex.property(Vertex.java:70)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:341)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:336)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
... 4 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308)
at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 26 common frames omitted
2021-06-04T01:03:56.479Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:03:56.858Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=002ff482-520c-476b-98ab-b6ad8f48e9fb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:03:56.858Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=002ff482-520c-476b-98ab-b6ad8f48e9fb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f745a0
2021-06-04T01:03:56.858Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=002ff482-520c-476b-98ab-b6ad8f48e9fb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:03:56.858Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=002ff482-520c-476b-98ab-b6ad8f48e9fb PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:03:59.904Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=002ff482-520c-476b-98ab-b6ad8f48e9fb ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:03:59.905Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=002ff482-520c-476b-98ab-b6ad8f48e9fb ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:03:59.905Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=002ff482-520c-476b-98ab-b6ad8f48e9fb ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:03:59.905Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=002ff482-520c-476b-98ab-b6ad8f48e9fb ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T01:04:02.859Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e98b2aa6-deff-454d-85cd-964da060b3d5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:04:02.859Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e98b2aa6-deff-454d-85cd-964da060b3d5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@66951b72
2021-06-04T01:04:02.859Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e98b2aa6-deff-454d-85cd-964da060b3d5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:04:02.859Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e98b2aa6-deff-454d-85cd-964da060b3d5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:04:03.419Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e98b2aa6-deff-454d-85cd-964da060b3d5 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:04:03.419Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e98b2aa6-deff-454d-85cd-964da060b3d5 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:04:08.154Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45de23fb-8554-4238-8c54-d9d01680e343 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:04:08.154Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45de23fb-8554-4238-8c54-d9d01680e343 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@704bfe3b
2021-06-04T01:04:08.154Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45de23fb-8554-4238-8c54-d9d01680e343 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:04:08.154Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45de23fb-8554-4238-8c54-d9d01680e343 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:04:13.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82ce5414-1522-42b1-a8dd-604a785fa91a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:04:13.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82ce5414-1522-42b1-a8dd-604a785fa91a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54c560f0
2021-06-04T01:04:13.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82ce5414-1522-42b1-a8dd-604a785fa91a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:04:13.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82ce5414-1522-42b1-a8dd-604a785fa91a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:04:14.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6f89169-0fd5-4dc2-8bc7-4f7f6c424071 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:04:14.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6f89169-0fd5-4dc2-8bc7-4f7f6c424071 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a45af91
2021-06-04T01:04:14.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6f89169-0fd5-4dc2-8bc7-4f7f6c424071 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:04:14.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6f89169-0fd5-4dc2-8bc7-4f7f6c424071 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:04:15.059Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:04:15.060Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:04:15.076Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:04:15.077Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:04:15.093Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:04:15.094Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:04:15.225Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:04:15.226Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:04:15.251Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:04:15.252Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:04:15.283Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:04:15.284Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:04:15.304Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:04:15.305Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:04:15.323Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:04:15.324Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:04:15.343Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:04:15.344Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:04:15.366Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:04:15.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f56bda01-3f16-43d3-a9da-ce51059b110e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:04:15.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f56bda01-3f16-43d3-a9da-ce51059b110e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23263d2
2021-06-04T01:04:15.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f56bda01-3f16-43d3-a9da-ce51059b110e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:04:15.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f56bda01-3f16-43d3-a9da-ce51059b110e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:04:15.716Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T01:04:15.716Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T01:04:15.717Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T01:04:15.717Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T01:04:15.843Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 503 Service Unavailable
2021-06-04T01:04:15.843Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 503
2021-06-04T01:04:15.844Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=503, variables=[]]
2021-06-04T01:04:15.844Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T01:04:15.844Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T01:04:15.844Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T01:04:15.844Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T01:04:15.904Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 503 Service Unavailable
2021-06-04T01:04:15.904Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 503
2021-06-04T01:04:15.904Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=503, variables=[]]
2021-06-04T01:04:16.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab61fb4d-a9c2-4077-9a26-0b9c91b883f9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:04:16.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab61fb4d-a9c2-4077-9a26-0b9c91b883f9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d27ef89
2021-06-04T01:04:16.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab61fb4d-a9c2-4077-9a26-0b9c91b883f9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:04:16.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab61fb4d-a9c2-4077-9a26-0b9c91b883f9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:04:17.773Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9baa2500-89bd-468e-add7-b0626f0d11ca PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:04:17.773Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9baa2500-89bd-468e-add7-b0626f0d11ca PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@529ac83d
2021-06-04T01:04:17.773Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9baa2500-89bd-468e-add7-b0626f0d11ca PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:04:17.773Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9baa2500-89bd-468e-add7-b0626f0d11ca PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:04:17.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:04:17.975Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:04:17.976Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T01:04:19.458Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7921c7c-fcf7-429d-9686-0617ec8ddcff PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:04:19.458Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7921c7c-fcf7-429d-9686-0617ec8ddcff PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6514dcd8
2021-06-04T01:04:19.458Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7921c7c-fcf7-429d-9686-0617ec8ddcff PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:04:19.458Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7921c7c-fcf7-429d-9686-0617ec8ddcff PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:04:20.154Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c7921c7c-fcf7-429d-9686-0617ec8ddcff ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:04:20.154Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c7921c7c-fcf7-429d-9686-0617ec8ddcff ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:04:21.257Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edc631aa-40f3-40d2-906a-ff01bf65ed4c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:04:21.257Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edc631aa-40f3-40d2-906a-ff01bf65ed4c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74291f5b
2021-06-04T01:04:21.257Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edc631aa-40f3-40d2-906a-ff01bf65ed4c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:04:21.257Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edc631aa-40f3-40d2-906a-ff01bf65ed4c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:04:22.657Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd41bd4a-b4de-427a-9ad3-5735acf2546e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:04:22.657Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd41bd4a-b4de-427a-9ad3-5735acf2546e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6660fdf0
2021-06-04T01:04:22.657Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd41bd4a-b4de-427a-9ad3-5735acf2546e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:04:22.657Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd41bd4a-b4de-427a-9ad3-5735acf2546e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:04:24.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=692be8e3-ca5b-4b42-ab99-8c0705e0a8ce PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:04:24.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=692be8e3-ca5b-4b42-ab99-8c0705e0a8ce PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@623f1a21
2021-06-04T01:04:24.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=692be8e3-ca5b-4b42-ab99-8c0705e0a8ce PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:04:24.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=692be8e3-ca5b-4b42-ab99-8c0705e0a8ce PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:04:26.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=384dab40-6290-4105-ba5e-247ee892646c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:04:26.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=384dab40-6290-4105-ba5e-247ee892646c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@218ef8a2
2021-06-04T01:04:26.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=384dab40-6290-4105-ba5e-247ee892646c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:04:26.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=384dab40-6290-4105-ba5e-247ee892646c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:04:27.958Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41ef2d9b-c756-49ca-90bc-655dd7d65806 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:04:27.958Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41ef2d9b-c756-49ca-90bc-655dd7d65806 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1de1e80f
2021-06-04T01:04:27.958Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41ef2d9b-c756-49ca-90bc-655dd7d65806 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:04:27.958Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41ef2d9b-c756-49ca-90bc-655dd7d65806 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:04:29.363Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47b38e7a-b55b-4604-bbff-e22cd5a2a59a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:04:29.363Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47b38e7a-b55b-4604-bbff-e22cd5a2a59a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7c8f093e
2021-06-04T01:04:29.363Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47b38e7a-b55b-4604-bbff-e22cd5a2a59a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:04:29.363Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47b38e7a-b55b-4604-bbff-e22cd5a2a59a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:04:31.058Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdfbfd41-f414-49b7-939b-e0305c1d50b4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:04:31.058Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdfbfd41-f414-49b7-939b-e0305c1d50b4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@66fbfa9c
2021-06-04T01:04:31.058Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdfbfd41-f414-49b7-939b-e0305c1d50b4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:04:31.058Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdfbfd41-f414-49b7-939b-e0305c1d50b4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:04:32.654Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8da137a3-df99-4bcd-8896-02163c711498 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:04:32.654Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8da137a3-df99-4bcd-8896-02163c711498 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30e64509
2021-06-04T01:04:32.654Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8da137a3-df99-4bcd-8896-02163c711498 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:04:32.654Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8da137a3-df99-4bcd-8896-02163c711498 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:04:32.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:04:32.967Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:04:34.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e88bd54-7f77-4995-bd99-16e3f96f993c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:04:34.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e88bd54-7f77-4995-bd99-16e3f96f993c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22d5628a
2021-06-04T01:04:34.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e88bd54-7f77-4995-bd99-16e3f96f993c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:04:34.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e88bd54-7f77-4995-bd99-16e3f96f993c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:04:35.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d43e910-c51e-422c-8d0d-0ee32b3171f1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:04:35.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d43e910-c51e-422c-8d0d-0ee32b3171f1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@26175917
2021-06-04T01:04:35.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d43e910-c51e-422c-8d0d-0ee32b3171f1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:04:35.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d43e910-c51e-422c-8d0d-0ee32b3171f1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:04:36.947Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=219c8a9c-08c0-4885-a487-cdcf24eb7c3a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:04:36.947Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=219c8a9c-08c0-4885-a487-cdcf24eb7c3a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f016853
2021-06-04T01:04:36.947Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=219c8a9c-08c0-4885-a487-cdcf24eb7c3a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:04:36.947Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=219c8a9c-08c0-4885-a487-cdcf24eb7c3a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:04:37.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a656cab2-cf41-4b3c-9242-99d1899f2a0b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:04:37.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a656cab2-cf41-4b3c-9242-99d1899f2a0b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d4da8b7
2021-06-04T01:04:37.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a656cab2-cf41-4b3c-9242-99d1899f2a0b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:04:37.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a656cab2-cf41-4b3c-9242-99d1899f2a0b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:04:39.270Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6b71b60-a182-4680-881f-8ab496e9f251 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:04:39.270Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6b71b60-a182-4680-881f-8ab496e9f251 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@140548a6
2021-06-04T01:04:39.270Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6b71b60-a182-4680-881f-8ab496e9f251 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:04:39.270Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6b71b60-a182-4680-881f-8ab496e9f251 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:04:41.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cb0700a-1daf-4a57-b9ef-9afc43ad42f7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:04:41.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cb0700a-1daf-4a57-b9ef-9afc43ad42f7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@84674d0
2021-06-04T01:04:41.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cb0700a-1daf-4a57-b9ef-9afc43ad42f7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:04:41.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cb0700a-1daf-4a57-b9ef-9afc43ad42f7 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:04:44.055Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4975121-24f8-411e-9233-16633278c4a0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:04:44.055Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4975121-24f8-411e-9233-16633278c4a0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c11d67b
2021-06-04T01:04:44.055Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4975121-24f8-411e-9233-16633278c4a0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:04:44.055Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4975121-24f8-411e-9233-16633278c4a0 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:04:46.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5ea29d7-77c0-4f80-b197-f8f994aee976 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:04:46.949Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5ea29d7-77c0-4f80-b197-f8f994aee976 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ce9dd5e
2021-06-04T01:04:46.949Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5ea29d7-77c0-4f80-b197-f8f994aee976 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:04:46.949Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5ea29d7-77c0-4f80-b197-f8f994aee976 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:04:47.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:04:47.970Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:04:48.961Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T01:04:48.961Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T01:04:48.962Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T01:04:49.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1bbfb73d-f6bd-420f-becb-90159404e537 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:04:49.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1bbfb73d-f6bd-420f-becb-90159404e537 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5297e81d
2021-06-04T01:04:49.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1bbfb73d-f6bd-420f-becb-90159404e537 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:04:49.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1bbfb73d-f6bd-420f-becb-90159404e537 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:04:52.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5595ccb-7afd-4b73-8c6b-4defbd0e48ef PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:04:52.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5595ccb-7afd-4b73-8c6b-4defbd0e48ef PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69ccf66b
2021-06-04T01:04:52.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5595ccb-7afd-4b73-8c6b-4defbd0e48ef PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:04:52.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5595ccb-7afd-4b73-8c6b-4defbd0e48ef PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:04:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e51fa19f-b01c-48dd-9d29-5d36958c9756 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:04:55.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e51fa19f-b01c-48dd-9d29-5d36958c9756 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b7c4727
2021-06-04T01:04:55.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e51fa19f-b01c-48dd-9d29-5d36958c9756 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:04:55.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e51fa19f-b01c-48dd-9d29-5d36958c9756 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:04:58.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc353acb-2aa1-4b3a-83b5-07c7d26526fe PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:04:58.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc353acb-2aa1-4b3a-83b5-07c7d26526fe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@595d763b
2021-06-04T01:04:58.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc353acb-2aa1-4b3a-83b5-07c7d26526fe PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:04:58.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc353acb-2aa1-4b3a-83b5-07c7d26526fe PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:05:01.760Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f10417a5-329f-4590-af67-db32be34c591 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:05:01.760Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f10417a5-329f-4590-af67-db32be34c591 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3467ba0d
2021-06-04T01:05:01.760Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f10417a5-329f-4590-af67-db32be34c591 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:05:01.760Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f10417a5-329f-4590-af67-db32be34c591 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:05:02.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:05:02.979Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:05:04.167Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T01:05:04.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fad13855-d48b-4cdd-8f29-4dbc4bd8f76d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:05:04.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fad13855-d48b-4cdd-8f29-4dbc4bd8f76d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a966d44
2021-06-04T01:05:04.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fad13855-d48b-4cdd-8f29-4dbc4bd8f76d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:05:04.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fad13855-d48b-4cdd-8f29-4dbc4bd8f76d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:05:08.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=777a0d19-13ac-4b1b-b18b-f17731c2f4cf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:05:08.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=777a0d19-13ac-4b1b-b18b-f17731c2f4cf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23ca404e
2021-06-04T01:05:08.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=777a0d19-13ac-4b1b-b18b-f17731c2f4cf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:05:08.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=777a0d19-13ac-4b1b-b18b-f17731c2f4cf PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:05:11.154Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=752f1a2d-5ded-4b7b-baa8-0aa66254ab59 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:05:11.155Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=752f1a2d-5ded-4b7b-baa8-0aa66254ab59 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@111416a2
2021-06-04T01:05:11.155Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=752f1a2d-5ded-4b7b-baa8-0aa66254ab59 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:05:11.155Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=752f1a2d-5ded-4b7b-baa8-0aa66254ab59 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:05:13.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52b2ba9d-b633-4fa9-9908-20b1f7ebe7b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:05:13.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52b2ba9d-b633-4fa9-9908-20b1f7ebe7b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@18aa615f
2021-06-04T01:05:13.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52b2ba9d-b633-4fa9-9908-20b1f7ebe7b9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:05:13.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52b2ba9d-b633-4fa9-9908-20b1f7ebe7b9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:05:16.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd38927b-752f-486f-9fee-5e04c774a8a4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:05:16.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd38927b-752f-486f-9fee-5e04c774a8a4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@115fc343
2021-06-04T01:05:16.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd38927b-752f-486f-9fee-5e04c774a8a4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:05:16.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd38927b-752f-486f-9fee-5e04c774a8a4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:05:17.953Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:05:18.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:05:20.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d28b0289-e0d5-46aa-8b5b-3b2f311acfde PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:05:20.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d28b0289-e0d5-46aa-8b5b-3b2f311acfde PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60662916
2021-06-04T01:05:20.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d28b0289-e0d5-46aa-8b5b-3b2f311acfde PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:05:20.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d28b0289-e0d5-46aa-8b5b-3b2f311acfde PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:05:23.249Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5142c06-53f3-494f-ba58-cb52413236ad PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:05:23.249Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5142c06-53f3-494f-ba58-cb52413236ad PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@51f682be
2021-06-04T01:05:23.249Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5142c06-53f3-494f-ba58-cb52413236ad PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:05:23.249Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5142c06-53f3-494f-ba58-cb52413236ad PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:05:25.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28f8da65-e714-4f8c-a36c-a8ea5303bc30 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:05:25.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28f8da65-e714-4f8c-a36c-a8ea5303bc30 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a9db146
2021-06-04T01:05:25.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28f8da65-e714-4f8c-a36c-a8ea5303bc30 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:05:25.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28f8da65-e714-4f8c-a36c-a8ea5303bc30 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:05:28.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2187093c-218b-4996-95a4-863b663a9bcf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:05:28.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2187093c-218b-4996-95a4-863b663a9bcf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@75b73c8d
2021-06-04T01:05:28.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2187093c-218b-4996-95a4-863b663a9bcf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:05:28.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2187093c-218b-4996-95a4-863b663a9bcf PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:05:32.266Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7843d0e-d5b0-47e1-a1de-413e350c6f1a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:05:32.266Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7843d0e-d5b0-47e1-a1de-413e350c6f1a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@24c895b4
2021-06-04T01:05:32.266Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7843d0e-d5b0-47e1-a1de-413e350c6f1a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:05:32.266Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7843d0e-d5b0-47e1-a1de-413e350c6f1a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:05:32.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:05:33.010Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:05:35.350Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24963380-4ddb-4e85-a6dd-0053c7cef7cb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:05:35.350Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24963380-4ddb-4e85-a6dd-0053c7cef7cb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41ce10e1
2021-06-04T01:05:35.350Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24963380-4ddb-4e85-a6dd-0053c7cef7cb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:05:35.350Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24963380-4ddb-4e85-a6dd-0053c7cef7cb PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:05:38.489Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edd6bdf2-c5cd-4fea-a013-d4f94866be29 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:05:38.489Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edd6bdf2-c5cd-4fea-a013-d4f94866be29 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@36ae8e1f
2021-06-04T01:05:38.489Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edd6bdf2-c5cd-4fea-a013-d4f94866be29 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:05:38.489Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edd6bdf2-c5cd-4fea-a013-d4f94866be29 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:05:41.180Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c286ad54-716d-4285-b3c3-e22cdeeb9130 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:05:41.180Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c286ad54-716d-4285-b3c3-e22cdeeb9130 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ab18f13
2021-06-04T01:05:41.180Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c286ad54-716d-4285-b3c3-e22cdeeb9130 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:05:41.180Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c286ad54-716d-4285-b3c3-e22cdeeb9130 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:05:45.266Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32a0db2a-808b-4ba4-aee8-475b145137f4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:05:45.266Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32a0db2a-808b-4ba4-aee8-475b145137f4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a34d0c4
2021-06-04T01:05:45.267Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32a0db2a-808b-4ba4-aee8-475b145137f4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:05:45.267Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32a0db2a-808b-4ba4-aee8-475b145137f4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:05:46.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e5c89bc-4db2-468d-ac5c-c78de6f16ba4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:05:46.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e5c89bc-4db2-468d-ac5c-c78de6f16ba4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b4c927b
2021-06-04T01:05:46.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e5c89bc-4db2-468d-ac5c-c78de6f16ba4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:05:46.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e5c89bc-4db2-468d-ac5c-c78de6f16ba4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:05:47.951Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:05:48.962Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T01:05:48.963Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T01:05:48.963Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T01:05:49.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da304a32-75ed-45bc-b43b-f93283472dc2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:05:49.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da304a32-75ed-45bc-b43b-f93283472dc2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69d02f7b
2021-06-04T01:05:49.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da304a32-75ed-45bc-b43b-f93283472dc2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:05:49.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da304a32-75ed-45bc-b43b-f93283472dc2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:05:52.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc271d07-36f4-4d34-baa3-f2587b691d80 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:05:52.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc271d07-36f4-4d34-baa3-f2587b691d80 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1fefec45
2021-06-04T01:05:52.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc271d07-36f4-4d34-baa3-f2587b691d80 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:05:52.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc271d07-36f4-4d34-baa3-f2587b691d80 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:05:55.346Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:05:55.348Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:05:55.617Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:05:57.178Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6baaedf0-9fb6-4113-bafb-7e79d7750504 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:05:57.178Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6baaedf0-9fb6-4113-bafb-7e79d7750504 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2361ad8c
2021-06-04T01:05:57.178Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6baaedf0-9fb6-4113-bafb-7e79d7750504 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:05:57.178Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6baaedf0-9fb6-4113-bafb-7e79d7750504 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:05:59.958Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99c5a788-c009-4a0e-bad7-61651bd1fbba PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:05:59.958Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99c5a788-c009-4a0e-bad7-61651bd1fbba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c713cd1
2021-06-04T01:05:59.958Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99c5a788-c009-4a0e-bad7-61651bd1fbba PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:05:59.958Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99c5a788-c009-4a0e-bad7-61651bd1fbba PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:06:02.359Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a3ec325-dded-4d56-86a4-c94d619d9812 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:06:02.359Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a3ec325-dded-4d56-86a4-c94d619d9812 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b27dd3
2021-06-04T01:06:02.359Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a3ec325-dded-4d56-86a4-c94d619d9812 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:06:02.359Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a3ec325-dded-4d56-86a4-c94d619d9812 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:06:02.951Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:06:05.311Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cea1d360-106d-407a-854f-e22aef2bac3a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:06:05.311Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cea1d360-106d-407a-854f-e22aef2bac3a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@645f24c4
2021-06-04T01:06:05.311Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cea1d360-106d-407a-854f-e22aef2bac3a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:06:05.311Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cea1d360-106d-407a-854f-e22aef2bac3a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:06:09.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a673c14e-dee4-4d14-9aab-c11021a31368 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:06:09.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a673c14e-dee4-4d14-9aab-c11021a31368 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a7cf80e
2021-06-04T01:06:09.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a673c14e-dee4-4d14-9aab-c11021a31368 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:06:09.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a673c14e-dee4-4d14-9aab-c11021a31368 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:06:10.951Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T01:06:11.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61a2c40f-87a7-429e-8ebc-a15971e9ae04 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:06:11.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61a2c40f-87a7-429e-8ebc-a15971e9ae04 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f8ec224
2021-06-04T01:06:11.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61a2c40f-87a7-429e-8ebc-a15971e9ae04 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:06:11.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61a2c40f-87a7-429e-8ebc-a15971e9ae04 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:06:12.544Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:06:12.546Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:06:13.338Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T01:06:14.266Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c00fc082-bd4f-496d-918b-23b48a775e49 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:06:14.266Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c00fc082-bd4f-496d-918b-23b48a775e49 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38c56ee3
2021-06-04T01:06:14.266Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c00fc082-bd4f-496d-918b-23b48a775e49 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:06:14.266Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c00fc082-bd4f-496d-918b-23b48a775e49 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:06:15.122Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c00fc082-bd4f-496d-918b-23b48a775e49 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:06:15.122Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c00fc082-bd4f-496d-918b-23b48a775e49 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:06:16.070Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:06:16.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1317beb3-d3bb-4963-a6f3-ad1698aa6691 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:06:16.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1317beb3-d3bb-4963-a6f3-ad1698aa6691 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@25a1043b
2021-06-04T01:06:16.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1317beb3-d3bb-4963-a6f3-ad1698aa6691 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:06:16.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1317beb3-d3bb-4963-a6f3-ad1698aa6691 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:06:17.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:06:18.196Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:06:18.197Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T01:06:19.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=891faa19-aee4-416f-859d-af501f80c917 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:06:19.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=891faa19-aee4-416f-859d-af501f80c917 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@8302409
2021-06-04T01:06:19.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=891faa19-aee4-416f-859d-af501f80c917 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:06:19.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=891faa19-aee4-416f-859d-af501f80c917 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:06:20.681Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=891faa19-aee4-416f-859d-af501f80c917 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:06:20.681Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=891faa19-aee4-416f-859d-af501f80c917 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:06:22.879Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e024d08e-3798-43c2-a5e6-754de0133a52 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:06:22.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e024d08e-3798-43c2-a5e6-754de0133a52 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@517648c9
2021-06-04T01:06:22.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e024d08e-3798-43c2-a5e6-754de0133a52 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:06:22.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e024d08e-3798-43c2-a5e6-754de0133a52 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:06:26.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe4bfa09-3899-4768-8214-3ed90b672566 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:06:26.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe4bfa09-3899-4768-8214-3ed90b672566 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42578672
2021-06-04T01:06:26.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe4bfa09-3899-4768-8214-3ed90b672566 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:06:26.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe4bfa09-3899-4768-8214-3ed90b672566 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:06:28.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb441a2b-fc21-4163-974d-13decbd1feaf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:06:28.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb441a2b-fc21-4163-974d-13decbd1feaf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f7ac2df
2021-06-04T01:06:28.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb441a2b-fc21-4163-974d-13decbd1feaf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:06:28.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb441a2b-fc21-4163-974d-13decbd1feaf PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:06:32.193Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d86c5ca6-eef1-40e4-aa95-b4d35a7c484a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:06:32.193Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d86c5ca6-eef1-40e4-aa95-b4d35a7c484a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6663b355
2021-06-04T01:06:32.193Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d86c5ca6-eef1-40e4-aa95-b4d35a7c484a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:06:32.193Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d86c5ca6-eef1-40e4-aa95-b4d35a7c484a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:06:32.953Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:06:35.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24349e4d-6736-44cb-823e-e4af611c23db PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:06:35.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24349e4d-6736-44cb-823e-e4af611c23db PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b08f50
2021-06-04T01:06:35.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24349e4d-6736-44cb-823e-e4af611c23db PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:06:35.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24349e4d-6736-44cb-823e-e4af611c23db PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:06:38.275Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d244b97d-af5e-46ef-a0c0-9cab14e96cde PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:06:38.275Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d244b97d-af5e-46ef-a0c0-9cab14e96cde PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7baaed82
2021-06-04T01:06:38.276Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d244b97d-af5e-46ef-a0c0-9cab14e96cde PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:06:38.276Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d244b97d-af5e-46ef-a0c0-9cab14e96cde PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:06:40.952Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T01:06:41.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e938f72-f333-4ee1-836a-0515d333d247 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:06:41.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e938f72-f333-4ee1-836a-0515d333d247 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@427fa412
2021-06-04T01:06:41.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e938f72-f333-4ee1-836a-0515d333d247 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:06:41.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e938f72-f333-4ee1-836a-0515d333d247 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:06:44.181Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:06:44.183Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:06:44.535Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:06:45.349Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f58e96b1-8f55-4f97-a40b-fa30556bf963 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:06:45.349Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f58e96b1-8f55-4f97-a40b-fa30556bf963 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@39fd4e13
2021-06-04T01:06:45.349Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f58e96b1-8f55-4f97-a40b-fa30556bf963 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:06:45.349Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f58e96b1-8f55-4f97-a40b-fa30556bf963 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:06:45.976Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f58e96b1-8f55-4f97-a40b-fa30556bf963 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:06:45.976Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f58e96b1-8f55-4f97-a40b-fa30556bf963 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:06:47.598Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7308442-7379-4498-b257-8f8248afbc00 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:06:47.598Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7308442-7379-4498-b257-8f8248afbc00 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38368c73
2021-06-04T01:06:47.598Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7308442-7379-4498-b257-8f8248afbc00 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:06:47.598Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7308442-7379-4498-b257-8f8248afbc00 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:06:47.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:06:48.961Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T01:06:48.962Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T01:06:48.962Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T01:06:49.002Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:06:49.003Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T01:06:50.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4f8836a-4f16-4d8b-b099-5d86b69907f2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:06:50.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4f8836a-4f16-4d8b-b099-5d86b69907f2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@145cb00a
2021-06-04T01:06:50.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4f8836a-4f16-4d8b-b099-5d86b69907f2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:06:50.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4f8836a-4f16-4d8b-b099-5d86b69907f2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:06:50.782Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e4f8836a-4f16-4d8b-b099-5d86b69907f2 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:06:50.782Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e4f8836a-4f16-4d8b-b099-5d86b69907f2 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:07:02.588Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=ApplicationDataTypesCache Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177)
at org.apache.tinkerpop.gremlin.structure.Element.keys(Element.java:69)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getProperties(JanusGraphGenericDao.java:1491)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getByCriteria(JanusGraphGenericDao.java:759)
at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypeNodes(PropertyOperation.java:1566)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.findAllDataTypesLazy(ApplicationDataTypeCache.java:309)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.hasDataTypesChanged(ApplicationDataTypeCache.java:220)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:200)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 0 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 0 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 0 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T01:07:02.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:07:05.784Z [cluster1-nio-worker-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadFailureException: Operation failed - received 0 responses and 1 failures
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:07:05.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4003a3c-989d-4c93-8188-66679a0d5ea8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:07:05.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4003a3c-989d-4c93-8188-66679a0d5ea8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2bbcc9a7
2021-06-04T01:07:05.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4003a3c-989d-4c93-8188-66679a0d5ea8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:07:05.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4003a3c-989d-4c93-8188-66679a0d5ea8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:07:06.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e81b249-a745-48cd-91ed-c2e6de0ada5b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:07:06.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e81b249-a745-48cd-91ed-c2e6de0ada5b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@78e29715
2021-06-04T01:07:06.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e81b249-a745-48cd-91ed-c2e6de0ada5b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:07:06.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e81b249-a745-48cd-91ed-c2e6de0ada5b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:07:08.171Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4aea7b63-55be-4b81-8a3f-0c93ce9fb688 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:07:08.171Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4aea7b63-55be-4b81-8a3f-0c93ce9fb688 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@743bc96e
2021-06-04T01:07:08.171Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4aea7b63-55be-4b81-8a3f-0c93ce9fb688 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:07:08.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4aea7b63-55be-4b81-8a3f-0c93ce9fb688 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:07:09.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cef300af-6dbb-4c97-aaac-096fea0350a2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:07:09.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cef300af-6dbb-4c97-aaac-096fea0350a2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@596fb03
2021-06-04T01:07:09.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cef300af-6dbb-4c97-aaac-096fea0350a2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:07:09.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cef300af-6dbb-4c97-aaac-096fea0350a2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:07:10.949Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T01:07:12.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8112460-f71a-41b9-aea1-6310bcf226e4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:07:12.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8112460-f71a-41b9-aea1-6310bcf226e4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@48aafbe7
2021-06-04T01:07:12.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8112460-f71a-41b9-aea1-6310bcf226e4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:07:12.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8112460-f71a-41b9-aea1-6310bcf226e4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:07:12.984Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:07:12.986Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:07:13.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e0f3374-8c10-4178-b254-ed008bfec63e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:07:13.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e0f3374-8c10-4178-b254-ed008bfec63e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@241c87d8
2021-06-04T01:07:13.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e0f3374-8c10-4178-b254-ed008bfec63e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:07:13.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e0f3374-8c10-4178-b254-ed008bfec63e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:07:13.766Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0e0f3374-8c10-4178-b254-ed008bfec63e ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:07:13.766Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0e0f3374-8c10-4178-b254-ed008bfec63e ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:07:14.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e913846a-a644-4fba-9af1-f5d2d03f7f68 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:07:14.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e913846a-a644-4fba-9af1-f5d2d03f7f68 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ec64a8c
2021-06-04T01:07:14.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e913846a-a644-4fba-9af1-f5d2d03f7f68 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:07:14.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e913846a-a644-4fba-9af1-f5d2d03f7f68 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:07:15.344Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T01:07:15.491Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:07:16.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27ee801e-48c7-4d82-bb82-abe01b08be72 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:07:16.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27ee801e-48c7-4d82-bb82-abe01b08be72 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c3af6b4
2021-06-04T01:07:16.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27ee801e-48c7-4d82-bb82-abe01b08be72 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:07:16.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27ee801e-48c7-4d82-bb82-abe01b08be72 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:07:17.271Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42daa0ce-7824-468e-86b1-6971aa7a25bf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:07:17.271Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42daa0ce-7824-468e-86b1-6971aa7a25bf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23d04717
2021-06-04T01:07:17.271Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42daa0ce-7824-468e-86b1-6971aa7a25bf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:07:17.271Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42daa0ce-7824-468e-86b1-6971aa7a25bf PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:07:17.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:07:20.276Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=42daa0ce-7824-468e-86b1-6971aa7a25bf ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:07:20.276Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=42daa0ce-7824-468e-86b1-6971aa7a25bf ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:07:20.277Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=42daa0ce-7824-468e-86b1-6971aa7a25bf ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:07:20.277Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=42daa0ce-7824-468e-86b1-6971aa7a25bf ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:07:20.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:07:20.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:07:21.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a112fb2-b09f-4b84-a158-f81793c83392 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:07:21.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a112fb2-b09f-4b84-a158-f81793c83392 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@633236f2
2021-06-04T01:07:21.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a112fb2-b09f-4b84-a158-f81793c83392 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:07:21.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a112fb2-b09f-4b84-a158-f81793c83392 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:07:21.684Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=1a112fb2-b09f-4b84-a158-f81793c83392 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:07:21.684Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=1a112fb2-b09f-4b84-a158-f81793c83392 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:07:22.658Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:07:23.067Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91b3193b-d1e8-4f28-8dd0-308596293fe7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:07:23.067Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91b3193b-d1e8-4f28-8dd0-308596293fe7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34784033
2021-06-04T01:07:23.067Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91b3193b-d1e8-4f28-8dd0-308596293fe7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:07:23.067Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91b3193b-d1e8-4f28-8dd0-308596293fe7 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:07:24.226Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=91b3193b-d1e8-4f28-8dd0-308596293fe7 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:07:24.227Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=91b3193b-d1e8-4f28-8dd0-308596293fe7 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T01:07:26.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4544b01-92d0-49ac-a0ea-f0b398fb3306 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:07:26.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4544b01-92d0-49ac-a0ea-f0b398fb3306 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15b15154
2021-06-04T01:07:26.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4544b01-92d0-49ac-a0ea-f0b398fb3306 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:07:26.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4544b01-92d0-49ac-a0ea-f0b398fb3306 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:07:26.583Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b4544b01-92d0-49ac-a0ea-f0b398fb3306 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:07:26.583Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b4544b01-92d0-49ac-a0ea-f0b398fb3306 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:07:29.358Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=872d8aed-2404-4b1c-8d65-f93d7bd1abbf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:07:29.358Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=872d8aed-2404-4b1c-8d65-f93d7bd1abbf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@67c670b6
2021-06-04T01:07:29.358Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=872d8aed-2404-4b1c-8d65-f93d7bd1abbf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:07:29.358Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=872d8aed-2404-4b1c-8d65-f93d7bd1abbf PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:07:29.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:07:29.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:07:31.568Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:07:31.959Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43c38b90-ece2-4746-ba48-2e1e371bc98f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:07:31.959Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43c38b90-ece2-4746-ba48-2e1e371bc98f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5cf0736e
2021-06-04T01:07:31.959Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43c38b90-ece2-4746-ba48-2e1e371bc98f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:07:31.959Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43c38b90-ece2-4746-ba48-2e1e371bc98f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:07:32.073Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=43c38b90-ece2-4746-ba48-2e1e371bc98f ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:07:32.073Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=43c38b90-ece2-4746-ba48-2e1e371bc98f ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T01:07:35.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0defb514-6812-43d4-91c0-f7825a62ae71 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:07:35.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0defb514-6812-43d4-91c0-f7825a62ae71 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a7fc91b
2021-06-04T01:07:35.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0defb514-6812-43d4-91c0-f7825a62ae71 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:07:35.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0defb514-6812-43d4-91c0-f7825a62ae71 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:07:35.481Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:07:35.486Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:07:35.677Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0defb514-6812-43d4-91c0-f7825a62ae71 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:07:35.677Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0defb514-6812-43d4-91c0-f7825a62ae71 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:07:35.767Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:07:35.768Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:07:37.941Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:07:37.943Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:07:37.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26651f19-b1d6-4936-9f5a-d300b4d63d0a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:07:37.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26651f19-b1d6-4936-9f5a-d300b4d63d0a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35db06f1
2021-06-04T01:07:37.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26651f19-b1d6-4936-9f5a-d300b4d63d0a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:07:37.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26651f19-b1d6-4936-9f5a-d300b4d63d0a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:07:38.303Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:07:38.304Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T01:07:40.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=729c3409-35bf-4aae-8eb2-bd63a920f299 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:07:40.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=729c3409-35bf-4aae-8eb2-bd63a920f299 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@614c933c
2021-06-04T01:07:40.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=729c3409-35bf-4aae-8eb2-bd63a920f299 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:07:40.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=729c3409-35bf-4aae-8eb2-bd63a920f299 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:07:41.763Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=729c3409-35bf-4aae-8eb2-bd63a920f299 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:07:41.764Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=729c3409-35bf-4aae-8eb2-bd63a920f299 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:07:43.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d42846ec-f9ca-42af-9dc8-75bb60ae42f6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:07:43.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d42846ec-f9ca-42af-9dc8-75bb60ae42f6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e78f778
2021-06-04T01:07:43.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d42846ec-f9ca-42af-9dc8-75bb60ae42f6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:07:43.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d42846ec-f9ca-42af-9dc8-75bb60ae42f6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:07:46.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ab6ee7f-8353-484f-ac6d-f22e7b170ba9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:07:46.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ab6ee7f-8353-484f-ac6d-f22e7b170ba9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6a9bd6bd
2021-06-04T01:07:46.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ab6ee7f-8353-484f-ac6d-f22e7b170ba9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:07:46.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ab6ee7f-8353-484f-ac6d-f22e7b170ba9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:07:47.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:07:48.028Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:07:48.962Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T01:07:48.963Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T01:07:48.963Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T01:07:49.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9252be28-f811-4e70-9700-3c95ff2d97e3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:07:49.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9252be28-f811-4e70-9700-3c95ff2d97e3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71aa991
2021-06-04T01:07:49.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9252be28-f811-4e70-9700-3c95ff2d97e3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:07:49.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9252be28-f811-4e70-9700-3c95ff2d97e3 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:07:52.602Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf095eef-517d-43fb-a9d6-48485699bcfb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:07:52.602Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf095eef-517d-43fb-a9d6-48485699bcfb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ca1f3d
2021-06-04T01:07:52.602Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf095eef-517d-43fb-a9d6-48485699bcfb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:07:52.602Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf095eef-517d-43fb-a9d6-48485699bcfb PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:07:56.460Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d97d74c-80b7-4beb-b6af-6faf9cb39e0b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:07:56.460Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d97d74c-80b7-4beb-b6af-6faf9cb39e0b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7bf0fb2b
2021-06-04T01:07:56.460Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d97d74c-80b7-4beb-b6af-6faf9cb39e0b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:07:56.460Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d97d74c-80b7-4beb-b6af-6faf9cb39e0b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:07:59.504Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c190da1-9cf7-42ec-8e1b-9cf1529ddf4d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:07:59.504Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c190da1-9cf7-42ec-8e1b-9cf1529ddf4d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4feae4d6
2021-06-04T01:07:59.504Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c190da1-9cf7-42ec-8e1b-9cf1529ddf4d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:07:59.504Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c190da1-9cf7-42ec-8e1b-9cf1529ddf4d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:08:01.606Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eae4aa89-71d9-41fa-9dc2-96bf7c85f703 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:08:01.606Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eae4aa89-71d9-41fa-9dc2-96bf7c85f703 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1dee9a9b
2021-06-04T01:08:01.606Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eae4aa89-71d9-41fa-9dc2-96bf7c85f703 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:08:01.606Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eae4aa89-71d9-41fa-9dc2-96bf7c85f703 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:08:02.952Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:08:03.494Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:08:05.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d8ebc6e-2bf7-4495-8bc7-fbf8187341d4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:08:05.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d8ebc6e-2bf7-4495-8bc7-fbf8187341d4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f0f5dec
2021-06-04T01:08:05.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d8ebc6e-2bf7-4495-8bc7-fbf8187341d4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:08:05.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d8ebc6e-2bf7-4495-8bc7-fbf8187341d4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:08:06.359Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T01:08:08.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57aa1f98-519b-4814-a699-3232ef229d89 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:08:08.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57aa1f98-519b-4814-a699-3232ef229d89 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@33dace85
2021-06-04T01:08:08.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57aa1f98-519b-4814-a699-3232ef229d89 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:08:08.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57aa1f98-519b-4814-a699-3232ef229d89 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:08:10.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c583843f-0d9c-4ad0-9b74-6978b4bcd7ed PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:08:10.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c583843f-0d9c-4ad0-9b74-6978b4bcd7ed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b0e507c
2021-06-04T01:08:10.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c583843f-0d9c-4ad0-9b74-6978b4bcd7ed PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:08:10.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c583843f-0d9c-4ad0-9b74-6978b4bcd7ed PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:08:15.858Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6481fae-ba21-4694-afd7-93491519251a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:08:15.858Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6481fae-ba21-4694-afd7-93491519251a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@425d2dc4
2021-06-04T01:08:15.858Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6481fae-ba21-4694-afd7-93491519251a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:08:15.858Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6481fae-ba21-4694-afd7-93491519251a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:08:17.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14bdfcdf-e7e0-4e1e-ac76-29258a9d0681 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:08:17.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14bdfcdf-e7e0-4e1e-ac76-29258a9d0681 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7708f85e
2021-06-04T01:08:17.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14bdfcdf-e7e0-4e1e-ac76-29258a9d0681 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:08:17.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14bdfcdf-e7e0-4e1e-ac76-29258a9d0681 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:08:17.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:08:20.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f88f2fb-fea5-471c-9ecb-acf690d49c0b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:08:20.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f88f2fb-fea5-471c-9ecb-acf690d49c0b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1243aedc
2021-06-04T01:08:20.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f88f2fb-fea5-471c-9ecb-acf690d49c0b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:08:20.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f88f2fb-fea5-471c-9ecb-acf690d49c0b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:08:20.680Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01lgoxmc8vtpl2paehgl67w3up573
2021-06-04T01:08:20.680Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0rpgwk7yirc0g1ksb7tf6lm6lx579
2021-06-04T01:08:20.680Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01femnwr8zfxb53jxgucx9idfv574
2021-06-04T01:08:20.680Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0dblu4i45q6o039zcnjqkcf32575
2021-06-04T01:08:20.680Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01v5bdm4ep2gql1q2c3v651ryt0577
2021-06-04T01:08:20.680Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0157arimewwdcd1rg95fdxbwpxt581
2021-06-04T01:08:20.680Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01gpg6bsf44omj1n5dh6pgtlbug580
2021-06-04T01:08:20.680Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01gyfu3ambfx1tkkzjcss1cwen576
2021-06-04T01:08:20.681Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01epypsrlwggz5139a8ybj67nbw582
2021-06-04T01:08:20.681Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node05nimwkdtrpyfm8q9w3r2q408578
2021-06-04T01:08:23.532Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=9f88f2fb-fea5-471c-9ecb-acf690d49c0b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:08:23.533Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=9f88f2fb-fea5-471c-9ecb-acf690d49c0b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:08:23.533Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9f88f2fb-fea5-471c-9ecb-acf690d49c0b ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:08:23.534Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9f88f2fb-fea5-471c-9ecb-acf690d49c0b ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:08:23.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:08:23.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:08:23.780Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:08:23.782Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:08:24.910Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e9af85b-c487-406a-ab8a-adb2351d5e4b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:08:24.910Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e9af85b-c487-406a-ab8a-adb2351d5e4b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b979158
2021-06-04T01:08:24.910Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e9af85b-c487-406a-ab8a-adb2351d5e4b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:08:24.910Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e9af85b-c487-406a-ab8a-adb2351d5e4b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:08:25.949Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T01:08:25.954Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0e9af85b-c487-406a-ab8a-adb2351d5e4b ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:08:25.954Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0e9af85b-c487-406a-ab8a-adb2351d5e4b ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:08:26.014Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:08:26.998Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:08:27.458Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b0fb1f7-4118-46df-8360-35f82d49e533 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:08:27.458Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b0fb1f7-4118-46df-8360-35f82d49e533 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@507578b4
2021-06-04T01:08:27.458Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b0fb1f7-4118-46df-8360-35f82d49e533 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:08:27.458Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b0fb1f7-4118-46df-8360-35f82d49e533 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:08:27.884Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=5b0fb1f7-4118-46df-8360-35f82d49e533 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:08:27.884Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=5b0fb1f7-4118-46df-8360-35f82d49e533 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T01:08:29.149Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f02c45c1-fb64-4509-ad06-e4006dd33706 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:08:29.149Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f02c45c1-fb64-4509-ad06-e4006dd33706 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f4f0928
2021-06-04T01:08:29.149Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f02c45c1-fb64-4509-ad06-e4006dd33706 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:08:29.149Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f02c45c1-fb64-4509-ad06-e4006dd33706 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:08:29.919Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f02c45c1-fb64-4509-ad06-e4006dd33706 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:08:29.919Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f02c45c1-fb64-4509-ad06-e4006dd33706 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:08:31.899Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9edb34b5-59a6-4b33-bc56-b85102ab9262 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:08:31.899Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9edb34b5-59a6-4b33-bc56-b85102ab9262 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28a54ec8
2021-06-04T01:08:31.899Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9edb34b5-59a6-4b33-bc56-b85102ab9262 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:08:31.899Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9edb34b5-59a6-4b33-bc56-b85102ab9262 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:08:32.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:08:35.294Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c803a9f-aa02-4de2-a6e3-e343c0f6fe12 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:08:35.294Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c803a9f-aa02-4de2-a6e3-e343c0f6fe12 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3500dd81
2021-06-04T01:08:35.294Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c803a9f-aa02-4de2-a6e3-e343c0f6fe12 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:08:35.294Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c803a9f-aa02-4de2-a6e3-e343c0f6fe12 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:08:37.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e79301a1-1301-46b7-a5e0-c6da59e21f4f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:08:37.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e79301a1-1301-46b7-a5e0-c6da59e21f4f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e4bb34d
2021-06-04T01:08:37.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e79301a1-1301-46b7-a5e0-c6da59e21f4f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:08:37.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e79301a1-1301-46b7-a5e0-c6da59e21f4f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:08:40.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c952c97-009f-48c9-a432-e3607efdf736 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:08:40.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c952c97-009f-48c9-a432-e3607efdf736 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@696ae5e5
2021-06-04T01:08:40.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c952c97-009f-48c9-a432-e3607efdf736 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:08:40.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c952c97-009f-48c9-a432-e3607efdf736 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:08:43.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c100990f-deab-4e10-951d-7fabf9239025 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:08:43.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c100990f-deab-4e10-951d-7fabf9239025 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b3b250e
2021-06-04T01:08:43.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c100990f-deab-4e10-951d-7fabf9239025 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:08:43.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c100990f-deab-4e10-951d-7fabf9239025 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:08:46.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c84fcc1-6985-4df0-9624-8efbfc92c914 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:08:46.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c84fcc1-6985-4df0-9624-8efbfc92c914 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58e4113d
2021-06-04T01:08:46.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c84fcc1-6985-4df0-9624-8efbfc92c914 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:08:46.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c84fcc1-6985-4df0-9624-8efbfc92c914 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:08:48.961Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T01:08:48.962Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T01:08:48.962Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T01:08:50.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae1280e1-9a87-4f35-82f6-db713b69730d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:08:50.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae1280e1-9a87-4f35-82f6-db713b69730d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ba610b7
2021-06-04T01:08:50.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae1280e1-9a87-4f35-82f6-db713b69730d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:08:50.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae1280e1-9a87-4f35-82f6-db713b69730d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:08:52.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=159d7720-ed72-43b3-9c86-1948222004b2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:08:52.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=159d7720-ed72-43b3-9c86-1948222004b2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@755d81eb
2021-06-04T01:08:52.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=159d7720-ed72-43b3-9c86-1948222004b2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:08:52.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=159d7720-ed72-43b3-9c86-1948222004b2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:08:53.382Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:08:53.384Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:08:55.882Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=159d7720-ed72-43b3-9c86-1948222004b2 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:08:55.882Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=159d7720-ed72-43b3-9c86-1948222004b2 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:08:55.882Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=159d7720-ed72-43b3-9c86-1948222004b2 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:08:55.882Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=159d7720-ed72-43b3-9c86-1948222004b2 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:08:58.177Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8573ae98-7334-414f-9387-6fab0b89f309 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:08:58.177Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8573ae98-7334-414f-9387-6fab0b89f309 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47fcc91b
2021-06-04T01:08:58.177Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8573ae98-7334-414f-9387-6fab0b89f309 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:08:58.178Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8573ae98-7334-414f-9387-6fab0b89f309 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:08:58.724Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8573ae98-7334-414f-9387-6fab0b89f309 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:08:58.724Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8573ae98-7334-414f-9387-6fab0b89f309 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:08:59.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec1b226e-a1b1-4aa4-a6d4-806bb788a48a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:08:59.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec1b226e-a1b1-4aa4-a6d4-806bb788a48a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4431d9c2
2021-06-04T01:08:59.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec1b226e-a1b1-4aa4-a6d4-806bb788a48a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:08:59.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec1b226e-a1b1-4aa4-a6d4-806bb788a48a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:09:01.962Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78c4176f-f9a5-4d6a-9c07-9d7db86884bc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:09:01.962Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78c4176f-f9a5-4d6a-9c07-9d7db86884bc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5dfa5a76
2021-06-04T01:09:01.962Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78c4176f-f9a5-4d6a-9c07-9d7db86884bc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:09:01.962Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78c4176f-f9a5-4d6a-9c07-9d7db86884bc PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:09:02.305Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:09:02.307Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:09:04.630Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:09:04.631Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:09:05.391Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3df94403-6356-4980-b160-ef3644bd3207 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:09:05.392Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3df94403-6356-4980-b160-ef3644bd3207 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7c6fe4c3
2021-06-04T01:09:05.392Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3df94403-6356-4980-b160-ef3644bd3207 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:09:05.392Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3df94403-6356-4980-b160-ef3644bd3207 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:09:07.931Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:09:07.933Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:09:07.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36dbe7be-1f20-48fe-b8d5-518502fe909a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:09:07.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36dbe7be-1f20-48fe-b8d5-518502fe909a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@95a7e2b
2021-06-04T01:09:07.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36dbe7be-1f20-48fe-b8d5-518502fe909a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:09:07.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36dbe7be-1f20-48fe-b8d5-518502fe909a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:09:08.421Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:09:08.422Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:09:09.203Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:09:09.203Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T01:09:10.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87a34cd0-c368-4037-97bc-97403435672a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:09:10.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87a34cd0-c368-4037-97bc-97403435672a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@436f490b
2021-06-04T01:09:10.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87a34cd0-c368-4037-97bc-97403435672a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:09:10.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87a34cd0-c368-4037-97bc-97403435672a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:09:11.306Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=87a34cd0-c368-4037-97bc-97403435672a ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:09:11.307Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=87a34cd0-c368-4037-97bc-97403435672a ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:09:14.678Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=326cf35d-ba40-4c8a-867a-363227d781ce PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:09:14.678Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=326cf35d-ba40-4c8a-867a-363227d781ce PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c4992fa
2021-06-04T01:09:14.678Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=326cf35d-ba40-4c8a-867a-363227d781ce PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:09:14.678Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=326cf35d-ba40-4c8a-867a-363227d781ce PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:09:17.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:09:17.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5805cf2-f8af-4f59-a6b9-b05467b93004 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:09:17.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5805cf2-f8af-4f59-a6b9-b05467b93004 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f833e4c
2021-06-04T01:09:17.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5805cf2-f8af-4f59-a6b9-b05467b93004 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:09:17.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5805cf2-f8af-4f59-a6b9-b05467b93004 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:09:19.706Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T01:09:20.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c45146f3-26c0-44e9-9bfe-12bd2e65ae69 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:09:20.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c45146f3-26c0-44e9-9bfe-12bd2e65ae69 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15f2bab1
2021-06-04T01:09:20.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c45146f3-26c0-44e9-9bfe-12bd2e65ae69 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:09:20.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c45146f3-26c0-44e9-9bfe-12bd2e65ae69 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:09:25.949Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T01:09:34.015Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:09:34.017Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:09:35.770Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=028df574-3fe1-4bbc-ba8e-1167a04b716a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:09:35.770Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=028df574-3fe1-4bbc-ba8e-1167a04b716a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c6c9e15
2021-06-04T01:09:35.770Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=028df574-3fe1-4bbc-ba8e-1167a04b716a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:09:35.770Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=028df574-3fe1-4bbc-ba8e-1167a04b716a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:09:41.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:09:41.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:09:42.539Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:09:42.540Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:09:42.565Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea2606a2-d78f-4201-bc40-4e8d5d863296 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:09:42.565Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea2606a2-d78f-4201-bc40-4e8d5d863296 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c320720
2021-06-04T01:09:42.565Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea2606a2-d78f-4201-bc40-4e8d5d863296 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:09:42.565Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea2606a2-d78f-4201-bc40-4e8d5d863296 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:09:42.764Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ea2606a2-d78f-4201-bc40-4e8d5d863296 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:09:42.764Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ea2606a2-d78f-4201-bc40-4e8d5d863296 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:09:43.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=365d937e-dd2d-41e7-82c6-0cf0c4842a9c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:09:43.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=365d937e-dd2d-41e7-82c6-0cf0c4842a9c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a153db4
2021-06-04T01:09:43.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=365d937e-dd2d-41e7-82c6-0cf0c4842a9c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:09:43.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=365d937e-dd2d-41e7-82c6-0cf0c4842a9c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:09:43.721Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:09:45.352Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=365d937e-dd2d-41e7-82c6-0cf0c4842a9c ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:09:45.352Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=365d937e-dd2d-41e7-82c6-0cf0c4842a9c ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T01:09:45.423Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:09:45.423Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:09:45.454Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:09:45.454Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:09:45.490Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:09:45.490Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:09:45.522Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:09:45.524Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:09:45.570Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:09:45.570Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:09:45.590Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:09:45.590Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:09:45.662Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:09:45.662Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:09:45.718Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:09:47.952Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:09:48.596Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e72aaa5-a57a-440d-8005-2b2f9f15c31e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:09:48.596Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e72aaa5-a57a-440d-8005-2b2f9f15c31e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a323775
2021-06-04T01:09:48.596Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e72aaa5-a57a-440d-8005-2b2f9f15c31e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:09:48.596Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e72aaa5-a57a-440d-8005-2b2f9f15c31e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:09:48.961Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T01:09:48.962Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T01:09:48.962Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T01:09:48.974Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:09:48.974Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:09:48.980Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:09:48.980Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:09:48.990Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:09:48.990Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:09:48.994Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:09:48.995Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:09:49.610Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:09:49.611Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:09:49.622Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:09:49.622Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:09:50.167Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9e72aaa5-a57a-440d-8005-2b2f9f15c31e ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:09:50.167Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9e72aaa5-a57a-440d-8005-2b2f9f15c31e ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:09:51.179Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1485ff3-2af3-4900-8222-55d849e5e0a2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:09:51.179Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1485ff3-2af3-4900-8222-55d849e5e0a2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@32e68210
2021-06-04T01:09:51.179Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1485ff3-2af3-4900-8222-55d849e5e0a2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:09:51.179Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1485ff3-2af3-4900-8222-55d849e5e0a2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:09:51.499Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16e67c07-ff7b-46bd-ba6a-fe1701467026 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:09:51.500Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16e67c07-ff7b-46bd-ba6a-fe1701467026 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ed1986b
2021-06-04T01:09:51.500Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16e67c07-ff7b-46bd-ba6a-fe1701467026 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:09:51.500Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16e67c07-ff7b-46bd-ba6a-fe1701467026 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:09:51.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edd6ed3b-bb6f-4728-a382-abc42e7ce02a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:09:51.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edd6ed3b-bb6f-4728-a382-abc42e7ce02a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d7aec98
2021-06-04T01:09:51.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edd6ed3b-bb6f-4728-a382-abc42e7ce02a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:09:51.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edd6ed3b-bb6f-4728-a382-abc42e7ce02a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:09:53.162Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ba59d67-8276-4bdc-8235-3403f758272a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:09:53.162Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ba59d67-8276-4bdc-8235-3403f758272a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3698e1dd
2021-06-04T01:09:53.162Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ba59d67-8276-4bdc-8235-3403f758272a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:09:53.162Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ba59d67-8276-4bdc-8235-3403f758272a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:09:56.169Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0ba59d67-8276-4bdc-8235-3403f758272a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:09:56.170Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0ba59d67-8276-4bdc-8235-3403f758272a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:09:56.170Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0ba59d67-8276-4bdc-8235-3403f758272a ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:09:56.170Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0ba59d67-8276-4bdc-8235-3403f758272a ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:09:57.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc43910a-5121-412b-8d3c-9b7b3d959303 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:09:57.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc43910a-5121-412b-8d3c-9b7b3d959303 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30e8031c
2021-06-04T01:09:57.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc43910a-5121-412b-8d3c-9b7b3d959303 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:09:57.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc43910a-5121-412b-8d3c-9b7b3d959303 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:09:58.074Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fc43910a-5121-412b-8d3c-9b7b3d959303 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:09:58.074Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fc43910a-5121-412b-8d3c-9b7b3d959303 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:09:58.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c35b1f6-4ec9-4f58-9e32-abfe0c612873 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:09:58.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c35b1f6-4ec9-4f58-9e32-abfe0c612873 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38ece341
2021-06-04T01:09:58.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c35b1f6-4ec9-4f58-9e32-abfe0c612873 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:09:58.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c35b1f6-4ec9-4f58-9e32-abfe0c612873 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:10:00.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15686844-004e-4ef7-9d16-ca94c4e9f071 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:10:00.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15686844-004e-4ef7-9d16-ca94c4e9f071 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@490b7b88
2021-06-04T01:10:00.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15686844-004e-4ef7-9d16-ca94c4e9f071 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:10:00.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15686844-004e-4ef7-9d16-ca94c4e9f071 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:10:01.710Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42088b55-bbf8-4fab-a5d6-5059b1764ca2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:10:01.710Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42088b55-bbf8-4fab-a5d6-5059b1764ca2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@398b6156
2021-06-04T01:10:01.710Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42088b55-bbf8-4fab-a5d6-5059b1764ca2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:10:01.710Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42088b55-bbf8-4fab-a5d6-5059b1764ca2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:10:03.006Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8cdde466-01a2-49e6-bdaf-ad83d1638af6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:10:03.006Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8cdde466-01a2-49e6-bdaf-ad83d1638af6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4d3aa44a
2021-06-04T01:10:03.006Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8cdde466-01a2-49e6-bdaf-ad83d1638af6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:10:03.006Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8cdde466-01a2-49e6-bdaf-ad83d1638af6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:10:05.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a8085a5-a0ce-4412-988b-e7c9f1592af5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:10:05.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a8085a5-a0ce-4412-988b-e7c9f1592af5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1293a047
2021-06-04T01:10:05.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a8085a5-a0ce-4412-988b-e7c9f1592af5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:10:05.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a8085a5-a0ce-4412-988b-e7c9f1592af5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:10:07.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb602b7c-f36a-4cd7-9a1d-405a92da0b67 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:10:07.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb602b7c-f36a-4cd7-9a1d-405a92da0b67 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@565ea6
2021-06-04T01:10:07.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb602b7c-f36a-4cd7-9a1d-405a92da0b67 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:10:07.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb602b7c-f36a-4cd7-9a1d-405a92da0b67 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:10:08.375Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b21bb28-bc04-4a42-8126-a013bc8e4110 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:10:08.375Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b21bb28-bc04-4a42-8126-a013bc8e4110 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@62b51e2b
2021-06-04T01:10:08.375Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b21bb28-bc04-4a42-8126-a013bc8e4110 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:10:08.375Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b21bb28-bc04-4a42-8126-a013bc8e4110 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:10:10.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67f29306-b386-4a71-8614-2e08787ac164 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:10:10.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67f29306-b386-4a71-8614-2e08787ac164 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ab5eec3
2021-06-04T01:10:10.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67f29306-b386-4a71-8614-2e08787ac164 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:10:10.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67f29306-b386-4a71-8614-2e08787ac164 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:10:15.159Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=360fc18c-faf4-4874-9813-e9ee0871b6a1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:10:15.159Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=360fc18c-faf4-4874-9813-e9ee0871b6a1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@752bf84a
2021-06-04T01:10:15.159Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=360fc18c-faf4-4874-9813-e9ee0871b6a1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:10:15.160Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=360fc18c-faf4-4874-9813-e9ee0871b6a1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:10:17.243Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T01:10:17.710Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e63bf68-110a-4677-9ade-fdd5a84d40ab PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:10:17.710Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e63bf68-110a-4677-9ade-fdd5a84d40ab PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47ba2b27
2021-06-04T01:10:17.710Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e63bf68-110a-4677-9ade-fdd5a84d40ab PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:10:17.710Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e63bf68-110a-4677-9ade-fdd5a84d40ab PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:10:19.957Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6d22889-3b69-4432-ba9b-302650c325c6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:10:19.957Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6d22889-3b69-4432-ba9b-302650c325c6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@db431bd
2021-06-04T01:10:19.957Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6d22889-3b69-4432-ba9b-302650c325c6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:10:19.957Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6d22889-3b69-4432-ba9b-302650c325c6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:10:24.586Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb9f059b-67ca-488b-903a-fd8900bbd231 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:10:24.586Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb9f059b-67ca-488b-903a-fd8900bbd231 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5822153e
2021-06-04T01:10:24.586Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb9f059b-67ca-488b-903a-fd8900bbd231 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:10:24.586Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb9f059b-67ca-488b-903a-fd8900bbd231 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:10:27.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b24a4733-6d36-411f-b839-28b7d17f8c50 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:10:27.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b24a4733-6d36-411f-b839-28b7d17f8c50 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@72614fd8
2021-06-04T01:10:27.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b24a4733-6d36-411f-b839-28b7d17f8c50 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:10:27.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b24a4733-6d36-411f-b839-28b7d17f8c50 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:10:28.873Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:10:28.876Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:10:29.773Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59cf0ee6-0cf8-4581-b463-158b18073528 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:10:29.773Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59cf0ee6-0cf8-4581-b463-158b18073528 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6494b1a0
2021-06-04T01:10:29.773Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59cf0ee6-0cf8-4581-b463-158b18073528 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:10:29.773Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59cf0ee6-0cf8-4581-b463-158b18073528 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:10:31.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acd927a8-fa59-4d8b-a244-867aadb303fe PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:10:31.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acd927a8-fa59-4d8b-a244-867aadb303fe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@48815d56
2021-06-04T01:10:31.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acd927a8-fa59-4d8b-a244-867aadb303fe PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:10:31.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acd927a8-fa59-4d8b-a244-867aadb303fe PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:10:33.413Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:10:33.413Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:10:35.298Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b7a7821-de58-4ccb-9fe3-97a5ff2662aa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:10:35.298Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b7a7821-de58-4ccb-9fe3-97a5ff2662aa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@c23a9d
2021-06-04T01:10:35.298Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b7a7821-de58-4ccb-9fe3-97a5ff2662aa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:10:35.298Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b7a7821-de58-4ccb-9fe3-97a5ff2662aa PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:10:38.446Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59269060-aafd-4570-a27c-2995bca80388 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:10:38.446Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59269060-aafd-4570-a27c-2995bca80388 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@78a5bad2
2021-06-04T01:10:38.446Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59269060-aafd-4570-a27c-2995bca80388 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:10:38.446Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59269060-aafd-4570-a27c-2995bca80388 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:10:40.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c2f9513-90bc-4aec-87b5-209576990360 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:10:40.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c2f9513-90bc-4aec-87b5-209576990360 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@397d0dd7
2021-06-04T01:10:40.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c2f9513-90bc-4aec-87b5-209576990360 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:10:40.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c2f9513-90bc-4aec-87b5-209576990360 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:10:43.859Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61188c86-d39b-464d-aa67-f184b6f2f044 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:10:43.859Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61188c86-d39b-464d-aa67-f184b6f2f044 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b548c43
2021-06-04T01:10:43.859Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61188c86-d39b-464d-aa67-f184b6f2f044 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:10:43.859Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61188c86-d39b-464d-aa67-f184b6f2f044 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:10:46.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fd01181-2667-4f3f-93fb-5b3f6349cb8a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:10:46.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fd01181-2667-4f3f-93fb-5b3f6349cb8a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ad34766
2021-06-04T01:10:46.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fd01181-2667-4f3f-93fb-5b3f6349cb8a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:10:46.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fd01181-2667-4f3f-93fb-5b3f6349cb8a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:10:48.961Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T01:10:48.962Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T01:10:48.962Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T01:10:49.969Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db4c30e8-dbe4-49b0-bda7-2bb9c70f10f8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:10:49.969Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db4c30e8-dbe4-49b0-bda7-2bb9c70f10f8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f7503c4
2021-06-04T01:10:49.969Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db4c30e8-dbe4-49b0-bda7-2bb9c70f10f8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:10:49.969Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db4c30e8-dbe4-49b0-bda7-2bb9c70f10f8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:10:52.972Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=db4c30e8-dbe4-49b0-bda7-2bb9c70f10f8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:10:52.973Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=db4c30e8-dbe4-49b0-bda7-2bb9c70f10f8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:10:52.973Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=db4c30e8-dbe4-49b0-bda7-2bb9c70f10f8 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:10:52.973Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=db4c30e8-dbe4-49b0-bda7-2bb9c70f10f8 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:10:53.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:10:53.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:10:56.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:10:58.778Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:10:58.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43ab424d-2bf0-4d65-a20f-e17487921904 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:10:58.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43ab424d-2bf0-4d65-a20f-e17487921904 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6eb7a248
2021-06-04T01:10:58.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43ab424d-2bf0-4d65-a20f-e17487921904 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:10:58.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43ab424d-2bf0-4d65-a20f-e17487921904 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:10:59.482Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://message-router.onap:3904: The target server failed to respond
2021-06-04T01:10:59.482Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:10:59.618Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=43ab424d-2bf0-4d65-a20f-e17487921904 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:10:59.618Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=43ab424d-2bf0-4d65-a20f-e17487921904 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:11:00.286Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e05dd2d-7a1d-42d4-ab81-b19af770cf75 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:11:00.286Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e05dd2d-7a1d-42d4-ab81-b19af770cf75 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41c68473
2021-06-04T01:11:00.286Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e05dd2d-7a1d-42d4-ab81-b19af770cf75 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:11:00.286Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e05dd2d-7a1d-42d4-ab81-b19af770cf75 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:11:00.947Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:11:00.948Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:11:01.218Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 503 Service Unavailable
2021-06-04T01:11:01.219Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 503
2021-06-04T01:11:01.219Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=503, variables=[]]
2021-06-04T01:11:02.578Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=979247f4-cb58-4cb3-9cb9-cd8d34c1c1b2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:11:02.578Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=979247f4-cb58-4cb3-9cb9-cd8d34c1c1b2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@563ac4ac
2021-06-04T01:11:02.578Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=979247f4-cb58-4cb3-9cb9-cd8d34c1c1b2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:11:02.578Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=979247f4-cb58-4cb3-9cb9-cd8d34c1c1b2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:11:03.194Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e162de0-b54b-4135-9279-faa8e3bef417 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:11:03.194Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e162de0-b54b-4135-9279-faa8e3bef417 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5cc99c1
2021-06-04T01:11:03.194Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e162de0-b54b-4135-9279-faa8e3bef417 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:11:03.194Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e162de0-b54b-4135-9279-faa8e3bef417 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:11:05.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4515768-d624-4c1c-a0ae-dd71aa42e2ec PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:11:05.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4515768-d624-4c1c-a0ae-dd71aa42e2ec PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@44b96864
2021-06-04T01:11:05.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4515768-d624-4c1c-a0ae-dd71aa42e2ec PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:11:05.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4515768-d624-4c1c-a0ae-dd71aa42e2ec PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:11:08.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85f7ea74-62f0-4f0c-91a3-12f0e61afe10 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:11:08.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85f7ea74-62f0-4f0c-91a3-12f0e61afe10 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3129999c
2021-06-04T01:11:08.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85f7ea74-62f0-4f0c-91a3-12f0e61afe10 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:11:08.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85f7ea74-62f0-4f0c-91a3-12f0e61afe10 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:11:10.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=689b0a5b-3ab7-4cd0-a755-c1a2bbac89a6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:11:10.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=689b0a5b-3ab7-4cd0-a755-c1a2bbac89a6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@313624b1
2021-06-04T01:11:10.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=689b0a5b-3ab7-4cd0-a755-c1a2bbac89a6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:11:10.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=689b0a5b-3ab7-4cd0-a755-c1a2bbac89a6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:11:13.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8203d7c7-64ef-46d0-bea5-690f907135a8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:11:13.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8203d7c7-64ef-46d0-bea5-690f907135a8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50d5b1c7
2021-06-04T01:11:13.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8203d7c7-64ef-46d0-bea5-690f907135a8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:11:13.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8203d7c7-64ef-46d0-bea5-690f907135a8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:11:16.877Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4d981c4-6d5a-41f0-bc55-803be7856a81 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:11:16.877Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4d981c4-6d5a-41f0-bc55-803be7856a81 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5fa019f1
2021-06-04T01:11:16.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4d981c4-6d5a-41f0-bc55-803be7856a81 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:11:16.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4d981c4-6d5a-41f0-bc55-803be7856a81 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:11:20.578Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4255a3e-4549-46d6-846e-79015d674db4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:11:20.578Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4255a3e-4549-46d6-846e-79015d674db4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22388ee0
2021-06-04T01:11:20.578Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4255a3e-4549-46d6-846e-79015d674db4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:11:20.578Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4255a3e-4549-46d6-846e-79015d674db4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:11:23.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:11:23.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:11:23.583Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f4255a3e-4549-46d6-846e-79015d674db4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:11:23.583Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f4255a3e-4549-46d6-846e-79015d674db4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:11:23.583Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f4255a3e-4549-46d6-846e-79015d674db4 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:11:23.583Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f4255a3e-4549-46d6-846e-79015d674db4 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:11:26.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:11:29.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57344ab3-3786-47d3-89e4-47d6d480cc7a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:11:29.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57344ab3-3786-47d3-89e4-47d6d480cc7a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22ab35ba
2021-06-04T01:11:29.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57344ab3-3786-47d3-89e4-47d6d480cc7a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:11:29.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57344ab3-3786-47d3-89e4-47d6d480cc7a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:11:29.110Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:11:29.665Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=57344ab3-3786-47d3-89e4-47d6d480cc7a ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:11:29.665Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=57344ab3-3786-47d3-89e4-47d6d480cc7a ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T01:11:35.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:11:35.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:11:36.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b86b12a-5399-4838-9d07-4260e5cca13c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:11:36.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b86b12a-5399-4838-9d07-4260e5cca13c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@bd1630
2021-06-04T01:11:36.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b86b12a-5399-4838-9d07-4260e5cca13c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:11:36.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b86b12a-5399-4838-9d07-4260e5cca13c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:11:37.626Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=2b86b12a-5399-4838-9d07-4260e5cca13c ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:11:37.626Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=2b86b12a-5399-4838-9d07-4260e5cca13c ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:11:38.014Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:11:38.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=98c7311b-05c8-4048-8cb3-c90eff894346 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:11:38.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=98c7311b-05c8-4048-8cb3-c90eff894346 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6614c749
2021-06-04T01:11:38.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=98c7311b-05c8-4048-8cb3-c90eff894346 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:11:38.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=98c7311b-05c8-4048-8cb3-c90eff894346 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:11:38.986Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=98c7311b-05c8-4048-8cb3-c90eff894346 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:11:38.986Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=98c7311b-05c8-4048-8cb3-c90eff894346 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T01:11:40.077Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b47ee43-4ed3-407d-9e5d-fade8f9c9248 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:11:40.077Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b47ee43-4ed3-407d-9e5d-fade8f9c9248 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1de928d4
2021-06-04T01:11:40.077Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b47ee43-4ed3-407d-9e5d-fade8f9c9248 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:11:40.077Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b47ee43-4ed3-407d-9e5d-fade8f9c9248 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:11:40.619Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9b47ee43-4ed3-407d-9e5d-fade8f9c9248 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:11:40.619Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9b47ee43-4ed3-407d-9e5d-fade8f9c9248 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:11:41.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69d5eddb-62a5-4e5f-90a9-e2a8a8a056f7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:11:41.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69d5eddb-62a5-4e5f-90a9-e2a8a8a056f7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d49d033
2021-06-04T01:11:41.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69d5eddb-62a5-4e5f-90a9-e2a8a8a056f7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:11:41.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69d5eddb-62a5-4e5f-90a9-e2a8a8a056f7 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:11:42.162Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4853ba50-0f7f-4364-a6a8-db7fa5ed7725 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:11:42.162Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4853ba50-0f7f-4364-a6a8-db7fa5ed7725 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@452d4f3c
2021-06-04T01:11:42.162Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4853ba50-0f7f-4364-a6a8-db7fa5ed7725 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:11:42.162Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4853ba50-0f7f-4364-a6a8-db7fa5ed7725 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:11:42.855Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f566903-8cc7-4219-9a59-55fa694ef359 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:11:42.855Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f566903-8cc7-4219-9a59-55fa694ef359 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c3e65f
2021-06-04T01:11:42.855Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f566903-8cc7-4219-9a59-55fa694ef359 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:11:42.855Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f566903-8cc7-4219-9a59-55fa694ef359 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:11:43.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abab5153-d4bf-4f6d-828a-88b0d4d5e0a0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:11:43.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abab5153-d4bf-4f6d-828a-88b0d4d5e0a0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@51b8d1bb
2021-06-04T01:11:43.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abab5153-d4bf-4f6d-828a-88b0d4d5e0a0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:11:43.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abab5153-d4bf-4f6d-828a-88b0d4d5e0a0 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:11:47.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=556f6e0b-6c36-4732-83b5-ced3923db6f3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:11:47.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=556f6e0b-6c36-4732-83b5-ced3923db6f3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@32135bf7
2021-06-04T01:11:47.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=556f6e0b-6c36-4732-83b5-ced3923db6f3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:11:47.151Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=556f6e0b-6c36-4732-83b5-ced3923db6f3 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:11:48.961Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T01:11:48.961Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T01:11:48.962Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T01:11:50.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c12fcc03-ebe6-42d5-93e1-146786a3e95c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:11:50.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c12fcc03-ebe6-42d5-93e1-146786a3e95c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d68a626
2021-06-04T01:11:50.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c12fcc03-ebe6-42d5-93e1-146786a3e95c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:11:50.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c12fcc03-ebe6-42d5-93e1-146786a3e95c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:11:52.858Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4335050-6205-4723-9df0-5574b42a1668 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:11:52.859Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4335050-6205-4723-9df0-5574b42a1668 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7034aca
2021-06-04T01:11:52.859Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4335050-6205-4723-9df0-5574b42a1668 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:11:52.859Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4335050-6205-4723-9df0-5574b42a1668 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:11:55.864Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a4335050-6205-4723-9df0-5574b42a1668 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:11:55.864Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a4335050-6205-4723-9df0-5574b42a1668 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:11:55.865Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a4335050-6205-4723-9df0-5574b42a1668 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:11:55.865Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a4335050-6205-4723-9df0-5574b42a1668 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:11:56.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:11:56.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:11:58.833Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://message-router.onap:3904: The target server failed to respond
2021-06-04T01:11:58.833Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:11:59.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:12:01.553Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:12:02.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5266984-d74c-4e5f-8194-0f955da3487d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:12:02.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5266984-d74c-4e5f-8194-0f955da3487d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@10a16698
2021-06-04T01:12:02.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5266984-d74c-4e5f-8194-0f955da3487d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:12:02.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5266984-d74c-4e5f-8194-0f955da3487d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:12:02.552Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=d5266984-d74c-4e5f-8194-0f955da3487d ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:12:02.552Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=d5266984-d74c-4e5f-8194-0f955da3487d ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:12:03.067Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99e5aaf0-b86b-4c7a-aa2f-5656081c262f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:12:03.067Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99e5aaf0-b86b-4c7a-aa2f-5656081c262f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60c49330
2021-06-04T01:12:03.067Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99e5aaf0-b86b-4c7a-aa2f-5656081c262f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:12:03.067Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99e5aaf0-b86b-4c7a-aa2f-5656081c262f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:12:05.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:12:05.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:12:06.859Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2f6c4ad-97ec-41c7-aa2d-219c3c5ed2c5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:12:06.860Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2f6c4ad-97ec-41c7-aa2d-219c3c5ed2c5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d0cc0f8
2021-06-04T01:12:06.860Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2f6c4ad-97ec-41c7-aa2d-219c3c5ed2c5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:12:06.860Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2f6c4ad-97ec-41c7-aa2d-219c3c5ed2c5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:12:08.114Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:12:11.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=adbb6ba0-d1d1-40c0-a9bf-caedb60a2757 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:12:11.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=adbb6ba0-d1d1-40c0-a9bf-caedb60a2757 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6682fc67
2021-06-04T01:12:11.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=adbb6ba0-d1d1-40c0-a9bf-caedb60a2757 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:12:11.055Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=adbb6ba0-d1d1-40c0-a9bf-caedb60a2757 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:12:11.174Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=adbb6ba0-d1d1-40c0-a9bf-caedb60a2757 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:12:11.174Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=adbb6ba0-d1d1-40c0-a9bf-caedb60a2757 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T01:12:12.064Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34dbe9e1-d765-4c72-86e3-00fcb6e45521 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:12:12.064Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34dbe9e1-d765-4c72-86e3-00fcb6e45521 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7489e2a4
2021-06-04T01:12:12.064Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34dbe9e1-d765-4c72-86e3-00fcb6e45521 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:12:12.064Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34dbe9e1-d765-4c72-86e3-00fcb6e45521 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:12:14.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:12:14.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:12:15.070Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=34dbe9e1-d765-4c72-86e3-00fcb6e45521 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:12:15.070Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=34dbe9e1-d765-4c72-86e3-00fcb6e45521 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:12:15.070Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=34dbe9e1-d765-4c72-86e3-00fcb6e45521 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:12:15.070Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=34dbe9e1-d765-4c72-86e3-00fcb6e45521 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:12:15.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aea5ccb5-6af2-487e-be86-de042bd44e8c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:12:15.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aea5ccb5-6af2-487e-be86-de042bd44e8c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3010b216
2021-06-04T01:12:15.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aea5ccb5-6af2-487e-be86-de042bd44e8c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:12:15.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aea5ccb5-6af2-487e-be86-de042bd44e8c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:12:16.278Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=aea5ccb5-6af2-487e-be86-de042bd44e8c ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:12:16.278Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=aea5ccb5-6af2-487e-be86-de042bd44e8c ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T01:12:16.697Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:12:16.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3272a292-de31-4ba5-827f-d93a8ae920ba PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:12:16.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3272a292-de31-4ba5-827f-d93a8ae920ba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a101f2f
2021-06-04T01:12:16.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3272a292-de31-4ba5-827f-d93a8ae920ba PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:12:16.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3272a292-de31-4ba5-827f-d93a8ae920ba PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:12:22.820Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f18383e2-229b-4a99-8723-c5b3ade5a7f1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:12:22.820Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f18383e2-229b-4a99-8723-c5b3ade5a7f1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@61374a0b
2021-06-04T01:12:22.820Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f18383e2-229b-4a99-8723-c5b3ade5a7f1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:12:22.820Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f18383e2-229b-4a99-8723-c5b3ade5a7f1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:12:23.052Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f18383e2-229b-4a99-8723-c5b3ade5a7f1 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:12:23.052Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f18383e2-229b-4a99-8723-c5b3ade5a7f1 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:12:29.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:12:29.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:12:30.558Z [cluster1-nio-worker-1] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ONE (1 responses were required but only 0 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.DefaultResultSetFuture.onSet(DefaultResultSetFuture.java:215)
at com.datastax.driver.core.DefaultResultSetFuture.onSet(DefaultResultSetFuture.java:242)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ONE (1 responses were required but only 0 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T01:12:30.558Z [cluster1-nio-worker-1] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.ConnectionException: [cassandra.onap/10.242.138.69:9042] Pool was closed during initialization
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:173)
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:158)
at com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1080)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.google.common.util.concurrent.CollectionFuture.handleAllCompleted(CollectionFuture.java:69)
at com.google.common.util.concurrent.AggregateFuture.processCompleted(AggregateFuture.java:282)
at com.google.common.util.concurrent.AggregateFuture.decrementCountAndMaybeComplete(AggregateFuture.java:264)
at com.google.common.util.concurrent.AggregateFuture.access$200(AggregateFuture.java:42)
at com.google.common.util.concurrent.AggregateFuture$1.run(AggregateFuture.java:147)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179)
at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179)
at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:100)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771)
at com.datastax.driver.core.DefaultResultSetFuture.onSet(DefaultResultSetFuture.java:215)
at com.datastax.driver.core.DefaultResultSetFuture.onSet(DefaultResultSetFuture.java:242)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:12:30.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fde417ea-f55c-4148-9bc3-0758f7edd551 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:12:30.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fde417ea-f55c-4148-9bc3-0758f7edd551 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5402d439
2021-06-04T01:12:30.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fde417ea-f55c-4148-9bc3-0758f7edd551 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:12:30.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fde417ea-f55c-4148-9bc3-0758f7edd551 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:12:31.093Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69da3df2-026c-4a8c-a913-59d8f40a2d3e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:12:31.093Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69da3df2-026c-4a8c-a913-59d8f40a2d3e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ad3fe8a
2021-06-04T01:12:31.093Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69da3df2-026c-4a8c-a913-59d8f40a2d3e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:12:31.093Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69da3df2-026c-4a8c-a913-59d8f40a2d3e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:12:32.957Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:12:33.618Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=69da3df2-026c-4a8c-a913-59d8f40a2d3e ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:12:33.619Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=69da3df2-026c-4a8c-a913-59d8f40a2d3e ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T01:12:34.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a07e59c1-2f88-46c0-8d19-13f472d22e3f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:12:34.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a07e59c1-2f88-46c0-8d19-13f472d22e3f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20e07f98
2021-06-04T01:12:34.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a07e59c1-2f88-46c0-8d19-13f472d22e3f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:12:34.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a07e59c1-2f88-46c0-8d19-13f472d22e3f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:12:34.575Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a07e59c1-2f88-46c0-8d19-13f472d22e3f ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:12:34.575Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a07e59c1-2f88-46c0-8d19-13f472d22e3f ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:12:36.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e637a136-f148-4909-9516-a22f77887de4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:12:36.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e637a136-f148-4909-9516-a22f77887de4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7bdc1e9d
2021-06-04T01:12:36.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e637a136-f148-4909-9516-a22f77887de4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:12:36.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e637a136-f148-4909-9516-a22f77887de4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:12:39.221Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fe6dea3-64d6-4955-af41-49487c3e64ea PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:12:39.221Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fe6dea3-64d6-4955-af41-49487c3e64ea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@393dbec3
2021-06-04T01:12:39.221Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fe6dea3-64d6-4955-af41-49487c3e64ea PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:12:39.221Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fe6dea3-64d6-4955-af41-49487c3e64ea PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:12:42.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92b5fb3d-c184-4616-9b7c-a765bc429a13 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:12:42.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92b5fb3d-c184-4616-9b7c-a765bc429a13 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5cff20c0
2021-06-04T01:12:42.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92b5fb3d-c184-4616-9b7c-a765bc429a13 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:12:42.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92b5fb3d-c184-4616-9b7c-a765bc429a13 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:12:43.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3dfd18a3-1230-4cac-9bb6-8a67798568b7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:12:43.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3dfd18a3-1230-4cac-9bb6-8a67798568b7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f408878
2021-06-04T01:12:43.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3dfd18a3-1230-4cac-9bb6-8a67798568b7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:12:43.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3dfd18a3-1230-4cac-9bb6-8a67798568b7 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:12:44.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d0696a8-c967-4a38-ba16-47bfc4ceea03 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:12:44.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d0696a8-c967-4a38-ba16-47bfc4ceea03 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@647349fb
2021-06-04T01:12:44.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d0696a8-c967-4a38-ba16-47bfc4ceea03 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:12:44.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d0696a8-c967-4a38-ba16-47bfc4ceea03 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:12:48.106Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=200edc56-e20b-4b59-8af9-5bde1b9504f6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:12:48.106Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=200edc56-e20b-4b59-8af9-5bde1b9504f6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30ec3810
2021-06-04T01:12:48.106Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=200edc56-e20b-4b59-8af9-5bde1b9504f6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:12:48.106Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=200edc56-e20b-4b59-8af9-5bde1b9504f6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:12:50.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c19d07d-fa0a-46cd-a1dc-3aa2821fd4b7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:12:50.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c19d07d-fa0a-46cd-a1dc-3aa2821fd4b7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15b0f7ed
2021-06-04T01:12:50.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c19d07d-fa0a-46cd-a1dc-3aa2821fd4b7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:12:50.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c19d07d-fa0a-46cd-a1dc-3aa2821fd4b7 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:12:51.759Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=957e768f-d5bb-4348-bcff-8a072c0d7a28 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:12:51.760Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=957e768f-d5bb-4348-bcff-8a072c0d7a28 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e48be6b
2021-06-04T01:12:51.760Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=957e768f-d5bb-4348-bcff-8a072c0d7a28 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:12:51.760Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=957e768f-d5bb-4348-bcff-8a072c0d7a28 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:12:53.684Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85b543b2-109b-46bb-be70-6baf24eccbc5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:12:53.685Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85b543b2-109b-46bb-be70-6baf24eccbc5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@100a0ec8
2021-06-04T01:12:53.685Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85b543b2-109b-46bb-be70-6baf24eccbc5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:12:53.685Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85b543b2-109b-46bb-be70-6baf24eccbc5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:12:56.690Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=85b543b2-109b-46bb-be70-6baf24eccbc5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:12:56.690Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=85b543b2-109b-46bb-be70-6baf24eccbc5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:12:56.691Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=85b543b2-109b-46bb-be70-6baf24eccbc5 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:12:56.691Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=85b543b2-109b-46bb-be70-6baf24eccbc5 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:13:16.731Z [cluster1-timeouter-0] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.138.69:9042] Operation timed out
at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:13:16.731Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b6c78cc-d135-46c6-82aa-021c35fba8cd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:13:16.731Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b6c78cc-d135-46c6-82aa-021c35fba8cd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41f78861
2021-06-04T01:13:16.731Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b6c78cc-d135-46c6-82aa-021c35fba8cd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:13:16.731Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b6c78cc-d135-46c6-82aa-021c35fba8cd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:13:19.772Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=6b6c78cc-d135-46c6-82aa-021c35fba8cd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:13:19.772Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=6b6c78cc-d135-46c6-82aa-021c35fba8cd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:13:20.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46ec67df-7df7-40e5-a266-8bbf8b8cce7d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:13:20.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46ec67df-7df7-40e5-a266-8bbf8b8cce7d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@787a57cd
2021-06-04T01:13:20.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46ec67df-7df7-40e5-a266-8bbf8b8cce7d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:13:20.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46ec67df-7df7-40e5-a266-8bbf8b8cce7d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:13:23.123Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=46ec67df-7df7-40e5-a266-8bbf8b8cce7d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:13:23.123Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=46ec67df-7df7-40e5-a266-8bbf8b8cce7d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:13:23.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4855bf73-4c82-41d2-9306-40a91067057d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:13:23.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4855bf73-4c82-41d2-9306-40a91067057d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@458f49bd
2021-06-04T01:13:23.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4855bf73-4c82-41d2-9306-40a91067057d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:13:23.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4855bf73-4c82-41d2-9306-40a91067057d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:13:24.550Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:13:24.550Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:13:25.550Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:13:26.550Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:13:26.562Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=4855bf73-4c82-41d2-9306-40a91067057d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:13:26.562Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=4855bf73-4c82-41d2-9306-40a91067057d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:13:27.551Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:13:27.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d54c546-028d-47ad-aa82-a214b22757a5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:13:27.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d54c546-028d-47ad-aa82-a214b22757a5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c893177
2021-06-04T01:13:27.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d54c546-028d-47ad-aa82-a214b22757a5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:13:27.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d54c546-028d-47ad-aa82-a214b22757a5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:13:28.551Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:13:29.370Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:13:30.261Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=5d54c546-028d-47ad-aa82-a214b22757a5 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:13:30.261Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=5d54c546-028d-47ad-aa82-a214b22757a5 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T01:13:30.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a63315ab-b947-4682-89ef-4b6aff5777c5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:13:30.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a63315ab-b947-4682-89ef-4b6aff5777c5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@586b9d06
2021-06-04T01:13:30.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a63315ab-b947-4682-89ef-4b6aff5777c5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:13:30.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a63315ab-b947-4682-89ef-4b6aff5777c5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:13:31.417Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a63315ab-b947-4682-89ef-4b6aff5777c5 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:13:31.417Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a63315ab-b947-4682-89ef-4b6aff5777c5 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:13:32.566Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:13:32.566Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:13:35.087Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:13:35.087Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:13:35.126Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:13:35.127Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T01:13:35.128Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T01:13:35.128Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T01:13:35.129Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T01:13:35.130Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T01:13:35.130Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T01:13:35.143Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:13:35.143Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:13:35.363Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f2c146d-ec80-4e0b-b716-f796feccf086 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:13:35.363Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f2c146d-ec80-4e0b-b716-f796feccf086 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20e6e948
2021-06-04T01:13:35.363Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f2c146d-ec80-4e0b-b716-f796feccf086 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:13:35.363Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f2c146d-ec80-4e0b-b716-f796feccf086 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:13:35.901Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:13:35.901Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:13:35.917Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:13:35.917Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:13:35.926Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T01:13:35.926Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T01:13:35.927Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T01:13:40.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db769163-f7f6-402f-b614-15bd0faba542 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:13:40.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db769163-f7f6-402f-b614-15bd0faba542 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c166aa
2021-06-04T01:13:40.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db769163-f7f6-402f-b614-15bd0faba542 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:13:40.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db769163-f7f6-402f-b614-15bd0faba542 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:13:44.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:13:44.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:13:47.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:13:48.305Z [cluster1-nio-worker-1] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:13:48.305Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6e77dd2-cd80-4697-9047-4604c8a27ca2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:13:48.306Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6e77dd2-cd80-4697-9047-4604c8a27ca2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@55104558
2021-06-04T01:13:48.306Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6e77dd2-cd80-4697-9047-4604c8a27ca2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:13:48.306Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6e77dd2-cd80-4697-9047-4604c8a27ca2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:13:48.961Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T01:13:48.961Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T01:13:48.962Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T01:13:48.962Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T01:13:50.154Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:13:50.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46910758-f5bd-4d46-9a31-8fd9ac2aa415 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:13:50.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46910758-f5bd-4d46-9a31-8fd9ac2aa415 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@51176151
2021-06-04T01:13:50.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46910758-f5bd-4d46-9a31-8fd9ac2aa415 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:13:50.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46910758-f5bd-4d46-9a31-8fd9ac2aa415 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:13:50.369Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=46910758-f5bd-4d46-9a31-8fd9ac2aa415 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:13:50.369Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=46910758-f5bd-4d46-9a31-8fd9ac2aa415 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T01:13:50.497Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec20f7db-43a6-4174-9aba-7fc870ef0570 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:13:50.497Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec20f7db-43a6-4174-9aba-7fc870ef0570 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@46ac7e92
2021-06-04T01:13:50.497Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec20f7db-43a6-4174-9aba-7fc870ef0570 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:13:50.498Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec20f7db-43a6-4174-9aba-7fc870ef0570 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:13:50.623Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ec20f7db-43a6-4174-9aba-7fc870ef0570 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:13:50.623Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ec20f7db-43a6-4174-9aba-7fc870ef0570 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:13:50.770Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5fdabb36-e0fa-4ec6-9671-b1fc4bfc0f95 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:13:50.770Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5fdabb36-e0fa-4ec6-9671-b1fc4bfc0f95 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4856a4db
2021-06-04T01:13:50.770Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5fdabb36-e0fa-4ec6-9671-b1fc4bfc0f95 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:13:50.770Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5fdabb36-e0fa-4ec6-9671-b1fc4bfc0f95 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:13:52.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=944a4f7d-606a-41f7-a90b-baa370a8c558 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:13:52.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=944a4f7d-606a-41f7-a90b-baa370a8c558 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1fbb020c
2021-06-04T01:13:52.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=944a4f7d-606a-41f7-a90b-baa370a8c558 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:13:52.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=944a4f7d-606a-41f7-a90b-baa370a8c558 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:13:56.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8f0a3b80-aea3-4875-820c-7e8fc4e3ad2b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:13:56.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8f0a3b80-aea3-4875-820c-7e8fc4e3ad2b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@75ccf543
2021-06-04T01:13:56.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8f0a3b80-aea3-4875-820c-7e8fc4e3ad2b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:13:56.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8f0a3b80-aea3-4875-820c-7e8fc4e3ad2b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:13:57.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a502c66-9964-447d-b1b0-1044a533c55d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:13:57.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a502c66-9964-447d-b1b0-1044a533c55d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50314d86
2021-06-04T01:13:57.673Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a502c66-9964-447d-b1b0-1044a533c55d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:13:57.673Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a502c66-9964-447d-b1b0-1044a533c55d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:14:00.678Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2a502c66-9964-447d-b1b0-1044a533c55d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:14:00.678Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2a502c66-9964-447d-b1b0-1044a533c55d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:14:00.678Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=2a502c66-9964-447d-b1b0-1044a533c55d ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:14:00.678Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=2a502c66-9964-447d-b1b0-1044a533c55d ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:14:02.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20f8b160-6eb3-4fc5-825e-40987153aece PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:14:02.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20f8b160-6eb3-4fc5-825e-40987153aece PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d3c5b27
2021-06-04T01:14:02.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20f8b160-6eb3-4fc5-825e-40987153aece PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:14:02.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20f8b160-6eb3-4fc5-825e-40987153aece PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:14:02.390Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=20f8b160-6eb3-4fc5-825e-40987153aece ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:14:02.390Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=20f8b160-6eb3-4fc5-825e-40987153aece ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:14:03.079Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c21c440d-84b6-4bce-96d8-5b66a645d189 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:14:03.079Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c21c440d-84b6-4bce-96d8-5b66a645d189 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7824010a
2021-06-04T01:14:03.079Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c21c440d-84b6-4bce-96d8-5b66a645d189 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:14:03.079Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c21c440d-84b6-4bce-96d8-5b66a645d189 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:14:04.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc2e3892-15c2-47cd-93e9-eaed3a6457d6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:14:04.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc2e3892-15c2-47cd-93e9-eaed3a6457d6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22232ef5
2021-06-04T01:14:04.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc2e3892-15c2-47cd-93e9-eaed3a6457d6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:14:04.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc2e3892-15c2-47cd-93e9-eaed3a6457d6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:14:05.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:14:05.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:14:06.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2fcd83c5-35f2-474a-997e-2de7d1ed58e5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:14:06.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2fcd83c5-35f2-474a-997e-2de7d1ed58e5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d89acf5
2021-06-04T01:14:06.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2fcd83c5-35f2-474a-997e-2de7d1ed58e5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:14:06.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2fcd83c5-35f2-474a-997e-2de7d1ed58e5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:14:06.593Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=2fcd83c5-35f2-474a-997e-2de7d1ed58e5 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:14:06.593Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=2fcd83c5-35f2-474a-997e-2de7d1ed58e5 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T01:14:16.572Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:14:17.710Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f5d2e0a-9da6-48b2-9654-1fde50d3ff2e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:14:17.710Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f5d2e0a-9da6-48b2-9654-1fde50d3ff2e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@308395d
2021-06-04T01:14:17.710Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f5d2e0a-9da6-48b2-9654-1fde50d3ff2e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:14:17.710Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f5d2e0a-9da6-48b2-9654-1fde50d3ff2e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:14:19.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ddd2c6a-7755-4e25-9705-4147241dabb1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:14:19.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ddd2c6a-7755-4e25-9705-4147241dabb1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b7c5467
2021-06-04T01:14:19.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ddd2c6a-7755-4e25-9705-4147241dabb1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:14:19.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ddd2c6a-7755-4e25-9705-4147241dabb1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:14:19.986Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0ddd2c6a-7755-4e25-9705-4147241dabb1 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:14:19.986Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0ddd2c6a-7755-4e25-9705-4147241dabb1 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:14:20.622Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:14:20.622Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:14:20.709Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8116b40c-d4da-4df2-8110-f17191d93507 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:14:20.709Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8116b40c-d4da-4df2-8110-f17191d93507 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60139d7b
2021-06-04T01:14:20.709Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8116b40c-d4da-4df2-8110-f17191d93507 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:14:20.709Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8116b40c-d4da-4df2-8110-f17191d93507 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:14:21.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a9b1b69-c91e-457a-8b3e-e31afd972de5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:14:21.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a9b1b69-c91e-457a-8b3e-e31afd972de5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@40dd6b88
2021-06-04T01:14:21.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a9b1b69-c91e-457a-8b3e-e31afd972de5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:14:21.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a9b1b69-c91e-457a-8b3e-e31afd972de5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:14:21.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78af2320-8315-4938-b4ca-9bd8c1ad3923 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:14:21.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78af2320-8315-4938-b4ca-9bd8c1ad3923 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2dd601f
2021-06-04T01:14:21.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78af2320-8315-4938-b4ca-9bd8c1ad3923 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:14:21.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78af2320-8315-4938-b4ca-9bd8c1ad3923 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:14:22.297Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b58a033d-b06e-43c6-9927-05dc78db7e5a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:14:22.297Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b58a033d-b06e-43c6-9927-05dc78db7e5a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3b3bd34f
2021-06-04T01:14:22.297Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b58a033d-b06e-43c6-9927-05dc78db7e5a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:14:22.297Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b58a033d-b06e-43c6-9927-05dc78db7e5a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:14:23.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14261a0a-06e4-4815-a5a6-c3b31cddbebd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:14:23.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14261a0a-06e4-4815-a5a6-c3b31cddbebd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47bf6916
2021-06-04T01:14:23.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14261a0a-06e4-4815-a5a6-c3b31cddbebd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:14:23.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14261a0a-06e4-4815-a5a6-c3b31cddbebd PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:14:27.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b5eb38b-b5df-4571-9342-d0da8c452aee PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:14:27.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b5eb38b-b5df-4571-9342-d0da8c452aee PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c15cb42
2021-06-04T01:14:27.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b5eb38b-b5df-4571-9342-d0da8c452aee PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:14:27.097Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b5eb38b-b5df-4571-9342-d0da8c452aee PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:14:28.380Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a790ee10-3348-43c3-8cd3-74ef1aaaf7d1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:14:28.380Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a790ee10-3348-43c3-8cd3-74ef1aaaf7d1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5218347
2021-06-04T01:14:28.380Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a790ee10-3348-43c3-8cd3-74ef1aaaf7d1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:14:28.380Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a790ee10-3348-43c3-8cd3-74ef1aaaf7d1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:14:29.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42c348dd-844e-4acc-b46d-9e300fb039c8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:14:29.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42c348dd-844e-4acc-b46d-9e300fb039c8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60659907
2021-06-04T01:14:29.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42c348dd-844e-4acc-b46d-9e300fb039c8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:14:29.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42c348dd-844e-4acc-b46d-9e300fb039c8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:14:32.178Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6251db9-9fee-42c5-8676-687da379677d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:14:32.178Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6251db9-9fee-42c5-8676-687da379677d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c2ebbc4
2021-06-04T01:14:32.178Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6251db9-9fee-42c5-8676-687da379677d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:14:32.178Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6251db9-9fee-42c5-8676-687da379677d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:14:32.495Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f38f569e-5882-4558-b1b1-f5ce9a00775e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:14:32.495Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f38f569e-5882-4558-b1b1-f5ce9a00775e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ea334d8
2021-06-04T01:14:32.495Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f38f569e-5882-4558-b1b1-f5ce9a00775e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:14:32.495Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f38f569e-5882-4558-b1b1-f5ce9a00775e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:14:48.715Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:14:48.715Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:14:49.715Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:14:50.716Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:14:51.716Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:14:52.716Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:14:53.717Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:14:54.831Z [cluster1-timeouter-0] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.138.69:9042] Operation timed out
at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:14:54.832Z [cluster1-timeouter-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.ConnectionException: [cassandra.onap/10.242.138.69:9042] Pool was closed during initialization
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:173)
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:158)
at com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1080)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.google.common.util.concurrent.CollectionFuture.handleAllCompleted(CollectionFuture.java:69)
at com.google.common.util.concurrent.AggregateFuture.processCompleted(AggregateFuture.java:282)
at com.google.common.util.concurrent.AggregateFuture.decrementCountAndMaybeComplete(AggregateFuture.java:264)
at com.google.common.util.concurrent.AggregateFuture.access$200(AggregateFuture.java:42)
at com.google.common.util.concurrent.AggregateFuture$1.run(AggregateFuture.java:147)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179)
at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179)
at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:100)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771)
at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:14:54.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=521ba01f-e185-4b1c-88ee-80a383e3005d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:14:54.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=521ba01f-e185-4b1c-88ee-80a383e3005d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1711b7f0
2021-06-04T01:14:54.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=521ba01f-e185-4b1c-88ee-80a383e3005d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:14:54.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=521ba01f-e185-4b1c-88ee-80a383e3005d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:14:56.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:14:57.839Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=521ba01f-e185-4b1c-88ee-80a383e3005d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:14:57.839Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=521ba01f-e185-4b1c-88ee-80a383e3005d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:14:57.839Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=521ba01f-e185-4b1c-88ee-80a383e3005d ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:14:57.839Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=521ba01f-e185-4b1c-88ee-80a383e3005d ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:14:58.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad19724b-2350-4fb2-885b-740bb4c027c2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:14:58.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad19724b-2350-4fb2-885b-740bb4c027c2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5bf0a9b4
2021-06-04T01:14:58.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad19724b-2350-4fb2-885b-740bb4c027c2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:14:58.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad19724b-2350-4fb2-885b-740bb4c027c2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:14:59.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:15:01.629Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ad19724b-2350-4fb2-885b-740bb4c027c2 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:15:01.629Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ad19724b-2350-4fb2-885b-740bb4c027c2 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:15:01.629Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ad19724b-2350-4fb2-885b-740bb4c027c2 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:15:01.629Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=ad19724b-2350-4fb2-885b-740bb4c027c2 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T01:15:01.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19036764-8225-414b-8fa6-28555b9bac50 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:15:01.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19036764-8225-414b-8fa6-28555b9bac50 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@75ab26ec
2021-06-04T01:15:01.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19036764-8225-414b-8fa6-28555b9bac50 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:15:01.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19036764-8225-414b-8fa6-28555b9bac50 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:15:02.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:15:04.811Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=19036764-8225-414b-8fa6-28555b9bac50 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:15:04.812Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=19036764-8225-414b-8fa6-28555b9bac50 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:15:05.376Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=889cd4fb-f323-41e8-9e84-d60397cb53cf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:15:05.376Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=889cd4fb-f323-41e8-9e84-d60397cb53cf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@31fc08c0
2021-06-04T01:15:05.376Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=889cd4fb-f323-41e8-9e84-d60397cb53cf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:15:05.376Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=889cd4fb-f323-41e8-9e84-d60397cb53cf PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:15:05.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:15:08.410Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=889cd4fb-f323-41e8-9e84-d60397cb53cf ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:15:08.411Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=889cd4fb-f323-41e8-9e84-d60397cb53cf ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:15:08.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:15:09.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ddc956a-54a1-4ae1-8dbb-d40030de63f2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:15:09.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ddc956a-54a1-4ae1-8dbb-d40030de63f2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2115c105
2021-06-04T01:15:09.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ddc956a-54a1-4ae1-8dbb-d40030de63f2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:15:09.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ddc956a-54a1-4ae1-8dbb-d40030de63f2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:15:11.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:15:12.107Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0ddc956a-54a1-4ae1-8dbb-d40030de63f2 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:15:12.107Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0ddc956a-54a1-4ae1-8dbb-d40030de63f2 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:15:12.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=036f8e5b-165b-4617-b843-4e4ad2111909 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:15:12.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=036f8e5b-165b-4617-b843-4e4ad2111909 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@627fb352
2021-06-04T01:15:12.285Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=036f8e5b-165b-4617-b843-4e4ad2111909 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:15:12.285Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=036f8e5b-165b-4617-b843-4e4ad2111909 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:15:14.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:15:14.622Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=ApplicationDataTypesCache Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177)
at org.apache.tinkerpop.gremlin.structure.Element.keys(Element.java:69)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getProperties(JanusGraphGenericDao.java:1491)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getByCriteria(JanusGraphGenericDao.java:759)
at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypeNodes(PropertyOperation.java:1566)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.findAllDataTypesLazy(ApplicationDataTypeCache.java:309)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.hasDataTypesChanged(ApplicationDataTypeCache.java:220)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:200)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T01:15:15.318Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=036f8e5b-165b-4617-b843-4e4ad2111909 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:15:15.318Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=036f8e5b-165b-4617-b843-4e4ad2111909 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:15:16.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bcb2bf07-1dbb-4451-b391-805649065ebb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:15:16.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bcb2bf07-1dbb-4451-b391-805649065ebb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@48bdf4cd
2021-06-04T01:15:16.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bcb2bf07-1dbb-4451-b391-805649065ebb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:15:16.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bcb2bf07-1dbb-4451-b391-805649065ebb PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:15:17.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:15:19.055Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=bcb2bf07-1dbb-4451-b391-805649065ebb ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:15:19.056Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=bcb2bf07-1dbb-4451-b391-805649065ebb ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:15:19.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd6ee349-60ab-47df-80e6-a281f55ad023 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:15:19.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd6ee349-60ab-47df-80e6-a281f55ad023 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@447f4ce4
2021-06-04T01:15:19.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd6ee349-60ab-47df-80e6-a281f55ad023 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:15:19.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd6ee349-60ab-47df-80e6-a281f55ad023 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:15:20.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:15:22.643Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=fd6ee349-60ab-47df-80e6-a281f55ad023 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:15:22.643Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=fd6ee349-60ab-47df-80e6-a281f55ad023 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:15:23.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6092b3c1-4219-413e-b58d-cce93025e46f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:15:23.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6092b3c1-4219-413e-b58d-cce93025e46f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c158db3
2021-06-04T01:15:23.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6092b3c1-4219-413e-b58d-cce93025e46f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:15:23.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6092b3c1-4219-413e-b58d-cce93025e46f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:15:23.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:15:23.854Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=ApplicationDataTypesCache Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177)
at org.apache.tinkerpop.gremlin.structure.Element.keys(Element.java:69)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getProperties(JanusGraphGenericDao.java:1491)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getByCriteria(JanusGraphGenericDao.java:759)
at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypeNodes(PropertyOperation.java:1566)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.findAllDataTypesLazy(ApplicationDataTypeCache.java:309)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.hasDataTypesChanged(ApplicationDataTypeCache.java:220)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:200)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T01:15:26.053Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=6092b3c1-4219-413e-b58d-cce93025e46f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:15:26.054Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=6092b3c1-4219-413e-b58d-cce93025e46f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:15:26.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:15:26.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8ee33ed-0ee9-47a6-8845-7bd65499faa5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:15:26.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8ee33ed-0ee9-47a6-8845-7bd65499faa5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15ce5418
2021-06-04T01:15:26.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8ee33ed-0ee9-47a6-8845-7bd65499faa5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:15:26.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8ee33ed-0ee9-47a6-8845-7bd65499faa5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:15:28.864Z [pool-8-thread-1] WARN o.j.diskstorage.log.kcvs.KCVSLog Could not read messages for timestamp [2021-06-04T01:15:00Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:56)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:158)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:726)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:100)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
... 8 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:792)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:789)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:147)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:161)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
... 9 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T01:15:29.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:15:29.617Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d8ee33ed-0ee9-47a6-8845-7bd65499faa5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:15:29.617Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d8ee33ed-0ee9-47a6-8845-7bd65499faa5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:15:30.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e4afc28-5cf6-4add-90b6-18f0bc95c012 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:15:30.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e4afc28-5cf6-4add-90b6-18f0bc95c012 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@56700762
2021-06-04T01:15:30.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e4afc28-5cf6-4add-90b6-18f0bc95c012 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:15:30.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e4afc28-5cf6-4add-90b6-18f0bc95c012 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:15:30.851Z [cluster1-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T01:15:30.852Z [cluster1-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 4000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:15:30.964Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=ApplicationDataTypesCache Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177)
at org.apache.tinkerpop.gremlin.structure.Element.keys(Element.java:69)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getProperties(JanusGraphGenericDao.java:1491)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getByCriteria(JanusGraphGenericDao.java:759)
at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypeNodes(PropertyOperation.java:1566)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.findAllDataTypesLazy(ApplicationDataTypeCache.java:309)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.hasDataTypesChanged(ApplicationDataTypeCache.java:220)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:200)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T01:15:31.134Z [JanusGraph-Health-Check-Thread] INFO o.j.d.util.BackendOperation Temporary exception during backend operation [VertexIndexQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:399)
at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:396)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.indexQuery(BackendTransaction.java:396)
at org.janusgraph.graphdb.query.graph.MultiKeySliceQuery.execute(MultiKeySliceQuery.java:51)
at org.janusgraph.graphdb.database.IndexSerializer.query(IndexSerializer.java:512)
at org.janusgraph.graphdb.util.SubqueryIterator.(SubqueryIterator.java:66)
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1295)
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1190)
at org.janusgraph.graphdb.query.QueryProcessor$LimitAdjustingIterator.getNewIterator(QueryProcessor.java:194)
at org.janusgraph.graphdb.query.LimitAdjustingIterator.hasNext(LimitAdjustingIterator.java:68)
at org.janusgraph.graphdb.query.ResultSetIterator.nextInternal(ResultSetIterator.java:54)
at org.janusgraph.graphdb.query.ResultSetIterator.(ResultSetIterator.java:44)
at org.janusgraph.graphdb.query.QueryProcessor.iterator(QueryProcessor.java:66)
at com.google.common.collect.Iterables$4.iterator(Iterables.java:559)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:340)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:336)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
... 4 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T01:15:32.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:15:33.106Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=4e4afc28-5cf6-4add-90b6-18f0bc95c012 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:15:33.106Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=4e4afc28-5cf6-4add-90b6-18f0bc95c012 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:15:33.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c76bb8a5-fd7b-469b-8961-79cd145b0fc3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:15:33.520Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c76bb8a5-fd7b-469b-8961-79cd145b0fc3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b54fa8b
2021-06-04T01:15:33.520Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c76bb8a5-fd7b-469b-8961-79cd145b0fc3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:15:33.520Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c76bb8a5-fd7b-469b-8961-79cd145b0fc3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:15:35.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:15:36.161Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=ApplicationDataTypesCache Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177)
at org.apache.tinkerpop.gremlin.structure.Element.keys(Element.java:69)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getProperties(JanusGraphGenericDao.java:1491)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getByCriteria(JanusGraphGenericDao.java:759)
at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypeNodes(PropertyOperation.java:1566)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.findAllDataTypesLazy(ApplicationDataTypeCache.java:309)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.hasDataTypesChanged(ApplicationDataTypeCache.java:220)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:200)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T01:15:36.394Z [JanusGraph-Health-Check-Thread] INFO o.j.d.util.BackendOperation Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.execute(VertexCentricQueryBuilder.java:73)
at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.properties(VertexCentricQueryBuilder.java:100)
at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177)
at org.apache.tinkerpop.gremlin.structure.Vertex.property(Vertex.java:70)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:341)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:336)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
... 4 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T01:15:36.560Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=c76bb8a5-fd7b-469b-8961-79cd145b0fc3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:15:36.560Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=c76bb8a5-fd7b-469b-8961-79cd145b0fc3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:15:37.185Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03806231-f339-4d0f-a361-52c8d697f07c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:15:37.185Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03806231-f339-4d0f-a361-52c8d697f07c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@682484fe
2021-06-04T01:15:37.185Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03806231-f339-4d0f-a361-52c8d697f07c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:15:37.185Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03806231-f339-4d0f-a361-52c8d697f07c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:15:38.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:15:40.219Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=03806231-f339-4d0f-a361-52c8d697f07c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:15:40.219Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=03806231-f339-4d0f-a361-52c8d697f07c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:15:40.476Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31364c5e-f439-4835-8184-24b84df3099c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:15:40.476Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31364c5e-f439-4835-8184-24b84df3099c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@40edbaaa
2021-06-04T01:15:40.476Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31364c5e-f439-4835-8184-24b84df3099c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:15:40.477Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31364c5e-f439-4835-8184-24b84df3099c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:15:41.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:15:41.815Z [ApplicationDataTypeCacheThread-1] ERROR o.o.s.b.m.c.ApplicationDataTypeCache RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=900 TargetEntity=null Failed to fetch data types from database. Status is GENERAL_ERROR
2021-06-04T01:15:41.815Z [ApplicationDataTypeCacheThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=ApplicationDataTypesCache Internal Connection problem. Description: Failed to fetch data types from database. Status is GENERAL_ERROR
2021-06-04T01:15:41.816Z [ApplicationDataTypeCacheThread-1] INFO o.o.s.b.m.c.ApplicationDataTypeCache RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=ApplicationDataTypesCache Detected changes in the data types, updating the data type cache.
2021-06-04T01:15:42.163Z [cluster1-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T01:15:42.164Z [cluster1-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 8000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:15:42.368Z [pool-8-thread-1] WARN o.j.diskstorage.log.kcvs.KCVSLog Could not read messages for timestamp [2021-06-04T01:15:00Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:56)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:158)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:726)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:100)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
... 8 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:792)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:789)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:147)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:161)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
... 9 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T01:15:43.515Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=31364c5e-f439-4835-8184-24b84df3099c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:15:43.516Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=31364c5e-f439-4835-8184-24b84df3099c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:15:43.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e74f9ea9-b907-43c8-8c52-a5fb07331bf8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:15:43.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e74f9ea9-b907-43c8-8c52-a5fb07331bf8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7c112fc5
2021-06-04T01:15:43.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e74f9ea9-b907-43c8-8c52-a5fb07331bf8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:15:43.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e74f9ea9-b907-43c8-8c52-a5fb07331bf8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:15:44.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:15:44.798Z [BE-Health-Check-Task] INFO o.a.http.impl.execchain.RetryExec RequestID=e74f9ea9-b907-43c8-8c52-a5fb07331bf8 PartnerName=SDC.BE I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {s}->https://sdc-onboarding-be.onap:8445: The target server failed to respond
2021-06-04T01:15:44.798Z [BE-Health-Check-Task] INFO o.a.http.impl.execchain.RetryExec RequestID=e74f9ea9-b907-43c8-8c52-a5fb07331bf8 PartnerName=SDC.BE Retrying request to {s}->https://sdc-onboarding-be.onap:8445
2021-06-04T01:15:44.799Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e74f9ea9-b907-43c8-8c52-a5fb07331bf8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T01:15:44.799Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e74f9ea9-b907-43c8-8c52-a5fb07331bf8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:15:45.273Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8017219b-9341-4932-8591-fe2fe9a1f55a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:15:45.273Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8017219b-9341-4932-8591-fe2fe9a1f55a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23b3db09
2021-06-04T01:15:45.273Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8017219b-9341-4932-8591-fe2fe9a1f55a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:15:45.273Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8017219b-9341-4932-8591-fe2fe9a1f55a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:15:45.275Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8017219b-9341-4932-8591-fe2fe9a1f55a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T01:15:45.275Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8017219b-9341-4932-8591-fe2fe9a1f55a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:15:45.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79446555-c16a-4ae1-809d-9374e24d0b5b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:15:45.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79446555-c16a-4ae1-809d-9374e24d0b5b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@589dc16f
2021-06-04T01:15:45.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79446555-c16a-4ae1-809d-9374e24d0b5b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:15:45.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79446555-c16a-4ae1-809d-9374e24d0b5b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:15:45.776Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=79446555-c16a-4ae1-809d-9374e24d0b5b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T01:15:45.776Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=79446555-c16a-4ae1-809d-9374e24d0b5b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:15:46.189Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=febe8871-ca77-4e9e-a4ed-cb47a9ab47ab PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:15:46.189Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=febe8871-ca77-4e9e-a4ed-cb47a9ab47ab PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68378c97
2021-06-04T01:15:46.189Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=febe8871-ca77-4e9e-a4ed-cb47a9ab47ab PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:15:46.189Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=febe8871-ca77-4e9e-a4ed-cb47a9ab47ab PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:15:46.190Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=febe8871-ca77-4e9e-a4ed-cb47a9ab47ab ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T01:15:46.190Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=febe8871-ca77-4e9e-a4ed-cb47a9ab47ab ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:15:46.861Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=ApplicationDataTypesCache Temporary exception during backend operation [VertexIndexQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:399)
at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:396)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.indexQuery(BackendTransaction.java:396)
at org.janusgraph.graphdb.query.graph.MultiKeySliceQuery.execute(MultiKeySliceQuery.java:51)
at org.janusgraph.graphdb.database.IndexSerializer.query(IndexSerializer.java:512)
at org.janusgraph.graphdb.util.SubqueryIterator.(SubqueryIterator.java:66)
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1295)
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1190)
at org.janusgraph.graphdb.query.QueryProcessor$LimitAdjustingIterator.getNewIterator(QueryProcessor.java:194)
at org.janusgraph.graphdb.query.LimitAdjustingIterator.hasNext(LimitAdjustingIterator.java:68)
at org.janusgraph.graphdb.query.ResultSetIterator.nextInternal(ResultSetIterator.java:54)
at org.janusgraph.graphdb.query.ResultSetIterator.(ResultSetIterator.java:44)
at org.janusgraph.graphdb.query.QueryProcessor.iterator(QueryProcessor.java:66)
at com.google.common.collect.Iterables$4.iterator(Iterables.java:559)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getByCriteria(JanusGraphGenericDao.java:755)
at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypes(PropertyOperation.java:1457)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.findAllDataTypesEager(ApplicationDataTypeCache.java:294)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.refreshDataTypesCache(ApplicationDataTypeCache.java:276)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:202)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T01:15:46.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c698d113-686e-4cb1-9e0d-bd1cce53fda3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:15:46.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c698d113-686e-4cb1-9e0d-bd1cce53fda3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45187bc2
2021-06-04T01:15:46.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c698d113-686e-4cb1-9e0d-bd1cce53fda3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:15:46.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c698d113-686e-4cb1-9e0d-bd1cce53fda3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:15:46.971Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=c698d113-686e-4cb1-9e0d-bd1cce53fda3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T01:15:46.972Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=c698d113-686e-4cb1-9e0d-bd1cce53fda3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:15:47.049Z [JanusGraph-Health-Check-Thread] INFO o.j.d.util.BackendOperation Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.execute(VertexCentricQueryBuilder.java:73)
at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.properties(VertexCentricQueryBuilder.java:100)
at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177)
at org.apache.tinkerpop.gremlin.structure.Vertex.property(Vertex.java:70)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:341)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:336)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
... 4 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T01:15:47.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:15:47.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=028c1b62-79cb-4847-8b0d-c762e31e48db PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:15:47.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=028c1b62-79cb-4847-8b0d-c762e31e48db PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4fd575ff
2021-06-04T01:15:47.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=028c1b62-79cb-4847-8b0d-c762e31e48db PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:15:47.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=028c1b62-79cb-4847-8b0d-c762e31e48db PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:15:47.573Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=028c1b62-79cb-4847-8b0d-c762e31e48db ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T01:15:47.574Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=028c1b62-79cb-4847-8b0d-c762e31e48db ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:15:48.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3e6cf7a-2681-49ff-b7a3-9f67f0c85b27 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:15:48.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3e6cf7a-2681-49ff-b7a3-9f67f0c85b27 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@78cf67dc
2021-06-04T01:15:48.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3e6cf7a-2681-49ff-b7a3-9f67f0c85b27 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:15:48.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3e6cf7a-2681-49ff-b7a3-9f67f0c85b27 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:15:48.182Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a3e6cf7a-2681-49ff-b7a3-9f67f0c85b27 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T01:15:48.182Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a3e6cf7a-2681-49ff-b7a3-9f67f0c85b27 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:15:48.875Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a27ab3e-6a3b-4212-9e07-166d4f63815b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:15:48.875Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a27ab3e-6a3b-4212-9e07-166d4f63815b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17017b43
2021-06-04T01:15:48.875Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a27ab3e-6a3b-4212-9e07-166d4f63815b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:15:48.875Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a27ab3e-6a3b-4212-9e07-166d4f63815b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:15:48.877Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0a27ab3e-6a3b-4212-9e07-166d4f63815b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T01:15:48.877Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0a27ab3e-6a3b-4212-9e07-166d4f63815b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:15:49.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c811946-c751-40c4-83e6-abb14b5fbe86 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:15:49.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c811946-c751-40c4-83e6-abb14b5fbe86 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@14d14a4d
2021-06-04T01:15:49.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c811946-c751-40c4-83e6-abb14b5fbe86 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:15:49.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c811946-c751-40c4-83e6-abb14b5fbe86 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:15:49.583Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0c811946-c751-40c4-83e6-abb14b5fbe86 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T01:15:49.583Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0c811946-c751-40c4-83e6-abb14b5fbe86 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:15:50.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5839995d-9a6a-4f20-b31c-d5e768ef6698 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:15:50.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5839995d-9a6a-4f20-b31c-d5e768ef6698 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7147c4d
2021-06-04T01:15:50.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5839995d-9a6a-4f20-b31c-d5e768ef6698 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:15:50.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5839995d-9a6a-4f20-b31c-d5e768ef6698 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:15:50.117Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=5839995d-9a6a-4f20-b31c-d5e768ef6698 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T01:15:50.117Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=5839995d-9a6a-4f20-b31c-d5e768ef6698 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:15:50.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c359d082-a9ce-42b8-96b0-00a0dc30b5e9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:15:50.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c359d082-a9ce-42b8-96b0-00a0dc30b5e9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17d3a625
2021-06-04T01:15:50.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c359d082-a9ce-42b8-96b0-00a0dc30b5e9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:15:50.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c359d082-a9ce-42b8-96b0-00a0dc30b5e9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:15:50.516Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=c359d082-a9ce-42b8-96b0-00a0dc30b5e9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T01:15:50.516Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=c359d082-a9ce-42b8-96b0-00a0dc30b5e9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:15:50.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:15:50.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34052794-b1b8-4cd6-9e26-0f847680b92c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:15:50.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34052794-b1b8-4cd6-9e26-0f847680b92c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@366f40a9
2021-06-04T01:15:50.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34052794-b1b8-4cd6-9e26-0f847680b92c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:15:50.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34052794-b1b8-4cd6-9e26-0f847680b92c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:15:50.972Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=34052794-b1b8-4cd6-9e26-0f847680b92c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T01:15:50.973Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=34052794-b1b8-4cd6-9e26-0f847680b92c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:15:51.379Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11e59308-75e1-47d4-947f-dc7b614dc856 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:15:51.379Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11e59308-75e1-47d4-947f-dc7b614dc856 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4583c04f
2021-06-04T01:15:51.379Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11e59308-75e1-47d4-947f-dc7b614dc856 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:15:51.379Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11e59308-75e1-47d4-947f-dc7b614dc856 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:15:51.381Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=11e59308-75e1-47d4-947f-dc7b614dc856 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T01:15:51.381Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=11e59308-75e1-47d4-947f-dc7b614dc856 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:15:51.698Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bbf15c4-e1bf-484d-a3b5-21ad64940e37 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:15:51.698Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bbf15c4-e1bf-484d-a3b5-21ad64940e37 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@76621d29
2021-06-04T01:15:51.698Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bbf15c4-e1bf-484d-a3b5-21ad64940e37 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:15:51.698Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bbf15c4-e1bf-484d-a3b5-21ad64940e37 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:15:53.448Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=ApplicationDataTypesCache Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177)
at org.apache.tinkerpop.gremlin.structure.Element.keys(Element.java:69)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getProperties(JanusGraphGenericDao.java:1491)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getByCriteria(JanusGraphGenericDao.java:759)
at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypes(PropertyOperation.java:1457)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.findAllDataTypesEager(ApplicationDataTypeCache.java:294)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.refreshDataTypesCache(ApplicationDataTypeCache.java:276)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:202)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T01:15:53.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:15:54.719Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=6bbf15c4-e1bf-484d-a3b5-21ad64940e37 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:15:54.719Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=6bbf15c4-e1bf-484d-a3b5-21ad64940e37 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:15:55.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=949675e7-dbfd-454a-8168-eec94daf5e12 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:15:55.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=949675e7-dbfd-454a-8168-eec94daf5e12 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3fe98870
2021-06-04T01:15:55.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=949675e7-dbfd-454a-8168-eec94daf5e12 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:15:55.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=949675e7-dbfd-454a-8168-eec94daf5e12 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:15:56.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:15:58.326Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=949675e7-dbfd-454a-8168-eec94daf5e12 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:15:58.326Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=949675e7-dbfd-454a-8168-eec94daf5e12 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:15:59.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b81da17a-13a1-4a0f-b399-69f72580ba23 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:15:59.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b81da17a-13a1-4a0f-b399-69f72580ba23 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@409faf07
2021-06-04T01:15:59.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b81da17a-13a1-4a0f-b399-69f72580ba23 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:15:59.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b81da17a-13a1-4a0f-b399-69f72580ba23 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:15:59.371Z [pool-8-thread-1] WARN o.j.diskstorage.log.kcvs.KCVSLog Could not read messages for timestamp [2021-06-04T01:15:46.869008Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:56)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:158)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:726)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:100)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
... 8 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:792)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:789)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:147)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:161)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
... 9 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308)
at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 26 common frames omitted
2021-06-04T01:15:59.371Z [ApplicationDataTypeCacheThread-1] ERROR o.o.s.b.m.c.ApplicationDataTypeCache RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=900 TargetEntity=null Failed to fetch data types from database. Status is GENERAL_ERROR
2021-06-04T01:15:59.372Z [ApplicationDataTypeCacheThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=ApplicationDataTypesCache Internal Connection problem. Description: Failed to fetch data types from database. Status is GENERAL_ERROR
2021-06-04T01:15:59.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:15:59.767Z [cluster1-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T01:15:59.767Z [cluster1-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 16000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:16:02.184Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=b81da17a-13a1-4a0f-b399-69f72580ba23 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:16:02.184Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=b81da17a-13a1-4a0f-b399-69f72580ba23 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:16:02.356Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c8f29f6b-a3bb-4141-87b3-8dbefeb11a70 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:16:02.356Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c8f29f6b-a3bb-4141-87b3-8dbefeb11a70 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ae4fcff
2021-06-04T01:16:02.356Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c8f29f6b-a3bb-4141-87b3-8dbefeb11a70 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:16:02.356Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c8f29f6b-a3bb-4141-87b3-8dbefeb11a70 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:16:02.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:16:05.368Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=c8f29f6b-a3bb-4141-87b3-8dbefeb11a70 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:16:05.369Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=c8f29f6b-a3bb-4141-87b3-8dbefeb11a70 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:16:05.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:16:05.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3dcc72d4-9ec8-4a87-83b2-c3e23e17a920 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:16:05.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3dcc72d4-9ec8-4a87-83b2-c3e23e17a920 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4254183a
2021-06-04T01:16:05.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3dcc72d4-9ec8-4a87-83b2-c3e23e17a920 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:16:05.974Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3dcc72d4-9ec8-4a87-83b2-c3e23e17a920 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:16:08.269Z [JanusGraph-Health-Check-Thread] INFO o.j.d.util.BackendOperation Temporary exception during backend operation [VertexIndexQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:399)
at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:396)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.indexQuery(BackendTransaction.java:396)
at org.janusgraph.graphdb.query.graph.MultiKeySliceQuery.execute(MultiKeySliceQuery.java:51)
at org.janusgraph.graphdb.database.IndexSerializer.query(IndexSerializer.java:512)
at org.janusgraph.graphdb.util.SubqueryIterator.(SubqueryIterator.java:66)
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1295)
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1190)
at org.janusgraph.graphdb.query.QueryProcessor$LimitAdjustingIterator.getNewIterator(QueryProcessor.java:194)
at org.janusgraph.graphdb.query.LimitAdjustingIterator.hasNext(LimitAdjustingIterator.java:68)
at org.janusgraph.graphdb.query.ResultSetIterator.nextInternal(ResultSetIterator.java:54)
at org.janusgraph.graphdb.query.ResultSetIterator.(ResultSetIterator.java:44)
at org.janusgraph.graphdb.query.QueryProcessor.iterator(QueryProcessor.java:66)
at com.google.common.collect.Iterables$4.iterator(Iterables.java:559)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:340)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:336)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
... 4 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T01:16:08.452Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=ApplicationDataTypesCache Temporary exception during backend operation [VertexIndexQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:399)
at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:396)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.indexQuery(BackendTransaction.java:396)
at org.janusgraph.graphdb.query.graph.MultiKeySliceQuery.execute(MultiKeySliceQuery.java:51)
at org.janusgraph.graphdb.database.IndexSerializer.query(IndexSerializer.java:512)
at org.janusgraph.graphdb.util.SubqueryIterator.(SubqueryIterator.java:66)
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1295)
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1190)
at org.janusgraph.graphdb.query.QueryProcessor$LimitAdjustingIterator.getNewIterator(QueryProcessor.java:194)
at org.janusgraph.graphdb.query.LimitAdjustingIterator.hasNext(LimitAdjustingIterator.java:68)
at org.janusgraph.graphdb.query.ResultSetIterator.nextInternal(ResultSetIterator.java:54)
at org.janusgraph.graphdb.query.ResultSetIterator.(ResultSetIterator.java:44)
at org.janusgraph.graphdb.query.QueryProcessor.iterator(QueryProcessor.java:66)
at com.google.common.collect.Iterables$4.iterator(Iterables.java:559)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getByCriteria(JanusGraphGenericDao.java:755)
at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypeNodes(PropertyOperation.java:1566)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.findAllDataTypesLazy(ApplicationDataTypeCache.java:309)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.hasDataTypesChanged(ApplicationDataTypeCache.java:220)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:200)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T01:16:08.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:16:08.983Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3dcc72d4-9ec8-4a87-83b2-c3e23e17a920 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:16:08.983Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3dcc72d4-9ec8-4a87-83b2-c3e23e17a920 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:16:09.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=451e29a7-9e06-4a1a-9343-b516193eba16 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:16:09.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=451e29a7-9e06-4a1a-9343-b516193eba16 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7c19acdc
2021-06-04T01:16:09.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=451e29a7-9e06-4a1a-9343-b516193eba16 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:16:09.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=451e29a7-9e06-4a1a-9343-b516193eba16 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:16:11.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:16:12.352Z [pool-8-thread-1] WARN o.j.diskstorage.log.kcvs.KCVSLog Could not read messages for timestamp [2021-06-04T01:15:46.869008Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:56)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:158)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:726)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:100)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
... 8 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:792)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:789)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:147)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:161)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
... 9 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T01:16:12.681Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=451e29a7-9e06-4a1a-9343-b516193eba16 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:16:12.681Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=451e29a7-9e06-4a1a-9343-b516193eba16 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:16:13.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69f7b9e5-c844-4b5d-88f4-bff0d39c749d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:16:13.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69f7b9e5-c844-4b5d-88f4-bff0d39c749d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@12567bcd
2021-06-04T01:16:13.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69f7b9e5-c844-4b5d-88f4-bff0d39c749d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:16:13.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69f7b9e5-c844-4b5d-88f4-bff0d39c749d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:16:14.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:16:16.033Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=69f7b9e5-c844-4b5d-88f4-bff0d39c749d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:16:16.034Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=69f7b9e5-c844-4b5d-88f4-bff0d39c749d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:16:16.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c582373-a9a1-4543-bc60-47ea72b48cd1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:16:16.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c582373-a9a1-4543-bc60-47ea72b48cd1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@f8b03b7
2021-06-04T01:16:16.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c582373-a9a1-4543-bc60-47ea72b48cd1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:16:16.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c582373-a9a1-4543-bc60-47ea72b48cd1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:16:17.048Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=ApplicationDataTypesCache Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177)
at org.apache.tinkerpop.gremlin.structure.Element.keys(Element.java:69)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getProperties(JanusGraphGenericDao.java:1491)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getByCriteria(JanusGraphGenericDao.java:759)
at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypeNodes(PropertyOperation.java:1566)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.findAllDataTypesLazy(ApplicationDataTypeCache.java:309)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.hasDataTypesChanged(ApplicationDataTypeCache.java:220)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:200)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T01:16:17.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:16:20.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:16:21.247Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2c582373-a9a1-4543-bc60-47ea72b48cd1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:16:21.247Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2c582373-a9a1-4543-bc60-47ea72b48cd1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:16:21.390Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b31103c-ab2d-424c-8a8a-00c413b52eec PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:16:21.390Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b31103c-ab2d-424c-8a8a-00c413b52eec PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57bb8791
2021-06-04T01:16:21.390Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b31103c-ab2d-424c-8a8a-00c413b52eec PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:16:21.390Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b31103c-ab2d-424c-8a8a-00c413b52eec PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:16:22.355Z [JanusGraph-Health-Check-Thread] INFO o.j.d.util.BackendOperation Temporary exception during backend operation [VertexIndexQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:399)
at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:396)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.indexQuery(BackendTransaction.java:396)
at org.janusgraph.graphdb.query.graph.MultiKeySliceQuery.execute(MultiKeySliceQuery.java:51)
at org.janusgraph.graphdb.database.IndexSerializer.query(IndexSerializer.java:512)
at org.janusgraph.graphdb.util.SubqueryIterator.(SubqueryIterator.java:66)
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1295)
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1190)
at org.janusgraph.graphdb.query.QueryProcessor$LimitAdjustingIterator.getNewIterator(QueryProcessor.java:194)
at org.janusgraph.graphdb.query.LimitAdjustingIterator.hasNext(LimitAdjustingIterator.java:68)
at org.janusgraph.graphdb.query.ResultSetIterator.nextInternal(ResultSetIterator.java:54)
at org.janusgraph.graphdb.query.ResultSetIterator.(ResultSetIterator.java:44)
at org.janusgraph.graphdb.query.QueryProcessor.iterator(QueryProcessor.java:66)
at com.google.common.collect.Iterables$4.iterator(Iterables.java:559)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:340)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:336)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
... 4 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T01:16:22.460Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=ApplicationDataTypesCache Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177)
at org.apache.tinkerpop.gremlin.structure.Element.keys(Element.java:69)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getProperties(JanusGraphGenericDao.java:1491)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getByCriteria(JanusGraphGenericDao.java:759)
at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypeNodes(PropertyOperation.java:1566)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.findAllDataTypesLazy(ApplicationDataTypeCache.java:309)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.hasDataTypesChanged(ApplicationDataTypeCache.java:220)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:200)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T01:16:22.784Z [cluster1-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T01:16:22.785Z [cluster1-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 32000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:16:23.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:16:24.430Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8b31103c-ab2d-424c-8a8a-00c413b52eec ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:16:24.430Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8b31103c-ab2d-424c-8a8a-00c413b52eec ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:16:24.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9d2991d-86eb-4b93-8524-cc96b9ed4c55 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:16:24.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9d2991d-86eb-4b93-8524-cc96b9ed4c55 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17171dc0
2021-06-04T01:16:24.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9d2991d-86eb-4b93-8524-cc96b9ed4c55 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:16:24.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9d2991d-86eb-4b93-8524-cc96b9ed4c55 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:16:26.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:16:27.976Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f9d2991d-86eb-4b93-8524-cc96b9ed4c55 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:16:27.976Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f9d2991d-86eb-4b93-8524-cc96b9ed4c55 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:16:28.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3d6ecaa-98f7-481b-895b-9dbe5a492cac PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:16:28.717Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3d6ecaa-98f7-481b-895b-9dbe5a492cac PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a7b75e5
2021-06-04T01:16:28.717Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3d6ecaa-98f7-481b-895b-9dbe5a492cac PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:16:28.717Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3d6ecaa-98f7-481b-895b-9dbe5a492cac PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:16:29.152Z [ApplicationDataTypeCacheThread-1] ERROR o.o.s.b.m.c.ApplicationDataTypeCache RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=900 TargetEntity=null Failed to fetch data types from database. Status is GENERAL_ERROR
2021-06-04T01:16:29.153Z [ApplicationDataTypeCacheThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=ApplicationDataTypesCache Internal Connection problem. Description: Failed to fetch data types from database. Status is GENERAL_ERROR
2021-06-04T01:16:29.153Z [ApplicationDataTypeCacheThread-1] INFO o.o.s.b.m.c.ApplicationDataTypeCache RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=ApplicationDataTypesCache Detected changes in the data types, updating the data type cache.
2021-06-04T01:16:29.160Z [JanusGraph-Health-Check-Thread] INFO o.j.d.util.BackendOperation Temporary exception during backend operation [VertexIndexQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:399)
at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:396)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.indexQuery(BackendTransaction.java:396)
at org.janusgraph.graphdb.query.graph.MultiKeySliceQuery.execute(MultiKeySliceQuery.java:51)
at org.janusgraph.graphdb.database.IndexSerializer.query(IndexSerializer.java:512)
at org.janusgraph.graphdb.util.SubqueryIterator.(SubqueryIterator.java:66)
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1295)
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1190)
at org.janusgraph.graphdb.query.QueryProcessor$LimitAdjustingIterator.getNewIterator(QueryProcessor.java:194)
at org.janusgraph.graphdb.query.LimitAdjustingIterator.hasNext(LimitAdjustingIterator.java:68)
at org.janusgraph.graphdb.query.ResultSetIterator.nextInternal(ResultSetIterator.java:54)
at org.janusgraph.graphdb.query.ResultSetIterator.(ResultSetIterator.java:44)
at org.janusgraph.graphdb.query.QueryProcessor.iterator(QueryProcessor.java:66)
at com.google.common.collect.Iterables$4.iterator(Iterables.java:559)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:340)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:336)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
... 4 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T01:16:29.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:16:31.756Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=b3d6ecaa-98f7-481b-895b-9dbe5a492cac ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:16:31.756Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=b3d6ecaa-98f7-481b-895b-9dbe5a492cac ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:16:31.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5864216a-4ff2-4961-88e6-3a28d76d1d7a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:16:31.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5864216a-4ff2-4961-88e6-3a28d76d1d7a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@244c97ca
2021-06-04T01:16:31.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5864216a-4ff2-4961-88e6-3a28d76d1d7a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:16:31.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5864216a-4ff2-4961-88e6-3a28d76d1d7a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:16:32.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:16:34.910Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=5864216a-4ff2-4961-88e6-3a28d76d1d7a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:16:34.911Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=5864216a-4ff2-4961-88e6-3a28d76d1d7a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:16:35.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7ef223b-98b3-4947-b43d-75e7a183ed78 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:16:35.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7ef223b-98b3-4947-b43d-75e7a183ed78 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b1a3128
2021-06-04T01:16:35.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7ef223b-98b3-4947-b43d-75e7a183ed78 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:16:35.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7ef223b-98b3-4947-b43d-75e7a183ed78 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:16:35.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:16:36.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f675174b-f899-4a60-ab0f-825ae617a092 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:16:36.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f675174b-f899-4a60-ab0f-825ae617a092 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53f9c499
2021-06-04T01:16:36.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f675174b-f899-4a60-ab0f-825ae617a092 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:16:36.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f675174b-f899-4a60-ab0f-825ae617a092 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:16:37.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00caba96-04ef-46ba-9219-b5c0780170aa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:16:37.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00caba96-04ef-46ba-9219-b5c0780170aa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@44af52f6
2021-06-04T01:16:37.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00caba96-04ef-46ba-9219-b5c0780170aa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:16:37.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00caba96-04ef-46ba-9219-b5c0780170aa PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:16:37.574Z [JanusGraph-Health-Check-Thread] INFO o.j.d.util.BackendOperation Temporary exception during backend operation [VertexIndexQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:399)
at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:396)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.indexQuery(BackendTransaction.java:396)
at org.janusgraph.graphdb.query.graph.MultiKeySliceQuery.execute(MultiKeySliceQuery.java:51)
at org.janusgraph.graphdb.database.IndexSerializer.query(IndexSerializer.java:512)
at org.janusgraph.graphdb.util.SubqueryIterator.(SubqueryIterator.java:66)
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1295)
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1190)
at org.janusgraph.graphdb.query.QueryProcessor$LimitAdjustingIterator.getNewIterator(QueryProcessor.java:194)
at org.janusgraph.graphdb.query.LimitAdjustingIterator.hasNext(LimitAdjustingIterator.java:68)
at org.janusgraph.graphdb.query.ResultSetIterator.nextInternal(ResultSetIterator.java:54)
at org.janusgraph.graphdb.query.ResultSetIterator.(ResultSetIterator.java:44)
at org.janusgraph.graphdb.query.QueryProcessor.iterator(QueryProcessor.java:66)
at com.google.common.collect.Iterables$4.iterator(Iterables.java:559)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:340)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:336)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
... 4 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308)
at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 26 common frames omitted
2021-06-04T01:16:37.575Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=ApplicationDataTypesCache Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177)
at org.apache.tinkerpop.gremlin.structure.Element.keys(Element.java:69)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getProperties(JanusGraphGenericDao.java:1491)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getByCriteria(JanusGraphGenericDao.java:759)
at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypes(PropertyOperation.java:1457)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.findAllDataTypesEager(ApplicationDataTypeCache.java:294)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.refreshDataTypesCache(ApplicationDataTypeCache.java:276)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:202)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T01:16:38.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a507f47-e9fe-4732-ab4a-c104f7c8d107 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:16:38.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a507f47-e9fe-4732-ab4a-c104f7c8d107 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ea6b83a
2021-06-04T01:16:38.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a507f47-e9fe-4732-ab4a-c104f7c8d107 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:16:38.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a507f47-e9fe-4732-ab4a-c104f7c8d107 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:16:38.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:16:39.685Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32f1477d-0885-40b2-84b9-48d466eb381d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:16:39.685Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32f1477d-0885-40b2-84b9-48d466eb381d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@123e6c08
2021-06-04T01:16:39.685Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32f1477d-0885-40b2-84b9-48d466eb381d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:16:39.685Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32f1477d-0885-40b2-84b9-48d466eb381d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:16:40.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae2041ae-280f-4212-8866-fad3a5a0f6b0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:16:40.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae2041ae-280f-4212-8866-fad3a5a0f6b0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@f7eafda
2021-06-04T01:16:40.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae2041ae-280f-4212-8866-fad3a5a0f6b0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:16:40.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae2041ae-280f-4212-8866-fad3a5a0f6b0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:16:41.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cb2c365-050b-4187-93e5-b03a2bfa676e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:16:41.384Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cb2c365-050b-4187-93e5-b03a2bfa676e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@31787421
2021-06-04T01:16:41.384Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cb2c365-050b-4187-93e5-b03a2bfa676e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:16:41.384Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cb2c365-050b-4187-93e5-b03a2bfa676e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:16:41.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:16:43.449Z [pool-8-thread-1] WARN o.j.diskstorage.log.kcvs.KCVSLog Could not read messages for timestamp [2021-06-04T01:16:26.876860Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:56)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:158)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:726)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:100)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
... 8 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:792)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:789)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:147)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:161)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
... 9 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T01:16:43.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fcea7d9-fd76-4471-8b18-41b4c362296d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:16:43.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fcea7d9-fd76-4471-8b18-41b4c362296d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5af47d5c
2021-06-04T01:16:43.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fcea7d9-fd76-4471-8b18-41b4c362296d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:16:43.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fcea7d9-fd76-4471-8b18-41b4c362296d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:16:44.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:16:46.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34be067a-08eb-47c8-a6b4-78ec14a35279 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:16:46.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34be067a-08eb-47c8-a6b4-78ec14a35279 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3bcb1426
2021-06-04T01:16:46.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34be067a-08eb-47c8-a6b4-78ec14a35279 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:16:46.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34be067a-08eb-47c8-a6b4-78ec14a35279 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:16:47.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:16:49.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3783c686-6628-4e14-a935-3df235b0643a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:16:49.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3783c686-6628-4e14-a935-3df235b0643a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41317cfa
2021-06-04T01:16:49.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3783c686-6628-4e14-a935-3df235b0643a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:16:49.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3783c686-6628-4e14-a935-3df235b0643a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:16:50.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:16:52.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70fa0804-8cfd-4508-a818-d3658e61346d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:16:52.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70fa0804-8cfd-4508-a818-d3658e61346d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@331ad181
2021-06-04T01:16:52.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70fa0804-8cfd-4508-a818-d3658e61346d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:16:52.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70fa0804-8cfd-4508-a818-d3658e61346d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:16:53.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:16:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1e07661-03e1-4099-a5e5-aa76397f99a4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:16:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1e07661-03e1-4099-a5e5-aa76397f99a4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a7d4423
2021-06-04T01:16:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1e07661-03e1-4099-a5e5-aa76397f99a4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:16:56.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1e07661-03e1-4099-a5e5-aa76397f99a4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:16:56.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:16:58.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e88639db-9374-4153-8fda-20237cd5a6f9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:16:58.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e88639db-9374-4153-8fda-20237cd5a6f9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29f4136e
2021-06-04T01:16:58.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e88639db-9374-4153-8fda-20237cd5a6f9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:16:58.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e88639db-9374-4153-8fda-20237cd5a6f9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:16:59.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:17:00.363Z [cluster1-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
2021-06-04T01:17:00.363Z [cluster1-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 64000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:17:01.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96ba472b-16dc-4c1b-89eb-0e1f4e008931 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:17:01.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96ba472b-16dc-4c1b-89eb-0e1f4e008931 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@63e86c06
2021-06-04T01:17:01.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96ba472b-16dc-4c1b-89eb-0e1f4e008931 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:17:01.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96ba472b-16dc-4c1b-89eb-0e1f4e008931 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:17:02.283Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:17:04.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb0657b6-d05d-4ebc-a7fb-1443731a1a8a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:17:04.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb0657b6-d05d-4ebc-a7fb-1443731a1a8a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@61b3f23
2021-06-04T01:17:04.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb0657b6-d05d-4ebc-a7fb-1443731a1a8a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:17:04.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb0657b6-d05d-4ebc-a7fb-1443731a1a8a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:17:05.192Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fb0657b6-d05d-4ebc-a7fb-1443731a1a8a ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:17:05.192Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fb0657b6-d05d-4ebc-a7fb-1443731a1a8a ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:17:08.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4e87610-ae43-4950-b01a-8089574da194 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:17:08.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4e87610-ae43-4950-b01a-8089574da194 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@26672f9f
2021-06-04T01:17:08.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4e87610-ae43-4950-b01a-8089574da194 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:17:08.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4e87610-ae43-4950-b01a-8089574da194 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:17:10.795Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b0c811e-9b7f-42fe-9bd8-1e39df040b28 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:17:10.795Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b0c811e-9b7f-42fe-9bd8-1e39df040b28 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f81375e
2021-06-04T01:17:10.795Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b0c811e-9b7f-42fe-9bd8-1e39df040b28 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:17:10.795Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b0c811e-9b7f-42fe-9bd8-1e39df040b28 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:17:13.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3dce8794-0cf8-4f7a-ba40-fafd7f3977c6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:17:13.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3dce8794-0cf8-4f7a-ba40-fafd7f3977c6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@fa9e6f4
2021-06-04T01:17:13.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3dce8794-0cf8-4f7a-ba40-fafd7f3977c6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:17:13.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3dce8794-0cf8-4f7a-ba40-fafd7f3977c6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:17:17.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55739a93-e04d-4d91-a9af-f5cb6b310bf1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:17:17.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55739a93-e04d-4d91-a9af-f5cb6b310bf1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50143205
2021-06-04T01:17:17.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55739a93-e04d-4d91-a9af-f5cb6b310bf1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:17:17.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55739a93-e04d-4d91-a9af-f5cb6b310bf1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:17:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1e44e34-7a63-4891-9043-abd2b968341b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:17:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1e44e34-7a63-4891-9043-abd2b968341b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f90e44f
2021-06-04T01:17:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1e44e34-7a63-4891-9043-abd2b968341b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:17:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1e44e34-7a63-4891-9043-abd2b968341b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:17:22.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09996b0a-e409-4a91-b27b-5d5f8e2b2578 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:17:22.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09996b0a-e409-4a91-b27b-5d5f8e2b2578 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@698d1124
2021-06-04T01:17:22.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09996b0a-e409-4a91-b27b-5d5f8e2b2578 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:17:22.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09996b0a-e409-4a91-b27b-5d5f8e2b2578 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:17:23.655Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:17:23.656Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:17:24.656Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:17:25.656Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:17:25.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6b21f9b-9f11-4038-8079-be588ca50341 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:17:25.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6b21f9b-9f11-4038-8079-be588ca50341 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29d3c4a7
2021-06-04T01:17:25.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6b21f9b-9f11-4038-8079-be588ca50341 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:17:25.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6b21f9b-9f11-4038-8079-be588ca50341 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:17:25.991Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f6b21f9b-9f11-4038-8079-be588ca50341 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:17:25.991Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=f6b21f9b-9f11-4038-8079-be588ca50341 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T01:17:26.656Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:17:27.657Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:17:29.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0d0cc95-8667-4173-9565-6f1df6e95e75 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:17:29.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0d0cc95-8667-4173-9565-6f1df6e95e75 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58264f82
2021-06-04T01:17:29.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0d0cc95-8667-4173-9565-6f1df6e95e75 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:17:29.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0d0cc95-8667-4173-9565-6f1df6e95e75 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:17:29.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:17:31.419Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:17:31.419Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:17:31.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=504fe7d3-00e0-4fdb-9e02-4b766843f275 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:17:31.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=504fe7d3-00e0-4fdb-9e02-4b766843f275 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@105c7a55
2021-06-04T01:17:31.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=504fe7d3-00e0-4fdb-9e02-4b766843f275 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:17:31.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=504fe7d3-00e0-4fdb-9e02-4b766843f275 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:17:32.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:17:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=180b7627-d497-45d2-939a-d7a6ebd5cfac PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:17:34.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=180b7627-d497-45d2-939a-d7a6ebd5cfac PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@11594d4b
2021-06-04T01:17:34.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=180b7627-d497-45d2-939a-d7a6ebd5cfac PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:17:34.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=180b7627-d497-45d2-939a-d7a6ebd5cfac PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:17:34.970Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:17:37.875Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bcda5146-9f0a-44b8-a7d9-fd8954d99fb3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:17:37.875Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bcda5146-9f0a-44b8-a7d9-fd8954d99fb3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2698453b
2021-06-04T01:17:37.875Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bcda5146-9f0a-44b8-a7d9-fd8954d99fb3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:17:37.875Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bcda5146-9f0a-44b8-a7d9-fd8954d99fb3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:17:38.181Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=bcda5146-9f0a-44b8-a7d9-fd8954d99fb3 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:17:38.181Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=bcda5146-9f0a-44b8-a7d9-fd8954d99fb3 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:17:40.776Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=381f3493-ac9a-47fa-9d40-031bb3ce836f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:17:40.776Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=381f3493-ac9a-47fa-9d40-031bb3ce836f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c284435
2021-06-04T01:17:40.776Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=381f3493-ac9a-47fa-9d40-031bb3ce836f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:17:40.776Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=381f3493-ac9a-47fa-9d40-031bb3ce836f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:17:43.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8b95b0f-56a6-4694-821b-6cb6ef3e0be6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:17:43.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8b95b0f-56a6-4694-821b-6cb6ef3e0be6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f550137
2021-06-04T01:17:43.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8b95b0f-56a6-4694-821b-6cb6ef3e0be6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:17:43.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8b95b0f-56a6-4694-821b-6cb6ef3e0be6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:17:44.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:17:44.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:17:45.873Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:17:45.873Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:17:47.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=111e615e-1650-4f15-a4a9-791a9397e163 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:17:47.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=111e615e-1650-4f15-a4a9-791a9397e163 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@64bd2083
2021-06-04T01:17:47.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=111e615e-1650-4f15-a4a9-791a9397e163 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:17:47.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=111e615e-1650-4f15-a4a9-791a9397e163 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:17:47.377Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=111e615e-1650-4f15-a4a9-791a9397e163 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:17:47.377Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=111e615e-1650-4f15-a4a9-791a9397e163 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T01:17:47.615Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:17:50.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=609cf311-897f-404d-9090-7b86606389ab PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:17:50.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=609cf311-897f-404d-9090-7b86606389ab PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e810b2
2021-06-04T01:17:50.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=609cf311-897f-404d-9090-7b86606389ab PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:17:50.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=609cf311-897f-404d-9090-7b86606389ab PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:17:50.193Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=609cf311-897f-404d-9090-7b86606389ab ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:17:50.193Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=609cf311-897f-404d-9090-7b86606389ab ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:17:52.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c51b4b2c-60a1-4fd8-a629-7b0f08b3ae11 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:17:52.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c51b4b2c-60a1-4fd8-a629-7b0f08b3ae11 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e6ff576
2021-06-04T01:17:52.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c51b4b2c-60a1-4fd8-a629-7b0f08b3ae11 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:17:52.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c51b4b2c-60a1-4fd8-a629-7b0f08b3ae11 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:17:53.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:17:53.540Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:17:56.076Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:17:56.171Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca51cd77-ca78-44aa-8cc2-300695e0c376 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:17:56.171Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca51cd77-ca78-44aa-8cc2-300695e0c376 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@19a40135
2021-06-04T01:17:56.171Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca51cd77-ca78-44aa-8cc2-300695e0c376 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:17:56.171Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca51cd77-ca78-44aa-8cc2-300695e0c376 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:17:56.287Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ca51cd77-ca78-44aa-8cc2-300695e0c376 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:17:56.287Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=ca51cd77-ca78-44aa-8cc2-300695e0c376 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T01:17:58.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a8b039b-3cf4-4dc8-8816-17dcb07b1bc9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:17:58.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a8b039b-3cf4-4dc8-8816-17dcb07b1bc9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@141083ba
2021-06-04T01:17:58.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a8b039b-3cf4-4dc8-8816-17dcb07b1bc9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:17:58.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a8b039b-3cf4-4dc8-8816-17dcb07b1bc9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:17:59.219Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0a8b039b-3cf4-4dc8-8816-17dcb07b1bc9 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:17:59.219Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0a8b039b-3cf4-4dc8-8816-17dcb07b1bc9 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:17:59.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:17:59.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:18:01.452Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa2cbb65-914d-43ff-b01d-349374778e73 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:18:01.452Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa2cbb65-914d-43ff-b01d-349374778e73 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@543d6c0a
2021-06-04T01:18:01.452Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa2cbb65-914d-43ff-b01d-349374778e73 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:18:01.452Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa2cbb65-914d-43ff-b01d-349374778e73 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:18:01.487Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=aa2cbb65-914d-43ff-b01d-349374778e73 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:18:01.487Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=aa2cbb65-914d-43ff-b01d-349374778e73 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T01:18:02.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:18:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abb05be0-2673-49e5-b353-3c80852fb289 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:18:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abb05be0-2673-49e5-b353-3c80852fb289 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2508e7be
2021-06-04T01:18:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abb05be0-2673-49e5-b353-3c80852fb289 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:18:04.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abb05be0-2673-49e5-b353-3c80852fb289 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:18:05.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:18:08.080Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fa29197-8ad3-4003-a28b-4551d38f3035 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:18:08.080Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fa29197-8ad3-4003-a28b-4551d38f3035 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c9cf783
2021-06-04T01:18:08.080Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fa29197-8ad3-4003-a28b-4551d38f3035 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:18:08.080Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fa29197-8ad3-4003-a28b-4551d38f3035 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:18:08.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:18:10.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69e95b77-bb26-470e-ad06-dcf9a9614850 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:18:10.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69e95b77-bb26-470e-ad06-dcf9a9614850 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@c01baf9
2021-06-04T01:18:10.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69e95b77-bb26-470e-ad06-dcf9a9614850 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:18:10.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69e95b77-bb26-470e-ad06-dcf9a9614850 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:18:11.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:18:13.731Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe04b7bf-2899-4085-9d94-1705ac1e79af PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:18:13.731Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe04b7bf-2899-4085-9d94-1705ac1e79af PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@33e3da4f
2021-06-04T01:18:13.731Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe04b7bf-2899-4085-9d94-1705ac1e79af PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:18:13.731Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe04b7bf-2899-4085-9d94-1705ac1e79af PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:18:14.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:18:16.912Z [cluster1-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
2021-06-04T01:18:16.913Z [cluster1-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 128000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:18:17.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23d5b77f-0d5d-497b-bc2e-ab2ff2cc7a11 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:18:17.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23d5b77f-0d5d-497b-bc2e-ab2ff2cc7a11 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5134ee9a
2021-06-04T01:18:17.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23d5b77f-0d5d-497b-bc2e-ab2ff2cc7a11 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:18:17.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23d5b77f-0d5d-497b-bc2e-ab2ff2cc7a11 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:18:17.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:18:19.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eba4d7e8-ff6b-4e3d-90b1-ef0bae5b1180 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:18:19.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eba4d7e8-ff6b-4e3d-90b1-ef0bae5b1180 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a6f2bd0
2021-06-04T01:18:19.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eba4d7e8-ff6b-4e3d-90b1-ef0bae5b1180 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:18:19.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eba4d7e8-ff6b-4e3d-90b1-ef0bae5b1180 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:18:20.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:18:20.682Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01jf13jgbuv1o170qo9s0ptqrb583
2021-06-04T01:18:20.682Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0vxdih1fiq94r1oqlbz1i3k9b0586
2021-06-04T01:18:20.682Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node08doopsfjzjeprgjqlyarbt4c584
2021-06-04T01:18:20.682Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01y0ra76p8p6a8a8r6la0z4eh0589
2021-06-04T01:18:20.682Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01ep0zf07b348jr6v9xukvvejy587
2021-06-04T01:18:20.682Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node015qiqcfxef1q6q92amjln7r4x588
2021-06-04T01:18:20.682Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01iy5sqh6w60cz115syxp32e41c592
2021-06-04T01:18:20.682Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01k8aswiz05ovb1dj105wfa045f590
2021-06-04T01:18:20.682Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0rsj6mqjo07v5kv9i83tt3yez591
2021-06-04T01:18:20.682Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01sh3tppofip11ii8v88e5qx37585
2021-06-04T01:18:22.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d7e95d9-3a3d-4974-ac26-ee7d188bf7e7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:18:22.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d7e95d9-3a3d-4974-ac26-ee7d188bf7e7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2bb88a16
2021-06-04T01:18:22.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d7e95d9-3a3d-4974-ac26-ee7d188bf7e7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:18:22.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d7e95d9-3a3d-4974-ac26-ee7d188bf7e7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:18:22.823Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:18:26.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76412635-09a6-47a2-9165-bbb3d45589a2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:18:26.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76412635-09a6-47a2-9165-bbb3d45589a2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6241c8c
2021-06-04T01:18:26.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76412635-09a6-47a2-9165-bbb3d45589a2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:18:26.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76412635-09a6-47a2-9165-bbb3d45589a2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:18:26.196Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=76412635-09a6-47a2-9165-bbb3d45589a2 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:18:26.197Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=76412635-09a6-47a2-9165-bbb3d45589a2 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:18:28.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d88b090f-5a3b-4b2b-9325-a16c0a4da3dc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:18:28.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d88b090f-5a3b-4b2b-9325-a16c0a4da3dc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@709272ec
2021-06-04T01:18:28.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d88b090f-5a3b-4b2b-9325-a16c0a4da3dc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:18:28.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d88b090f-5a3b-4b2b-9325-a16c0a4da3dc PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:18:31.457Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f4120fd-5e39-48e5-a672-8017b9383b6b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:18:31.458Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f4120fd-5e39-48e5-a672-8017b9383b6b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23f0e685
2021-06-04T01:18:31.458Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f4120fd-5e39-48e5-a672-8017b9383b6b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:18:31.458Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f4120fd-5e39-48e5-a672-8017b9383b6b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:18:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d02e9281-990f-4d42-a048-a8cbc217b69b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:18:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d02e9281-990f-4d42-a048-a8cbc217b69b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4cf730d7
2021-06-04T01:18:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d02e9281-990f-4d42-a048-a8cbc217b69b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:18:34.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d02e9281-990f-4d42-a048-a8cbc217b69b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:18:37.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43a1d1b5-412b-4b7f-bf40-357affb39dcd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:18:37.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43a1d1b5-412b-4b7f-bf40-357affb39dcd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6a9195b9
2021-06-04T01:18:37.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43a1d1b5-412b-4b7f-bf40-357affb39dcd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:18:37.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43a1d1b5-412b-4b7f-bf40-357affb39dcd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:18:40.613Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f6ce1df-bcd1-4cec-9a93-88a2d7af9d73 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:18:40.613Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f6ce1df-bcd1-4cec-9a93-88a2d7af9d73 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9778f15
2021-06-04T01:18:40.613Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f6ce1df-bcd1-4cec-9a93-88a2d7af9d73 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:18:40.613Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f6ce1df-bcd1-4cec-9a93-88a2d7af9d73 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:18:43.732Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=266350bf-88ad-4a23-988e-96f0d4666cee PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:18:43.732Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=266350bf-88ad-4a23-988e-96f0d4666cee PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d179470
2021-06-04T01:18:43.732Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=266350bf-88ad-4a23-988e-96f0d4666cee PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:18:43.732Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=266350bf-88ad-4a23-988e-96f0d4666cee PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:18:47.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fefec097-cfae-4dbd-a219-1393d09a12fe PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:18:47.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fefec097-cfae-4dbd-a219-1393d09a12fe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5813688d
2021-06-04T01:18:47.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fefec097-cfae-4dbd-a219-1393d09a12fe PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:18:47.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fefec097-cfae-4dbd-a219-1393d09a12fe PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:18:50.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5167ac93-2f86-4cfb-b564-057d175327c2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:18:50.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5167ac93-2f86-4cfb-b564-057d175327c2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ec9026b
2021-06-04T01:18:50.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5167ac93-2f86-4cfb-b564-057d175327c2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:18:50.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5167ac93-2f86-4cfb-b564-057d175327c2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:18:51.084Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:18:51.085Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:18:52.085Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:18:52.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bde5e104-4374-43c1-af3e-3ccb37272da2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:18:52.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bde5e104-4374-43c1-af3e-3ccb37272da2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@bf33d80
2021-06-04T01:18:52.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bde5e104-4374-43c1-af3e-3ccb37272da2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:18:52.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bde5e104-4374-43c1-af3e-3ccb37272da2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:18:52.538Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=bde5e104-4374-43c1-af3e-3ccb37272da2 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:18:52.538Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=bde5e104-4374-43c1-af3e-3ccb37272da2 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T01:18:53.085Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:18:54.086Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:18:55.971Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:18:55.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8659a7fc-7de7-4a7f-a1e5-a4143aecec2c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:18:55.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8659a7fc-7de7-4a7f-a1e5-a4143aecec2c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ad68c9a
2021-06-04T01:18:55.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8659a7fc-7de7-4a7f-a1e5-a4143aecec2c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:18:55.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8659a7fc-7de7-4a7f-a1e5-a4143aecec2c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:18:59.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7eb7a0c-4fdf-4698-87e2-6db4691fb579 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:18:59.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7eb7a0c-4fdf-4698-87e2-6db4691fb579 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5942d84d
2021-06-04T01:18:59.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7eb7a0c-4fdf-4698-87e2-6db4691fb579 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:18:59.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7eb7a0c-4fdf-4698-87e2-6db4691fb579 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:18:59.424Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f7eb7a0c-4fdf-4698-87e2-6db4691fb579 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:18:59.424Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f7eb7a0c-4fdf-4698-87e2-6db4691fb579 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:19:01.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f14b5e2c-5b81-4c53-9caf-4be3c1d1b926 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:19:01.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f14b5e2c-5b81-4c53-9caf-4be3c1d1b926 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f6e4354
2021-06-04T01:19:01.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f14b5e2c-5b81-4c53-9caf-4be3c1d1b926 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:19:01.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f14b5e2c-5b81-4c53-9caf-4be3c1d1b926 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:19:04.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21a3410d-e8c7-4661-a78d-7cc4f4666e7a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:19:04.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21a3410d-e8c7-4661-a78d-7cc4f4666e7a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d636404
2021-06-04T01:19:04.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21a3410d-e8c7-4661-a78d-7cc4f4666e7a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:19:04.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21a3410d-e8c7-4661-a78d-7cc4f4666e7a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:19:07.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e9b6356-51c6-439e-ab57-140615ec2340 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:19:07.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e9b6356-51c6-439e-ab57-140615ec2340 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@137f8d6e
2021-06-04T01:19:07.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e9b6356-51c6-439e-ab57-140615ec2340 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:19:07.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e9b6356-51c6-439e-ab57-140615ec2340 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:19:10.699Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d469f4ff-f5fa-487d-8117-d1815fd83742 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:19:10.700Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d469f4ff-f5fa-487d-8117-d1815fd83742 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c30affc
2021-06-04T01:19:10.700Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d469f4ff-f5fa-487d-8117-d1815fd83742 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:19:10.700Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d469f4ff-f5fa-487d-8117-d1815fd83742 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:19:13.724Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f172132-0220-4c4f-83f4-89f3e795497f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:19:13.724Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f172132-0220-4c4f-83f4-89f3e795497f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@11933cd
2021-06-04T01:19:13.724Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f172132-0220-4c4f-83f4-89f3e795497f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:19:13.724Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f172132-0220-4c4f-83f4-89f3e795497f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:19:16.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3b7af3c-c789-4648-ad3c-b608bf24c182 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:19:16.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3b7af3c-c789-4648-ad3c-b608bf24c182 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@277c34ae
2021-06-04T01:19:16.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3b7af3c-c789-4648-ad3c-b608bf24c182 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:19:16.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3b7af3c-c789-4648-ad3c-b608bf24c182 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:19:17.566Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=ApplicationDataTypesCache Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177)
at org.apache.tinkerpop.gremlin.structure.Element.keys(Element.java:69)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getProperties(JanusGraphGenericDao.java:1491)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getChildrenNodes(JanusGraphGenericDao.java:1198)
at org.openecomp.sdc.be.dao.janusgraph.HealingJanusGraphGenericDao.getChildrenNodes(HealingJanusGraphGenericDao.java:62)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getChildrenNodes(JanusGraphGenericDao.java:1243)
at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.findPropertiesOfNode(PropertyOperation.java:344)
at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.fillProperties(PropertyOperation.java:1272)
at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAndAddDataTypeByUid(PropertyOperation.java:1519)
at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypes(PropertyOperation.java:1474)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.findAllDataTypesEager(ApplicationDataTypeCache.java:294)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.refreshDataTypesCache(ApplicationDataTypeCache.java:276)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:202)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308)
at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 26 common frames omitted
2021-06-04T01:19:17.566Z [pool-8-thread-1] WARN o.j.diskstorage.log.kcvs.KCVSLog Could not read messages for timestamp [2021-06-04T01:19:06.070136Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:56)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:158)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:726)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:100)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
... 8 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:792)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:789)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:147)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:161)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
... 9 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T01:19:19.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f39a9e3-8a85-4ea0-8937-4217f5223954 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:19:19.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f39a9e3-8a85-4ea0-8937-4217f5223954 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4807d9d2
2021-06-04T01:19:19.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f39a9e3-8a85-4ea0-8937-4217f5223954 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:19:19.773Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f39a9e3-8a85-4ea0-8937-4217f5223954 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:19:22.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59ba623d-538a-4674-8958-24d55a80db95 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:19:22.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59ba623d-538a-4674-8958-24d55a80db95 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1191d061
2021-06-04T01:19:22.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59ba623d-538a-4674-8958-24d55a80db95 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:19:22.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59ba623d-538a-4674-8958-24d55a80db95 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:19:25.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3b5dcbd-d6a5-4f17-ad37-2c5139f331e5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:19:25.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3b5dcbd-d6a5-4f17-ad37-2c5139f331e5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@59de1ec5
2021-06-04T01:19:25.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3b5dcbd-d6a5-4f17-ad37-2c5139f331e5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:19:25.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3b5dcbd-d6a5-4f17-ad37-2c5139f331e5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:19:25.960Z [JanusGraph-Health-Check-Task] INFO o.j.d.util.BackendOperation RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.execute(VertexCentricQueryBuilder.java:73)
at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.properties(VertexCentricQueryBuilder.java:100)
at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177)
at org.apache.tinkerpop.gremlin.structure.Vertex.property(Vertex.java:70)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient.isGraphOpen(JanusGraphClient.java:284)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckScheduledTask.run(JanusGraphClient.java:352)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308)
at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 26 common frames omitted
2021-06-04T01:19:25.960Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=ApplicationDataTypesCache Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.vertices.AbstractVertex.edges(AbstractVertex.java:173)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getChildrenNodes(JanusGraphGenericDao.java:1187)
at org.openecomp.sdc.be.dao.janusgraph.HealingJanusGraphGenericDao.getChildrenNodes(HealingJanusGraphGenericDao.java:62)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getChildrenNodes(JanusGraphGenericDao.java:1243)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getChild(JanusGraphGenericDao.java:1296)
at org.openecomp.sdc.be.dao.janusgraph.HealingJanusGraphGenericDao.getChild(HealingJanusGraphGenericDao.java:75)
at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAndAddDataTypeByUid(PropertyOperation.java:1532)
at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypes(PropertyOperation.java:1474)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.findAllDataTypesEager(ApplicationDataTypeCache.java:294)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.refreshDataTypesCache(ApplicationDataTypeCache.java:276)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:202)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T01:19:27.082Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:19:27.082Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:19:28.082Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:19:28.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51dc0fc0-ee3b-44fc-a851-32ebc9633cfe PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:19:28.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51dc0fc0-ee3b-44fc-a851-32ebc9633cfe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1fc18814
2021-06-04T01:19:28.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51dc0fc0-ee3b-44fc-a851-32ebc9633cfe PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:19:28.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51dc0fc0-ee3b-44fc-a851-32ebc9633cfe PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:19:28.986Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=51dc0fc0-ee3b-44fc-a851-32ebc9633cfe ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:19:28.986Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=51dc0fc0-ee3b-44fc-a851-32ebc9633cfe ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T01:19:29.083Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:19:30.083Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:19:31.083Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:19:31.157Z [JanusGraph-Health-Check-Thread] INFO o.j.d.util.BackendOperation Temporary exception during backend operation [VertexIndexQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:399)
at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:396)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.indexQuery(BackendTransaction.java:396)
at org.janusgraph.graphdb.query.graph.MultiKeySliceQuery.execute(MultiKeySliceQuery.java:51)
at org.janusgraph.graphdb.database.IndexSerializer.query(IndexSerializer.java:512)
at org.janusgraph.graphdb.util.SubqueryIterator.(SubqueryIterator.java:66)
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1295)
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1190)
at org.janusgraph.graphdb.query.QueryProcessor$LimitAdjustingIterator.getNewIterator(QueryProcessor.java:194)
at org.janusgraph.graphdb.query.LimitAdjustingIterator.hasNext(LimitAdjustingIterator.java:68)
at org.janusgraph.graphdb.query.ResultSetIterator.nextInternal(ResultSetIterator.java:54)
at org.janusgraph.graphdb.query.ResultSetIterator.(ResultSetIterator.java:44)
at org.janusgraph.graphdb.query.QueryProcessor.iterator(QueryProcessor.java:66)
at com.google.common.collect.Iterables$4.iterator(Iterables.java:559)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:340)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:336)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
... 4 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T01:19:31.463Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c30b07e-492f-4ced-87ae-b2a30d6e0af4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:19:31.463Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c30b07e-492f-4ced-87ae-b2a30d6e0af4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@697e1b77
2021-06-04T01:19:31.463Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c30b07e-492f-4ced-87ae-b2a30d6e0af4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:19:31.463Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c30b07e-492f-4ced-87ae-b2a30d6e0af4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:19:31.577Z [ApplicationDataTypeCacheThread-1] ERROR o.o.s.b.m.c.ApplicationDataTypeCache RequestID=null ErrorCategory=ERROR ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=900 TargetEntity=null Failed to run refresh data types cache job
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:56)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.vertices.AbstractVertex.edges(AbstractVertex.java:173)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getChildrenNodes(JanusGraphGenericDao.java:1187)
at org.openecomp.sdc.be.dao.janusgraph.HealingJanusGraphGenericDao.getChildrenNodes(HealingJanusGraphGenericDao.java:62)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getChildrenNodes(JanusGraphGenericDao.java:1243)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getChild(JanusGraphGenericDao.java:1296)
at org.openecomp.sdc.be.dao.janusgraph.HealingJanusGraphGenericDao.getChild(HealingJanusGraphGenericDao.java:75)
at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAndAddDataTypeByUid(PropertyOperation.java:1532)
at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypes(PropertyOperation.java:1474)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.findAllDataTypesEager(ApplicationDataTypeCache.java:294)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.refreshDataTypesCache(ApplicationDataTypeCache.java:276)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:202)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT10S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:100)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
... 30 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
... 31 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T01:19:31.577Z [ApplicationDataTypeCacheThread-1] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=900 TargetEntity=ApplicationDataTypesCache Unexpected error. Description: Failed to run refresh data types cache job
2021-06-04T01:19:32.083Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:19:33.090Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:19:34.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c8616ae-1539-444a-9afc-e49b8e49068a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:19:34.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c8616ae-1539-444a-9afc-e49b8e49068a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7673cce1
2021-06-04T01:19:34.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c8616ae-1539-444a-9afc-e49b8e49068a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:19:34.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c8616ae-1539-444a-9afc-e49b8e49068a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:19:35.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:19:37.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5ca9c15-27ce-4264-b32a-db5338f95da8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:19:37.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5ca9c15-27ce-4264-b32a-db5338f95da8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ff2ccdc
2021-06-04T01:19:37.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5ca9c15-27ce-4264-b32a-db5338f95da8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:19:37.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5ca9c15-27ce-4264-b32a-db5338f95da8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:19:38.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:19:40.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17176a3b-0a4b-4c6e-8b09-3c885ea6d71e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:19:40.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17176a3b-0a4b-4c6e-8b09-3c885ea6d71e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ce06e1e
2021-06-04T01:19:40.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17176a3b-0a4b-4c6e-8b09-3c885ea6d71e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:19:40.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17176a3b-0a4b-4c6e-8b09-3c885ea6d71e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:19:41.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:19:43.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbbe845e-2405-484a-955c-778867a721f4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:19:43.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbbe845e-2405-484a-955c-778867a721f4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@555c7156
2021-06-04T01:19:43.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbbe845e-2405-484a-955c-778867a721f4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:19:43.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbbe845e-2405-484a-955c-778867a721f4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:19:44.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:19:46.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9dbfc524-ccde-4361-a555-00f21b7bdb52 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:19:46.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9dbfc524-ccde-4361-a555-00f21b7bdb52 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d20bbd8
2021-06-04T01:19:46.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9dbfc524-ccde-4361-a555-00f21b7bdb52 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:19:46.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9dbfc524-ccde-4361-a555-00f21b7bdb52 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:19:47.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:19:49.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=243dae5b-fb62-4042-b4e7-0699dc7288ab PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:19:49.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=243dae5b-fb62-4042-b4e7-0699dc7288ab PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@747d148c
2021-06-04T01:19:49.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=243dae5b-fb62-4042-b4e7-0699dc7288ab PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:19:49.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=243dae5b-fb62-4042-b4e7-0699dc7288ab PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:19:50.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:19:52.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f120015-57ea-4bce-adc8-1be0d2431b01 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:19:52.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f120015-57ea-4bce-adc8-1be0d2431b01 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3b221483
2021-06-04T01:19:52.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f120015-57ea-4bce-adc8-1be0d2431b01 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:19:52.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f120015-57ea-4bce-adc8-1be0d2431b01 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:19:53.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:19:55.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=388a6945-d704-4d33-8c8f-247f93b0b0fc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:19:55.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=388a6945-d704-4d33-8c8f-247f93b0b0fc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@dc21470
2021-06-04T01:19:55.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=388a6945-d704-4d33-8c8f-247f93b0b0fc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:19:55.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=388a6945-d704-4d33-8c8f-247f93b0b0fc PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:19:56.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:19:58.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a3acbd2-af83-49b2-aacb-860c6986d9be PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:19:58.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a3acbd2-af83-49b2-aacb-860c6986d9be PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3584806b
2021-06-04T01:19:58.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a3acbd2-af83-49b2-aacb-860c6986d9be PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:19:58.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a3acbd2-af83-49b2-aacb-860c6986d9be PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:19:59.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:20:01.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0c1cec4-527c-4bec-9a38-30adfdc24f7d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:20:01.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0c1cec4-527c-4bec-9a38-30adfdc24f7d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29c12b23
2021-06-04T01:20:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0c1cec4-527c-4bec-9a38-30adfdc24f7d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:20:01.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0c1cec4-527c-4bec-9a38-30adfdc24f7d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:20:02.539Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:20:23.769Z [main] WARN o.o.s.c.util.YamlToObjectConverter RequestID=null ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= The file /app/jetty/config/catalog-be/neo4j-errors-configuration.yaml cannot be found. Ignore reading configuration.
2021-06-04T01:20:23.881Z [main] INFO o.o.s.be.listen.BEAppContextListener RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= ASDC version from MANIFEST is 1.9.0
2021-06-04T01:20:23.922Z [main] INFO o.o.s.b.m.BeMonitoringService RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= BE monitoring service is disabled
2021-06-04T01:20:23.927Z [main] INFO o.s.web.context.ContextLoader RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= Root WebApplicationContext: initialization started
2021-06-04T01:20:25.940Z [main] INFO o.o.s.b.d.j.JanusGraphClient RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= ** JanusGraphClient created
2021-06-04T01:20:25.943Z [main] INFO o.o.s.b.d.j.JanusGraphClient RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= ** createGraph started **
2021-06-04T01:20:25.944Z [main] INFO o.o.s.b.d.j.JanusGraphClient RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= ** open graph with /app/jetty/config/catalog-be/janusgraph.properties started
2021-06-04T01:20:25.944Z [main] INFO o.o.s.b.d.j.JanusGraphClient RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= openGraph : try to load file /app/jetty/config/catalog-be/janusgraph.properties
2021-06-04T01:20:26.190Z [main] INFO com.datastax.driver.core RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= DataStax Java driver 3.8.0 for Apache Cassandra
2021-06-04T01:20:26.194Z [main] INFO c.d.driver.core.GuavaCompatibility RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= Detected Guava >= 19 in the classpath, using modern compatibility layer
2021-06-04T01:20:26.217Z [main] INFO c.d.driver.core.SystemProperties RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= com.datastax.driver.USE_NATIVE_CLOCK is defined, using value false
2021-06-04T01:20:26.217Z [main] INFO c.datastax.driver.core.ClockFactory RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= Using java.lang.System clock to generate timestamps.
2021-06-04T01:20:26.630Z [main] INFO com.datastax.driver.core.NettyUtil RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= Found Netty's native epoll transport in the classpath, using it
2021-06-04T01:20:28.096Z [main] INFO c.d.d.c.p.DCAwareRoundRobinPolicy RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= Using provided data-center name 'Pod' for DCAwareRoundRobinPolicy
2021-06-04T01:20:28.098Z [main] INFO com.datastax.driver.core.Cluster RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= New Cassandra host cassandra.onap/10.242.104.73:9042 added
2021-06-04T01:20:28.098Z [main] INFO com.datastax.driver.core.Cluster RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= New Cassandra host /10.242.47.7:9042 added
2021-06-04T01:20:28.098Z [main] INFO com.datastax.driver.core.Cluster RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= New Cassandra host /10.242.138.69:9042 added
2021-06-04T01:20:39.563Z [JanusGraph Cluster-nio-worker-0] WARN com.datastax.driver.core.Session Error creating pool to /10.242.138.69:9042
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:20:40.089Z [main] WARN o.j.g.c.GraphDatabaseConfiguration RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= Local setting storage.cql.replication-strategy-options=[Pod, 3] (Type: FIXED) is overridden by globally managed value ([Pod, 3]). Use the ManagementSystem interface instead of the local configuration to control this setting.
2021-06-04T01:20:42.141Z [main] INFO o.j.g.c.GraphDatabaseConfiguration RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= Generated unique-instance-id=0af2f6cb117-dev-sdc-be-5ddb77679c-fjvdd1
2021-06-04T01:20:42.159Z [main] INFO c.d.driver.core.SystemProperties RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= com.datastax.driver.USE_NATIVE_CLOCK is defined, using value false
2021-06-04T01:20:42.159Z [main] INFO c.datastax.driver.core.ClockFactory RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= Using java.lang.System clock to generate timestamps.
2021-06-04T01:20:42.409Z [main] INFO c.d.d.c.p.DCAwareRoundRobinPolicy RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= Using provided data-center name 'Pod' for DCAwareRoundRobinPolicy
2021-06-04T01:20:42.409Z [main] INFO com.datastax.driver.core.Cluster RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= New Cassandra host cassandra.onap/10.242.104.73:9042 added
2021-06-04T01:20:42.409Z [main] INFO com.datastax.driver.core.Cluster RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= New Cassandra host /10.242.47.7:9042 added
2021-06-04T01:20:42.409Z [main] INFO com.datastax.driver.core.Cluster RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= New Cassandra host /10.242.138.69:9042 added
2021-06-04T01:20:49.459Z [JanusGraph Cluster-nio-worker-0] WARN com.datastax.driver.core.Session Error creating pool to /10.242.138.69:9042
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:20:49.473Z [main] INFO org.janusgraph.diskstorage.Backend RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= Initiated backend operations thread pool of size 2
2021-06-04T01:20:50.087Z [main] INFO o.j.diskstorage.log.kcvs.KCVSLog RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= Loaded unidentified ReadMarker start time 2021-06-04T01:20:50.087955Z into org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller@900ffc4
2021-06-04T01:20:50.227Z [main] INFO o.o.s.b.d.j.JanusGraphClient RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= ** JanusGraph graph created
2021-06-04T01:20:50.294Z [main] INFO o.o.s.b.d.j.JanusGraphGenericDao RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= ** JanusGraphGenericDao created
2021-06-04T01:20:50.324Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:20:50.544Z [main] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= All sdc keyspaces are : [sdcartifact, sdcrepository, sdcaudit]
2021-06-04T01:20:50.545Z [main] INFO o.o.s.b.d.c.schema.SdcSchemaUtils RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= Connecting to node: [cassandra.onap] port: 9042.
2021-06-04T01:20:50.546Z [main] INFO o.o.s.b.d.c.schema.SdcSchemaUtils RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= Connection timeout in seconds : 120
2021-06-04T01:20:50.546Z [main] INFO o.o.s.b.d.c.schema.SdcSchemaUtils RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= SocketConnectTimeout was provided, setting Cassandra client to use SocketConnectTimeout: 20000 .
2021-06-04T01:20:50.546Z [main] INFO o.o.s.b.d.c.schema.SdcSchemaUtils RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= SocketReadTimeout was provided, setting Cassandra client to use SocketReadTimeout: 20000 .
2021-06-04T01:20:50.546Z [main] INFO o.o.s.b.d.c.schema.SdcSchemaUtils RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= localDatacenter was provided, setting Cassndra clint to use datacenter: Pod as local.
2021-06-04T01:20:50.546Z [main] INFO c.d.driver.core.SystemProperties RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= com.datastax.driver.USE_NATIVE_CLOCK is defined, using value false
2021-06-04T01:20:50.546Z [main] INFO c.datastax.driver.core.ClockFactory RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= Using java.lang.System clock to generate timestamps.
2021-06-04T01:20:50.547Z [main] INFO o.o.s.b.d.c.schema.SdcSchemaUtils RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= ** cluster created
2021-06-04T01:20:50.547Z [main] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= creating cluster for Cassandra Health Check.
2021-06-04T01:20:50.754Z [main] INFO c.d.d.c.p.DCAwareRoundRobinPolicy RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= Using provided data-center name 'Pod' for DCAwareRoundRobinPolicy
2021-06-04T01:20:50.754Z [main] INFO com.datastax.driver.core.Cluster RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= New Cassandra host cassandra.onap/10.242.104.73:9042 added
2021-06-04T01:20:50.754Z [main] INFO com.datastax.driver.core.Cluster RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= New Cassandra host cassandra.onap/10.242.47.7:9042 added
2021-06-04T01:20:50.754Z [main] INFO com.datastax.driver.core.Cluster RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= New Cassandra host cassandra.onap/10.242.138.69:9042 added
2021-06-04T01:20:50.754Z [main] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= Cluster Metadata: com.datastax.driver.core.Metadata@1e470a51
2021-06-04T01:20:50.754Z [main] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= keyspace : sdcartifact , replication: {Pod=3, class=org.apache.cassandra.locator.NetworkTopologyStrategy}
2021-06-04T01:20:50.754Z [main] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= keyspace : sdcrepository , replication: {Pod=3, class=org.apache.cassandra.locator.NetworkTopologyStrategy}
2021-06-04T01:20:50.754Z [main] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= keyspace : sdcaudit , replication: {Pod=3, class=org.apache.cassandra.locator.NetworkTopologyStrategy}
2021-06-04T01:20:50.754Z [main] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= maxReplication Factor is: 3
2021-06-04T01:20:50.755Z [main] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= localQuorum is: 2
2021-06-04T01:20:50.755Z [main] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=WARN ServerIPAddress=10.242.246.203 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity= Health Check formula : Replication Factor – Local_Quorum = 1
2021-06-04T01:20:50.769Z [main] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=null ECOMP Portal health check configuration is missing.
2021-06-04T01:20:50.781Z [main] INFO o.o.s.b.s.d.SwitchoverDetector RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=null Enter init method of SwitchoverDetector
2021-06-04T01:20:50.781Z [main] INFO o.o.s.b.s.d.SwitchoverDetector RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=null switchover detector service is disabled
2021-06-04T01:21:10.962Z [cluster1-timeouter-0] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.138.69:9042] Operation timed out
at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:21:10.963Z [cluster1-timeouter-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.ConnectionException: [cassandra.onap/10.242.138.69:9042] Pool was closed during initialization
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:173)
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:158)
at com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1080)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.google.common.util.concurrent.CollectionFuture.handleAllCompleted(CollectionFuture.java:69)
at com.google.common.util.concurrent.AggregateFuture.processCompleted(AggregateFuture.java:282)
at com.google.common.util.concurrent.AggregateFuture.decrementCountAndMaybeComplete(AggregateFuture.java:264)
at com.google.common.util.concurrent.AggregateFuture.access$200(AggregateFuture.java:42)
at com.google.common.util.concurrent.AggregateFuture$1.run(AggregateFuture.java:147)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179)
at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179)
at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:100)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771)
at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:21:10.964Z [main] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=null creating cluster for Cassandra for monitoring.
2021-06-04T01:21:10.964Z [main] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=null The cassandra session is com.datastax.driver.core.SessionManager@16c6d5a2
2021-06-04T01:21:10.964Z [main] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=null The number of cassandra nodes is:3
2021-06-04T01:21:10.967Z [main] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=null The cassandra down nodes number is 1
2021-06-04T01:21:12.016Z [main] INFO o.o.s.be.dao.jsongraph.JanusGraphDao RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=null ** JanusGraphDao created
2021-06-04T01:21:12.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6c7217f-146d-428f-aab5-9671079d37f9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:21:12.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6c7217f-146d-428f-aab5-9671079d37f9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b1c8e2e
2021-06-04T01:21:12.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6c7217f-146d-428f-aab5-9671079d37f9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:21:12.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6c7217f-146d-428f-aab5-9671079d37f9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:21:14.581Z [main] INFO o.o.s.b.d.cassandra.CassandraClient RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=null SocketConnectTimeout was provided, setting Cassandra client to use SocketConnectTimeout: 20000 .
2021-06-04T01:21:14.581Z [main] INFO o.o.s.b.d.cassandra.CassandraClient RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=null SocketReadTimeout was provided, setting Cassandra client to use SocketReadTimeout: 20000 .
2021-06-04T01:21:14.581Z [main] INFO o.o.s.b.d.cassandra.CassandraClient RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=null localDatacenter was provided, setting Cassndra clint to use datacenter: Pod as local.
2021-06-04T01:21:14.581Z [main] INFO c.d.driver.core.SystemProperties RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=null com.datastax.driver.USE_NATIVE_CLOCK is defined, using value false
2021-06-04T01:21:14.581Z [main] INFO c.datastax.driver.core.ClockFactory RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=null Using java.lang.System clock to generate timestamps.
2021-06-04T01:21:14.584Z [main] INFO o.o.s.b.d.cassandra.CassandraClient RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=null ** CassandraClient created
2021-06-04T01:21:15.474Z [main] INFO c.d.d.c.p.DCAwareRoundRobinPolicy RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=null Using provided data-center name 'Pod' for DCAwareRoundRobinPolicy
2021-06-04T01:21:15.475Z [main] INFO com.datastax.driver.core.Cluster RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=null New Cassandra host cassandra.onap/10.242.104.73:9042 added
2021-06-04T01:21:15.475Z [main] INFO com.datastax.driver.core.Cluster RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=null New Cassandra host cassandra.onap/10.242.47.7:9042 added
2021-06-04T01:21:15.475Z [main] INFO com.datastax.driver.core.Cluster RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=null New Cassandra host cassandra.onap/10.242.138.69:9042 added
2021-06-04T01:21:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a63ce2ff-22fc-4922-bafe-7adc17724d50 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:21:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a63ce2ff-22fc-4922-bafe-7adc17724d50 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e31fe66
2021-06-04T01:21:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a63ce2ff-22fc-4922-bafe-7adc17724d50 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:21:15.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a63ce2ff-22fc-4922-bafe-7adc17724d50 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:21:15.796Z [JanusGraph Cluster-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host /10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T01:21:15.797Z [JanusGraph Cluster-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to /10.242.138.69:9042, scheduling retry in 4000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:21:18.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac6816d4-fb76-4446-8907-2407e6ede7c1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:21:18.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac6816d4-fb76-4446-8907-2407e6ede7c1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7084dbda
2021-06-04T01:21:18.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac6816d4-fb76-4446-8907-2407e6ede7c1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:21:18.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac6816d4-fb76-4446-8907-2407e6ede7c1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:21:20.268Z [cluster1-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T01:21:20.269Z [cluster1-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 2000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:21:21.049Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ee6477b-4ca3-42ee-8107-824f904274cc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:21:21.049Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ee6477b-4ca3-42ee-8107-824f904274cc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ec1b0f2
2021-06-04T01:21:21.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ee6477b-4ca3-42ee-8107-824f904274cc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:21:21.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ee6477b-4ca3-42ee-8107-824f904274cc PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:21:24.243Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=831f9bd2-4574-4215-b3da-4e71d6e8e95b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:21:24.243Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=831f9bd2-4574-4215-b3da-4e71d6e8e95b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b9c2935
2021-06-04T01:21:24.243Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=831f9bd2-4574-4215-b3da-4e71d6e8e95b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:21:24.243Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=831f9bd2-4574-4215-b3da-4e71d6e8e95b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:21:27.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b96b3603-256d-41de-800e-774310c5dbba PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:21:27.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b96b3603-256d-41de-800e-774310c5dbba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7cbb6c0d
2021-06-04T01:21:27.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b96b3603-256d-41de-800e-774310c5dbba PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:21:27.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b96b3603-256d-41de-800e-774310c5dbba PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:21:30.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60878bf5-5acb-41a1-be4d-5f62c98d3bfb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:21:30.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60878bf5-5acb-41a1-be4d-5f62c98d3bfb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1af5a273
2021-06-04T01:21:30.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60878bf5-5acb-41a1-be4d-5f62c98d3bfb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:21:30.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60878bf5-5acb-41a1-be4d-5f62c98d3bfb PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:21:33.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25291254-da34-4fc3-97bf-7053ff3757e4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:21:33.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25291254-da34-4fc3-97bf-7053ff3757e4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@526d29c8
2021-06-04T01:21:33.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25291254-da34-4fc3-97bf-7053ff3757e4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:21:33.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25291254-da34-4fc3-97bf-7053ff3757e4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:21:36.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac1d6196-84ab-44e9-9b13-3969ce7394f7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:21:36.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac1d6196-84ab-44e9-9b13-3969ce7394f7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1de837d5
2021-06-04T01:21:36.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac1d6196-84ab-44e9-9b13-3969ce7394f7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:21:36.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac1d6196-84ab-44e9-9b13-3969ce7394f7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:21:39.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afd70d02-8980-466e-8d6a-bb7739e7f98e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:21:39.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afd70d02-8980-466e-8d6a-bb7739e7f98e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a94eb61
2021-06-04T01:21:39.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afd70d02-8980-466e-8d6a-bb7739e7f98e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:21:39.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afd70d02-8980-466e-8d6a-bb7739e7f98e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:21:40.305Z [cluster2-timeouter-0] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.138.69:9042] Operation timed out
at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:21:40.305Z [cluster2-timeouter-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.ConnectionException: [cassandra.onap/10.242.138.69:9042] Pool was closed during initialization
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:173)
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:158)
at com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1080)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.google.common.util.concurrent.CollectionFuture.handleAllCompleted(CollectionFuture.java:69)
at com.google.common.util.concurrent.AggregateFuture.processCompleted(AggregateFuture.java:282)
at com.google.common.util.concurrent.AggregateFuture.decrementCountAndMaybeComplete(AggregateFuture.java:264)
at com.google.common.util.concurrent.AggregateFuture.access$200(AggregateFuture.java:42)
at com.google.common.util.concurrent.AggregateFuture$1.run(AggregateFuture.java:147)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179)
at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179)
at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:100)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771)
at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:21:40.417Z [main] INFO o.o.s.b.d.c.AuditCassandraDao RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=null ** AuditCassandraDao created
2021-06-04T01:21:40.569Z [main] INFO o.o.s.b.c.d.e.DmaapClientFactory RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=null The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1622769608, consumerId=sdc-AUTO1-1622769608, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/app/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman)
2021-06-04T01:21:40.643Z [main] ERROR o.o.s.be.catalog.impl.DmaapProducer RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=null Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit
2021-06-04T01:21:41.861Z [main] INFO o.o.s.b.d.c.ArtifactCassandraDao RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=null ** ArtifactCassandraDao created
2021-06-04T01:21:42.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c8ff7d8-a715-4be5-81bb-3475a8c18d58 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:21:42.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c8ff7d8-a715-4be5-81bb-3475a8c18d58 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@dc5207a
2021-06-04T01:21:42.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c8ff7d8-a715-4be5-81bb-3475a8c18d58 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:21:42.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c8ff7d8-a715-4be5-81bb-3475a8c18d58 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:21:45.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c46cf79d-64b1-492d-b8be-947718ea6fdc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:21:45.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c46cf79d-64b1-492d-b8be-947718ea6fdc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@36dd6b63
2021-06-04T01:21:45.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c46cf79d-64b1-492d-b8be-947718ea6fdc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:21:45.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c46cf79d-64b1-492d-b8be-947718ea6fdc PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:21:48.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a7c3338-fa51-4b76-91bf-99d8bc3901c8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:21:48.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a7c3338-fa51-4b76-91bf-99d8bc3901c8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ad7a4f2
2021-06-04T01:21:48.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a7c3338-fa51-4b76-91bf-99d8bc3901c8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:21:48.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a7c3338-fa51-4b76-91bf-99d8bc3901c8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:21:51.290Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94e30206-5204-4b7b-85de-085fc190da41 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:21:51.290Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94e30206-5204-4b7b-85de-085fc190da41 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7705852a
2021-06-04T01:21:51.290Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94e30206-5204-4b7b-85de-085fc190da41 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:21:51.291Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94e30206-5204-4b7b-85de-085fc190da41 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:21:51.672Z [ApplicationDataTypeCacheThread-1] INFO o.o.s.b.m.c.ApplicationDataTypeCache RequestID=null Detected changes in the data types, updating the data type cache.
2021-06-04T01:21:54.420Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4024ed43-787e-420d-9bc3-570a38e5528f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:21:54.421Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4024ed43-787e-420d-9bc3-570a38e5528f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53e7bd40
2021-06-04T01:21:54.421Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4024ed43-787e-420d-9bc3-570a38e5528f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:21:54.421Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4024ed43-787e-420d-9bc3-570a38e5528f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:21:56.727Z [main] INFO o.o.s.b.d.c.SdcSchemaFilesCassandraDao RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=null ** SdcSchemaFilesCassandraDao created
2021-06-04T01:21:57.001Z [main] WARN o.o.s.b.c.s.CertificateManagerImpl RequestID=84c445b6-a014-4a72-8f13-839978ff2260 ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=null Environment variable 'SDC_CERT_DIR' was not provided. Could not load certificates.
2021-06-04T01:21:57.679Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25cfc180-84dc-49e3-b924-2820c82754ed PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:21:57.679Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25cfc180-84dc-49e3-b924-2820c82754ed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ebc422c
2021-06-04T01:21:57.680Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25cfc180-84dc-49e3-b924-2820c82754ed PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:21:57.680Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25cfc180-84dc-49e3-b924-2820c82754ed PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:21:59.825Z [main] INFO o.o.s.b.c.d.e.EnvironmentsEngine RequestID=5766d34b-7c9c-4897-a587-c58757ed83ba PartnerName=SDC.BE Environments engine is disabled
2021-06-04T01:21:59.897Z [pool-14-thread-1] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/topics (anonymous) ...
2021-06-04T01:22:00.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c4f268d-9fb1-4d62-868d-587475d1683e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:22:00.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c4f268d-9fb1-4d62-868d-587475d1683e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@599b973d
2021-06-04T01:22:00.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c4f268d-9fb1-4d62-868d-587475d1683e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:22:00.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c4f268d-9fb1-4d62-868d-587475d1683e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:22:02.039Z [ApplicationDataTypeCacheThread-1] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=500 TargetEntity=ReplaceDataTypesCache Internal flow error. Operation: Succeed to replace the data types cache
2021-06-04T01:22:03.328Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a489c8ab-c8bc-451f-9727-57213f527bae PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:22:03.328Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a489c8ab-c8bc-451f-9727-57213f527bae PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ec65f1
2021-06-04T01:22:03.328Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a489c8ab-c8bc-451f-9727-57213f527bae PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:22:03.328Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a489c8ab-c8bc-451f-9727-57213f527bae PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:22:03.554Z [main] INFO o.o.s.b.c.s.AsdcComponentsCleanerTask RequestID=5766d34b-7c9c-4897-a587-c58757ed83ba PartnerName=SDC.BE ServerIPAddress=10.242.246.203 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd Enter init method of AsdcComponentsCleaner
2021-06-04T01:22:03.555Z [main] INFO o.o.s.b.c.s.AsdcComponentsCleanerTask RequestID=5766d34b-7c9c-4897-a587-c58757ed83ba PartnerName=SDC.BE ServerIPAddress=10.242.246.203 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd End init method of AsdcComponentsCleaner
2021-06-04T01:22:03.616Z [main] INFO o.s.b.f.a.AutowiredAnnotationBeanPostProcessor RequestID=5766d34b-7c9c-4897-a587-c58757ed83ba PartnerName=SDC.BE ServerIPAddress=10.242.246.203 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd Autowired annotation is not supported on static methods: public static void org.openecomp.sdc.be.components.impl.ImportUtils.setComponentsUtils(org.openecomp.sdc.be.impl.ComponentsUtils)
2021-06-04T01:22:04.039Z [main] INFO o.o.s.b.d.cassandra.FeatureToggleDao RequestID=5766d34b-7c9c-4897-a587-c58757ed83ba PartnerName=SDC.BE ServerIPAddress=10.242.246.203 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd ** FeatureToggleDao created
2021-06-04T01:22:04.147Z [cluster1-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadFailureException: Operation failed - received 0 responses and 1 failures
2021-06-04T01:22:04.148Z [cluster1-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 8000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadFailureException: Operation failed - received 0 responses and 1 failures
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:22:04.382Z [main] INFO o.s.web.context.ContextLoader RequestID=5766d34b-7c9c-4897-a587-c58757ed83ba PartnerName=SDC.BE ServerIPAddress=10.242.246.203 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd Root WebApplicationContext initialized in 100455 ms
2021-06-04T01:22:06.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f410bca6-2eba-4435-b8c2-330a0288d388 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:22:06.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f410bca6-2eba-4435-b8c2-330a0288d388 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c8fd551
2021-06-04T01:22:06.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f410bca6-2eba-4435-b8c2-330a0288d388 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:22:06.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f410bca6-2eba-4435-b8c2-330a0288d388 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:22:07.369Z [main] INFO o.a.c.b.FluentPropertyBeanIntrospector RequestID=5766d34b-7c9c-4897-a587-c58757ed83ba PartnerName=SDC.BE ServerIPAddress=10.242.246.203 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property.
2021-06-04T01:22:07.391Z [main] INFO o.a.c.b.FluentPropertyBeanIntrospector RequestID=5766d34b-7c9c-4897-a587-c58757ed83ba PartnerName=SDC.BE ServerIPAddress=10.242.246.203 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property.
2021-06-04T01:22:07.418Z [main] INFO o.a.c.b.FluentPropertyBeanIntrospector RequestID=5766d34b-7c9c-4897-a587-c58757ed83ba PartnerName=SDC.BE ServerIPAddress=10.242.246.203 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property.
2021-06-04T01:22:09.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec0a0e34-4c0d-4e89-b8a2-107e4d01b488 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:22:09.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec0a0e34-4c0d-4e89-b8a2-107e4d01b488 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e57ce
2021-06-04T01:22:09.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec0a0e34-4c0d-4e89-b8a2-107e4d01b488 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:22:09.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec0a0e34-4c0d-4e89-b8a2-107e4d01b488 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:22:10.100Z [main] INFO o.h.validator.internal.util.Version RequestID=5766d34b-7c9c-4897-a587-c58757ed83ba PartnerName=SDC.BE ServerIPAddress=10.242.246.203 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd HV000001: Hibernate Validator 5.3.6.Final
2021-06-04T01:22:11.112Z [qtp817348612-14] INFO com.jcabi.aspects.aj.NamedThreads RequestID=null ServerIPAddress=10.242.246.203 ServiceName=/healthCheck EntryTimestamp=2021-06-04T01:22:10.804Z InvocationID=6a3d2bd5-8c84-4764-9e71-a6e04d9abb83 PartnerName=kube-probe/1.18 auditOn=true ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd jcabi-aspects 0.20.1/f0aff93 started new daemon thread jcabi-loggable for watching of @Loggable annotated methods
2021-06-04T01:22:11.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a16ac20-5105-4d53-aa4e-9bff35276406 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:22:11.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a16ac20-5105-4d53-aa4e-9bff35276406 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e90a85
2021-06-04T01:22:11.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a16ac20-5105-4d53-aa4e-9bff35276406 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:22:11.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a16ac20-5105-4d53-aa4e-9bff35276406 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:22:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82a77c07-44d2-4810-a982-617c2112bf4c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:22:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82a77c07-44d2-4810-a982-617c2112bf4c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@644b3424
2021-06-04T01:22:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82a77c07-44d2-4810-a982-617c2112bf4c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:22:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82a77c07-44d2-4810-a982-617c2112bf4c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:22:18.475Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a93b7620-edf1-40c0-a51a-2012ec0e483a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:22:18.475Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a93b7620-edf1-40c0-a51a-2012ec0e483a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@767c50a1
2021-06-04T01:22:18.475Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a93b7620-edf1-40c0-a51a-2012ec0e483a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:22:18.476Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a93b7620-edf1-40c0-a51a-2012ec0e483a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:22:21.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6105bdbd-bbad-4b6a-8525-22f74686baf9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:22:21.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6105bdbd-bbad-4b6a-8525-22f74686baf9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4fe9987
2021-06-04T01:22:21.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6105bdbd-bbad-4b6a-8525-22f74686baf9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:22:21.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6105bdbd-bbad-4b6a-8525-22f74686baf9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:22:24.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61eb4b0a-a0f3-4124-b19a-1157d55ed11a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:22:24.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61eb4b0a-a0f3-4124-b19a-1157d55ed11a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@498e16bf
2021-06-04T01:22:24.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61eb4b0a-a0f3-4124-b19a-1157d55ed11a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:22:24.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61eb4b0a-a0f3-4124-b19a-1157d55ed11a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:22:27.480Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5266bc0-2305-4293-8bb5-34a12e9c9b23 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:22:27.480Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5266bc0-2305-4293-8bb5-34a12e9c9b23 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74d9e1be
2021-06-04T01:22:27.480Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5266bc0-2305-4293-8bb5-34a12e9c9b23 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:22:27.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5266bc0-2305-4293-8bb5-34a12e9c9b23 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:22:30.379Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2702b9ee-3b47-48eb-9a96-1798fcbc7f33 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:22:30.379Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2702b9ee-3b47-48eb-9a96-1798fcbc7f33 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60345edc
2021-06-04T01:22:30.379Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2702b9ee-3b47-48eb-9a96-1798fcbc7f33 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:22:30.380Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2702b9ee-3b47-48eb-9a96-1798fcbc7f33 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:22:33.327Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2070d9d6-4171-4cd8-b884-04e1d40774eb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:22:33.329Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2070d9d6-4171-4cd8-b884-04e1d40774eb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1076d1fc
2021-06-04T01:22:33.329Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2070d9d6-4171-4cd8-b884-04e1d40774eb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:22:33.329Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2070d9d6-4171-4cd8-b884-04e1d40774eb PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:22:36.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21c9f31b-fb10-4160-a5ed-39a5d48cec87 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:22:36.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21c9f31b-fb10-4160-a5ed-39a5d48cec87 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@297416a3
2021-06-04T01:22:36.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21c9f31b-fb10-4160-a5ed-39a5d48cec87 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:22:36.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21c9f31b-fb10-4160-a5ed-39a5d48cec87 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:22:39.660Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c22a52b-f210-4980-950f-d9b5b444d8ec PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:22:39.660Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c22a52b-f210-4980-950f-d9b5b444d8ec PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@129bc622
2021-06-04T01:22:39.660Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c22a52b-f210-4980-950f-d9b5b444d8ec PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:22:39.660Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c22a52b-f210-4980-950f-d9b5b444d8ec PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:22:41.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c364c447-7c5a-484e-853f-402ef7708487 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:22:41.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c364c447-7c5a-484e-853f-402ef7708487 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@501ba813
2021-06-04T01:22:41.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c364c447-7c5a-484e-853f-402ef7708487 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:22:41.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c364c447-7c5a-484e-853f-402ef7708487 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:22:45.475Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e014c96-e86d-4d5a-a42d-da110d3fddf5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:22:45.476Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e014c96-e86d-4d5a-a42d-da110d3fddf5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@76c47add
2021-06-04T01:22:45.476Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e014c96-e86d-4d5a-a42d-da110d3fddf5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:22:45.476Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e014c96-e86d-4d5a-a42d-da110d3fddf5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:22:48.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f4e9602-e06a-4e88-bdd8-87c6e4b67b82 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:22:48.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f4e9602-e06a-4e88-bdd8-87c6e4b67b82 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f0caba8
2021-06-04T01:22:48.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f4e9602-e06a-4e88-bdd8-87c6e4b67b82 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:22:48.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f4e9602-e06a-4e88-bdd8-87c6e4b67b82 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:22:51.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4b432a2-009c-4c17-997e-d80d7c5d6e6c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:22:51.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4b432a2-009c-4c17-997e-d80d7c5d6e6c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@33eac8bd
2021-06-04T01:22:51.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4b432a2-009c-4c17-997e-d80d7c5d6e6c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:22:51.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4b432a2-009c-4c17-997e-d80d7c5d6e6c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:22:54.228Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ed94ea3-7b02-4bab-bb1c-d088a67360a8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:22:54.228Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ed94ea3-7b02-4bab-bb1c-d088a67360a8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ebcb5e3
2021-06-04T01:22:54.228Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ed94ea3-7b02-4bab-bb1c-d088a67360a8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:22:54.228Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ed94ea3-7b02-4bab-bb1c-d088a67360a8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:22:57.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c82e97e7-f5d4-499c-a650-39d6fb14629e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:22:57.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c82e97e7-f5d4-499c-a650-39d6fb14629e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b7b227b
2021-06-04T01:22:57.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c82e97e7-f5d4-499c-a650-39d6fb14629e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:22:57.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c82e97e7-f5d4-499c-a650-39d6fb14629e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:23:00.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=170c7487-d349-4fb4-bdd7-51e1ea04dc85 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:23:00.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=170c7487-d349-4fb4-bdd7-51e1ea04dc85 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71b09557
2021-06-04T01:23:00.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=170c7487-d349-4fb4-bdd7-51e1ea04dc85 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:23:00.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=170c7487-d349-4fb4-bdd7-51e1ea04dc85 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:23:03.243Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f138087-2f33-437f-aca6-7fc071623b25 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:23:03.243Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f138087-2f33-437f-aca6-7fc071623b25 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@14fa04fc
2021-06-04T01:23:03.243Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f138087-2f33-437f-aca6-7fc071623b25 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:23:03.243Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f138087-2f33-437f-aca6-7fc071623b25 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:23:06.674Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8abbea2-f3c9-4404-8d2f-065c5389159b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:23:06.675Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8abbea2-f3c9-4404-8d2f-065c5389159b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4fb2b82d
2021-06-04T01:23:06.675Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8abbea2-f3c9-4404-8d2f-065c5389159b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:23:06.675Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8abbea2-f3c9-4404-8d2f-065c5389159b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:23:09.423Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7d5a097-afdd-4e4f-909c-2bbc995f9194 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:23:09.423Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7d5a097-afdd-4e4f-909c-2bbc995f9194 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d68235a
2021-06-04T01:23:09.423Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7d5a097-afdd-4e4f-909c-2bbc995f9194 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:23:09.424Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7d5a097-afdd-4e4f-909c-2bbc995f9194 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:23:12.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45ea9295-6d77-463e-b020-6c9ab471400b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:23:12.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45ea9295-6d77-463e-b020-6c9ab471400b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@8070b8d
2021-06-04T01:23:12.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45ea9295-6d77-463e-b020-6c9ab471400b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:23:12.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45ea9295-6d77-463e-b020-6c9ab471400b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:23:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6899f88f-4e2b-4c69-b8d2-fff8e81eee72 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:23:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6899f88f-4e2b-4c69-b8d2-fff8e81eee72 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c1e2395
2021-06-04T01:23:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6899f88f-4e2b-4c69-b8d2-fff8e81eee72 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:23:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6899f88f-4e2b-4c69-b8d2-fff8e81eee72 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:23:18.675Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e6a2383-4b8b-45e5-83f0-548f2506b86d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:23:18.675Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e6a2383-4b8b-45e5-83f0-548f2506b86d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@16b789eb
2021-06-04T01:23:18.675Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e6a2383-4b8b-45e5-83f0-548f2506b86d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:23:18.675Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e6a2383-4b8b-45e5-83f0-548f2506b86d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:23:20.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5fe51ec0-87a5-42c3-bcef-74f865188633 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:23:20.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5fe51ec0-87a5-42c3-bcef-74f865188633 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a791a94
2021-06-04T01:23:20.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5fe51ec0-87a5-42c3-bcef-74f865188633 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:23:20.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5fe51ec0-87a5-42c3-bcef-74f865188633 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:23:24.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3365e538-e7b9-4fb3-8b04-ad3fb43964f9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:23:24.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3365e538-e7b9-4fb3-8b04-ad3fb43964f9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a922735
2021-06-04T01:23:24.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3365e538-e7b9-4fb3-8b04-ad3fb43964f9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:23:24.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3365e538-e7b9-4fb3-8b04-ad3fb43964f9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:23:27.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e8970f4-05a0-43dc-9c07-dac43a385ee4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:23:27.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e8970f4-05a0-43dc-9c07-dac43a385ee4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@272dbd79
2021-06-04T01:23:27.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e8970f4-05a0-43dc-9c07-dac43a385ee4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:23:27.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e8970f4-05a0-43dc-9c07-dac43a385ee4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:23:30.415Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0113fbd2-16f0-4138-b677-ffcd50d41245 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:23:30.415Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0113fbd2-16f0-4138-b677-ffcd50d41245 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@dff90a6
2021-06-04T01:23:30.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0113fbd2-16f0-4138-b677-ffcd50d41245 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:23:30.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0113fbd2-16f0-4138-b677-ffcd50d41245 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:23:33.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=319070b5-28df-408f-bd94-5a5b0ffd93ff PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:23:33.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=319070b5-28df-408f-bd94-5a5b0ffd93ff PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6fb08637
2021-06-04T01:23:33.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=319070b5-28df-408f-bd94-5a5b0ffd93ff PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:23:33.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=319070b5-28df-408f-bd94-5a5b0ffd93ff PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:23:36.487Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c685d64c-dd19-4d23-aff3-6707fb92cd36 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:23:36.488Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c685d64c-dd19-4d23-aff3-6707fb92cd36 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6410bf7b
2021-06-04T01:23:36.488Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c685d64c-dd19-4d23-aff3-6707fb92cd36 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:23:36.488Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c685d64c-dd19-4d23-aff3-6707fb92cd36 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:23:36.852Z [cluster1-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T01:23:36.853Z [cluster1-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 32000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:23:36.871Z [cluster2-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T01:23:36.872Z [cluster2-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 30000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:23:39.715Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce68b083-d39f-4ab4-9b21-1d062cee8839 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:23:39.715Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce68b083-d39f-4ab4-9b21-1d062cee8839 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e9c10f5
2021-06-04T01:23:39.715Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce68b083-d39f-4ab4-9b21-1d062cee8839 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:23:39.715Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce68b083-d39f-4ab4-9b21-1d062cee8839 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:23:41.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4d3154f-b722-490b-a1d1-463636952d2a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:23:41.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4d3154f-b722-490b-a1d1-463636952d2a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f17df20
2021-06-04T01:23:41.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4d3154f-b722-490b-a1d1-463636952d2a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:23:41.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4d3154f-b722-490b-a1d1-463636952d2a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:23:45.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5315e01-5470-414a-8d43-eeac42314489 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:23:45.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5315e01-5470-414a-8d43-eeac42314489 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34fd6bcb
2021-06-04T01:23:45.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5315e01-5470-414a-8d43-eeac42314489 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:23:45.475Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5315e01-5470-414a-8d43-eeac42314489 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:23:48.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d483fef9-0ada-4da4-9e01-fe9eba6944d6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:23:48.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d483fef9-0ada-4da4-9e01-fe9eba6944d6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5577e148
2021-06-04T01:23:48.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d483fef9-0ada-4da4-9e01-fe9eba6944d6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:23:48.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d483fef9-0ada-4da4-9e01-fe9eba6944d6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:23:51.004Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c876805-5eed-49da-8e10-15577c432888 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:23:51.004Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c876805-5eed-49da-8e10-15577c432888 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b2248ab
2021-06-04T01:23:51.004Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c876805-5eed-49da-8e10-15577c432888 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:23:51.004Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c876805-5eed-49da-8e10-15577c432888 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:23:54.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66d3607d-2e5c-4273-a5a6-6b7ded9cdc6c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:23:54.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66d3607d-2e5c-4273-a5a6-6b7ded9cdc6c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a2d7a30
2021-06-04T01:23:54.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66d3607d-2e5c-4273-a5a6-6b7ded9cdc6c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:23:54.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66d3607d-2e5c-4273-a5a6-6b7ded9cdc6c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:23:57.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b31a464-e57c-45e2-8666-2af88617e482 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:23:57.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b31a464-e57c-45e2-8666-2af88617e482 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2551f58d
2021-06-04T01:23:57.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b31a464-e57c-45e2-8666-2af88617e482 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:23:57.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b31a464-e57c-45e2-8666-2af88617e482 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:24:00.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=697ab9cc-a9a0-476f-bd19-f45db29065b5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:24:00.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=697ab9cc-a9a0-476f-bd19-f45db29065b5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4fc62dce
2021-06-04T01:24:00.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=697ab9cc-a9a0-476f-bd19-f45db29065b5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:24:00.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=697ab9cc-a9a0-476f-bd19-f45db29065b5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:24:03.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=193dbeed-4271-4c3d-90ca-d4c4ee73209f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:24:03.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=193dbeed-4271-4c3d-90ca-d4c4ee73209f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@46a8438d
2021-06-04T01:24:03.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=193dbeed-4271-4c3d-90ca-d4c4ee73209f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:24:03.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=193dbeed-4271-4c3d-90ca-d4c4ee73209f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:24:06.585Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf356061-f6ec-43ac-ab43-96a8d6c81c90 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:24:06.585Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf356061-f6ec-43ac-ab43-96a8d6c81c90 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57c55d92
2021-06-04T01:24:06.585Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf356061-f6ec-43ac-ab43-96a8d6c81c90 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:24:06.585Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf356061-f6ec-43ac-ab43-96a8d6c81c90 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:24:09.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d94c24d-05e3-46a7-9053-694ca65fb150 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:24:09.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d94c24d-05e3-46a7-9053-694ca65fb150 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d92377a
2021-06-04T01:24:09.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d94c24d-05e3-46a7-9053-694ca65fb150 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:24:09.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d94c24d-05e3-46a7-9053-694ca65fb150 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:24:10.586Z [pool-14-thread-1] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T01:24:10.590Z [pool-14-thread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR ErrorCategory=ERROR RequestID=null ServiceName=getTopics TargetServiceName=null ErrorCode=200 TargetEntity=getTopics Connection problem towards U-EB server. Reason: 500
2021-06-04T01:24:10.590Z [pool-14-thread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine Error occured during access to U-EB Server. Operation: try retrieve list of topics from U-EB server
2021-06-04T01:24:11.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0be47c0-e86f-4db5-8d77-a77715f6e701 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:24:11.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0be47c0-e86f-4db5-8d77-a77715f6e701 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c4dd5b
2021-06-04T01:24:11.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0be47c0-e86f-4db5-8d77-a77715f6e701 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:24:11.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0be47c0-e86f-4db5-8d77-a77715f6e701 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:24:15.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70c43d9b-8fde-4051-b4be-e7ce81d660cc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:24:15.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70c43d9b-8fde-4051-b4be-e7ce81d660cc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f44285
2021-06-04T01:24:15.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70c43d9b-8fde-4051-b4be-e7ce81d660cc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:24:15.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70c43d9b-8fde-4051-b4be-e7ce81d660cc PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:24:15.594Z [pool-14-thread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine GET http://message-router.onap:3904/topics (anonymous) ...
2021-06-04T01:24:18.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4ef6d33-c697-4905-ae3a-f859e9456491 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:24:18.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4ef6d33-c697-4905-ae3a-f859e9456491 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7aa0b624
2021-06-04T01:24:18.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4ef6d33-c697-4905-ae3a-f859e9456491 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:24:18.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4ef6d33-c697-4905-ae3a-f859e9456491 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:24:21.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3e269cd-c740-4bbf-a7db-5967e5214bf1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:24:21.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3e269cd-c740-4bbf-a7db-5967e5214bf1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@16e567ed
2021-06-04T01:24:21.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3e269cd-c740-4bbf-a7db-5967e5214bf1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:24:21.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3e269cd-c740-4bbf-a7db-5967e5214bf1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:24:24.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=334c0b22-4775-4aa4-bfcd-a20c03957051 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:24:24.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=334c0b22-4775-4aa4-bfcd-a20c03957051 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@33ee5e6f
2021-06-04T01:24:24.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=334c0b22-4775-4aa4-bfcd-a20c03957051 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:24:24.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=334c0b22-4775-4aa4-bfcd-a20c03957051 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:24:27.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3eec7a50-7e39-44f1-9426-f1f565b1a1a0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:24:27.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3eec7a50-7e39-44f1-9426-f1f565b1a1a0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@162bc2fd
2021-06-04T01:24:27.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3eec7a50-7e39-44f1-9426-f1f565b1a1a0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:24:27.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3eec7a50-7e39-44f1-9426-f1f565b1a1a0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:24:30.292Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47e390da-d57b-4fa2-946a-5352f0239b24 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:24:30.293Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47e390da-d57b-4fa2-946a-5352f0239b24 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69c5578a
2021-06-04T01:24:30.293Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47e390da-d57b-4fa2-946a-5352f0239b24 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:24:30.293Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47e390da-d57b-4fa2-946a-5352f0239b24 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:24:31.427Z [cluster2-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T01:24:31.428Z [cluster2-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 30000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:24:33.339Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f8f592b-bd80-4723-8a10-880bcfea7387 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:24:33.339Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f8f592b-bd80-4723-8a10-880bcfea7387 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54a28f50
2021-06-04T01:24:33.340Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f8f592b-bd80-4723-8a10-880bcfea7387 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:24:33.340Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f8f592b-bd80-4723-8a10-880bcfea7387 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:24:36.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b43047ec-3cd1-4011-8fd8-11bd0357e740 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:24:36.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b43047ec-3cd1-4011-8fd8-11bd0357e740 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@157eae8d
2021-06-04T01:24:36.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b43047ec-3cd1-4011-8fd8-11bd0357e740 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:24:36.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b43047ec-3cd1-4011-8fd8-11bd0357e740 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:24:39.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84ae0609-0640-43f1-b3a5-aaa596b9cde7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:24:39.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84ae0609-0640-43f1-b3a5-aaa596b9cde7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d8abaf5
2021-06-04T01:24:39.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84ae0609-0640-43f1-b3a5-aaa596b9cde7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:24:39.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84ae0609-0640-43f1-b3a5-aaa596b9cde7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:24:42.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d8d3f07-fe6d-43cb-8552-c2eda4e8e29f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:24:42.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d8d3f07-fe6d-43cb-8552-c2eda4e8e29f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1eb0dfc9
2021-06-04T01:24:42.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d8d3f07-fe6d-43cb-8552-c2eda4e8e29f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:24:42.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d8d3f07-fe6d-43cb-8552-c2eda4e8e29f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:24:45.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38b1a4b1-8c54-4367-9b3e-65b32752fbcd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:24:45.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38b1a4b1-8c54-4367-9b3e-65b32752fbcd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ea81b40
2021-06-04T01:24:45.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38b1a4b1-8c54-4367-9b3e-65b32752fbcd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:24:45.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38b1a4b1-8c54-4367-9b3e-65b32752fbcd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:24:48.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71951833-00b9-402f-9b1b-4bd45ea8817e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:24:48.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71951833-00b9-402f-9b1b-4bd45ea8817e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e42dcde
2021-06-04T01:24:48.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71951833-00b9-402f-9b1b-4bd45ea8817e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:24:48.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71951833-00b9-402f-9b1b-4bd45ea8817e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:24:50.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4eeced0b-2459-446b-9a76-39d62a84f5d2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:24:50.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4eeced0b-2459-446b-9a76-39d62a84f5d2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@369784f1
2021-06-04T01:24:50.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4eeced0b-2459-446b-9a76-39d62a84f5d2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:24:50.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4eeced0b-2459-446b-9a76-39d62a84f5d2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:24:54.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63f4dd44-2f86-46d5-a3cc-5a296e506317 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:24:54.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63f4dd44-2f86-46d5-a3cc-5a296e506317 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ec15b7d
2021-06-04T01:24:54.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63f4dd44-2f86-46d5-a3cc-5a296e506317 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:24:54.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63f4dd44-2f86-46d5-a3cc-5a296e506317 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:24:57.614Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ae683fd-c60c-4736-8a5f-4ccb74f8e1be PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:24:57.614Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ae683fd-c60c-4736-8a5f-4ccb74f8e1be PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30ad37fe
2021-06-04T01:24:57.614Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ae683fd-c60c-4736-8a5f-4ccb74f8e1be PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:24:57.614Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ae683fd-c60c-4736-8a5f-4ccb74f8e1be PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:25:00.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4279b889-447e-4703-98b2-ddb2ef61a065 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:25:00.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4279b889-447e-4703-98b2-ddb2ef61a065 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@18a1b919
2021-06-04T01:25:00.373Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4279b889-447e-4703-98b2-ddb2ef61a065 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:25:00.373Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4279b889-447e-4703-98b2-ddb2ef61a065 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:25:03.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5fe1a4bb-f2c4-489e-893e-13a876e05487 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:25:03.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5fe1a4bb-f2c4-489e-893e-13a876e05487 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@129b16f0
2021-06-04T01:25:03.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5fe1a4bb-f2c4-489e-893e-13a876e05487 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:25:03.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5fe1a4bb-f2c4-489e-893e-13a876e05487 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:25:06.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c5ecef0-73fa-4f19-bdac-d8e4ff7e1f73 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:25:06.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c5ecef0-73fa-4f19-bdac-d8e4ff7e1f73 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@36a5bd6d
2021-06-04T01:25:06.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c5ecef0-73fa-4f19-bdac-d8e4ff7e1f73 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:25:06.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c5ecef0-73fa-4f19-bdac-d8e4ff7e1f73 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:25:09.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a5b3be7-a22c-4b76-ace8-8fdbbc0db34b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:25:09.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a5b3be7-a22c-4b76-ace8-8fdbbc0db34b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6fee6e80
2021-06-04T01:25:09.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a5b3be7-a22c-4b76-ace8-8fdbbc0db34b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:25:09.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a5b3be7-a22c-4b76-ace8-8fdbbc0db34b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:25:11.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b595f988-5787-4850-b193-6da8927b8732 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:25:11.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b595f988-5787-4850-b193-6da8927b8732 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a127b15
2021-06-04T01:25:11.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b595f988-5787-4850-b193-6da8927b8732 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:25:11.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b595f988-5787-4850-b193-6da8927b8732 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:25:15.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38759686-dbf6-4dfd-b87d-4acb0b33cb4c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:25:15.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38759686-dbf6-4dfd-b87d-4acb0b33cb4c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30f4de31
2021-06-04T01:25:15.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38759686-dbf6-4dfd-b87d-4acb0b33cb4c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:25:15.384Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38759686-dbf6-4dfd-b87d-4acb0b33cb4c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:25:16.859Z [cluster2-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadFailureException: Operation failed - received 0 responses and 1 failures
2021-06-04T01:25:16.860Z [cluster2-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 30000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadFailureException: Operation failed - received 0 responses and 1 failures
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:25:18.679Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a38915c8-ddd8-42be-997e-6aa98630d69a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:25:18.680Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a38915c8-ddd8-42be-997e-6aa98630d69a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ba14397
2021-06-04T01:25:18.680Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a38915c8-ddd8-42be-997e-6aa98630d69a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:25:18.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a38915c8-ddd8-42be-997e-6aa98630d69a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:25:20.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f656aac5-8e64-4797-b495-c91437f4d3f7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:25:20.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f656aac5-8e64-4797-b495-c91437f4d3f7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3727b20d
2021-06-04T01:25:20.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f656aac5-8e64-4797-b495-c91437f4d3f7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:25:20.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f656aac5-8e64-4797-b495-c91437f4d3f7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:25:24.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbf0eb0f-faa3-42be-afd8-4c375c455798 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:25:24.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbf0eb0f-faa3-42be-afd8-4c375c455798 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e84ad2f
2021-06-04T01:25:24.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbf0eb0f-faa3-42be-afd8-4c375c455798 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:25:24.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbf0eb0f-faa3-42be-afd8-4c375c455798 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:25:27.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a7a0614-9b7a-4d11-85e9-f6c134631d46 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:25:27.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a7a0614-9b7a-4d11-85e9-f6c134631d46 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4817f598
2021-06-04T01:25:27.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a7a0614-9b7a-4d11-85e9-f6c134631d46 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:25:27.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a7a0614-9b7a-4d11-85e9-f6c134631d46 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:25:30.622Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=489bbb9a-2d78-4738-8039-543eed36e0da PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:25:30.622Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=489bbb9a-2d78-4738-8039-543eed36e0da PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@698baaf6
2021-06-04T01:25:30.622Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=489bbb9a-2d78-4738-8039-543eed36e0da PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:25:30.622Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=489bbb9a-2d78-4738-8039-543eed36e0da PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:25:33.337Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed94b31c-4eea-43bf-ab78-66851ce48d15 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:25:33.337Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed94b31c-4eea-43bf-ab78-66851ce48d15 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6336da10
2021-06-04T01:25:33.338Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed94b31c-4eea-43bf-ab78-66851ce48d15 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:25:33.338Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed94b31c-4eea-43bf-ab78-66851ce48d15 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:25:36.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c07e31a2-c4c6-44b6-8f25-3b5f2a5add0a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:25:36.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c07e31a2-c4c6-44b6-8f25-3b5f2a5add0a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@18a0fe8c
2021-06-04T01:25:36.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c07e31a2-c4c6-44b6-8f25-3b5f2a5add0a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:25:36.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c07e31a2-c4c6-44b6-8f25-3b5f2a5add0a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:25:39.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a13d45b8-777c-4e69-a26b-92c65bb07b02 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:25:39.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a13d45b8-777c-4e69-a26b-92c65bb07b02 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f6c6335
2021-06-04T01:25:39.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a13d45b8-777c-4e69-a26b-92c65bb07b02 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:25:39.480Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a13d45b8-777c-4e69-a26b-92c65bb07b02 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:25:42.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d817e00-8361-4064-a91b-8125387f4794 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:25:42.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d817e00-8361-4064-a91b-8125387f4794 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b04b834
2021-06-04T01:25:42.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d817e00-8361-4064-a91b-8125387f4794 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:25:42.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d817e00-8361-4064-a91b-8125387f4794 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:25:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66fd4260-a4c5-49c2-8b35-b132be538bd1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:25:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66fd4260-a4c5-49c2-8b35-b132be538bd1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@eb70f1e
2021-06-04T01:25:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66fd4260-a4c5-49c2-8b35-b132be538bd1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:25:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66fd4260-a4c5-49c2-8b35-b132be538bd1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:25:48.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a851c573-9514-4d3a-9e63-a4cb86f65c7c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:25:48.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a851c573-9514-4d3a-9e63-a4cb86f65c7c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@117cc4da
2021-06-04T01:25:48.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a851c573-9514-4d3a-9e63-a4cb86f65c7c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:25:48.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a851c573-9514-4d3a-9e63-a4cb86f65c7c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:25:50.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8dd2b63-d2f4-4fb3-a201-92b7772d561a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:25:50.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8dd2b63-d2f4-4fb3-a201-92b7772d561a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d85680b
2021-06-04T01:25:50.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8dd2b63-d2f4-4fb3-a201-92b7772d561a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:25:50.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8dd2b63-d2f4-4fb3-a201-92b7772d561a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:25:54.236Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce3a3074-5e81-4ebb-bdc0-1a17517c9bbe PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:25:54.236Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce3a3074-5e81-4ebb-bdc0-1a17517c9bbe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@633eb697
2021-06-04T01:25:54.236Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce3a3074-5e81-4ebb-bdc0-1a17517c9bbe PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:25:54.236Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce3a3074-5e81-4ebb-bdc0-1a17517c9bbe PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:25:57.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5725f92-df56-42cb-bb76-de39521d2dcf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:25:57.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5725f92-df56-42cb-bb76-de39521d2dcf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@55478a11
2021-06-04T01:25:57.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5725f92-df56-42cb-bb76-de39521d2dcf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:25:57.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5725f92-df56-42cb-bb76-de39521d2dcf PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:26:00.431Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ad04a8d-2d16-4032-8fff-22ccdb3805cf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:26:00.432Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ad04a8d-2d16-4032-8fff-22ccdb3805cf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@226ade77
2021-06-04T01:26:00.432Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ad04a8d-2d16-4032-8fff-22ccdb3805cf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:26:00.432Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ad04a8d-2d16-4032-8fff-22ccdb3805cf PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:26:03.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e6b1d51-734b-435f-ba6e-7e8377f88517 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:26:03.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e6b1d51-734b-435f-ba6e-7e8377f88517 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@14993f01
2021-06-04T01:26:03.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e6b1d51-734b-435f-ba6e-7e8377f88517 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:26:03.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e6b1d51-734b-435f-ba6e-7e8377f88517 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:26:06.480Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c39e2ff7-154e-4fce-97d4-9eef7846246d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:26:06.480Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c39e2ff7-154e-4fce-97d4-9eef7846246d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@285a90b
2021-06-04T01:26:06.480Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c39e2ff7-154e-4fce-97d4-9eef7846246d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:26:06.480Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c39e2ff7-154e-4fce-97d4-9eef7846246d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:26:09.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c97f055-54b7-4449-8bab-b336aff03521 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:26:09.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c97f055-54b7-4449-8bab-b336aff03521 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b7bbc48
2021-06-04T01:26:09.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c97f055-54b7-4449-8bab-b336aff03521 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:26:09.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c97f055-54b7-4449-8bab-b336aff03521 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:26:12.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcc0186d-cf3d-462b-828c-5925bc6bf4e8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:26:12.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcc0186d-cf3d-462b-828c-5925bc6bf4e8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f165e36
2021-06-04T01:26:12.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcc0186d-cf3d-462b-828c-5925bc6bf4e8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:26:12.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcc0186d-cf3d-462b-828c-5925bc6bf4e8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:26:15.520Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6017c206-6b13-47a7-8018-c2d1dbf53b3f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:26:15.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6017c206-6b13-47a7-8018-c2d1dbf53b3f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@422a0be2
2021-06-04T01:26:15.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6017c206-6b13-47a7-8018-c2d1dbf53b3f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:26:15.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6017c206-6b13-47a7-8018-c2d1dbf53b3f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:26:18.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7917245d-1495-4901-8d76-36386327cd36 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:26:18.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7917245d-1495-4901-8d76-36386327cd36 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6dc83f5d
2021-06-04T01:26:18.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7917245d-1495-4901-8d76-36386327cd36 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:26:18.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7917245d-1495-4901-8d76-36386327cd36 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:26:21.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e97657d1-1cb4-4134-b0cc-6574517ffa04 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:26:21.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e97657d1-1cb4-4134-b0cc-6574517ffa04 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b675750
2021-06-04T01:26:21.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e97657d1-1cb4-4134-b0cc-6574517ffa04 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:26:21.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e97657d1-1cb4-4134-b0cc-6574517ffa04 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:26:24.240Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7e12ceb-9809-48f8-a281-b42e631819f1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:26:24.240Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7e12ceb-9809-48f8-a281-b42e631819f1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@762d55e4
2021-06-04T01:26:24.240Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7e12ceb-9809-48f8-a281-b42e631819f1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:26:24.241Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7e12ceb-9809-48f8-a281-b42e631819f1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:26:25.753Z [pool-14-thread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T01:26:25.754Z [pool-14-thread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=200 TargetEntity=getTopics Connection problem towards U-EB server. Reason: 500
2021-06-04T01:26:25.754Z [pool-14-thread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine Error occured during access to U-EB Server. Operation: try retrieve list of topics from U-EB server
2021-06-04T01:26:27.488Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d34be2b7-4a79-4dd0-82e5-101835fc3765 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:26:27.488Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d34be2b7-4a79-4dd0-82e5-101835fc3765 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@644a25d8
2021-06-04T01:26:27.488Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d34be2b7-4a79-4dd0-82e5-101835fc3765 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:26:27.488Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d34be2b7-4a79-4dd0-82e5-101835fc3765 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:26:30.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61611ae3-5483-4fd3-bdd1-17b8f9ba5734 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:26:30.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61611ae3-5483-4fd3-bdd1-17b8f9ba5734 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4854dcdb
2021-06-04T01:26:30.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61611ae3-5483-4fd3-bdd1-17b8f9ba5734 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:26:30.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61611ae3-5483-4fd3-bdd1-17b8f9ba5734 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:26:33.244Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ad22f01-a78a-47f1-b359-9f7572ec10f7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:26:33.244Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ad22f01-a78a-47f1-b359-9f7572ec10f7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29e8cf56
2021-06-04T01:26:33.244Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ad22f01-a78a-47f1-b359-9f7572ec10f7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:26:33.244Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ad22f01-a78a-47f1-b359-9f7572ec10f7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:26:35.760Z [pool-14-thread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine GET http://message-router.onap:3904/topics (anonymous) ...
2021-06-04T01:26:36.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fd35e41-0c94-4eba-8cf5-def58b7c8f58 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:26:36.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fd35e41-0c94-4eba-8cf5-def58b7c8f58 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35f62dfa
2021-06-04T01:26:36.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fd35e41-0c94-4eba-8cf5-def58b7c8f58 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:26:36.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fd35e41-0c94-4eba-8cf5-def58b7c8f58 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:26:39.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61ab2dfa-e179-41b0-887a-a1d4cb6c45ed PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:26:39.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61ab2dfa-e179-41b0-887a-a1d4cb6c45ed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27aa79
2021-06-04T01:26:39.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61ab2dfa-e179-41b0-887a-a1d4cb6c45ed PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:26:39.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61ab2dfa-e179-41b0-887a-a1d4cb6c45ed PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:26:42.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf8048d8-8ddb-4978-b540-70fb951b8b01 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:26:42.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf8048d8-8ddb-4978-b540-70fb951b8b01 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6efb0ca2
2021-06-04T01:26:42.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf8048d8-8ddb-4978-b540-70fb951b8b01 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:26:42.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf8048d8-8ddb-4978-b540-70fb951b8b01 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:26:45.475Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d46d401-5785-4de4-92d5-4a5e17953c16 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:26:45.476Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d46d401-5785-4de4-92d5-4a5e17953c16 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@186fc54
2021-06-04T01:26:45.476Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d46d401-5785-4de4-92d5-4a5e17953c16 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:26:45.476Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d46d401-5785-4de4-92d5-4a5e17953c16 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:26:45.482Z [BE-Health-Check-Task] INFO o.a.http.impl.execchain.RetryExec RequestID=0d46d401-5785-4de4-92d5-4a5e17953c16 PartnerName=SDC.BE I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {s}->https://sdc-onboarding-be.onap:8445: The target server failed to respond
2021-06-04T01:26:45.483Z [BE-Health-Check-Task] INFO o.a.http.impl.execchain.RetryExec RequestID=0d46d401-5785-4de4-92d5-4a5e17953c16 PartnerName=SDC.BE Retrying request to {s}->https://sdc-onboarding-be.onap:8445
2021-06-04T01:26:45.487Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0d46d401-5785-4de4-92d5-4a5e17953c16 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T01:26:45.489Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0d46d401-5785-4de4-92d5-4a5e17953c16 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:26:48.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a4e681e-9d6d-48f8-86ce-b067eff5b8b0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:26:48.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a4e681e-9d6d-48f8-86ce-b067eff5b8b0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50c47b4
2021-06-04T01:26:48.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a4e681e-9d6d-48f8-86ce-b067eff5b8b0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:26:48.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a4e681e-9d6d-48f8-86ce-b067eff5b8b0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:26:48.385Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0a4e681e-9d6d-48f8-86ce-b067eff5b8b0 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T01:26:48.386Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0a4e681e-9d6d-48f8-86ce-b067eff5b8b0 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:26:51.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b34d9bb-4ab6-483c-9e72-f9f8580c7f17 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:26:51.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b34d9bb-4ab6-483c-9e72-f9f8580c7f17 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a7aa7ff
2021-06-04T01:26:51.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b34d9bb-4ab6-483c-9e72-f9f8580c7f17 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:26:51.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b34d9bb-4ab6-483c-9e72-f9f8580c7f17 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:26:51.045Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2b34d9bb-4ab6-483c-9e72-f9f8580c7f17 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T01:26:51.045Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2b34d9bb-4ab6-483c-9e72-f9f8580c7f17 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:26:54.322Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27ad7b8b-7f3d-41cd-846f-e6502c2ea9e3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:26:54.322Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27ad7b8b-7f3d-41cd-846f-e6502c2ea9e3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@471680ba
2021-06-04T01:26:54.322Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27ad7b8b-7f3d-41cd-846f-e6502c2ea9e3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:26:54.322Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27ad7b8b-7f3d-41cd-846f-e6502c2ea9e3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:26:57.338Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=27ad7b8b-7f3d-41cd-846f-e6502c2ea9e3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:26:57.339Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=27ad7b8b-7f3d-41cd-846f-e6502c2ea9e3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:26:58.079Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70a9fa19-8bdf-4c12-9683-9e510aa40255 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:26:58.079Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70a9fa19-8bdf-4c12-9683-9e510aa40255 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@422102fd
2021-06-04T01:26:58.079Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70a9fa19-8bdf-4c12-9683-9e510aa40255 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:26:58.079Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70a9fa19-8bdf-4c12-9683-9e510aa40255 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:27:01.090Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=70a9fa19-8bdf-4c12-9683-9e510aa40255 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:27:01.092Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=70a9fa19-8bdf-4c12-9683-9e510aa40255 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:27:01.237Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=826a1a25-5d44-45eb-a781-f343a074c57f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:27:01.237Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=826a1a25-5d44-45eb-a781-f343a074c57f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c942d44
2021-06-04T01:27:01.237Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=826a1a25-5d44-45eb-a781-f343a074c57f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:27:01.237Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=826a1a25-5d44-45eb-a781-f343a074c57f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:27:03.556Z [ComponentsCleanThread-1] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null lock resource with name DELETE_LOCKER
2021-06-04T01:27:04.257Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=826a1a25-5d44-45eb-a781-f343a074c57f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:27:04.257Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=826a1a25-5d44-45eb-a781-f343a074c57f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:27:05.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d34c4b4-6297-4d05-a5e1-6c9ecd168965 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:27:05.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d34c4b4-6297-4d05-a5e1-6c9ecd168965 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@12d3788d
2021-06-04T01:27:05.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d34c4b4-6297-4d05-a5e1-6c9ecd168965 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:27:05.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d34c4b4-6297-4d05-a5e1-6c9ecd168965 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:27:05.818Z [ComponentsCleanThread-1] INFO o.o.s.b.c.s.ComponentsCleanBusinessLogic RequestID=null Lock cleanup operation is done with result = OK
2021-06-04T01:27:08.035Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=7d34c4b4-6297-4d05-a5e1-6c9ecd168965 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:27:08.036Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=7d34c4b4-6297-4d05-a5e1-6c9ecd168965 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:27:08.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c3cffaa-4fd6-4eff-a1ad-023649b35fcc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:27:08.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c3cffaa-4fd6-4eff-a1ad-023649b35fcc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@75f8b244
2021-06-04T01:27:08.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c3cffaa-4fd6-4eff-a1ad-023649b35fcc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:27:08.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c3cffaa-4fd6-4eff-a1ad-023649b35fcc PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:27:11.890Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=7c3cffaa-4fd6-4eff-a1ad-023649b35fcc ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:27:11.891Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=7c3cffaa-4fd6-4eff-a1ad-023649b35fcc ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:27:12.040Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67afdd67-7c13-40e9-a3d4-b2950862f05a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:27:12.040Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67afdd67-7c13-40e9-a3d4-b2950862f05a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5990b5bf
2021-06-04T01:27:12.040Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67afdd67-7c13-40e9-a3d4-b2950862f05a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:27:12.040Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67afdd67-7c13-40e9-a3d4-b2950862f05a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:27:15.053Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=67afdd67-7c13-40e9-a3d4-b2950862f05a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:27:15.054Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=67afdd67-7c13-40e9-a3d4-b2950862f05a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:27:15.078Z [ComponentsCleanThread-1] INFO o.o.s.b.c.s.ComponentsCleanBusinessLogic RequestID=null ServerIPAddress=10.242.246.203 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd Unlock cleanup operation is done with result = OK
2021-06-04T01:27:15.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44b9266b-c15b-49d4-b8a9-4cec83f4d570 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:27:15.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44b9266b-c15b-49d4-b8a9-4cec83f4d570 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2bf3fcfc
2021-06-04T01:27:15.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44b9266b-c15b-49d4-b8a9-4cec83f4d570 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:27:15.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44b9266b-c15b-49d4-b8a9-4cec83f4d570 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:27:18.639Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=44b9266b-c15b-49d4-b8a9-4cec83f4d570 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:27:18.641Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=44b9266b-c15b-49d4-b8a9-4cec83f4d570 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:27:19.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1263a69-5e4f-481d-9ce8-210c9e5eb450 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:27:19.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1263a69-5e4f-481d-9ce8-210c9e5eb450 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5278e7b0
2021-06-04T01:27:19.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1263a69-5e4f-481d-9ce8-210c9e5eb450 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:27:19.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1263a69-5e4f-481d-9ce8-210c9e5eb450 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:27:22.349Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a1263a69-5e4f-481d-9ce8-210c9e5eb450 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:27:22.349Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a1263a69-5e4f-481d-9ce8-210c9e5eb450 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:27:22.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4dfc14aa-ec13-4eec-8a26-c6fc610e9e41 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:27:22.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4dfc14aa-ec13-4eec-8a26-c6fc610e9e41 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35980918
2021-06-04T01:27:22.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4dfc14aa-ec13-4eec-8a26-c6fc610e9e41 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:27:22.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4dfc14aa-ec13-4eec-8a26-c6fc610e9e41 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:27:26.574Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=4dfc14aa-ec13-4eec-8a26-c6fc610e9e41 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:27:26.576Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=4dfc14aa-ec13-4eec-8a26-c6fc610e9e41 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:27:27.273Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f1ffeb0-ed50-4da1-a7f7-ff0838b1773c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:27:27.273Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f1ffeb0-ed50-4da1-a7f7-ff0838b1773c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6227001d
2021-06-04T01:27:27.273Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f1ffeb0-ed50-4da1-a7f7-ff0838b1773c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:27:27.273Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f1ffeb0-ed50-4da1-a7f7-ff0838b1773c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:27:30.332Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0f1ffeb0-ed50-4da1-a7f7-ff0838b1773c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:27:30.333Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0f1ffeb0-ed50-4da1-a7f7-ff0838b1773c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:27:30.858Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be0fc554-b5da-46e5-910e-dbf3721f3cc4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:27:30.858Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be0fc554-b5da-46e5-910e-dbf3721f3cc4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5675ced4
2021-06-04T01:27:30.859Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be0fc554-b5da-46e5-910e-dbf3721f3cc4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:27:30.859Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be0fc554-b5da-46e5-910e-dbf3721f3cc4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:27:33.921Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=be0fc554-b5da-46e5-910e-dbf3721f3cc4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:27:33.922Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=be0fc554-b5da-46e5-910e-dbf3721f3cc4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:27:34.333Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21404077-0a71-428e-93f8-4e94a2937b91 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:27:34.333Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21404077-0a71-428e-93f8-4e94a2937b91 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42d002d2
2021-06-04T01:27:34.333Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21404077-0a71-428e-93f8-4e94a2937b91 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:27:34.333Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21404077-0a71-428e-93f8-4e94a2937b91 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:27:37.379Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=21404077-0a71-428e-93f8-4e94a2937b91 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:27:37.379Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=21404077-0a71-428e-93f8-4e94a2937b91 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:27:38.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac8bb1a8-8672-4e3a-a2ec-acb3642100a1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:27:38.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac8bb1a8-8672-4e3a-a2ec-acb3642100a1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f459b91
2021-06-04T01:27:38.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac8bb1a8-8672-4e3a-a2ec-acb3642100a1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:27:38.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac8bb1a8-8672-4e3a-a2ec-acb3642100a1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:27:41.121Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ac8bb1a8-8672-4e3a-a2ec-acb3642100a1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:27:41.121Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ac8bb1a8-8672-4e3a-a2ec-acb3642100a1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:27:41.252Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee69a8c6-90e1-447c-8f07-253e40ec5139 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:27:41.252Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee69a8c6-90e1-447c-8f07-253e40ec5139 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2beb4368
2021-06-04T01:27:41.253Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee69a8c6-90e1-447c-8f07-253e40ec5139 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:27:41.253Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee69a8c6-90e1-447c-8f07-253e40ec5139 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:27:44.309Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ee69a8c6-90e1-447c-8f07-253e40ec5139 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:27:44.309Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ee69a8c6-90e1-447c-8f07-253e40ec5139 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:27:44.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61bb6444-f344-4a67-98b1-0e08f423241d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:27:44.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61bb6444-f344-4a67-98b1-0e08f423241d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@839a9b3
2021-06-04T01:27:44.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61bb6444-f344-4a67-98b1-0e08f423241d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:27:44.820Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61bb6444-f344-4a67-98b1-0e08f423241d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:27:47.878Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=61bb6444-f344-4a67-98b1-0e08f423241d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:27:47.879Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=61bb6444-f344-4a67-98b1-0e08f423241d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:27:48.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b2e6e21-31d4-4e92-a2c1-1d752c521ce2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:27:48.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b2e6e21-31d4-4e92-a2c1-1d752c521ce2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6816d55a
2021-06-04T01:27:48.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b2e6e21-31d4-4e92-a2c1-1d752c521ce2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:27:48.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b2e6e21-31d4-4e92-a2c1-1d752c521ce2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:27:51.632Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8b2e6e21-31d4-4e92-a2c1-1d752c521ce2 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:27:51.632Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8b2e6e21-31d4-4e92-a2c1-1d752c521ce2 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:27:51.743Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2e4ecff-9a4f-4e4d-b9ca-1e90c8fb6c38 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:27:51.743Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2e4ecff-9a4f-4e4d-b9ca-1e90c8fb6c38 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@fb409e5
2021-06-04T01:27:51.743Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2e4ecff-9a4f-4e4d-b9ca-1e90c8fb6c38 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:27:51.743Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2e4ecff-9a4f-4e4d-b9ca-1e90c8fb6c38 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:27:54.785Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f2e4ecff-9a4f-4e4d-b9ca-1e90c8fb6c38 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:27:54.786Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f2e4ecff-9a4f-4e4d-b9ca-1e90c8fb6c38 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:27:55.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=517ba89c-58aa-4d24-aeca-e6d69c36623a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:27:55.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=517ba89c-58aa-4d24-aeca-e6d69c36623a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71c92607
2021-06-04T01:27:55.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=517ba89c-58aa-4d24-aeca-e6d69c36623a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:27:55.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=517ba89c-58aa-4d24-aeca-e6d69c36623a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:27:58.416Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=517ba89c-58aa-4d24-aeca-e6d69c36623a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:27:58.416Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=517ba89c-58aa-4d24-aeca-e6d69c36623a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:27:58.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18711a3d-88fc-4474-b2a8-2692a7c30af9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:27:58.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18711a3d-88fc-4474-b2a8-2692a7c30af9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e51a190
2021-06-04T01:27:58.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18711a3d-88fc-4474-b2a8-2692a7c30af9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:27:58.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18711a3d-88fc-4474-b2a8-2692a7c30af9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:28:00.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6f956e2-a16b-478e-a7fa-9612cc59b54d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:28:00.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6f956e2-a16b-478e-a7fa-9612cc59b54d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@751dc437
2021-06-04T01:28:00.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6f956e2-a16b-478e-a7fa-9612cc59b54d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:28:00.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6f956e2-a16b-478e-a7fa-9612cc59b54d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:28:01.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbbce6a7-4fe8-4ebd-9fae-cd526e82766d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:28:01.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbbce6a7-4fe8-4ebd-9fae-cd526e82766d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f69dda9
2021-06-04T01:28:01.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbbce6a7-4fe8-4ebd-9fae-cd526e82766d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:28:01.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbbce6a7-4fe8-4ebd-9fae-cd526e82766d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:28:01.272Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0158c0de-aa4f-4aa3-b826-fff7db481a1e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:28:01.272Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0158c0de-aa4f-4aa3-b826-fff7db481a1e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7c87a8f5
2021-06-04T01:28:01.272Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0158c0de-aa4f-4aa3-b826-fff7db481a1e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:28:01.272Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0158c0de-aa4f-4aa3-b826-fff7db481a1e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:28:01.432Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dea9d20a-c24a-4e90-90b9-d051f234c149 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:28:01.432Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dea9d20a-c24a-4e90-90b9-d051f234c149 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50a3bd72
2021-06-04T01:28:01.432Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dea9d20a-c24a-4e90-90b9-d051f234c149 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:28:01.432Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dea9d20a-c24a-4e90-90b9-d051f234c149 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:28:03.427Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22f45f7f-e0e2-43dd-9ca3-c7c54832240b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:28:03.427Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22f45f7f-e0e2-43dd-9ca3-c7c54832240b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b04f72d
2021-06-04T01:28:03.428Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22f45f7f-e0e2-43dd-9ca3-c7c54832240b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:28:03.428Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22f45f7f-e0e2-43dd-9ca3-c7c54832240b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:28:06.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ad5973e-8604-44c2-81d9-2a7a364398ac PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:28:06.487Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ad5973e-8604-44c2-81d9-2a7a364398ac PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a81ff71
2021-06-04T01:28:06.487Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ad5973e-8604-44c2-81d9-2a7a364398ac PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:28:06.487Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ad5973e-8604-44c2-81d9-2a7a364398ac PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:28:09.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ed5e872-372b-44f7-b981-4eb90838ffd7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:28:09.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ed5e872-372b-44f7-b981-4eb90838ffd7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b8026d4
2021-06-04T01:28:09.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ed5e872-372b-44f7-b981-4eb90838ffd7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:28:09.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ed5e872-372b-44f7-b981-4eb90838ffd7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:28:11.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=284691b2-036d-4a5b-a574-4847f055ebf2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:28:11.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=284691b2-036d-4a5b-a574-4847f055ebf2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@468542fb
2021-06-04T01:28:11.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=284691b2-036d-4a5b-a574-4847f055ebf2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:28:11.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=284691b2-036d-4a5b-a574-4847f055ebf2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:28:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c8a56920-6d9f-49b9-a645-548f83818b39 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:28:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c8a56920-6d9f-49b9-a645-548f83818b39 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ad46899
2021-06-04T01:28:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c8a56920-6d9f-49b9-a645-548f83818b39 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:28:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c8a56920-6d9f-49b9-a645-548f83818b39 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:28:18.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c83c6b31-450e-44a4-9527-39ef47f6148c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:28:18.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c83c6b31-450e-44a4-9527-39ef47f6148c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f6b70c5
2021-06-04T01:28:18.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c83c6b31-450e-44a4-9527-39ef47f6148c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:28:18.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c83c6b31-450e-44a4-9527-39ef47f6148c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:28:21.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9d91cc4-f29e-43f2-8bb8-09a78134c2e2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:28:21.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9d91cc4-f29e-43f2-8bb8-09a78134c2e2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65d74d7a
2021-06-04T01:28:21.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9d91cc4-f29e-43f2-8bb8-09a78134c2e2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:28:21.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9d91cc4-f29e-43f2-8bb8-09a78134c2e2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:28:24.327Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=569d9361-3786-4257-a139-f12e0808aa67 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:28:24.327Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=569d9361-3786-4257-a139-f12e0808aa67 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@92949a1
2021-06-04T01:28:24.327Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=569d9361-3786-4257-a139-f12e0808aa67 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:28:24.328Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=569d9361-3786-4257-a139-f12e0808aa67 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:28:27.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=599884fa-fd67-40b6-8ba0-006dabe3297e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:28:27.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=599884fa-fd67-40b6-8ba0-006dabe3297e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b078bd
2021-06-04T01:28:27.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=599884fa-fd67-40b6-8ba0-006dabe3297e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:28:27.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=599884fa-fd67-40b6-8ba0-006dabe3297e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:28:30.396Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b429b47-83c1-4db6-b7a6-4502e82ce827 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:28:30.396Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b429b47-83c1-4db6-b7a6-4502e82ce827 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3469cd36
2021-06-04T01:28:30.396Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b429b47-83c1-4db6-b7a6-4502e82ce827 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:28:30.396Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b429b47-83c1-4db6-b7a6-4502e82ce827 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:28:33.335Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f1c5630-b948-414e-9462-49c06b7b3adf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:28:33.336Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f1c5630-b948-414e-9462-49c06b7b3adf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b0aea5c
2021-06-04T01:28:33.336Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f1c5630-b948-414e-9462-49c06b7b3adf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:28:33.336Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f1c5630-b948-414e-9462-49c06b7b3adf PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:28:36.477Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d7db342-5baa-4796-84e6-93a34acc4385 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:28:36.477Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d7db342-5baa-4796-84e6-93a34acc4385 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@282dd2dd
2021-06-04T01:28:36.477Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d7db342-5baa-4796-84e6-93a34acc4385 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:28:36.477Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d7db342-5baa-4796-84e6-93a34acc4385 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:28:39.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=992dc78e-fd4e-4db7-9763-d8d4d304175a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:28:39.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=992dc78e-fd4e-4db7-9763-d8d4d304175a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2bdb22f5
2021-06-04T01:28:39.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=992dc78e-fd4e-4db7-9763-d8d4d304175a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:28:39.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=992dc78e-fd4e-4db7-9763-d8d4d304175a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:28:42.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a99995e-7e91-406e-9378-10396978ac68 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:28:42.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a99995e-7e91-406e-9378-10396978ac68 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@51a15ac5
2021-06-04T01:28:42.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a99995e-7e91-406e-9378-10396978ac68 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:28:42.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a99995e-7e91-406e-9378-10396978ac68 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:28:45.016Z [pool-14-thread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T01:28:45.017Z [pool-14-thread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=200 TargetEntity=getTopics Connection problem towards U-EB server. Reason: 500
2021-06-04T01:28:45.017Z [pool-14-thread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine Error occured during access to U-EB Server. Operation: try retrieve list of topics from U-EB server
2021-06-04T01:28:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32899170-f6cf-4e97-b67a-90fe05ff81c2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:28:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32899170-f6cf-4e97-b67a-90fe05ff81c2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d4502a7
2021-06-04T01:28:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32899170-f6cf-4e97-b67a-90fe05ff81c2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:28:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32899170-f6cf-4e97-b67a-90fe05ff81c2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:28:48.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1affdd8-f4a5-42e8-9f4a-fdcb29d0ae58 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:28:48.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1affdd8-f4a5-42e8-9f4a-fdcb29d0ae58 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b389ee8
2021-06-04T01:28:48.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1affdd8-f4a5-42e8-9f4a-fdcb29d0ae58 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:28:48.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1affdd8-f4a5-42e8-9f4a-fdcb29d0ae58 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:28:51.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b142ce1c-5f8f-4ec5-9957-3868fbc86d93 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:28:51.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b142ce1c-5f8f-4ec5-9957-3868fbc86d93 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5906ddf0
2021-06-04T01:28:51.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b142ce1c-5f8f-4ec5-9957-3868fbc86d93 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:28:51.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b142ce1c-5f8f-4ec5-9957-3868fbc86d93 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:28:54.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec64d518-21e8-44f5-9963-a75efd1c6a0a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:28:54.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec64d518-21e8-44f5-9963-a75efd1c6a0a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22ac367
2021-06-04T01:28:54.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec64d518-21e8-44f5-9963-a75efd1c6a0a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:28:54.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec64d518-21e8-44f5-9963-a75efd1c6a0a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:28:57.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9074ac9b-8f9d-4aeb-8b1a-d349cfe047cc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:28:57.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9074ac9b-8f9d-4aeb-8b1a-d349cfe047cc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47bfb9bf
2021-06-04T01:28:57.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9074ac9b-8f9d-4aeb-8b1a-d349cfe047cc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:28:57.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9074ac9b-8f9d-4aeb-8b1a-d349cfe047cc PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:29:00.277Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ffb5ae48-2e9a-4453-bfaf-b56d0d5964ae PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:29:00.277Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ffb5ae48-2e9a-4453-bfaf-b56d0d5964ae PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@289fa07e
2021-06-04T01:29:00.277Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ffb5ae48-2e9a-4453-bfaf-b56d0d5964ae PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:29:00.277Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ffb5ae48-2e9a-4453-bfaf-b56d0d5964ae PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:29:03.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d38ad64-4ca4-43ad-99b6-6ad851bde2a6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:29:03.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d38ad64-4ca4-43ad-99b6-6ad851bde2a6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@479901c0
2021-06-04T01:29:03.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d38ad64-4ca4-43ad-99b6-6ad851bde2a6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:29:03.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d38ad64-4ca4-43ad-99b6-6ad851bde2a6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:29:05.023Z [pool-14-thread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine GET http://message-router.onap:3904/topics (anonymous) ...
2021-06-04T01:29:06.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d044ca1-1dc0-4c2e-97fe-51ad87fd44e4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:29:06.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d044ca1-1dc0-4c2e-97fe-51ad87fd44e4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@137cc3af
2021-06-04T01:29:06.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d044ca1-1dc0-4c2e-97fe-51ad87fd44e4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:29:06.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d044ca1-1dc0-4c2e-97fe-51ad87fd44e4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:29:09.438Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bccfe3be-df46-48d1-9854-99d505175fc4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:29:09.438Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bccfe3be-df46-48d1-9854-99d505175fc4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29b4e23e
2021-06-04T01:29:09.438Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bccfe3be-df46-48d1-9854-99d505175fc4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:29:09.438Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bccfe3be-df46-48d1-9854-99d505175fc4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:29:11.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57099883-367b-487c-9379-0cdca79de1e0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:29:11.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57099883-367b-487c-9379-0cdca79de1e0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7c7d2b26
2021-06-04T01:29:11.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57099883-367b-487c-9379-0cdca79de1e0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:29:11.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57099883-367b-487c-9379-0cdca79de1e0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:29:15.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4adcd0e7-dc7d-4ed3-9f9a-f819bb07bbe4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:29:15.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4adcd0e7-dc7d-4ed3-9f9a-f819bb07bbe4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7365b268
2021-06-04T01:29:15.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4adcd0e7-dc7d-4ed3-9f9a-f819bb07bbe4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:29:15.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4adcd0e7-dc7d-4ed3-9f9a-f819bb07bbe4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:29:18.490Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2eec3a7f-c5bd-43e0-a5c5-a3ee41da3ce7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:29:18.491Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2eec3a7f-c5bd-43e0-a5c5-a3ee41da3ce7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6717610
2021-06-04T01:29:18.491Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2eec3a7f-c5bd-43e0-a5c5-a3ee41da3ce7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:29:18.491Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2eec3a7f-c5bd-43e0-a5c5-a3ee41da3ce7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:29:20.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b999478f-a424-4928-b280-80fc9b1c7da7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:29:20.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b999478f-a424-4928-b280-80fc9b1c7da7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@85ad1f2
2021-06-04T01:29:20.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b999478f-a424-4928-b280-80fc9b1c7da7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:29:20.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b999478f-a424-4928-b280-80fc9b1c7da7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:29:24.236Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57636a4e-8987-4d9a-8c8d-d18144d8e79a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:29:24.236Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57636a4e-8987-4d9a-8c8d-d18144d8e79a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1debefc4
2021-06-04T01:29:24.236Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57636a4e-8987-4d9a-8c8d-d18144d8e79a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:29:24.236Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57636a4e-8987-4d9a-8c8d-d18144d8e79a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:29:27.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0bd189d7-2dab-42e1-9142-29cc04d3a9bc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:29:27.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0bd189d7-2dab-42e1-9142-29cc04d3a9bc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43c3f8e3
2021-06-04T01:29:27.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0bd189d7-2dab-42e1-9142-29cc04d3a9bc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:29:27.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0bd189d7-2dab-42e1-9142-29cc04d3a9bc PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:29:30.420Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92f5b7c9-05c2-4fae-8af4-845b50bf8be5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:29:30.420Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92f5b7c9-05c2-4fae-8af4-845b50bf8be5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e0fc77d
2021-06-04T01:29:30.420Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92f5b7c9-05c2-4fae-8af4-845b50bf8be5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:29:30.420Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92f5b7c9-05c2-4fae-8af4-845b50bf8be5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:29:30.864Z [cluster2-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T01:29:30.865Z [cluster2-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 30000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:29:33.327Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ebcdea1-6d11-462b-910b-83a7edca1d90 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:29:33.327Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ebcdea1-6d11-462b-910b-83a7edca1d90 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@10045a0f
2021-06-04T01:29:33.327Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ebcdea1-6d11-462b-910b-83a7edca1d90 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:29:33.327Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ebcdea1-6d11-462b-910b-83a7edca1d90 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:29:36.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=856b5ac3-3abb-4c18-ad52-080586090420 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:29:36.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=856b5ac3-3abb-4c18-ad52-080586090420 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@52531204
2021-06-04T01:29:36.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=856b5ac3-3abb-4c18-ad52-080586090420 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:29:36.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=856b5ac3-3abb-4c18-ad52-080586090420 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:29:39.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b23dc508-befc-43f4-9e07-ae3b9f0999c9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:29:39.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b23dc508-befc-43f4-9e07-ae3b9f0999c9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e0bfc4d
2021-06-04T01:29:39.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b23dc508-befc-43f4-9e07-ae3b9f0999c9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:29:39.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b23dc508-befc-43f4-9e07-ae3b9f0999c9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:29:42.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a851500b-d3d4-4f29-b7a0-039bad8495fd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:29:42.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a851500b-d3d4-4f29-b7a0-039bad8495fd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e0fe6de
2021-06-04T01:29:42.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a851500b-d3d4-4f29-b7a0-039bad8495fd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:29:42.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a851500b-d3d4-4f29-b7a0-039bad8495fd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:29:45.379Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91543826-8566-494c-bf56-cdc7a3875033 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:29:45.379Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91543826-8566-494c-bf56-cdc7a3875033 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@c691732
2021-06-04T01:29:45.379Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91543826-8566-494c-bf56-cdc7a3875033 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:29:45.379Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91543826-8566-494c-bf56-cdc7a3875033 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:29:48.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6016f00d-db37-49b2-9232-610ec7be7694 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:29:48.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6016f00d-db37-49b2-9232-610ec7be7694 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4660f789
2021-06-04T01:29:48.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6016f00d-db37-49b2-9232-610ec7be7694 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:29:48.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6016f00d-db37-49b2-9232-610ec7be7694 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:29:51.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42168529-db47-4dd3-8456-5187b33e2bc2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:29:51.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42168529-db47-4dd3-8456-5187b33e2bc2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17d8829c
2021-06-04T01:29:51.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42168529-db47-4dd3-8456-5187b33e2bc2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:29:51.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42168529-db47-4dd3-8456-5187b33e2bc2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:29:54.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef2abaaa-9674-443c-920a-8e4ff07d3014 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:29:54.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef2abaaa-9674-443c-920a-8e4ff07d3014 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@56a0afaf
2021-06-04T01:29:54.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef2abaaa-9674-443c-920a-8e4ff07d3014 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:29:54.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef2abaaa-9674-443c-920a-8e4ff07d3014 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:29:57.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=380ce9b3-319f-4c04-83f4-a3a997623a17 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:29:57.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=380ce9b3-319f-4c04-83f4-a3a997623a17 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@12b4f2ce
2021-06-04T01:29:57.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=380ce9b3-319f-4c04-83f4-a3a997623a17 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:29:57.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=380ce9b3-319f-4c04-83f4-a3a997623a17 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:30:00.272Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b1baa0f-e7d1-4234-af7c-7ed70967da70 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:30:00.272Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b1baa0f-e7d1-4234-af7c-7ed70967da70 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53b83d4b
2021-06-04T01:30:00.272Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b1baa0f-e7d1-4234-af7c-7ed70967da70 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:30:00.273Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b1baa0f-e7d1-4234-af7c-7ed70967da70 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:30:03.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fedee547-a97c-469a-906c-d473dacc4e78 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:30:03.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fedee547-a97c-469a-906c-d473dacc4e78 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@66af9770
2021-06-04T01:30:03.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fedee547-a97c-469a-906c-d473dacc4e78 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:30:03.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fedee547-a97c-469a-906c-d473dacc4e78 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:30:06.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb06af84-e7f0-4220-8ff1-426d84a68d54 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:30:06.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb06af84-e7f0-4220-8ff1-426d84a68d54 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79045cf8
2021-06-04T01:30:06.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb06af84-e7f0-4220-8ff1-426d84a68d54 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:30:06.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb06af84-e7f0-4220-8ff1-426d84a68d54 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:30:09.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=541e3ef9-3cda-470d-8ead-340d6c73fad5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:30:09.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=541e3ef9-3cda-470d-8ead-340d6c73fad5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@483a5372
2021-06-04T01:30:09.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=541e3ef9-3cda-470d-8ead-340d6c73fad5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:30:09.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=541e3ef9-3cda-470d-8ead-340d6c73fad5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:30:12.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b30ec886-ae67-4e15-83ad-7978a58bdde1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:30:12.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b30ec886-ae67-4e15-83ad-7978a58bdde1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5afa6d5b
2021-06-04T01:30:12.001Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b30ec886-ae67-4e15-83ad-7978a58bdde1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:30:12.001Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b30ec886-ae67-4e15-83ad-7978a58bdde1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:30:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=496fa814-9ebb-4e07-9ece-a187163f4033 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:30:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=496fa814-9ebb-4e07-9ece-a187163f4033 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@40f47563
2021-06-04T01:30:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=496fa814-9ebb-4e07-9ece-a187163f4033 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:30:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=496fa814-9ebb-4e07-9ece-a187163f4033 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:30:18.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce9dba55-70f6-4d41-b042-2ed0ca07e3d8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:30:18.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce9dba55-70f6-4d41-b042-2ed0ca07e3d8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1bcc1219
2021-06-04T01:30:18.772Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce9dba55-70f6-4d41-b042-2ed0ca07e3d8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:30:18.773Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce9dba55-70f6-4d41-b042-2ed0ca07e3d8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:30:21.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e3a30cb-c09b-4eb9-8548-007c835848ca PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:30:21.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e3a30cb-c09b-4eb9-8548-007c835848ca PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f773d1
2021-06-04T01:30:21.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e3a30cb-c09b-4eb9-8548-007c835848ca PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:30:21.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e3a30cb-c09b-4eb9-8548-007c835848ca PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:30:24.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce4a53c9-0f69-452a-b936-289f6017e1d5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:30:24.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce4a53c9-0f69-452a-b936-289f6017e1d5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@86e4601
2021-06-04T01:30:24.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce4a53c9-0f69-452a-b936-289f6017e1d5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:30:24.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce4a53c9-0f69-452a-b936-289f6017e1d5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:30:27.477Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a86d319-571b-44f6-96ac-7050088d8fa5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:30:27.477Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a86d319-571b-44f6-96ac-7050088d8fa5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b526502
2021-06-04T01:30:27.477Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a86d319-571b-44f6-96ac-7050088d8fa5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:30:27.477Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a86d319-571b-44f6-96ac-7050088d8fa5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:30:30.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc223c4c-fb1e-48aa-839c-db8fc1e2f29f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:30:30.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc223c4c-fb1e-48aa-839c-db8fc1e2f29f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1075feab
2021-06-04T01:30:30.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc223c4c-fb1e-48aa-839c-db8fc1e2f29f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:30:30.281Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc223c4c-fb1e-48aa-839c-db8fc1e2f29f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:30:33.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d5f5e6e-6910-4cd8-bb9e-d7eba4f1d61f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:30:33.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d5f5e6e-6910-4cd8-bb9e-d7eba4f1d61f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a267e8f
2021-06-04T01:30:33.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d5f5e6e-6910-4cd8-bb9e-d7eba4f1d61f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:30:33.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d5f5e6e-6910-4cd8-bb9e-d7eba4f1d61f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:30:36.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3378b4c-64aa-4879-b7a6-9871f041de79 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:30:36.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3378b4c-64aa-4879-b7a6-9871f041de79 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50827b84
2021-06-04T01:30:36.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3378b4c-64aa-4879-b7a6-9871f041de79 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:30:36.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3378b4c-64aa-4879-b7a6-9871f041de79 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:30:39.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7ba11da-f1ac-4bcf-8c52-126485cee776 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:30:39.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7ba11da-f1ac-4bcf-8c52-126485cee776 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28807ee3
2021-06-04T01:30:39.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7ba11da-f1ac-4bcf-8c52-126485cee776 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:30:39.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7ba11da-f1ac-4bcf-8c52-126485cee776 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:30:42.005Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2984edc-f7ff-4020-a25c-527eb07c92ff PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:30:42.005Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2984edc-f7ff-4020-a25c-527eb07c92ff PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@173f5dfe
2021-06-04T01:30:42.005Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2984edc-f7ff-4020-a25c-527eb07c92ff PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:30:42.005Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2984edc-f7ff-4020-a25c-527eb07c92ff PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:30:45.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a70ee0d-4dd8-4638-8a6a-4cd26d8ee54d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:30:45.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a70ee0d-4dd8-4638-8a6a-4cd26d8ee54d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e748b90
2021-06-04T01:30:45.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a70ee0d-4dd8-4638-8a6a-4cd26d8ee54d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:30:45.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a70ee0d-4dd8-4638-8a6a-4cd26d8ee54d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:30:48.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=573bb6c0-775d-41b5-a61f-a14d37c25b69 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:30:48.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=573bb6c0-775d-41b5-a61f-a14d37c25b69 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4d699f81
2021-06-04T01:30:48.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=573bb6c0-775d-41b5-a61f-a14d37c25b69 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:30:48.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=573bb6c0-775d-41b5-a61f-a14d37c25b69 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:30:51.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6442b28-9e4c-4acc-8409-675281ced838 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:30:51.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6442b28-9e4c-4acc-8409-675281ced838 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@663597a9
2021-06-04T01:30:51.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6442b28-9e4c-4acc-8409-675281ced838 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:30:51.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6442b28-9e4c-4acc-8409-675281ced838 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:30:54.326Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc37c827-0ea0-4a49-911f-7f7bf17d3294 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:30:54.326Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc37c827-0ea0-4a49-911f-7f7bf17d3294 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b08f63c
2021-06-04T01:30:54.326Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc37c827-0ea0-4a49-911f-7f7bf17d3294 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:30:54.326Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc37c827-0ea0-4a49-911f-7f7bf17d3294 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:30:57.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45eea70b-95e6-45ea-98da-90de5ab89548 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:30:57.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45eea70b-95e6-45ea-98da-90de5ab89548 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@210ad4c6
2021-06-04T01:30:57.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45eea70b-95e6-45ea-98da-90de5ab89548 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:30:57.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45eea70b-95e6-45ea-98da-90de5ab89548 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:31:00.287Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2fee726-bef0-4f6f-9674-81c0d522813e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:31:00.287Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2fee726-bef0-4f6f-9674-81c0d522813e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@201ed2f1
2021-06-04T01:31:00.287Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2fee726-bef0-4f6f-9674-81c0d522813e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:31:00.287Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2fee726-bef0-4f6f-9674-81c0d522813e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:31:03.328Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=033b257c-0365-4023-9fe6-3c4ae06db6b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:31:03.328Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=033b257c-0365-4023-9fe6-3c4ae06db6b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6adc9184
2021-06-04T01:31:03.328Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=033b257c-0365-4023-9fe6-3c4ae06db6b9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:31:03.328Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=033b257c-0365-4023-9fe6-3c4ae06db6b9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:31:06.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e11a7029-3a95-4d62-9331-d39ae19c3514 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:31:06.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e11a7029-3a95-4d62-9331-d39ae19c3514 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@262923f5
2021-06-04T01:31:06.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e11a7029-3a95-4d62-9331-d39ae19c3514 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:31:06.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e11a7029-3a95-4d62-9331-d39ae19c3514 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:31:09.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=887e55f4-7e3e-4bcc-908d-fafe3a958c88 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:31:09.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=887e55f4-7e3e-4bcc-908d-fafe3a958c88 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@51f27f12
2021-06-04T01:31:09.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=887e55f4-7e3e-4bcc-908d-fafe3a958c88 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:31:09.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=887e55f4-7e3e-4bcc-908d-fafe3a958c88 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:31:12.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c7fcbb1-99c8-4851-a907-d16abca52cff PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:31:12.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c7fcbb1-99c8-4851-a907-d16abca52cff PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@72db687
2021-06-04T01:31:12.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c7fcbb1-99c8-4851-a907-d16abca52cff PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:31:12.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c7fcbb1-99c8-4851-a907-d16abca52cff PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:31:14.520Z [pool-14-thread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T01:31:14.522Z [pool-14-thread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=200 TargetEntity=getTopics Connection problem towards U-EB server. Reason: 500
2021-06-04T01:31:14.522Z [pool-14-thread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine Error occured during access to U-EB Server. Operation: try retrieve list of topics from U-EB server
2021-06-04T01:31:15.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56282746-f72d-4250-a479-1684b20579b1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:31:15.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56282746-f72d-4250-a479-1684b20579b1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9734757
2021-06-04T01:31:15.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56282746-f72d-4250-a479-1684b20579b1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:31:15.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56282746-f72d-4250-a479-1684b20579b1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:31:18.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42dc23b3-3892-4f34-8e6a-dbd936a4cb38 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:31:18.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42dc23b3-3892-4f34-8e6a-dbd936a4cb38 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@66aaeb07
2021-06-04T01:31:18.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42dc23b3-3892-4f34-8e6a-dbd936a4cb38 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:31:18.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42dc23b3-3892-4f34-8e6a-dbd936a4cb38 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:31:21.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e63ced3c-55ff-47c5-ba59-25a74e433de5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:31:21.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e63ced3c-55ff-47c5-ba59-25a74e433de5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@24e2022f
2021-06-04T01:31:21.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e63ced3c-55ff-47c5-ba59-25a74e433de5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:31:21.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e63ced3c-55ff-47c5-ba59-25a74e433de5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:31:24.234Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca6614d4-80a3-4b6b-89e8-a7fb88abb3e6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:31:24.234Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca6614d4-80a3-4b6b-89e8-a7fb88abb3e6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e9111ba
2021-06-04T01:31:24.234Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca6614d4-80a3-4b6b-89e8-a7fb88abb3e6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:31:24.234Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca6614d4-80a3-4b6b-89e8-a7fb88abb3e6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:31:27.148Z [cluster2-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T01:31:27.149Z [cluster2-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 30000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:31:27.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b239b57e-0e3f-4066-b924-1ee1f9f42fba PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:31:27.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b239b57e-0e3f-4066-b924-1ee1f9f42fba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5dcbbec0
2021-06-04T01:31:27.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b239b57e-0e3f-4066-b924-1ee1f9f42fba PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:31:27.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b239b57e-0e3f-4066-b924-1ee1f9f42fba PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:31:30.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=675546cd-7304-484c-93be-42dbc1bf8756 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:31:30.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=675546cd-7304-484c-93be-42dbc1bf8756 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c0884ad
2021-06-04T01:31:30.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=675546cd-7304-484c-93be-42dbc1bf8756 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:31:30.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=675546cd-7304-484c-93be-42dbc1bf8756 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:31:33.333Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c2ccb70-6696-4e72-ad49-6a8749f5e0c1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:31:33.333Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c2ccb70-6696-4e72-ad49-6a8749f5e0c1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58cf1079
2021-06-04T01:31:33.333Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c2ccb70-6696-4e72-ad49-6a8749f5e0c1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:31:33.333Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c2ccb70-6696-4e72-ad49-6a8749f5e0c1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:31:36.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c8534fda-5b5c-469e-bc5b-db1add893fed PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:31:36.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c8534fda-5b5c-469e-bc5b-db1add893fed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e95d61b
2021-06-04T01:31:36.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c8534fda-5b5c-469e-bc5b-db1add893fed PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:31:36.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c8534fda-5b5c-469e-bc5b-db1add893fed PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:31:39.652Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f63006d0-bdea-429b-9fee-8833a1291c05 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:31:39.653Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f63006d0-bdea-429b-9fee-8833a1291c05 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e2846b7
2021-06-04T01:31:39.653Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f63006d0-bdea-429b-9fee-8833a1291c05 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:31:39.653Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f63006d0-bdea-429b-9fee-8833a1291c05 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:31:41.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b77bf050-1259-4172-a976-0cf465e3e980 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:31:41.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b77bf050-1259-4172-a976-0cf465e3e980 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@36ad8433
2021-06-04T01:31:41.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b77bf050-1259-4172-a976-0cf465e3e980 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:31:41.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b77bf050-1259-4172-a976-0cf465e3e980 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:31:45.415Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c09ccfdd-fe74-4f50-b67a-7718cd6186b1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:31:45.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c09ccfdd-fe74-4f50-b67a-7718cd6186b1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@16410647
2021-06-04T01:31:45.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c09ccfdd-fe74-4f50-b67a-7718cd6186b1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:31:45.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c09ccfdd-fe74-4f50-b67a-7718cd6186b1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:31:48.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bddd9a5f-909f-4455-b286-b7801597520e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:31:48.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bddd9a5f-909f-4455-b286-b7801597520e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@26542f9a
2021-06-04T01:31:48.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bddd9a5f-909f-4455-b286-b7801597520e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:31:48.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bddd9a5f-909f-4455-b286-b7801597520e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:31:50.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=569b342f-1b38-41c0-b901-9ceffa592551 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:31:50.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=569b342f-1b38-41c0-b901-9ceffa592551 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a15c819
2021-06-04T01:31:50.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=569b342f-1b38-41c0-b901-9ceffa592551 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:31:50.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=569b342f-1b38-41c0-b901-9ceffa592551 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:31:54.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=efd75033-cc56-4740-ad6b-b3cdeaff9a19 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:31:54.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=efd75033-cc56-4740-ad6b-b3cdeaff9a19 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20435774
2021-06-04T01:31:54.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=efd75033-cc56-4740-ad6b-b3cdeaff9a19 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:31:54.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=efd75033-cc56-4740-ad6b-b3cdeaff9a19 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:31:54.525Z [pool-14-thread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine GET http://message-router.onap:3904/topics (anonymous) ...
2021-06-04T01:31:57.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f5e46f7-5ff3-4d36-9d39-7ae3889a8fa1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:31:57.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f5e46f7-5ff3-4d36-9d39-7ae3889a8fa1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e2e0e05
2021-06-04T01:31:57.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f5e46f7-5ff3-4d36-9d39-7ae3889a8fa1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:31:57.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f5e46f7-5ff3-4d36-9d39-7ae3889a8fa1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:32:00.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aac8674e-60d6-4fb1-b923-847cfd960b16 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:32:00.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aac8674e-60d6-4fb1-b923-847cfd960b16 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3981cea5
2021-06-04T01:32:00.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aac8674e-60d6-4fb1-b923-847cfd960b16 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:32:00.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aac8674e-60d6-4fb1-b923-847cfd960b16 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:32:03.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3de21e16-a2dd-4cb7-8ce7-f7c8724ce6fc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:32:03.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3de21e16-a2dd-4cb7-8ce7-f7c8724ce6fc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d009c8c
2021-06-04T01:32:03.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3de21e16-a2dd-4cb7-8ce7-f7c8724ce6fc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:32:03.240Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3de21e16-a2dd-4cb7-8ce7-f7c8724ce6fc PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:32:06.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4073e98d-d9b9-44a0-94b9-b5276f8c2cb8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:32:06.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4073e98d-d9b9-44a0-94b9-b5276f8c2cb8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57428eaf
2021-06-04T01:32:06.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4073e98d-d9b9-44a0-94b9-b5276f8c2cb8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:32:06.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4073e98d-d9b9-44a0-94b9-b5276f8c2cb8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:32:09.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75faf84e-8652-40d8-9b69-d908bea67c69 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:32:09.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75faf84e-8652-40d8-9b69-d908bea67c69 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@19d2fc64
2021-06-04T01:32:09.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75faf84e-8652-40d8-9b69-d908bea67c69 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:32:09.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75faf84e-8652-40d8-9b69-d908bea67c69 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:32:11.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=959b92fb-d467-4178-b7ad-1c3b31a64614 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:32:12.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=959b92fb-d467-4178-b7ad-1c3b31a64614 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e11fd1d
2021-06-04T01:32:12.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=959b92fb-d467-4178-b7ad-1c3b31a64614 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:32:12.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=959b92fb-d467-4178-b7ad-1c3b31a64614 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:32:15.520Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3eab11c-a961-41fd-98d6-fd5329399d88 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:32:15.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3eab11c-a961-41fd-98d6-fd5329399d88 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@471cf0af
2021-06-04T01:32:15.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3eab11c-a961-41fd-98d6-fd5329399d88 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:32:15.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3eab11c-a961-41fd-98d6-fd5329399d88 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:32:18.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d31ef8d-cd74-4d70-bfef-ba71a79f584c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:32:18.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d31ef8d-cd74-4d70-bfef-ba71a79f584c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4683915
2021-06-04T01:32:18.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d31ef8d-cd74-4d70-bfef-ba71a79f584c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:32:18.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d31ef8d-cd74-4d70-bfef-ba71a79f584c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:32:21.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44fc9635-6635-4059-b10a-fe5c14a8c6fa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:32:21.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44fc9635-6635-4059-b10a-fe5c14a8c6fa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a57d420
2021-06-04T01:32:21.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44fc9635-6635-4059-b10a-fe5c14a8c6fa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:32:21.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44fc9635-6635-4059-b10a-fe5c14a8c6fa PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:32:24.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21e533c3-e7bd-4c2a-b1b8-3e008c45b839 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:32:24.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21e533c3-e7bd-4c2a-b1b8-3e008c45b839 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b8f3962
2021-06-04T01:32:24.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21e533c3-e7bd-4c2a-b1b8-3e008c45b839 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:32:24.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21e533c3-e7bd-4c2a-b1b8-3e008c45b839 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:32:27.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c1b1978-961e-47b4-81d8-9ead6fb37118 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:32:27.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c1b1978-961e-47b4-81d8-9ead6fb37118 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@bb62d34
2021-06-04T01:32:27.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c1b1978-961e-47b4-81d8-9ead6fb37118 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:32:27.333Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c1b1978-961e-47b4-81d8-9ead6fb37118 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:32:30.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6260622-3f2a-436a-9f6b-d0462ca41f3b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:32:30.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6260622-3f2a-436a-9f6b-d0462ca41f3b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e530dc6
2021-06-04T01:32:30.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6260622-3f2a-436a-9f6b-d0462ca41f3b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:32:30.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6260622-3f2a-436a-9f6b-d0462ca41f3b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:32:33.232Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d47ed06-db2a-4390-917d-9eb5820c7e89 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:32:33.232Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d47ed06-db2a-4390-917d-9eb5820c7e89 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a1136f8
2021-06-04T01:32:33.232Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d47ed06-db2a-4390-917d-9eb5820c7e89 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:32:33.233Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d47ed06-db2a-4390-917d-9eb5820c7e89 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:32:36.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9fc28a40-6ef0-4f8c-b01d-ab738c4ac64d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:32:36.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9fc28a40-6ef0-4f8c-b01d-ab738c4ac64d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@280754f1
2021-06-04T01:32:36.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9fc28a40-6ef0-4f8c-b01d-ab738c4ac64d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:32:36.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9fc28a40-6ef0-4f8c-b01d-ab738c4ac64d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:32:39.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ede9c0c-c51f-4a71-98a8-494b6ef60026 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:32:39.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ede9c0c-c51f-4a71-98a8-494b6ef60026 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@12e20348
2021-06-04T01:32:39.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ede9c0c-c51f-4a71-98a8-494b6ef60026 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:32:39.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ede9c0c-c51f-4a71-98a8-494b6ef60026 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:32:42.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37f68f12-dd5b-45cc-84c5-aab4cb48fd78 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:32:42.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37f68f12-dd5b-45cc-84c5-aab4cb48fd78 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@448901ef
2021-06-04T01:32:42.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37f68f12-dd5b-45cc-84c5-aab4cb48fd78 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:32:42.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37f68f12-dd5b-45cc-84c5-aab4cb48fd78 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:32:45.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a62916c-defd-43d8-be9b-bd72799da91b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:32:45.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a62916c-defd-43d8-be9b-bd72799da91b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@37dc5970
2021-06-04T01:32:45.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a62916c-defd-43d8-be9b-bd72799da91b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:32:45.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a62916c-defd-43d8-be9b-bd72799da91b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:32:48.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9f71b44-367d-42e6-bebc-195accef5c91 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:32:48.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9f71b44-367d-42e6-bebc-195accef5c91 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@256e33a6
2021-06-04T01:32:48.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9f71b44-367d-42e6-bebc-195accef5c91 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:32:48.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9f71b44-367d-42e6-bebc-195accef5c91 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:32:50.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12a34244-6c64-4d35-a631-451c2f4ad1de PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:32:50.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12a34244-6c64-4d35-a631-451c2f4ad1de PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27949c00
2021-06-04T01:32:50.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12a34244-6c64-4d35-a631-451c2f4ad1de PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:32:50.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12a34244-6c64-4d35-a631-451c2f4ad1de PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:32:54.250Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72484cc3-01ba-47ae-9eeb-53a836889f8c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:32:54.250Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72484cc3-01ba-47ae-9eeb-53a836889f8c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b1e7764
2021-06-04T01:32:54.250Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72484cc3-01ba-47ae-9eeb-53a836889f8c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:32:54.250Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72484cc3-01ba-47ae-9eeb-53a836889f8c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:32:57.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79c87677-e7be-40e2-b7ad-4112981eadf5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:32:57.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79c87677-e7be-40e2-b7ad-4112981eadf5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e5cacae
2021-06-04T01:32:57.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79c87677-e7be-40e2-b7ad-4112981eadf5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:32:57.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79c87677-e7be-40e2-b7ad-4112981eadf5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:33:00.291Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57d29179-19c2-4b15-87c1-fb98008bd31b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:33:00.291Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57d29179-19c2-4b15-87c1-fb98008bd31b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a7b43c0
2021-06-04T01:33:00.291Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57d29179-19c2-4b15-87c1-fb98008bd31b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:33:00.291Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57d29179-19c2-4b15-87c1-fb98008bd31b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:33:03.336Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0cfc28b7-ec5f-4937-9c55-963d7b6a2f8f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:33:03.336Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0cfc28b7-ec5f-4937-9c55-963d7b6a2f8f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@290cae13
2021-06-04T01:33:03.336Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0cfc28b7-ec5f-4937-9c55-963d7b6a2f8f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:33:03.336Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0cfc28b7-ec5f-4937-9c55-963d7b6a2f8f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:33:06.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3dc75b3d-46a5-461c-8352-3ac485efdb09 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:33:06.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3dc75b3d-46a5-461c-8352-3ac485efdb09 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71f15901
2021-06-04T01:33:06.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3dc75b3d-46a5-461c-8352-3ac485efdb09 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:33:06.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3dc75b3d-46a5-461c-8352-3ac485efdb09 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:33:09.428Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b58bfb65-4d3c-4fe2-8a71-2353859fba14 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:33:09.428Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b58bfb65-4d3c-4fe2-8a71-2353859fba14 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ad3b24d
2021-06-04T01:33:09.428Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b58bfb65-4d3c-4fe2-8a71-2353859fba14 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:33:09.428Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b58bfb65-4d3c-4fe2-8a71-2353859fba14 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:33:12.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d063c184-2725-4d2b-95d6-09afdc879256 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:33:12.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d063c184-2725-4d2b-95d6-09afdc879256 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a469994
2021-06-04T01:33:12.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d063c184-2725-4d2b-95d6-09afdc879256 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:33:12.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d063c184-2725-4d2b-95d6-09afdc879256 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:33:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=580f865d-25b2-4bba-a282-e4d20879ade1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:33:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=580f865d-25b2-4bba-a282-e4d20879ade1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5676c0f9
2021-06-04T01:33:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=580f865d-25b2-4bba-a282-e4d20879ade1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:33:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=580f865d-25b2-4bba-a282-e4d20879ade1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:33:18.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6079abb8-8381-4ce5-b5f2-992a13c9904b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:33:18.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6079abb8-8381-4ce5-b5f2-992a13c9904b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2db4b267
2021-06-04T01:33:18.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6079abb8-8381-4ce5-b5f2-992a13c9904b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:33:18.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6079abb8-8381-4ce5-b5f2-992a13c9904b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:33:21.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a6412a2-83a5-4355-9681-dd85132a981e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:33:21.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a6412a2-83a5-4355-9681-dd85132a981e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a022c46
2021-06-04T01:33:21.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a6412a2-83a5-4355-9681-dd85132a981e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:33:21.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a6412a2-83a5-4355-9681-dd85132a981e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:33:24.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aeb6706b-c08b-48d1-8b49-03c54e10d068 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:33:24.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aeb6706b-c08b-48d1-8b49-03c54e10d068 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@742684ab
2021-06-04T01:33:24.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aeb6706b-c08b-48d1-8b49-03c54e10d068 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:33:24.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aeb6706b-c08b-48d1-8b49-03c54e10d068 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:33:27.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3e10190-3cb8-4a5f-866f-a0badd02d054 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:33:27.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3e10190-3cb8-4a5f-866f-a0badd02d054 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1437f3de
2021-06-04T01:33:27.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3e10190-3cb8-4a5f-866f-a0badd02d054 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:33:27.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3e10190-3cb8-4a5f-866f-a0badd02d054 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:33:30.388Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ee2932c-dd91-4690-b6cc-6ee2103068a2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:33:30.388Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ee2932c-dd91-4690-b6cc-6ee2103068a2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c985cb5
2021-06-04T01:33:30.388Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ee2932c-dd91-4690-b6cc-6ee2103068a2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:33:30.388Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ee2932c-dd91-4690-b6cc-6ee2103068a2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:33:33.326Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb147f14-baa8-4538-b1d2-ec3694bbdbd3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:33:33.326Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb147f14-baa8-4538-b1d2-ec3694bbdbd3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5733337c
2021-06-04T01:33:33.326Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb147f14-baa8-4538-b1d2-ec3694bbdbd3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:33:33.326Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb147f14-baa8-4538-b1d2-ec3694bbdbd3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:33:36.487Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c33f2991-f604-4198-b62b-de854e394107 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:33:36.487Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c33f2991-f604-4198-b62b-de854e394107 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1770e6ed
2021-06-04T01:33:36.487Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c33f2991-f604-4198-b62b-de854e394107 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:33:36.487Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c33f2991-f604-4198-b62b-de854e394107 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:33:39.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c77bb914-fdf3-442e-b61e-42c948c7d1fc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:33:39.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c77bb914-fdf3-442e-b61e-42c948c7d1fc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c724ede
2021-06-04T01:33:39.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c77bb914-fdf3-442e-b61e-42c948c7d1fc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:33:39.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c77bb914-fdf3-442e-b61e-42c948c7d1fc PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:33:42.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfa9a31b-ebb8-4e50-a9fc-7f936f2aa596 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:33:42.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfa9a31b-ebb8-4e50-a9fc-7f936f2aa596 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6251d011
2021-06-04T01:33:42.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfa9a31b-ebb8-4e50-a9fc-7f936f2aa596 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:33:42.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfa9a31b-ebb8-4e50-a9fc-7f936f2aa596 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:33:45.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f24d57b-85c8-471c-abe4-c9433c18ae49 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:33:45.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f24d57b-85c8-471c-abe4-c9433c18ae49 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c37b7f4
2021-06-04T01:33:45.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f24d57b-85c8-471c-abe4-c9433c18ae49 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:33:45.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f24d57b-85c8-471c-abe4-c9433c18ae49 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:33:48.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f379f74-b5ab-4cef-9732-bd13079bc524 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:33:48.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f379f74-b5ab-4cef-9732-bd13079bc524 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ce07b11
2021-06-04T01:33:48.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f379f74-b5ab-4cef-9732-bd13079bc524 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:33:48.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f379f74-b5ab-4cef-9732-bd13079bc524 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:33:50.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a471c737-703e-4c05-bb61-c0c7f90f40bb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:33:50.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a471c737-703e-4c05-bb61-c0c7f90f40bb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@12cad6ed
2021-06-04T01:33:50.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a471c737-703e-4c05-bb61-c0c7f90f40bb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:33:50.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a471c737-703e-4c05-bb61-c0c7f90f40bb PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:33:54.322Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0dd6fa39-9ae8-4e85-bc1a-cf90232c3864 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:33:54.322Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0dd6fa39-9ae8-4e85-bc1a-cf90232c3864 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e774dfd
2021-06-04T01:33:54.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0dd6fa39-9ae8-4e85-bc1a-cf90232c3864 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:33:54.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0dd6fa39-9ae8-4e85-bc1a-cf90232c3864 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:33:57.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99dc6810-043e-4385-aeab-65e97f4a1191 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:33:57.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99dc6810-043e-4385-aeab-65e97f4a1191 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f6ecdd0
2021-06-04T01:33:57.480Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99dc6810-043e-4385-aeab-65e97f4a1191 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:33:57.480Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99dc6810-043e-4385-aeab-65e97f4a1191 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:34:00.274Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b5953bc-1ff1-4870-a23a-138b5ee94830 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:34:00.274Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b5953bc-1ff1-4870-a23a-138b5ee94830 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50e90bdf
2021-06-04T01:34:00.274Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b5953bc-1ff1-4870-a23a-138b5ee94830 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:34:00.275Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b5953bc-1ff1-4870-a23a-138b5ee94830 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:34:03.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f138be6d-b3a9-42f8-94c2-bed3e72a9213 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:34:03.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f138be6d-b3a9-42f8-94c2-bed3e72a9213 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1450d291
2021-06-04T01:34:03.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f138be6d-b3a9-42f8-94c2-bed3e72a9213 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:34:03.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f138be6d-b3a9-42f8-94c2-bed3e72a9213 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:34:04.504Z [pool-14-thread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T01:34:04.505Z [pool-14-thread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=200 TargetEntity=getTopics Connection problem towards U-EB server. Reason: 500
2021-06-04T01:34:04.506Z [pool-14-thread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine Error occured during access to U-EB Server. Operation: try retrieve list of topics from U-EB server
2021-06-04T01:34:04.509Z [pool-14-thread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine GET http://message-router.onap:3904/topics (anonymous) ...
2021-06-04T01:34:06.378Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11f49053-1228-4f45-bc74-4d6caf66a0dd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:34:06.379Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11f49053-1228-4f45-bc74-4d6caf66a0dd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@500c6d43
2021-06-04T01:34:06.379Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11f49053-1228-4f45-bc74-4d6caf66a0dd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:34:06.379Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11f49053-1228-4f45-bc74-4d6caf66a0dd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:34:09.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f453746b-5a7c-42a5-a4dc-3f7abf542703 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:34:09.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f453746b-5a7c-42a5-a4dc-3f7abf542703 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49152adf
2021-06-04T01:34:09.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f453746b-5a7c-42a5-a4dc-3f7abf542703 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:34:09.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f453746b-5a7c-42a5-a4dc-3f7abf542703 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:34:12.040Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfe81601-e336-4bf4-a195-59d6eb7596d3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:34:12.040Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfe81601-e336-4bf4-a195-59d6eb7596d3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@513a67d1
2021-06-04T01:34:12.040Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfe81601-e336-4bf4-a195-59d6eb7596d3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:34:12.040Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfe81601-e336-4bf4-a195-59d6eb7596d3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:34:15.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b02e2c2d-854f-431f-94ea-55cde14e7ccc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:34:15.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b02e2c2d-854f-431f-94ea-55cde14e7ccc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@436ce33d
2021-06-04T01:34:15.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b02e2c2d-854f-431f-94ea-55cde14e7ccc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:34:15.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b02e2c2d-854f-431f-94ea-55cde14e7ccc PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:34:18.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c75a754f-29d6-485f-ad38-5943010f3824 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:34:18.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c75a754f-29d6-485f-ad38-5943010f3824 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7039f866
2021-06-04T01:34:18.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c75a754f-29d6-485f-ad38-5943010f3824 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:34:18.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c75a754f-29d6-485f-ad38-5943010f3824 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:34:21.052Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0311751-b954-4528-abb5-1231b3cf8fba PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:34:21.052Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0311751-b954-4528-abb5-1231b3cf8fba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@109a676c
2021-06-04T01:34:21.052Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0311751-b954-4528-abb5-1231b3cf8fba PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:34:21.052Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0311751-b954-4528-abb5-1231b3cf8fba PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:34:24.322Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1262669f-ac5e-4b2f-854d-950f7973e459 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:34:24.322Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1262669f-ac5e-4b2f-854d-950f7973e459 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@129c9e41
2021-06-04T01:34:24.322Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1262669f-ac5e-4b2f-854d-950f7973e459 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:34:24.322Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1262669f-ac5e-4b2f-854d-950f7973e459 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:34:27.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8d67016-da84-48a3-a99c-8e4bf8a2f225 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:34:27.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8d67016-da84-48a3-a99c-8e4bf8a2f225 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@36cdf224
2021-06-04T01:34:27.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8d67016-da84-48a3-a99c-8e4bf8a2f225 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:34:27.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8d67016-da84-48a3-a99c-8e4bf8a2f225 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:34:30.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=822406e7-e25c-44ec-8947-231c915dd7c9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:34:30.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=822406e7-e25c-44ec-8947-231c915dd7c9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@988d653
2021-06-04T01:34:30.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=822406e7-e25c-44ec-8947-231c915dd7c9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:34:30.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=822406e7-e25c-44ec-8947-231c915dd7c9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:34:33.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33db29d1-bd90-4d65-8f46-fc34d5bb52e5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:34:33.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33db29d1-bd90-4d65-8f46-fc34d5bb52e5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a6a7109
2021-06-04T01:34:33.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33db29d1-bd90-4d65-8f46-fc34d5bb52e5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:34:33.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33db29d1-bd90-4d65-8f46-fc34d5bb52e5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:34:36.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3f81ff4-ab6b-4340-a458-d42048029486 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:34:36.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3f81ff4-ab6b-4340-a458-d42048029486 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c728093
2021-06-04T01:34:36.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3f81ff4-ab6b-4340-a458-d42048029486 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:34:36.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3f81ff4-ab6b-4340-a458-d42048029486 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:34:39.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56eece34-77ba-4fc1-9a0c-a59167db7e9c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:34:39.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56eece34-77ba-4fc1-9a0c-a59167db7e9c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65f709eb
2021-06-04T01:34:39.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56eece34-77ba-4fc1-9a0c-a59167db7e9c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:34:39.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56eece34-77ba-4fc1-9a0c-a59167db7e9c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:34:42.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad2ef7ef-ccd1-4673-b00e-a98fe2641c55 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:34:42.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad2ef7ef-ccd1-4673-b00e-a98fe2641c55 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a826148
2021-06-04T01:34:42.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad2ef7ef-ccd1-4673-b00e-a98fe2641c55 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:34:42.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad2ef7ef-ccd1-4673-b00e-a98fe2641c55 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:34:45.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a4920cd-e9dd-4cad-9970-f73eaa909b4a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:34:45.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a4920cd-e9dd-4cad-9970-f73eaa909b4a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3379af28
2021-06-04T01:34:45.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a4920cd-e9dd-4cad-9970-f73eaa909b4a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:34:45.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a4920cd-e9dd-4cad-9970-f73eaa909b4a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:34:48.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3026dfe8-d514-4609-aa4a-f4a3a5ab531a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:34:48.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3026dfe8-d514-4609-aa4a-f4a3a5ab531a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ba7d7cc
2021-06-04T01:34:48.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3026dfe8-d514-4609-aa4a-f4a3a5ab531a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:34:48.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3026dfe8-d514-4609-aa4a-f4a3a5ab531a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:34:50.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb6f6be0-2950-4145-8538-3d9986f09c3f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:34:50.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb6f6be0-2950-4145-8538-3d9986f09c3f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@46423d02
2021-06-04T01:34:50.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb6f6be0-2950-4145-8538-3d9986f09c3f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:34:50.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb6f6be0-2950-4145-8538-3d9986f09c3f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:34:54.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63239e7e-a6be-4546-919e-b87139b0d950 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:34:54.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63239e7e-a6be-4546-919e-b87139b0d950 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f739ca3
2021-06-04T01:34:54.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63239e7e-a6be-4546-919e-b87139b0d950 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:34:54.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63239e7e-a6be-4546-919e-b87139b0d950 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:34:57.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45916597-93e8-4f03-98a6-2b3b6504f4bc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:34:57.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45916597-93e8-4f03-98a6-2b3b6504f4bc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@10d6c8a
2021-06-04T01:34:57.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45916597-93e8-4f03-98a6-2b3b6504f4bc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:34:57.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45916597-93e8-4f03-98a6-2b3b6504f4bc PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:35:00.376Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8542aae6-8f38-4180-8d96-e76bd5a38c7a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:35:00.376Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8542aae6-8f38-4180-8d96-e76bd5a38c7a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2431d2d0
2021-06-04T01:35:00.376Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8542aae6-8f38-4180-8d96-e76bd5a38c7a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:35:00.376Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8542aae6-8f38-4180-8d96-e76bd5a38c7a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:35:03.235Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df9610b4-7b17-4965-bac2-8756b0577103 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:35:03.235Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df9610b4-7b17-4965-bac2-8756b0577103 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@73cc4179
2021-06-04T01:35:03.235Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df9610b4-7b17-4965-bac2-8756b0577103 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:35:03.235Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df9610b4-7b17-4965-bac2-8756b0577103 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:35:06.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9512af0f-7585-41b4-80b1-b123122869a6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:35:06.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9512af0f-7585-41b4-80b1-b123122869a6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@10394d27
2021-06-04T01:35:06.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9512af0f-7585-41b4-80b1-b123122869a6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:35:06.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9512af0f-7585-41b4-80b1-b123122869a6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:35:09.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2fb0bdf4-aaef-46c9-afc9-90795fdbb7e4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:35:09.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2fb0bdf4-aaef-46c9-afc9-90795fdbb7e4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7aba0a96
2021-06-04T01:35:09.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2fb0bdf4-aaef-46c9-afc9-90795fdbb7e4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:35:09.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2fb0bdf4-aaef-46c9-afc9-90795fdbb7e4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:35:12.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=453d1701-9b2c-47d5-a329-57c75a8e74aa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:35:12.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=453d1701-9b2c-47d5-a329-57c75a8e74aa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5037f043
2021-06-04T01:35:12.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=453d1701-9b2c-47d5-a329-57c75a8e74aa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:35:12.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=453d1701-9b2c-47d5-a329-57c75a8e74aa PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:35:15.489Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e06d0b2-e8b5-4fac-a305-dd9625f08aa0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:35:15.490Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e06d0b2-e8b5-4fac-a305-dd9625f08aa0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4161b4b5
2021-06-04T01:35:15.490Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e06d0b2-e8b5-4fac-a305-dd9625f08aa0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:35:15.490Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e06d0b2-e8b5-4fac-a305-dd9625f08aa0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:35:18.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0afec021-85f5-47c4-a168-c586d0e02fea PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:35:18.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0afec021-85f5-47c4-a168-c586d0e02fea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b6b89cb
2021-06-04T01:35:18.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0afec021-85f5-47c4-a168-c586d0e02fea PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:35:18.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0afec021-85f5-47c4-a168-c586d0e02fea PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:35:21.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbebf200-978f-4289-8ac4-e1268acb1823 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:35:21.052Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbebf200-978f-4289-8ac4-e1268acb1823 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@312fce8a
2021-06-04T01:35:21.052Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbebf200-978f-4289-8ac4-e1268acb1823 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:35:21.052Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbebf200-978f-4289-8ac4-e1268acb1823 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:35:24.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97649435-d2fb-464a-9fed-ef433853332a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:35:24.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97649435-d2fb-464a-9fed-ef433853332a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e759504
2021-06-04T01:35:24.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97649435-d2fb-464a-9fed-ef433853332a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:35:24.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97649435-d2fb-464a-9fed-ef433853332a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:35:27.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5b114da-23d3-4ac4-9c50-775adfa53022 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:35:27.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5b114da-23d3-4ac4-9c50-775adfa53022 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@127d5663
2021-06-04T01:35:27.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5b114da-23d3-4ac4-9c50-775adfa53022 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:35:27.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5b114da-23d3-4ac4-9c50-775adfa53022 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:35:30.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=007d42f6-e2dd-4ce9-a9ae-9682b4bcc4d5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:35:30.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=007d42f6-e2dd-4ce9-a9ae-9682b4bcc4d5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@559fa036
2021-06-04T01:35:30.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=007d42f6-e2dd-4ce9-a9ae-9682b4bcc4d5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:35:30.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=007d42f6-e2dd-4ce9-a9ae-9682b4bcc4d5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:35:33.339Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8f093004-a3e4-4970-9ebe-9e77a32e018a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:35:33.339Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8f093004-a3e4-4970-9ebe-9e77a32e018a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a8b7f91
2021-06-04T01:35:33.339Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8f093004-a3e4-4970-9ebe-9e77a32e018a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:35:33.339Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8f093004-a3e4-4970-9ebe-9e77a32e018a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:35:36.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09367737-174c-450c-8e7a-a0823d3cba37 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:35:36.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09367737-174c-450c-8e7a-a0823d3cba37 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68240471
2021-06-04T01:35:36.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09367737-174c-450c-8e7a-a0823d3cba37 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:35:36.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09367737-174c-450c-8e7a-a0823d3cba37 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:35:39.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=962d4aed-e997-4e32-bdda-c7fefde50915 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:35:39.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=962d4aed-e997-4e32-bdda-c7fefde50915 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@10129958
2021-06-04T01:35:39.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=962d4aed-e997-4e32-bdda-c7fefde50915 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:35:39.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=962d4aed-e997-4e32-bdda-c7fefde50915 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:35:42.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=799f9d7b-0114-4ab3-a5a6-1e84f943d00d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:35:42.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=799f9d7b-0114-4ab3-a5a6-1e84f943d00d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38a4157c
2021-06-04T01:35:42.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=799f9d7b-0114-4ab3-a5a6-1e84f943d00d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:35:42.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=799f9d7b-0114-4ab3-a5a6-1e84f943d00d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:35:45.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=670f55ed-ff5c-49ef-8b4e-825fce75c0bf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:35:45.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=670f55ed-ff5c-49ef-8b4e-825fce75c0bf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7912920e
2021-06-04T01:35:45.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=670f55ed-ff5c-49ef-8b4e-825fce75c0bf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:35:45.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=670f55ed-ff5c-49ef-8b4e-825fce75c0bf PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:35:48.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0cdc55cc-bb47-4885-bd4d-56d62701c124 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:35:48.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0cdc55cc-bb47-4885-bd4d-56d62701c124 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@31dd06d1
2021-06-04T01:35:48.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0cdc55cc-bb47-4885-bd4d-56d62701c124 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:35:48.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0cdc55cc-bb47-4885-bd4d-56d62701c124 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:35:51.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8980d625-a2b6-440b-9f09-52be9ac6fbab PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:35:51.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8980d625-a2b6-440b-9f09-52be9ac6fbab PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@358181eb
2021-06-04T01:35:51.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8980d625-a2b6-440b-9f09-52be9ac6fbab PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:35:51.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8980d625-a2b6-440b-9f09-52be9ac6fbab PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:35:54.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=157ad3f6-3fc1-47d6-ab94-f70c4b5baeab PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:35:54.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=157ad3f6-3fc1-47d6-ab94-f70c4b5baeab PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d966dd2
2021-06-04T01:35:54.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=157ad3f6-3fc1-47d6-ab94-f70c4b5baeab PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:35:54.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=157ad3f6-3fc1-47d6-ab94-f70c4b5baeab PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:35:57.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57dac44f-530b-48d1-802a-7034bf314106 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:35:57.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57dac44f-530b-48d1-802a-7034bf314106 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4079188c
2021-06-04T01:35:57.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57dac44f-530b-48d1-802a-7034bf314106 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:35:57.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57dac44f-530b-48d1-802a-7034bf314106 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:36:00.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15193ff3-b4d9-4e27-8bfc-976da7d2771c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:36:00.373Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15193ff3-b4d9-4e27-8bfc-976da7d2771c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@194b65dc
2021-06-04T01:36:00.373Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15193ff3-b4d9-4e27-8bfc-976da7d2771c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:36:00.373Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15193ff3-b4d9-4e27-8bfc-976da7d2771c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:36:03.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f92a0c04-8f79-4c3c-b9cc-d98cdfd81885 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:36:03.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f92a0c04-8f79-4c3c-b9cc-d98cdfd81885 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@207c31c7
2021-06-04T01:36:03.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f92a0c04-8f79-4c3c-b9cc-d98cdfd81885 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:36:03.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f92a0c04-8f79-4c3c-b9cc-d98cdfd81885 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:36:06.477Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccb056b5-d7a2-4615-b190-16978c2253bf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:36:06.477Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccb056b5-d7a2-4615-b190-16978c2253bf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e9a20e7
2021-06-04T01:36:06.477Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccb056b5-d7a2-4615-b190-16978c2253bf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:36:06.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccb056b5-d7a2-4615-b190-16978c2253bf PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:36:09.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11f71fa1-d9f9-4c1a-bbf0-86ac03cc0b59 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:36:09.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11f71fa1-d9f9-4c1a-bbf0-86ac03cc0b59 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@362ff2c0
2021-06-04T01:36:09.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11f71fa1-d9f9-4c1a-bbf0-86ac03cc0b59 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:36:09.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11f71fa1-d9f9-4c1a-bbf0-86ac03cc0b59 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:36:12.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c8d03a32-847c-45e4-9026-40414bb7ff60 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:36:12.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c8d03a32-847c-45e4-9026-40414bb7ff60 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7408045c
2021-06-04T01:36:12.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c8d03a32-847c-45e4-9026-40414bb7ff60 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:36:12.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c8d03a32-847c-45e4-9026-40414bb7ff60 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:36:15.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9dafdf56-ebc6-499e-a15d-7eae2227336d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:36:15.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9dafdf56-ebc6-499e-a15d-7eae2227336d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35bbe113
2021-06-04T01:36:15.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9dafdf56-ebc6-499e-a15d-7eae2227336d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:36:15.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9dafdf56-ebc6-499e-a15d-7eae2227336d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:36:15.580Z [pool-14-thread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T01:36:15.581Z [pool-14-thread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=200 TargetEntity=getTopics Connection problem towards U-EB server. Reason: 500
2021-06-04T01:36:15.581Z [pool-14-thread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine Error occured during access to U-EB Server. Operation: try retrieve list of topics from U-EB server
2021-06-04T01:36:15.589Z [pool-14-thread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine GET http://message-router.onap:3904/topics (anonymous) ...
2021-06-04T01:36:18.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2935cdcc-4710-4aef-893c-5a391a97f528 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:36:18.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2935cdcc-4710-4aef-893c-5a391a97f528 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a49725b
2021-06-04T01:36:18.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2935cdcc-4710-4aef-893c-5a391a97f528 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:36:18.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2935cdcc-4710-4aef-893c-5a391a97f528 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:36:20.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94443d65-15d9-44ff-ac78-6451d5309767 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:36:20.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94443d65-15d9-44ff-ac78-6451d5309767 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@13392220
2021-06-04T01:36:20.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94443d65-15d9-44ff-ac78-6451d5309767 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:36:20.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94443d65-15d9-44ff-ac78-6451d5309767 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:36:24.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc8bf9e8-8eb4-4086-80e3-00487cbbd5a5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:36:24.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc8bf9e8-8eb4-4086-80e3-00487cbbd5a5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27a7eeff
2021-06-04T01:36:24.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc8bf9e8-8eb4-4086-80e3-00487cbbd5a5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:36:24.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc8bf9e8-8eb4-4086-80e3-00487cbbd5a5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:36:27.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7123e24d-a872-424b-9994-4229d7c3b49c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:36:27.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7123e24d-a872-424b-9994-4229d7c3b49c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4d7e3061
2021-06-04T01:36:27.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7123e24d-a872-424b-9994-4229d7c3b49c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:36:27.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7123e24d-a872-424b-9994-4229d7c3b49c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:36:30.292Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15a48e21-4cf4-456a-b062-c88c3d2fbd7b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:36:30.292Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15a48e21-4cf4-456a-b062-c88c3d2fbd7b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c34583f
2021-06-04T01:36:30.292Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15a48e21-4cf4-456a-b062-c88c3d2fbd7b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:36:30.292Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15a48e21-4cf4-456a-b062-c88c3d2fbd7b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:36:33.235Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89b17c54-595a-4e51-bed7-4ee7d279bbc7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:36:33.235Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89b17c54-595a-4e51-bed7-4ee7d279bbc7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c659bb
2021-06-04T01:36:33.235Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89b17c54-595a-4e51-bed7-4ee7d279bbc7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:36:33.235Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89b17c54-595a-4e51-bed7-4ee7d279bbc7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:36:36.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b6470c2-426a-41b6-bf4d-8545da19f1e5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:36:36.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b6470c2-426a-41b6-bf4d-8545da19f1e5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e8e8f8a
2021-06-04T01:36:36.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b6470c2-426a-41b6-bf4d-8545da19f1e5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:36:36.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b6470c2-426a-41b6-bf4d-8545da19f1e5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:36:39.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03016de0-f335-4337-b9bc-eac1f232d8a9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:36:39.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03016de0-f335-4337-b9bc-eac1f232d8a9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@224f4902
2021-06-04T01:36:39.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03016de0-f335-4337-b9bc-eac1f232d8a9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:36:39.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03016de0-f335-4337-b9bc-eac1f232d8a9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:36:41.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=932a9480-901a-49bd-be4a-3970712a6a45 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:36:41.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=932a9480-901a-49bd-be4a-3970712a6a45 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c4418d4
2021-06-04T01:36:41.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=932a9480-901a-49bd-be4a-3970712a6a45 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:36:41.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=932a9480-901a-49bd-be4a-3970712a6a45 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:36:45.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c46e7f1-8562-4860-af46-5011165a8603 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:36:45.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c46e7f1-8562-4860-af46-5011165a8603 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68fb8966
2021-06-04T01:36:45.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c46e7f1-8562-4860-af46-5011165a8603 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:36:45.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c46e7f1-8562-4860-af46-5011165a8603 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:36:48.615Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=035025e1-0804-4de3-92bc-429035d2d284 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:36:48.615Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=035025e1-0804-4de3-92bc-429035d2d284 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@263a92c
2021-06-04T01:36:48.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=035025e1-0804-4de3-92bc-429035d2d284 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:36:48.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=035025e1-0804-4de3-92bc-429035d2d284 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:36:51.339Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c76f480a-edcc-49f7-8717-037442277c91 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:36:51.339Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c76f480a-edcc-49f7-8717-037442277c91 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a3cf73b
2021-06-04T01:36:51.340Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c76f480a-edcc-49f7-8717-037442277c91 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:36:51.340Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c76f480a-edcc-49f7-8717-037442277c91 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:36:54.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c9ff8e7-2b6c-41c4-9c2a-6fe510c242d4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:36:54.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c9ff8e7-2b6c-41c4-9c2a-6fe510c242d4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2642c610
2021-06-04T01:36:54.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c9ff8e7-2b6c-41c4-9c2a-6fe510c242d4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:36:54.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c9ff8e7-2b6c-41c4-9c2a-6fe510c242d4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:36:57.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f689891-c481-40c4-bbf1-5dc1b0d4ee95 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:36:57.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f689891-c481-40c4-bbf1-5dc1b0d4ee95 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1246db07
2021-06-04T01:36:57.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f689891-c481-40c4-bbf1-5dc1b0d4ee95 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:36:57.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f689891-c481-40c4-bbf1-5dc1b0d4ee95 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:37:00.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c626cd98-0b1a-40bf-bb22-100e6c108dfd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:37:00.373Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c626cd98-0b1a-40bf-bb22-100e6c108dfd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d733aaa
2021-06-04T01:37:00.373Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c626cd98-0b1a-40bf-bb22-100e6c108dfd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:37:00.373Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c626cd98-0b1a-40bf-bb22-100e6c108dfd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:37:03.322Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b9bdf45-ce53-46bc-b7ed-95c792971e29 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:37:03.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b9bdf45-ce53-46bc-b7ed-95c792971e29 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@304b9110
2021-06-04T01:37:03.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b9bdf45-ce53-46bc-b7ed-95c792971e29 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:37:03.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b9bdf45-ce53-46bc-b7ed-95c792971e29 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:37:06.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e5d9dc7-e69b-4c79-9db9-29e7602be915 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:37:06.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e5d9dc7-e69b-4c79-9db9-29e7602be915 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@89b34f
2021-06-04T01:37:06.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e5d9dc7-e69b-4c79-9db9-29e7602be915 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:37:06.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e5d9dc7-e69b-4c79-9db9-29e7602be915 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:37:09.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=089719ed-fea4-414b-bab6-b47a8a289031 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:37:09.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=089719ed-fea4-414b-bab6-b47a8a289031 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2433ceba
2021-06-04T01:37:09.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=089719ed-fea4-414b-bab6-b47a8a289031 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:37:09.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=089719ed-fea4-414b-bab6-b47a8a289031 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:37:11.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5b3f108-2abb-483f-b0e6-4f7ccbab9c20 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:37:11.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5b3f108-2abb-483f-b0e6-4f7ccbab9c20 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@300106fc
2021-06-04T01:37:11.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5b3f108-2abb-483f-b0e6-4f7ccbab9c20 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:37:11.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5b3f108-2abb-483f-b0e6-4f7ccbab9c20 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:37:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7c185a3-5af7-45e6-a424-f2ada87a64a7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:37:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7c185a3-5af7-45e6-a424-f2ada87a64a7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c2ec2fd
2021-06-04T01:37:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7c185a3-5af7-45e6-a424-f2ada87a64a7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:37:15.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7c185a3-5af7-45e6-a424-f2ada87a64a7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:37:18.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c9eb93e-31f5-4b7d-8b62-12a71b23034c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:37:18.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c9eb93e-31f5-4b7d-8b62-12a71b23034c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@117011fc
2021-06-04T01:37:18.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c9eb93e-31f5-4b7d-8b62-12a71b23034c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:37:18.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c9eb93e-31f5-4b7d-8b62-12a71b23034c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:37:21.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8f7a250-a9ea-4140-ba3c-d76e94189f50 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:37:21.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8f7a250-a9ea-4140-ba3c-d76e94189f50 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b8c4b76
2021-06-04T01:37:21.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8f7a250-a9ea-4140-ba3c-d76e94189f50 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:37:21.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8f7a250-a9ea-4140-ba3c-d76e94189f50 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:37:24.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5c7ac21-b941-4770-b676-64fe78a960f1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:37:24.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5c7ac21-b941-4770-b676-64fe78a960f1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@13028e1d
2021-06-04T01:37:24.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5c7ac21-b941-4770-b676-64fe78a960f1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:37:24.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5c7ac21-b941-4770-b676-64fe78a960f1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:37:27.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4158f85e-cfea-4b3d-8137-bd6b9ba8eb05 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:37:27.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4158f85e-cfea-4b3d-8137-bd6b9ba8eb05 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@39119faa
2021-06-04T01:37:27.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4158f85e-cfea-4b3d-8137-bd6b9ba8eb05 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:37:27.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4158f85e-cfea-4b3d-8137-bd6b9ba8eb05 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:37:30.309Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fcbd1a0b-4ffc-428c-8d7c-75a24c121898 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:37:30.309Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fcbd1a0b-4ffc-428c-8d7c-75a24c121898 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@287f9685
2021-06-04T01:37:30.309Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fcbd1a0b-4ffc-428c-8d7c-75a24c121898 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:37:30.309Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fcbd1a0b-4ffc-428c-8d7c-75a24c121898 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:37:33.327Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=957b9e8b-f6a0-47b7-a161-857d79cfda64 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:37:33.328Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=957b9e8b-f6a0-47b7-a161-857d79cfda64 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6161af07
2021-06-04T01:37:33.328Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=957b9e8b-f6a0-47b7-a161-857d79cfda64 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:37:33.328Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=957b9e8b-f6a0-47b7-a161-857d79cfda64 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:37:36.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf3881f8-6d51-4c57-9744-b835ae745b9d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:37:36.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf3881f8-6d51-4c57-9744-b835ae745b9d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6614b750
2021-06-04T01:37:36.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf3881f8-6d51-4c57-9744-b835ae745b9d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:37:36.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf3881f8-6d51-4c57-9744-b835ae745b9d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:37:39.432Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9df4560c-4dee-489d-87cb-68e047b25c54 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:37:39.432Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9df4560c-4dee-489d-87cb-68e047b25c54 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@534d98f7
2021-06-04T01:37:39.432Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9df4560c-4dee-489d-87cb-68e047b25c54 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:37:39.432Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9df4560c-4dee-489d-87cb-68e047b25c54 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:37:42.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37af4bed-3ad5-4280-8304-bbe26e0c766d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:37:42.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37af4bed-3ad5-4280-8304-bbe26e0c766d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d2f7a5
2021-06-04T01:37:42.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37af4bed-3ad5-4280-8304-bbe26e0c766d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:37:42.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37af4bed-3ad5-4280-8304-bbe26e0c766d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:37:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12fd3ff9-6663-4d71-9577-4f401d36b8de PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:37:45.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12fd3ff9-6663-4d71-9577-4f401d36b8de PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ba769cf
2021-06-04T01:37:45.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12fd3ff9-6663-4d71-9577-4f401d36b8de PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:37:45.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12fd3ff9-6663-4d71-9577-4f401d36b8de PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:37:48.678Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79907fd1-ebc0-45c3-8944-90a0cbae806a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:37:48.678Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79907fd1-ebc0-45c3-8944-90a0cbae806a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28caeddc
2021-06-04T01:37:48.678Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79907fd1-ebc0-45c3-8944-90a0cbae806a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:37:48.678Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79907fd1-ebc0-45c3-8944-90a0cbae806a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:37:51.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48b4f615-4c63-4f77-a2f3-f443a1ec2975 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:37:51.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48b4f615-4c63-4f77-a2f3-f443a1ec2975 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17ff4212
2021-06-04T01:37:51.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48b4f615-4c63-4f77-a2f3-f443a1ec2975 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:37:51.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48b4f615-4c63-4f77-a2f3-f443a1ec2975 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:37:54.327Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d9157b7-9ac1-4f00-bb34-2d164cc6cd70 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:37:54.327Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d9157b7-9ac1-4f00-bb34-2d164cc6cd70 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@780e097
2021-06-04T01:37:54.327Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d9157b7-9ac1-4f00-bb34-2d164cc6cd70 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:37:54.327Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d9157b7-9ac1-4f00-bb34-2d164cc6cd70 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:37:57.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5078c3d7-cb98-49dd-8a5d-8fe131f5167b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:37:57.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5078c3d7-cb98-49dd-8a5d-8fe131f5167b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57b908b9
2021-06-04T01:37:57.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5078c3d7-cb98-49dd-8a5d-8fe131f5167b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:37:57.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5078c3d7-cb98-49dd-8a5d-8fe131f5167b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:38:00.298Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc4b6dac-9399-4875-8eda-3cdf3dcd5322 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:38:00.298Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc4b6dac-9399-4875-8eda-3cdf3dcd5322 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2862ab9f
2021-06-04T01:38:00.298Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc4b6dac-9399-4875-8eda-3cdf3dcd5322 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:38:00.298Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc4b6dac-9399-4875-8eda-3cdf3dcd5322 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:38:03.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=593deba7-de83-41ef-af59-c609a8192d3e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:38:03.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=593deba7-de83-41ef-af59-c609a8192d3e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45e09353
2021-06-04T01:38:03.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=593deba7-de83-41ef-af59-c609a8192d3e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:38:03.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=593deba7-de83-41ef-af59-c609a8192d3e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:38:06.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eda90d54-f12e-4967-b79c-9ded1e1d0052 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:38:06.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eda90d54-f12e-4967-b79c-9ded1e1d0052 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45e44720
2021-06-04T01:38:06.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eda90d54-f12e-4967-b79c-9ded1e1d0052 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:38:06.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eda90d54-f12e-4967-b79c-9ded1e1d0052 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:38:09.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79605a21-1ac4-4cb3-8ef1-14f130b3b8e9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:38:09.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79605a21-1ac4-4cb3-8ef1-14f130b3b8e9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a8763e5
2021-06-04T01:38:09.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79605a21-1ac4-4cb3-8ef1-14f130b3b8e9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:38:09.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79605a21-1ac4-4cb3-8ef1-14f130b3b8e9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:38:12.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1981ca08-068b-46aa-8c63-6965391e7fd0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:38:12.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1981ca08-068b-46aa-8c63-6965391e7fd0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@67840579
2021-06-04T01:38:12.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1981ca08-068b-46aa-8c63-6965391e7fd0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:38:12.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1981ca08-068b-46aa-8c63-6965391e7fd0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:38:15.415Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b558be8-7783-4bfb-9947-2f2d73d6fd2e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:38:15.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b558be8-7783-4bfb-9947-2f2d73d6fd2e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@26bf78d1
2021-06-04T01:38:15.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b558be8-7783-4bfb-9947-2f2d73d6fd2e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:38:15.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b558be8-7783-4bfb-9947-2f2d73d6fd2e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:38:18.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0139378c-a1a8-4d60-99d9-dda5b07785ae PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:38:18.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0139378c-a1a8-4d60-99d9-dda5b07785ae PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4185e661
2021-06-04T01:38:18.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0139378c-a1a8-4d60-99d9-dda5b07785ae PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:38:18.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0139378c-a1a8-4d60-99d9-dda5b07785ae PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:38:21.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82565589-5380-4af6-b887-4bee1b746d31 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:38:21.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82565589-5380-4af6-b887-4bee1b746d31 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@207c2dff
2021-06-04T01:38:21.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82565589-5380-4af6-b887-4bee1b746d31 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:38:21.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82565589-5380-4af6-b887-4bee1b746d31 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:38:24.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2252f31a-13ef-4c43-bfa6-4c2877d7610a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:38:24.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2252f31a-13ef-4c43-bfa6-4c2877d7610a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@67945b44
2021-06-04T01:38:24.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2252f31a-13ef-4c43-bfa6-4c2877d7610a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:38:24.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2252f31a-13ef-4c43-bfa6-4c2877d7610a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:38:24.318Z [BE-Health-Check-Task] INFO o.a.http.impl.execchain.RetryExec RequestID=2252f31a-13ef-4c43-bfa6-4c2877d7610a PartnerName=SDC.BE I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {s}->https://sdc-onboarding-be.onap:8445: The target server failed to respond
2021-06-04T01:38:24.318Z [BE-Health-Check-Task] INFO o.a.http.impl.execchain.RetryExec RequestID=2252f31a-13ef-4c43-bfa6-4c2877d7610a PartnerName=SDC.BE Retrying request to {s}->https://sdc-onboarding-be.onap:8445
2021-06-04T01:38:24.324Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2252f31a-13ef-4c43-bfa6-4c2877d7610a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T01:38:24.324Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2252f31a-13ef-4c43-bfa6-4c2877d7610a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:38:26.652Z [pool-14-thread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T01:38:26.653Z [pool-14-thread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=200 TargetEntity=getTopics Connection problem towards U-EB server. Reason: 500
2021-06-04T01:38:26.653Z [pool-14-thread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine Error occured during access to U-EB Server. Operation: try retrieve list of topics from U-EB server
2021-06-04T01:38:26.660Z [pool-14-thread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine GET http://message-router.onap:3904/topics (anonymous) ...
2021-06-04T01:38:27.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51bf5b0e-0562-4968-8c0f-621ef6765a4c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:38:27.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51bf5b0e-0562-4968-8c0f-621ef6765a4c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5468915e
2021-06-04T01:38:27.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51bf5b0e-0562-4968-8c0f-621ef6765a4c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:38:27.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51bf5b0e-0562-4968-8c0f-621ef6765a4c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:38:27.385Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=51bf5b0e-0562-4968-8c0f-621ef6765a4c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T01:38:27.385Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=51bf5b0e-0562-4968-8c0f-621ef6765a4c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:38:30.302Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39d2658c-551a-4cbe-8bb2-e473343564cc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:38:30.302Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39d2658c-551a-4cbe-8bb2-e473343564cc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50316a61
2021-06-04T01:38:30.302Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39d2658c-551a-4cbe-8bb2-e473343564cc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:38:30.302Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39d2658c-551a-4cbe-8bb2-e473343564cc PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:38:33.313Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=39d2658c-551a-4cbe-8bb2-e473343564cc ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:38:33.314Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=39d2658c-551a-4cbe-8bb2-e473343564cc ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:38:33.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c0216d7-da72-4f4b-8695-e92b5fa5a9bf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:38:33.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c0216d7-da72-4f4b-8695-e92b5fa5a9bf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7cbbcc20
2021-06-04T01:38:33.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c0216d7-da72-4f4b-8695-e92b5fa5a9bf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:38:33.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c0216d7-da72-4f4b-8695-e92b5fa5a9bf PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:38:36.644Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=6c0216d7-da72-4f4b-8695-e92b5fa5a9bf ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:38:36.645Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=6c0216d7-da72-4f4b-8695-e92b5fa5a9bf ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:38:37.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a7b4dba-ba24-4a1b-8bcd-91fd1a4638d8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:38:37.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a7b4dba-ba24-4a1b-8bcd-91fd1a4638d8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@609014bd
2021-06-04T01:38:37.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a7b4dba-ba24-4a1b-8bcd-91fd1a4638d8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:38:37.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a7b4dba-ba24-4a1b-8bcd-91fd1a4638d8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:38:40.190Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=7a7b4dba-ba24-4a1b-8bcd-91fd1a4638d8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:38:40.190Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=7a7b4dba-ba24-4a1b-8bcd-91fd1a4638d8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:38:40.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=860c8f19-fa2a-4c5e-9b29-8f391c9a9f8c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:38:40.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=860c8f19-fa2a-4c5e-9b29-8f391c9a9f8c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6493a97a
2021-06-04T01:38:40.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=860c8f19-fa2a-4c5e-9b29-8f391c9a9f8c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:38:40.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=860c8f19-fa2a-4c5e-9b29-8f391c9a9f8c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:38:43.326Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=860c8f19-fa2a-4c5e-9b29-8f391c9a9f8c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:38:43.327Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=860c8f19-fa2a-4c5e-9b29-8f391c9a9f8c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:38:43.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=083dcccd-c182-4044-833e-733578cc8f66 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:38:43.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=083dcccd-c182-4044-833e-733578cc8f66 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@778292c3
2021-06-04T01:38:43.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=083dcccd-c182-4044-833e-733578cc8f66 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:38:43.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=083dcccd-c182-4044-833e-733578cc8f66 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:38:46.929Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=083dcccd-c182-4044-833e-733578cc8f66 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:38:46.929Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=083dcccd-c182-4044-833e-733578cc8f66 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:38:47.578Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00b6a847-8658-4774-96dc-a21a5db23d85 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:38:47.579Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00b6a847-8658-4774-96dc-a21a5db23d85 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15e90e9d
2021-06-04T01:38:47.579Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00b6a847-8658-4774-96dc-a21a5db23d85 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:38:47.579Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00b6a847-8658-4774-96dc-a21a5db23d85 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:38:50.591Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=00b6a847-8658-4774-96dc-a21a5db23d85 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:38:50.592Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=00b6a847-8658-4774-96dc-a21a5db23d85 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:38:50.714Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9953e095-a83f-4bb1-99eb-4644064fe5d1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:38:50.714Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9953e095-a83f-4bb1-99eb-4644064fe5d1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b2f0083
2021-06-04T01:38:50.715Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9953e095-a83f-4bb1-99eb-4644064fe5d1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:38:50.715Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9953e095-a83f-4bb1-99eb-4644064fe5d1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:38:53.728Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=9953e095-a83f-4bb1-99eb-4644064fe5d1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:38:53.729Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=9953e095-a83f-4bb1-99eb-4644064fe5d1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:38:54.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22541566-f1df-43bb-9d0c-608504f46d2d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:38:54.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22541566-f1df-43bb-9d0c-608504f46d2d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f1ebccb
2021-06-04T01:38:54.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22541566-f1df-43bb-9d0c-608504f46d2d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:38:54.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22541566-f1df-43bb-9d0c-608504f46d2d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:38:57.139Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=22541566-f1df-43bb-9d0c-608504f46d2d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:38:57.140Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=22541566-f1df-43bb-9d0c-608504f46d2d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:38:57.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a29bff5-0e3c-4cf8-8844-93a94eea1b78 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:38:57.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a29bff5-0e3c-4cf8-8844-93a94eea1b78 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@707c978d
2021-06-04T01:38:57.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a29bff5-0e3c-4cf8-8844-93a94eea1b78 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:38:57.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a29bff5-0e3c-4cf8-8844-93a94eea1b78 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:39:00.936Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=4a29bff5-0e3c-4cf8-8844-93a94eea1b78 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:39:00.937Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=4a29bff5-0e3c-4cf8-8844-93a94eea1b78 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:39:01.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b892707-9953-40da-88da-8d6d7f3f10e8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:39:01.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b892707-9953-40da-88da-8d6d7f3f10e8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ecb1bca
2021-06-04T01:39:01.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b892707-9953-40da-88da-8d6d7f3f10e8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:39:01.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b892707-9953-40da-88da-8d6d7f3f10e8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:39:01.579Z [cluster2-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T01:39:01.581Z [cluster2-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 30000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:39:05.807Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=5b892707-9953-40da-88da-8d6d7f3f10e8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:39:05.808Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=5b892707-9953-40da-88da-8d6d7f3f10e8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:39:06.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09152647-27ed-4388-8b3f-302a82e3fe2a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:39:06.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09152647-27ed-4388-8b3f-302a82e3fe2a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ceed360
2021-06-04T01:39:06.384Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09152647-27ed-4388-8b3f-302a82e3fe2a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:39:06.384Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09152647-27ed-4388-8b3f-302a82e3fe2a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:39:09.436Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=09152647-27ed-4388-8b3f-302a82e3fe2a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:39:09.436Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=09152647-27ed-4388-8b3f-302a82e3fe2a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:39:10.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9700ac2-717b-440e-8f44-16e2be0e8501 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:39:10.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9700ac2-717b-440e-8f44-16e2be0e8501 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@61361d3
2021-06-04T01:39:10.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9700ac2-717b-440e-8f44-16e2be0e8501 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:39:10.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9700ac2-717b-440e-8f44-16e2be0e8501 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:39:13.068Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d9700ac2-717b-440e-8f44-16e2be0e8501 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:39:13.068Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d9700ac2-717b-440e-8f44-16e2be0e8501 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:39:13.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a927d938-99db-4114-9d84-b2b3437a1bed PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:39:13.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a927d938-99db-4114-9d84-b2b3437a1bed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@33d19bcb
2021-06-04T01:39:13.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a927d938-99db-4114-9d84-b2b3437a1bed PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:39:13.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a927d938-99db-4114-9d84-b2b3437a1bed PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:39:16.595Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a927d938-99db-4114-9d84-b2b3437a1bed ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:39:16.595Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a927d938-99db-4114-9d84-b2b3437a1bed ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:39:17.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa4d1ba5-7181-4844-aab9-f6e3d7156d8a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:39:17.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa4d1ba5-7181-4844-aab9-f6e3d7156d8a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@18ee016a
2021-06-04T01:39:17.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa4d1ba5-7181-4844-aab9-f6e3d7156d8a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:39:17.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa4d1ba5-7181-4844-aab9-f6e3d7156d8a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:39:18.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=226421a0-0639-479a-b669-80cad3279f86 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:39:18.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=226421a0-0639-479a-b669-80cad3279f86 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2971410
2021-06-04T01:39:18.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=226421a0-0639-479a-b669-80cad3279f86 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:39:18.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=226421a0-0639-479a-b669-80cad3279f86 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:39:20.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68a1546f-f2ed-4d9c-b9a1-c95a95e3640d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:39:20.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68a1546f-f2ed-4d9c-b9a1-c95a95e3640d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5354175a
2021-06-04T01:39:20.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68a1546f-f2ed-4d9c-b9a1-c95a95e3640d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:39:20.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68a1546f-f2ed-4d9c-b9a1-c95a95e3640d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:39:21.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9fb9d731-68e4-4380-b2d2-cc6e4bb7f5bf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:39:21.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9fb9d731-68e4-4380-b2d2-cc6e4bb7f5bf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3bd9a90b
2021-06-04T01:39:21.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9fb9d731-68e4-4380-b2d2-cc6e4bb7f5bf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:39:21.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9fb9d731-68e4-4380-b2d2-cc6e4bb7f5bf PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:39:22.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac172764-5f59-4f12-9367-fe7b5f6b6860 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:39:22.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac172764-5f59-4f12-9367-fe7b5f6b6860 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@509072a
2021-06-04T01:39:22.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac172764-5f59-4f12-9367-fe7b5f6b6860 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:39:22.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac172764-5f59-4f12-9367-fe7b5f6b6860 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:39:24.329Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bbfe7a4-994b-4b0a-8ec3-d31faa76f39c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:39:24.329Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bbfe7a4-994b-4b0a-8ec3-d31faa76f39c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f84a40f
2021-06-04T01:39:24.329Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bbfe7a4-994b-4b0a-8ec3-d31faa76f39c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:39:24.329Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bbfe7a4-994b-4b0a-8ec3-d31faa76f39c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:39:27.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c8b3955-fe58-4e6b-85e8-32e58d420c5e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:39:27.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c8b3955-fe58-4e6b-85e8-32e58d420c5e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c999a62
2021-06-04T01:39:27.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c8b3955-fe58-4e6b-85e8-32e58d420c5e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:39:27.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c8b3955-fe58-4e6b-85e8-32e58d420c5e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:39:30.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9113bc11-7ca1-4224-abc0-6e57f37884a8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:39:30.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9113bc11-7ca1-4224-abc0-6e57f37884a8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3afef30b
2021-06-04T01:39:30.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9113bc11-7ca1-4224-abc0-6e57f37884a8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:39:30.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9113bc11-7ca1-4224-abc0-6e57f37884a8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:39:33.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92a4fe5c-8657-4c8f-acd4-ca4e6c95661a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:39:33.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92a4fe5c-8657-4c8f-acd4-ca4e6c95661a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@77838329
2021-06-04T01:39:33.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92a4fe5c-8657-4c8f-acd4-ca4e6c95661a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:39:33.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92a4fe5c-8657-4c8f-acd4-ca4e6c95661a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:39:36.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d431df26-cb8f-4440-9f70-fc3fd2ef7f5b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:39:36.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d431df26-cb8f-4440-9f70-fc3fd2ef7f5b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6dbde50a
2021-06-04T01:39:36.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d431df26-cb8f-4440-9f70-fc3fd2ef7f5b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:39:36.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d431df26-cb8f-4440-9f70-fc3fd2ef7f5b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:39:39.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f703adec-1a45-4926-b53b-7ea67f8f9f05 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:39:39.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f703adec-1a45-4926-b53b-7ea67f8f9f05 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d772855
2021-06-04T01:39:39.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f703adec-1a45-4926-b53b-7ea67f8f9f05 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:39:39.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f703adec-1a45-4926-b53b-7ea67f8f9f05 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:39:42.040Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8189823-f5c2-45b4-bec3-37e5f38c9132 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:39:42.040Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8189823-f5c2-45b4-bec3-37e5f38c9132 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@205cf85b
2021-06-04T01:39:42.040Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8189823-f5c2-45b4-bec3-37e5f38c9132 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:39:42.040Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8189823-f5c2-45b4-bec3-37e5f38c9132 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:39:45.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a65496ae-4a06-4281-a097-7b6fc91cbaef PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:39:45.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a65496ae-4a06-4281-a097-7b6fc91cbaef PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b2dbdb2
2021-06-04T01:39:45.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a65496ae-4a06-4281-a097-7b6fc91cbaef PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:39:45.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a65496ae-4a06-4281-a097-7b6fc91cbaef PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:39:48.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4dfa453f-04f1-4cc4-aaad-3700acd9b53a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:39:48.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4dfa453f-04f1-4cc4-aaad-3700acd9b53a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@493a9468
2021-06-04T01:39:48.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4dfa453f-04f1-4cc4-aaad-3700acd9b53a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:39:48.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4dfa453f-04f1-4cc4-aaad-3700acd9b53a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:39:51.056Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f53ea415-3305-4613-86da-3f6be7967018 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:39:51.056Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f53ea415-3305-4613-86da-3f6be7967018 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d5b389a
2021-06-04T01:39:51.056Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f53ea415-3305-4613-86da-3f6be7967018 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:39:51.056Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f53ea415-3305-4613-86da-3f6be7967018 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:39:54.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d4196f0-00c4-4328-abbd-a196251e5a35 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:39:54.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d4196f0-00c4-4328-abbd-a196251e5a35 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a82954a
2021-06-04T01:39:54.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d4196f0-00c4-4328-abbd-a196251e5a35 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:39:54.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d4196f0-00c4-4328-abbd-a196251e5a35 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:39:57.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=529d2814-9ea2-4ed1-8fd5-d47476acdff4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:39:57.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=529d2814-9ea2-4ed1-8fd5-d47476acdff4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7c646385
2021-06-04T01:39:57.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=529d2814-9ea2-4ed1-8fd5-d47476acdff4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:39:57.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=529d2814-9ea2-4ed1-8fd5-d47476acdff4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:40:00.288Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61815b40-d2ed-4422-b848-ebad443db77b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:40:00.288Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61815b40-d2ed-4422-b848-ebad443db77b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@61e031b5
2021-06-04T01:40:00.288Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61815b40-d2ed-4422-b848-ebad443db77b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:40:00.288Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61815b40-d2ed-4422-b848-ebad443db77b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:40:03.328Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fa09fa6-9ce6-47ae-8ba0-5c56b8c33df5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:40:03.328Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fa09fa6-9ce6-47ae-8ba0-5c56b8c33df5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@253b5afb
2021-06-04T01:40:03.328Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fa09fa6-9ce6-47ae-8ba0-5c56b8c33df5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:40:03.328Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fa09fa6-9ce6-47ae-8ba0-5c56b8c33df5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:40:06.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a8d2858-0436-416f-b30e-4c3c497ab68c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:40:06.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a8d2858-0436-416f-b30e-4c3c497ab68c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6bdda3d3
2021-06-04T01:40:06.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a8d2858-0436-416f-b30e-4c3c497ab68c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:40:06.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a8d2858-0436-416f-b30e-4c3c497ab68c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:40:09.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a6e6b45-a02b-4062-b3b4-93963fffb036 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:40:09.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a6e6b45-a02b-4062-b3b4-93963fffb036 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@347a9d66
2021-06-04T01:40:09.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a6e6b45-a02b-4062-b3b4-93963fffb036 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:40:09.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a6e6b45-a02b-4062-b3b4-93963fffb036 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:40:11.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59352e89-a2e4-457a-8788-63ffd60d5c34 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:40:11.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59352e89-a2e4-457a-8788-63ffd60d5c34 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54f77fc5
2021-06-04T01:40:11.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59352e89-a2e4-457a-8788-63ffd60d5c34 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:40:11.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59352e89-a2e4-457a-8788-63ffd60d5c34 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:40:15.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3ebf1fb-f857-4fb3-934e-7cfa35a464a8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:40:15.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3ebf1fb-f857-4fb3-934e-7cfa35a464a8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b641b22
2021-06-04T01:40:15.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3ebf1fb-f857-4fb3-934e-7cfa35a464a8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:40:15.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3ebf1fb-f857-4fb3-934e-7cfa35a464a8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:40:18.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f723613-8213-4083-9eb4-df5eb2490ac1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:40:18.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f723613-8213-4083-9eb4-df5eb2490ac1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d21e6a6
2021-06-04T01:40:18.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f723613-8213-4083-9eb4-df5eb2490ac1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:40:18.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f723613-8213-4083-9eb4-df5eb2490ac1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:40:20.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abdce83a-b03d-445f-9be3-ac2252b4d601 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:40:20.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abdce83a-b03d-445f-9be3-ac2252b4d601 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4dd0cfc9
2021-06-04T01:40:20.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abdce83a-b03d-445f-9be3-ac2252b4d601 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:40:20.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abdce83a-b03d-445f-9be3-ac2252b4d601 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:40:24.335Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=753fcf9a-de98-423c-984c-b73241bfd214 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:40:24.335Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=753fcf9a-de98-423c-984c-b73241bfd214 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@223688e1
2021-06-04T01:40:24.335Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=753fcf9a-de98-423c-984c-b73241bfd214 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:40:24.335Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=753fcf9a-de98-423c-984c-b73241bfd214 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:40:27.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5c4f113-9b76-4b91-85e3-23b3f82165f3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:40:27.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5c4f113-9b76-4b91-85e3-23b3f82165f3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29803a8e
2021-06-04T01:40:27.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5c4f113-9b76-4b91-85e3-23b3f82165f3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:40:27.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5c4f113-9b76-4b91-85e3-23b3f82165f3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:40:30.331Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ac47cd8-e336-4c05-ae43-35ad9a5f4674 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:40:30.331Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ac47cd8-e336-4c05-ae43-35ad9a5f4674 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b36fdce
2021-06-04T01:40:30.331Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ac47cd8-e336-4c05-ae43-35ad9a5f4674 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:40:30.331Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ac47cd8-e336-4c05-ae43-35ad9a5f4674 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:40:33.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e984eb89-1c98-4ae7-86ea-5c1a23b0d070 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:40:33.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e984eb89-1c98-4ae7-86ea-5c1a23b0d070 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@40d3c5e6
2021-06-04T01:40:33.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e984eb89-1c98-4ae7-86ea-5c1a23b0d070 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:40:33.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e984eb89-1c98-4ae7-86ea-5c1a23b0d070 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:40:36.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8bcebf5d-873d-4641-b7de-c61361f43009 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:40:36.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8bcebf5d-873d-4641-b7de-c61361f43009 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42ac6215
2021-06-04T01:40:36.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8bcebf5d-873d-4641-b7de-c61361f43009 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:40:36.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8bcebf5d-873d-4641-b7de-c61361f43009 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:40:37.720Z [pool-14-thread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T01:40:37.721Z [pool-14-thread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=200 TargetEntity=getTopics Connection problem towards U-EB server. Reason: 500
2021-06-04T01:40:37.721Z [pool-14-thread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine Error occured during access to U-EB Server. Operation: try retrieve list of topics from U-EB server
2021-06-04T01:40:37.724Z [pool-14-thread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine GET http://message-router.onap:3904/topics (anonymous) ...
2021-06-04T01:40:39.620Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=271e02d0-9c57-4def-ada8-540ed40804f5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:40:39.621Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=271e02d0-9c57-4def-ada8-540ed40804f5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c0e6353
2021-06-04T01:40:39.621Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=271e02d0-9c57-4def-ada8-540ed40804f5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:40:39.621Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=271e02d0-9c57-4def-ada8-540ed40804f5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:40:42.001Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=305f4d30-18b4-43c2-be88-3f24b7e66ead PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:40:42.001Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=305f4d30-18b4-43c2-be88-3f24b7e66ead PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ba9f48b
2021-06-04T01:40:42.001Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=305f4d30-18b4-43c2-be88-3f24b7e66ead PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:40:42.001Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=305f4d30-18b4-43c2-be88-3f24b7e66ead PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:40:45.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46d39f8c-d9fa-4bdd-b5d5-78bce2683bca PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:40:45.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46d39f8c-d9fa-4bdd-b5d5-78bce2683bca PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@541aa5a1
2021-06-04T01:40:45.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46d39f8c-d9fa-4bdd-b5d5-78bce2683bca PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:40:45.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46d39f8c-d9fa-4bdd-b5d5-78bce2683bca PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:40:48.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3c72e0f-ac55-4381-baed-77a2953aee30 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:40:48.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3c72e0f-ac55-4381-baed-77a2953aee30 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7587c9fd
2021-06-04T01:40:48.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3c72e0f-ac55-4381-baed-77a2953aee30 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:40:48.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3c72e0f-ac55-4381-baed-77a2953aee30 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:40:51.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60f639f3-1872-4fc2-bad1-73b51c273034 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:40:51.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60f639f3-1872-4fc2-bad1-73b51c273034 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1afc38e5
2021-06-04T01:40:51.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60f639f3-1872-4fc2-bad1-73b51c273034 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:40:51.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60f639f3-1872-4fc2-bad1-73b51c273034 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:40:54.337Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f079c966-adc5-4fff-8b2f-c3880f76683d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:40:54.337Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f079c966-adc5-4fff-8b2f-c3880f76683d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e558a9d
2021-06-04T01:40:54.337Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f079c966-adc5-4fff-8b2f-c3880f76683d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:40:54.337Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f079c966-adc5-4fff-8b2f-c3880f76683d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:40:57.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=06f76a08-8e9c-4b61-8dfc-6cb66462a486 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:40:57.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=06f76a08-8e9c-4b61-8dfc-6cb66462a486 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f63175b
2021-06-04T01:40:57.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=06f76a08-8e9c-4b61-8dfc-6cb66462a486 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:40:57.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=06f76a08-8e9c-4b61-8dfc-6cb66462a486 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:41:00.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97ea64b7-78e8-4a55-a9c8-8c69c0721f25 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:41:00.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97ea64b7-78e8-4a55-a9c8-8c69c0721f25 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7460f96b
2021-06-04T01:41:00.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97ea64b7-78e8-4a55-a9c8-8c69c0721f25 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:41:00.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97ea64b7-78e8-4a55-a9c8-8c69c0721f25 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:41:03.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b0b908f-fdb8-47cc-8ee7-661670944ad9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:41:03.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b0b908f-fdb8-47cc-8ee7-661670944ad9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@f20cc12
2021-06-04T01:41:03.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b0b908f-fdb8-47cc-8ee7-661670944ad9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:41:03.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b0b908f-fdb8-47cc-8ee7-661670944ad9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:41:06.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1088fffb-aa48-4094-a4a7-da526d75c835 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:41:06.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1088fffb-aa48-4094-a4a7-da526d75c835 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1db3be09
2021-06-04T01:41:06.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1088fffb-aa48-4094-a4a7-da526d75c835 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:41:06.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1088fffb-aa48-4094-a4a7-da526d75c835 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:41:09.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=321c09d7-dcd0-4eca-a725-a0472a6fe120 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:41:09.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=321c09d7-dcd0-4eca-a725-a0472a6fe120 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a4dab2b
2021-06-04T01:41:09.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=321c09d7-dcd0-4eca-a725-a0472a6fe120 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:41:09.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=321c09d7-dcd0-4eca-a725-a0472a6fe120 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:41:11.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2f5bdad-725a-472e-8c4d-0ff1b11ce9ab PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:41:11.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2f5bdad-725a-472e-8c4d-0ff1b11ce9ab PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4915a6a8
2021-06-04T01:41:11.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2f5bdad-725a-472e-8c4d-0ff1b11ce9ab PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:41:11.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2f5bdad-725a-472e-8c4d-0ff1b11ce9ab PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:41:15.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3bf4356-10e4-492f-b69c-0bbbb08a1ffc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:41:15.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3bf4356-10e4-492f-b69c-0bbbb08a1ffc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@40dca3c4
2021-06-04T01:41:15.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3bf4356-10e4-492f-b69c-0bbbb08a1ffc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:41:15.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3bf4356-10e4-492f-b69c-0bbbb08a1ffc PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:41:18.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=417b6944-f8d9-4685-be27-8e231a4d2d3f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:41:18.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=417b6944-f8d9-4685-be27-8e231a4d2d3f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@401f1e20
2021-06-04T01:41:18.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=417b6944-f8d9-4685-be27-8e231a4d2d3f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:41:18.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=417b6944-f8d9-4685-be27-8e231a4d2d3f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:41:21.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7efa0f1-98d6-40d3-a295-f82e934ccf14 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:41:21.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7efa0f1-98d6-40d3-a295-f82e934ccf14 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@175ce1fb
2021-06-04T01:41:21.001Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7efa0f1-98d6-40d3-a295-f82e934ccf14 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:41:21.001Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7efa0f1-98d6-40d3-a295-f82e934ccf14 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:41:24.242Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=458220e0-854e-410c-aa9c-b2816b247c6a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:41:24.242Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=458220e0-854e-410c-aa9c-b2816b247c6a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7318355e
2021-06-04T01:41:24.242Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=458220e0-854e-410c-aa9c-b2816b247c6a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:41:24.242Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=458220e0-854e-410c-aa9c-b2816b247c6a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:41:27.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8654ecac-519f-4a64-afc2-f2a4f65f163b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:41:27.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8654ecac-519f-4a64-afc2-f2a4f65f163b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e8af79c
2021-06-04T01:41:27.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8654ecac-519f-4a64-afc2-f2a4f65f163b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:41:27.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8654ecac-519f-4a64-afc2-f2a4f65f163b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:41:29.973Z [cluster2-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T01:41:29.975Z [cluster2-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 30000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T01:41:30.192Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f46af136-e149-4542-9ba5-1e5a2934cc8b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:41:30.193Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f46af136-e149-4542-9ba5-1e5a2934cc8b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c0a83d6
2021-06-04T01:41:30.193Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f46af136-e149-4542-9ba5-1e5a2934cc8b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:41:30.193Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f46af136-e149-4542-9ba5-1e5a2934cc8b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:41:33.221Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e4c1457-e504-4bf2-bc46-6a51744377a9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:41:33.221Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e4c1457-e504-4bf2-bc46-6a51744377a9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@18b1097
2021-06-04T01:41:33.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e4c1457-e504-4bf2-bc46-6a51744377a9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:41:33.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e4c1457-e504-4bf2-bc46-6a51744377a9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:41:36.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d082db2f-a3b5-4e27-96d1-cd2849c0d079 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:41:36.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d082db2f-a3b5-4e27-96d1-cd2849c0d079 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2384e5e5
2021-06-04T01:41:36.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d082db2f-a3b5-4e27-96d1-cd2849c0d079 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:41:36.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d082db2f-a3b5-4e27-96d1-cd2849c0d079 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:41:39.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42c16435-4ff6-4c6d-9caa-a577276e65be PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:41:39.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42c16435-4ff6-4c6d-9caa-a577276e65be PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6afbd01e
2021-06-04T01:41:39.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42c16435-4ff6-4c6d-9caa-a577276e65be PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:41:39.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42c16435-4ff6-4c6d-9caa-a577276e65be PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:41:42.046Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4acfa644-dda9-42f2-b2a4-ac814ab1d231 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:41:42.046Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4acfa644-dda9-42f2-b2a4-ac814ab1d231 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1297eaa4
2021-06-04T01:41:42.046Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4acfa644-dda9-42f2-b2a4-ac814ab1d231 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:41:42.046Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4acfa644-dda9-42f2-b2a4-ac814ab1d231 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:41:45.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df94b53e-aa15-43c6-a997-41a4a85f92ac PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:41:45.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df94b53e-aa15-43c6-a997-41a4a85f92ac PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b415fc9
2021-06-04T01:41:45.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df94b53e-aa15-43c6-a997-41a4a85f92ac PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:41:45.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df94b53e-aa15-43c6-a997-41a4a85f92ac PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:41:48.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85648ba6-322b-409c-b9a2-a7b3c843991a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:41:48.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85648ba6-322b-409c-b9a2-a7b3c843991a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f6e3089
2021-06-04T01:41:48.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85648ba6-322b-409c-b9a2-a7b3c843991a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:41:48.585Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85648ba6-322b-409c-b9a2-a7b3c843991a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:41:50.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44ac72f0-2a5b-43fc-9998-8944d734e482 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:41:50.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44ac72f0-2a5b-43fc-9998-8944d734e482 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b21725a
2021-06-04T01:41:50.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44ac72f0-2a5b-43fc-9998-8944d734e482 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:41:50.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44ac72f0-2a5b-43fc-9998-8944d734e482 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:41:54.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22b348e7-ec2d-42d6-8371-fd4c2c1ff7ed PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:41:54.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22b348e7-ec2d-42d6-8371-fd4c2c1ff7ed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@56ce6550
2021-06-04T01:41:54.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22b348e7-ec2d-42d6-8371-fd4c2c1ff7ed PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:41:54.231Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22b348e7-ec2d-42d6-8371-fd4c2c1ff7ed PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:41:57.569Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b5e9531-1b59-4043-a6de-5ca64b12d5c3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:41:57.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b5e9531-1b59-4043-a6de-5ca64b12d5c3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1730d757
2021-06-04T01:41:57.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b5e9531-1b59-4043-a6de-5ca64b12d5c3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:41:57.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b5e9531-1b59-4043-a6de-5ca64b12d5c3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:42:00.281Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c8be1d9d-678b-49ed-8d0a-76a39063376e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:42:00.281Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c8be1d9d-678b-49ed-8d0a-76a39063376e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29645740
2021-06-04T01:42:00.281Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c8be1d9d-678b-49ed-8d0a-76a39063376e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:42:00.281Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c8be1d9d-678b-49ed-8d0a-76a39063376e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:42:03.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e92cf60e-5979-4100-9c94-3ed2d0b18190 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:42:03.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e92cf60e-5979-4100-9c94-3ed2d0b18190 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@59274394
2021-06-04T01:42:03.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e92cf60e-5979-4100-9c94-3ed2d0b18190 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:42:03.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e92cf60e-5979-4100-9c94-3ed2d0b18190 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:42:06.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96ae271d-0b12-4618-8195-17f5df7d683e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:42:06.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96ae271d-0b12-4618-8195-17f5df7d683e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7c665905
2021-06-04T01:42:06.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96ae271d-0b12-4618-8195-17f5df7d683e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:42:06.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96ae271d-0b12-4618-8195-17f5df7d683e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:42:09.415Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f44d6a5-1136-4c9c-be8b-548ac13750b1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:42:09.415Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f44d6a5-1136-4c9c-be8b-548ac13750b1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6dfdb3b1
2021-06-04T01:42:09.415Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f44d6a5-1136-4c9c-be8b-548ac13750b1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:42:09.415Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f44d6a5-1136-4c9c-be8b-548ac13750b1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:42:11.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15d16fdf-8af5-4f0a-a013-43d60fd90dc0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:42:11.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15d16fdf-8af5-4f0a-a013-43d60fd90dc0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@66283719
2021-06-04T01:42:11.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15d16fdf-8af5-4f0a-a013-43d60fd90dc0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:42:11.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15d16fdf-8af5-4f0a-a013-43d60fd90dc0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:42:15.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d9b72a7-f562-4940-84bf-5eadfc2ecb01 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:42:15.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d9b72a7-f562-4940-84bf-5eadfc2ecb01 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f0e3ab
2021-06-04T01:42:15.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d9b72a7-f562-4940-84bf-5eadfc2ecb01 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:42:15.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d9b72a7-f562-4940-84bf-5eadfc2ecb01 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:42:18.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ec318f6-b9e6-4514-b268-59ec2acaf91d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:42:18.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ec318f6-b9e6-4514-b268-59ec2acaf91d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b102c61
2021-06-04T01:42:18.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ec318f6-b9e6-4514-b268-59ec2acaf91d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:42:18.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ec318f6-b9e6-4514-b268-59ec2acaf91d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:42:21.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59b5092a-24c0-4944-80f4-81a25c5c5812 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:42:21.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59b5092a-24c0-4944-80f4-81a25c5c5812 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4bf06e89
2021-06-04T01:42:21.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59b5092a-24c0-4944-80f4-81a25c5c5812 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:42:21.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59b5092a-24c0-4944-80f4-81a25c5c5812 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:42:24.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=653d8a71-5b86-4f23-b022-db32702c1cfc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:42:24.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=653d8a71-5b86-4f23-b022-db32702c1cfc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c470811
2021-06-04T01:42:24.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=653d8a71-5b86-4f23-b022-db32702c1cfc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:42:24.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=653d8a71-5b86-4f23-b022-db32702c1cfc PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:42:27.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7776a040-e63b-4d75-811b-bd9b3845d241 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:42:27.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7776a040-e63b-4d75-811b-bd9b3845d241 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ea85389
2021-06-04T01:42:27.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7776a040-e63b-4d75-811b-bd9b3845d241 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:42:27.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7776a040-e63b-4d75-811b-bd9b3845d241 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:42:30.367Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5dfbce41-402e-4a2f-b178-0b30eef0a949 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:42:30.367Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5dfbce41-402e-4a2f-b178-0b30eef0a949 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@24910919
2021-06-04T01:42:30.367Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5dfbce41-402e-4a2f-b178-0b30eef0a949 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:42:30.367Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5dfbce41-402e-4a2f-b178-0b30eef0a949 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:42:33.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a212ea09-1a6a-405b-bab2-d524b0139169 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:42:33.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a212ea09-1a6a-405b-bab2-d524b0139169 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6cddaf24
2021-06-04T01:42:33.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a212ea09-1a6a-405b-bab2-d524b0139169 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:42:33.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a212ea09-1a6a-405b-bab2-d524b0139169 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:42:36.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e2aac45-7370-4747-93d9-16969c22ef26 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:42:36.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e2aac45-7370-4747-93d9-16969c22ef26 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@388e352e
2021-06-04T01:42:36.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e2aac45-7370-4747-93d9-16969c22ef26 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:42:36.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e2aac45-7370-4747-93d9-16969c22ef26 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:42:39.428Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa792942-7a7f-49ea-a8ed-6ec8fe49768f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:42:39.428Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa792942-7a7f-49ea-a8ed-6ec8fe49768f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@14960dad
2021-06-04T01:42:39.428Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa792942-7a7f-49ea-a8ed-6ec8fe49768f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:42:39.428Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa792942-7a7f-49ea-a8ed-6ec8fe49768f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:42:42.009Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=205b288d-2fe6-46c2-8ad4-6365781d5771 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:42:42.009Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=205b288d-2fe6-46c2-8ad4-6365781d5771 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38e307e7
2021-06-04T01:42:42.009Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=205b288d-2fe6-46c2-8ad4-6365781d5771 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:42:42.009Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=205b288d-2fe6-46c2-8ad4-6365781d5771 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:42:45.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff85c1ee-696e-468c-ba7c-124fd235a649 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:42:45.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff85c1ee-696e-468c-ba7c-124fd235a649 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@39462b50
2021-06-04T01:42:45.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff85c1ee-696e-468c-ba7c-124fd235a649 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:42:45.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff85c1ee-696e-468c-ba7c-124fd235a649 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:42:48.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09a69456-e894-487f-b5e1-c6ed20395836 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:42:48.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09a69456-e894-487f-b5e1-c6ed20395836 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@70a84e13
2021-06-04T01:42:48.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09a69456-e894-487f-b5e1-c6ed20395836 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:42:48.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09a69456-e894-487f-b5e1-c6ed20395836 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:42:48.793Z [pool-14-thread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T01:42:48.794Z [pool-14-thread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=200 TargetEntity=getTopics Connection problem towards U-EB server. Reason: 500
2021-06-04T01:42:48.794Z [pool-14-thread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine Error occured during access to U-EB Server. Operation: try retrieve list of topics from U-EB server
2021-06-04T01:42:48.799Z [pool-14-thread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine GET http://message-router.onap:3904/topics (anonymous) ...
2021-06-04T01:42:51.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70642fa4-2664-4cc5-9aca-e4fbb4881241 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:42:51.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70642fa4-2664-4cc5-9aca-e4fbb4881241 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5477cece
2021-06-04T01:42:51.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70642fa4-2664-4cc5-9aca-e4fbb4881241 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:42:51.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70642fa4-2664-4cc5-9aca-e4fbb4881241 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:42:54.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=088f608c-9eeb-4eb5-b577-cd880ee15ba8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:42:54.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=088f608c-9eeb-4eb5-b577-cd880ee15ba8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@748b3798
2021-06-04T01:42:54.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=088f608c-9eeb-4eb5-b577-cd880ee15ba8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:42:54.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=088f608c-9eeb-4eb5-b577-cd880ee15ba8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:42:57.476Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64f3a6b4-5319-45c4-b193-6c5d99e54a86 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:42:57.476Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64f3a6b4-5319-45c4-b193-6c5d99e54a86 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7c9f9ef2
2021-06-04T01:42:57.476Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64f3a6b4-5319-45c4-b193-6c5d99e54a86 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:42:57.477Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64f3a6b4-5319-45c4-b193-6c5d99e54a86 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:43:00.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=363871f5-a4e4-464a-b390-01752650de42 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:43:00.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=363871f5-a4e4-464a-b390-01752650de42 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ef58fa4
2021-06-04T01:43:00.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=363871f5-a4e4-464a-b390-01752650de42 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:43:00.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=363871f5-a4e4-464a-b390-01752650de42 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:43:03.243Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd3a7995-dad5-4c57-b429-27936238f342 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:43:03.243Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd3a7995-dad5-4c57-b429-27936238f342 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@249e390a
2021-06-04T01:43:03.243Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd3a7995-dad5-4c57-b429-27936238f342 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:43:03.244Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd3a7995-dad5-4c57-b429-27936238f342 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:43:06.673Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bbb567b-21bd-4463-858e-fb97e90085a9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:43:06.673Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bbb567b-21bd-4463-858e-fb97e90085a9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@904fdf6
2021-06-04T01:43:06.673Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bbb567b-21bd-4463-858e-fb97e90085a9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:43:06.673Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bbb567b-21bd-4463-858e-fb97e90085a9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:43:09.677Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29e7d67c-b4a8-4c77-84ea-2e74440952bf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:43:09.677Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29e7d67c-b4a8-4c77-84ea-2e74440952bf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@96c8a2a
2021-06-04T01:43:09.677Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29e7d67c-b4a8-4c77-84ea-2e74440952bf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:43:09.677Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29e7d67c-b4a8-4c77-84ea-2e74440952bf PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:43:12.053Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1fed5348-6a6b-4e57-ade2-78d3217b3e65 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:43:12.053Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1fed5348-6a6b-4e57-ade2-78d3217b3e65 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b06bc0c
2021-06-04T01:43:12.053Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1fed5348-6a6b-4e57-ade2-78d3217b3e65 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:43:12.053Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1fed5348-6a6b-4e57-ade2-78d3217b3e65 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:43:15.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5118f8e2-0d4d-48c6-b3a8-cb988039ecb7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:43:15.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5118f8e2-0d4d-48c6-b3a8-cb988039ecb7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e858e0f
2021-06-04T01:43:15.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5118f8e2-0d4d-48c6-b3a8-cb988039ecb7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:43:15.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5118f8e2-0d4d-48c6-b3a8-cb988039ecb7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:43:18.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9309975-790c-4f2c-acee-301cf293524d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:43:18.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9309975-790c-4f2c-acee-301cf293524d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@10c03f64
2021-06-04T01:43:18.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9309975-790c-4f2c-acee-301cf293524d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:43:18.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9309975-790c-4f2c-acee-301cf293524d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:43:21.001Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b117a58-ee00-4c36-8076-b4d9fffdadee PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:43:21.001Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b117a58-ee00-4c36-8076-b4d9fffdadee PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d10da8c
2021-06-04T01:43:21.001Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b117a58-ee00-4c36-8076-b4d9fffdadee PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:43:21.001Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b117a58-ee00-4c36-8076-b4d9fffdadee PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:43:24.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0990dd2-f520-4bfb-8a4d-5554f4f31b9f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:43:24.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0990dd2-f520-4bfb-8a4d-5554f4f31b9f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23a8fffe
2021-06-04T01:43:24.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0990dd2-f520-4bfb-8a4d-5554f4f31b9f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:43:24.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0990dd2-f520-4bfb-8a4d-5554f4f31b9f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:43:27.614Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=796217dc-f2f3-4089-81e1-80df7a9f813b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:43:27.614Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=796217dc-f2f3-4089-81e1-80df7a9f813b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@31cfe872
2021-06-04T01:43:27.614Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=796217dc-f2f3-4089-81e1-80df7a9f813b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:43:27.615Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=796217dc-f2f3-4089-81e1-80df7a9f813b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:43:30.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b056723c-ec0e-429c-b4b7-767e7aafed02 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:43:30.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b056723c-ec0e-429c-b4b7-767e7aafed02 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20e5ca30
2021-06-04T01:43:30.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b056723c-ec0e-429c-b4b7-767e7aafed02 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:43:30.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b056723c-ec0e-429c-b4b7-767e7aafed02 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:43:33.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86fe522d-e9e2-4257-b937-5422de8d6e5a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:43:33.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86fe522d-e9e2-4257-b937-5422de8d6e5a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b5ab01a
2021-06-04T01:43:33.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86fe522d-e9e2-4257-b937-5422de8d6e5a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:43:33.240Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86fe522d-e9e2-4257-b937-5422de8d6e5a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:43:36.388Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7a8337a-6871-4225-87ba-d155715bd91b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:43:36.388Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7a8337a-6871-4225-87ba-d155715bd91b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3fe9e380
2021-06-04T01:43:36.388Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7a8337a-6871-4225-87ba-d155715bd91b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:43:36.388Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7a8337a-6871-4225-87ba-d155715bd91b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:43:39.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61f32f3c-a7db-4c73-a849-b0149d54504a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:43:39.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61f32f3c-a7db-4c73-a849-b0149d54504a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@712b0077
2021-06-04T01:43:39.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61f32f3c-a7db-4c73-a849-b0149d54504a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:43:39.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61f32f3c-a7db-4c73-a849-b0149d54504a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:43:42.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b8fa7c8-ac82-49dd-b08a-13d546a823dd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:43:42.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b8fa7c8-ac82-49dd-b08a-13d546a823dd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f91e028
2021-06-04T01:43:42.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b8fa7c8-ac82-49dd-b08a-13d546a823dd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:43:42.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b8fa7c8-ac82-49dd-b08a-13d546a823dd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:43:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1385657a-89db-4b51-9ad9-3145fae35e50 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:43:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1385657a-89db-4b51-9ad9-3145fae35e50 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71c545a0
2021-06-04T01:43:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1385657a-89db-4b51-9ad9-3145fae35e50 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:43:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1385657a-89db-4b51-9ad9-3145fae35e50 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:43:48.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12a2cfed-0b67-4c92-b16b-57bba46015e8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:43:48.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12a2cfed-0b67-4c92-b16b-57bba46015e8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c05dfb
2021-06-04T01:43:48.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12a2cfed-0b67-4c92-b16b-57bba46015e8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:43:48.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12a2cfed-0b67-4c92-b16b-57bba46015e8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:43:50.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f729c99f-7724-4a63-b150-fa45635003f4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:43:50.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f729c99f-7724-4a63-b150-fa45635003f4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2841dd0c
2021-06-04T01:43:50.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f729c99f-7724-4a63-b150-fa45635003f4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:43:50.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f729c99f-7724-4a63-b150-fa45635003f4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:43:54.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c80329d7-0450-4436-ac33-d7560ee63b78 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:43:54.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c80329d7-0450-4436-ac33-d7560ee63b78 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58a1e88c
2021-06-04T01:43:54.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c80329d7-0450-4436-ac33-d7560ee63b78 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:43:54.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c80329d7-0450-4436-ac33-d7560ee63b78 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:43:57.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e6b5615-9404-46d6-9f7e-fc4a47378522 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:43:57.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e6b5615-9404-46d6-9f7e-fc4a47378522 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3124e7d
2021-06-04T01:43:57.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e6b5615-9404-46d6-9f7e-fc4a47378522 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:43:57.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e6b5615-9404-46d6-9f7e-fc4a47378522 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:44:00.272Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81b9e0df-d051-4514-a63f-5347f8610bd5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:44:00.272Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81b9e0df-d051-4514-a63f-5347f8610bd5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@bee461
2021-06-04T01:44:00.273Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81b9e0df-d051-4514-a63f-5347f8610bd5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:44:00.273Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81b9e0df-d051-4514-a63f-5347f8610bd5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:44:03.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0cd4da4d-f8b6-406e-8d99-ec8eb3ffc10f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:44:03.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0cd4da4d-f8b6-406e-8d99-ec8eb3ffc10f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2631e0c7
2021-06-04T01:44:03.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0cd4da4d-f8b6-406e-8d99-ec8eb3ffc10f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:44:03.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0cd4da4d-f8b6-406e-8d99-ec8eb3ffc10f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:44:06.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=337bb1e4-e265-439e-acb6-190d8c767485 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:44:06.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=337bb1e4-e265-439e-acb6-190d8c767485 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71839905
2021-06-04T01:44:06.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=337bb1e4-e265-439e-acb6-190d8c767485 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:44:06.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=337bb1e4-e265-439e-acb6-190d8c767485 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:44:09.636Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c260dddf-ba62-45b2-86e6-9224c2d7485d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:44:09.636Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c260dddf-ba62-45b2-86e6-9224c2d7485d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@607340ee
2021-06-04T01:44:09.636Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c260dddf-ba62-45b2-86e6-9224c2d7485d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:44:09.636Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c260dddf-ba62-45b2-86e6-9224c2d7485d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:44:12.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b915913-6198-4c42-ac6b-9711688f893e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:44:12.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b915913-6198-4c42-ac6b-9711688f893e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17993d6d
2021-06-04T01:44:12.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b915913-6198-4c42-ac6b-9711688f893e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:44:12.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b915913-6198-4c42-ac6b-9711688f893e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:44:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c0eb18b-cdfd-4522-8ba8-fad6c0e980da PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:44:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c0eb18b-cdfd-4522-8ba8-fad6c0e980da PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e87d081
2021-06-04T01:44:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c0eb18b-cdfd-4522-8ba8-fad6c0e980da PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:44:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c0eb18b-cdfd-4522-8ba8-fad6c0e980da PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:44:18.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d90ad7b0-5355-403b-9acb-8f2140469db8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:44:18.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d90ad7b0-5355-403b-9acb-8f2140469db8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53212de5
2021-06-04T01:44:18.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d90ad7b0-5355-403b-9acb-8f2140469db8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:44:18.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d90ad7b0-5355-403b-9acb-8f2140469db8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:44:21.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6725e1f1-da12-4149-a7b9-b11279660628 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:44:21.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6725e1f1-da12-4149-a7b9-b11279660628 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29af735f
2021-06-04T01:44:21.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6725e1f1-da12-4149-a7b9-b11279660628 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:44:21.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6725e1f1-da12-4149-a7b9-b11279660628 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:44:24.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=775791dc-2701-4737-954b-a956cdf29d4d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:44:24.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=775791dc-2701-4737-954b-a956cdf29d4d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@77035152
2021-06-04T01:44:24.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=775791dc-2701-4737-954b-a956cdf29d4d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:44:24.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=775791dc-2701-4737-954b-a956cdf29d4d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:44:27.480Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbe729ef-ada7-4fae-b81a-0858957330c0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:44:27.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbe729ef-ada7-4fae-b81a-0858957330c0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@770094eb
2021-06-04T01:44:27.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbe729ef-ada7-4fae-b81a-0858957330c0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:44:27.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbe729ef-ada7-4fae-b81a-0858957330c0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:44:30.297Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6d69688-05a0-4035-9d92-87f906053f6f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:44:30.297Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6d69688-05a0-4035-9d92-87f906053f6f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d94c1eb
2021-06-04T01:44:30.297Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6d69688-05a0-4035-9d92-87f906053f6f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:44:30.297Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6d69688-05a0-4035-9d92-87f906053f6f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:44:33.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76cdfd86-4cec-4490-a4ea-fa9de3517273 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:44:33.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76cdfd86-4cec-4490-a4ea-fa9de3517273 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ff37a8d
2021-06-04T01:44:33.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76cdfd86-4cec-4490-a4ea-fa9de3517273 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:44:33.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76cdfd86-4cec-4490-a4ea-fa9de3517273 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:44:36.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1fbd3540-b6a5-4921-976c-f61953460e81 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:44:36.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1fbd3540-b6a5-4921-976c-f61953460e81 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@12973de0
2021-06-04T01:44:36.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1fbd3540-b6a5-4921-976c-f61953460e81 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:44:36.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1fbd3540-b6a5-4921-976c-f61953460e81 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:44:39.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74845bd7-6ea1-453d-8a93-15b62b536c41 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:44:39.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74845bd7-6ea1-453d-8a93-15b62b536c41 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@61c34495
2021-06-04T01:44:39.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74845bd7-6ea1-453d-8a93-15b62b536c41 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:44:39.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74845bd7-6ea1-453d-8a93-15b62b536c41 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:44:42.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92c0da5e-3613-4f02-a4fd-21584bdf9b7a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:44:42.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92c0da5e-3613-4f02-a4fd-21584bdf9b7a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ad34adf
2021-06-04T01:44:42.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92c0da5e-3613-4f02-a4fd-21584bdf9b7a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:44:42.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92c0da5e-3613-4f02-a4fd-21584bdf9b7a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:44:45.420Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92f081a9-a44e-4b5f-b0b2-430d242d86b4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:44:45.420Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92f081a9-a44e-4b5f-b0b2-430d242d86b4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e10621a
2021-06-04T01:44:45.420Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92f081a9-a44e-4b5f-b0b2-430d242d86b4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:44:45.420Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92f081a9-a44e-4b5f-b0b2-430d242d86b4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:44:48.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=448cf46e-7555-4706-98bf-6e52142338fd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:44:48.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=448cf46e-7555-4706-98bf-6e52142338fd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@25432605
2021-06-04T01:44:48.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=448cf46e-7555-4706-98bf-6e52142338fd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:44:48.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=448cf46e-7555-4706-98bf-6e52142338fd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:44:51.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c404950-2fc0-4f90-b2f7-c660bb01fc07 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:44:51.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c404950-2fc0-4f90-b2f7-c660bb01fc07 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5edf29d4
2021-06-04T01:44:51.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c404950-2fc0-4f90-b2f7-c660bb01fc07 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:44:51.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c404950-2fc0-4f90-b2f7-c660bb01fc07 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:44:54.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23798c7d-b1cf-4831-8942-71db62efe5a7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:44:54.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23798c7d-b1cf-4831-8942-71db62efe5a7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e2a1562
2021-06-04T01:44:54.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23798c7d-b1cf-4831-8942-71db62efe5a7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:44:54.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23798c7d-b1cf-4831-8942-71db62efe5a7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:44:57.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f84302b-d76e-468e-a6eb-12cf1b2f6858 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:44:57.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f84302b-d76e-468e-a6eb-12cf1b2f6858 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23a7a20f
2021-06-04T01:44:57.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f84302b-d76e-468e-a6eb-12cf1b2f6858 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:44:57.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f84302b-d76e-468e-a6eb-12cf1b2f6858 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:44:59.865Z [pool-14-thread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T01:44:59.866Z [pool-14-thread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=200 TargetEntity=getTopics Connection problem towards U-EB server. Reason: 500
2021-06-04T01:44:59.866Z [pool-14-thread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine Error occured during access to U-EB Server. Operation: try retrieve list of topics from U-EB server
2021-06-04T01:44:59.872Z [pool-14-thread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine GET http://message-router.onap:3904/topics (anonymous) ...
2021-06-04T01:45:00.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9031b74-ff7c-4314-97d9-39bd0034cc5a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:45:00.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9031b74-ff7c-4314-97d9-39bd0034cc5a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1fe8cb70
2021-06-04T01:45:00.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9031b74-ff7c-4314-97d9-39bd0034cc5a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:45:00.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9031b74-ff7c-4314-97d9-39bd0034cc5a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:45:03.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb2185e2-c6f9-486b-a7b5-6cde5f1da868 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:45:03.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb2185e2-c6f9-486b-a7b5-6cde5f1da868 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38dec0d0
2021-06-04T01:45:03.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb2185e2-c6f9-486b-a7b5-6cde5f1da868 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:45:03.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb2185e2-c6f9-486b-a7b5-6cde5f1da868 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:45:06.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b42c322-e1eb-4550-aa64-0bfe31ef8155 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:45:06.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b42c322-e1eb-4550-aa64-0bfe31ef8155 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@462143ac
2021-06-04T01:45:06.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b42c322-e1eb-4550-aa64-0bfe31ef8155 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:45:06.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b42c322-e1eb-4550-aa64-0bfe31ef8155 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:45:09.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d2c7ba4-b753-4e2f-a18d-2975559f300a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:45:09.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d2c7ba4-b753-4e2f-a18d-2975559f300a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@580826bd
2021-06-04T01:45:09.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d2c7ba4-b753-4e2f-a18d-2975559f300a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:45:09.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d2c7ba4-b753-4e2f-a18d-2975559f300a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:45:12.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0b22f14-9554-459f-9f2e-e80385ed3a4a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:45:12.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0b22f14-9554-459f-9f2e-e80385ed3a4a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@162c587
2021-06-04T01:45:12.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0b22f14-9554-459f-9f2e-e80385ed3a4a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:45:12.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0b22f14-9554-459f-9f2e-e80385ed3a4a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:45:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e6f8342-e093-4bfe-b327-792415b7834c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:45:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e6f8342-e093-4bfe-b327-792415b7834c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f745d3b
2021-06-04T01:45:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e6f8342-e093-4bfe-b327-792415b7834c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:45:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e6f8342-e093-4bfe-b327-792415b7834c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:45:18.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e039a30-34ae-4428-86f3-d08341a76bbe PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:45:18.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e039a30-34ae-4428-86f3-d08341a76bbe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3045b5a
2021-06-04T01:45:18.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e039a30-34ae-4428-86f3-d08341a76bbe PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:45:18.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e039a30-34ae-4428-86f3-d08341a76bbe PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:45:20.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f6205ff-90f1-4070-9e8c-227deea919a4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:45:20.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f6205ff-90f1-4070-9e8c-227deea919a4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1aa0b849
2021-06-04T01:45:20.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f6205ff-90f1-4070-9e8c-227deea919a4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:45:20.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f6205ff-90f1-4070-9e8c-227deea919a4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:45:24.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f41fbc00-c628-4bf8-9ec9-9cecee69896b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:45:24.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f41fbc00-c628-4bf8-9ec9-9cecee69896b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@df90867
2021-06-04T01:45:24.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f41fbc00-c628-4bf8-9ec9-9cecee69896b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:45:24.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f41fbc00-c628-4bf8-9ec9-9cecee69896b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:45:27.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed151f03-665f-4ade-a1a8-99acb7388cbd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:45:27.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed151f03-665f-4ade-a1a8-99acb7388cbd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60091166
2021-06-04T01:45:27.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed151f03-665f-4ade-a1a8-99acb7388cbd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:45:27.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed151f03-665f-4ade-a1a8-99acb7388cbd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:45:30.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19415a4c-0a0e-4946-bdc8-c888ffd679df PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:45:30.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19415a4c-0a0e-4946-bdc8-c888ffd679df PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@417648b6
2021-06-04T01:45:30.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19415a4c-0a0e-4946-bdc8-c888ffd679df PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:45:30.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19415a4c-0a0e-4946-bdc8-c888ffd679df PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:45:33.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a20d5fdf-06da-4fd1-89ba-57c29cffd187 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:45:33.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a20d5fdf-06da-4fd1-89ba-57c29cffd187 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@33def39e
2021-06-04T01:45:33.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a20d5fdf-06da-4fd1-89ba-57c29cffd187 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:45:33.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a20d5fdf-06da-4fd1-89ba-57c29cffd187 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:45:36.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=862d5533-0867-4786-a4cd-3f596f3efb4a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:45:36.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=862d5533-0867-4786-a4cd-3f596f3efb4a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@409e3eab
2021-06-04T01:45:36.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=862d5533-0867-4786-a4cd-3f596f3efb4a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:45:36.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=862d5533-0867-4786-a4cd-3f596f3efb4a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:45:39.579Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4bef3116-8aa4-4030-9c3f-a52b22f1d0a9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:45:39.579Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4bef3116-8aa4-4030-9c3f-a52b22f1d0a9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4004e653
2021-06-04T01:45:39.579Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4bef3116-8aa4-4030-9c3f-a52b22f1d0a9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:45:39.579Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4bef3116-8aa4-4030-9c3f-a52b22f1d0a9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:45:42.059Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f527fe8-65d3-4db1-99b2-24eeb0704c2a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:45:42.059Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f527fe8-65d3-4db1-99b2-24eeb0704c2a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7954fc0f
2021-06-04T01:45:42.059Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f527fe8-65d3-4db1-99b2-24eeb0704c2a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:45:42.060Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f527fe8-65d3-4db1-99b2-24eeb0704c2a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:45:45.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e608c40-548a-4f5d-8371-c184fc96367d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:45:45.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e608c40-548a-4f5d-8371-c184fc96367d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3dd2b2b8
2021-06-04T01:45:45.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e608c40-548a-4f5d-8371-c184fc96367d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:45:45.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e608c40-548a-4f5d-8371-c184fc96367d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:45:48.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0eec968b-33a8-4fe0-8e46-e75e284328b5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:45:48.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0eec968b-33a8-4fe0-8e46-e75e284328b5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@c08a8cf
2021-06-04T01:45:48.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0eec968b-33a8-4fe0-8e46-e75e284328b5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:45:48.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0eec968b-33a8-4fe0-8e46-e75e284328b5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:45:50.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b125a3f1-d7c3-4dae-938c-2559faf614e6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:45:50.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b125a3f1-d7c3-4dae-938c-2559faf614e6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6bd9e163
2021-06-04T01:45:50.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b125a3f1-d7c3-4dae-938c-2559faf614e6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:45:50.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b125a3f1-d7c3-4dae-938c-2559faf614e6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:45:54.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2d50c40-419e-44c8-aaf5-9dccbc0315f7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:45:54.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2d50c40-419e-44c8-aaf5-9dccbc0315f7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35b3cc93
2021-06-04T01:45:54.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2d50c40-419e-44c8-aaf5-9dccbc0315f7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:45:54.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2d50c40-419e-44c8-aaf5-9dccbc0315f7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:45:57.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ee7eacb-5cd7-42c3-a0ac-bc91e7bbc920 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:45:57.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ee7eacb-5cd7-42c3-a0ac-bc91e7bbc920 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ddcffef
2021-06-04T01:45:57.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ee7eacb-5cd7-42c3-a0ac-bc91e7bbc920 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:45:57.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ee7eacb-5cd7-42c3-a0ac-bc91e7bbc920 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:46:00.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0108fc4-3765-4fd5-83d7-fb35b7c6d611 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:46:00.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0108fc4-3765-4fd5-83d7-fb35b7c6d611 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54db624b
2021-06-04T01:46:00.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0108fc4-3765-4fd5-83d7-fb35b7c6d611 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:46:00.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0108fc4-3765-4fd5-83d7-fb35b7c6d611 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:46:03.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf28f95b-e422-418d-8a59-ff3e4390871f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:46:03.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf28f95b-e422-418d-8a59-ff3e4390871f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@702d434a
2021-06-04T01:46:03.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf28f95b-e422-418d-8a59-ff3e4390871f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:46:03.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf28f95b-e422-418d-8a59-ff3e4390871f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:46:06.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=383fd5f5-6fcf-4300-ba1b-b817cd201273 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:46:06.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=383fd5f5-6fcf-4300-ba1b-b817cd201273 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b51ce88
2021-06-04T01:46:06.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=383fd5f5-6fcf-4300-ba1b-b817cd201273 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:46:06.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=383fd5f5-6fcf-4300-ba1b-b817cd201273 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:46:09.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=879b34aa-396a-46a6-9c2e-6ac3d52d6d0b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:46:09.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=879b34aa-396a-46a6-9c2e-6ac3d52d6d0b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2188718a
2021-06-04T01:46:09.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=879b34aa-396a-46a6-9c2e-6ac3d52d6d0b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:46:09.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=879b34aa-396a-46a6-9c2e-6ac3d52d6d0b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:46:12.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93947b40-e753-469d-b3dc-f2121c6f84e4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:46:12.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93947b40-e753-469d-b3dc-f2121c6f84e4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ece86ca
2021-06-04T01:46:12.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93947b40-e753-469d-b3dc-f2121c6f84e4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:46:12.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93947b40-e753-469d-b3dc-f2121c6f84e4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:46:15.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34a4988b-ac79-4834-8594-6048005588f0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:46:15.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34a4988b-ac79-4834-8594-6048005588f0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34e3b74a
2021-06-04T01:46:15.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34a4988b-ac79-4834-8594-6048005588f0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:46:15.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34a4988b-ac79-4834-8594-6048005588f0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:46:18.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7261014f-62f7-47c3-b06e-03d273c41cb5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:46:18.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7261014f-62f7-47c3-b06e-03d273c41cb5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@61930ad0
2021-06-04T01:46:18.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7261014f-62f7-47c3-b06e-03d273c41cb5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:46:18.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7261014f-62f7-47c3-b06e-03d273c41cb5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:46:21.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a49c7d1-4df3-4076-975c-66c559d4d2a8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:46:21.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a49c7d1-4df3-4076-975c-66c559d4d2a8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f53349
2021-06-04T01:46:21.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a49c7d1-4df3-4076-975c-66c559d4d2a8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:46:21.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a49c7d1-4df3-4076-975c-66c559d4d2a8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:46:24.322Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f8d3621-c278-4963-ae07-ac8c364bd5dc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:46:24.322Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f8d3621-c278-4963-ae07-ac8c364bd5dc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@59d70d2b
2021-06-04T01:46:24.322Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f8d3621-c278-4963-ae07-ac8c364bd5dc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:46:24.322Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f8d3621-c278-4963-ae07-ac8c364bd5dc PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:46:27.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d63fc74-05cf-42c9-afc4-645fea4b921a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:46:27.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d63fc74-05cf-42c9-afc4-645fea4b921a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7027b8bc
2021-06-04T01:46:27.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d63fc74-05cf-42c9-afc4-645fea4b921a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:46:27.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d63fc74-05cf-42c9-afc4-645fea4b921a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:46:30.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=551ad7f1-6359-4e34-bcc1-5e0472aa191f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:46:30.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=551ad7f1-6359-4e34-bcc1-5e0472aa191f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@99be9e2
2021-06-04T01:46:30.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=551ad7f1-6359-4e34-bcc1-5e0472aa191f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:46:30.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=551ad7f1-6359-4e34-bcc1-5e0472aa191f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:46:33.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2173e830-572c-415a-a8a2-301a1d81426d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:46:33.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2173e830-572c-415a-a8a2-301a1d81426d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23deece3
2021-06-04T01:46:33.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2173e830-572c-415a-a8a2-301a1d81426d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:46:33.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2173e830-572c-415a-a8a2-301a1d81426d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:46:36.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=641cf304-830b-46c3-b35a-8a746ea1b7e5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:46:36.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=641cf304-830b-46c3-b35a-8a746ea1b7e5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@428113e6
2021-06-04T01:46:36.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=641cf304-830b-46c3-b35a-8a746ea1b7e5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:46:36.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=641cf304-830b-46c3-b35a-8a746ea1b7e5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:46:39.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d545273-9a8a-462a-bbb9-67d58dd867e5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:46:39.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d545273-9a8a-462a-bbb9-67d58dd867e5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@faea152
2021-06-04T01:46:39.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d545273-9a8a-462a-bbb9-67d58dd867e5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:46:39.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d545273-9a8a-462a-bbb9-67d58dd867e5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:46:42.049Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7cf99d2-37e2-4979-8b18-67061dfa22ac PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:46:42.049Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7cf99d2-37e2-4979-8b18-67061dfa22ac PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@592c9dbc
2021-06-04T01:46:42.049Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7cf99d2-37e2-4979-8b18-67061dfa22ac PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:46:42.049Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7cf99d2-37e2-4979-8b18-67061dfa22ac PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:46:45.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fe3ba65-2a3f-4521-b91b-43210c164642 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:46:45.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fe3ba65-2a3f-4521-b91b-43210c164642 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@dc1cb8e
2021-06-04T01:46:45.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fe3ba65-2a3f-4521-b91b-43210c164642 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:46:45.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fe3ba65-2a3f-4521-b91b-43210c164642 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:46:48.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0889d56e-8fa3-47fc-a9b5-ff497e33c23b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:46:48.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0889d56e-8fa3-47fc-a9b5-ff497e33c23b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4795e7f3
2021-06-04T01:46:48.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0889d56e-8fa3-47fc-a9b5-ff497e33c23b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:46:48.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0889d56e-8fa3-47fc-a9b5-ff497e33c23b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:46:51.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e660a827-b272-4422-8096-2dfda242a7b8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:46:51.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e660a827-b272-4422-8096-2dfda242a7b8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3dcb6a62
2021-06-04T01:46:51.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e660a827-b272-4422-8096-2dfda242a7b8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:46:51.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e660a827-b272-4422-8096-2dfda242a7b8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:46:54.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8892c60-12a3-4c3f-8409-49703f951a36 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:46:54.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8892c60-12a3-4c3f-8409-49703f951a36 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b7d11a
2021-06-04T01:46:54.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8892c60-12a3-4c3f-8409-49703f951a36 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:46:54.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8892c60-12a3-4c3f-8409-49703f951a36 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:46:57.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0bf464f-1dfd-4a48-8821-b6a4bbd3ef8a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:46:57.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0bf464f-1dfd-4a48-8821-b6a4bbd3ef8a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a9e739
2021-06-04T01:46:57.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0bf464f-1dfd-4a48-8821-b6a4bbd3ef8a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:46:57.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0bf464f-1dfd-4a48-8821-b6a4bbd3ef8a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:47:00.276Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b02ac6c2-390c-4fc9-9ee7-c04b99c90631 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:47:00.276Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b02ac6c2-390c-4fc9-9ee7-c04b99c90631 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b6b32c0
2021-06-04T01:47:00.276Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b02ac6c2-390c-4fc9-9ee7-c04b99c90631 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:47:00.276Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b02ac6c2-390c-4fc9-9ee7-c04b99c90631 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:47:03.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09982907-3b54-44fa-bda1-da19211a37a6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:47:03.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09982907-3b54-44fa-bda1-da19211a37a6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d95ddb5
2021-06-04T01:47:03.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09982907-3b54-44fa-bda1-da19211a37a6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:47:03.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09982907-3b54-44fa-bda1-da19211a37a6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:47:06.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5fb95297-47b3-4bc1-acfa-b9e56bf6597a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:47:06.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5fb95297-47b3-4bc1-acfa-b9e56bf6597a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3394e21c
2021-06-04T01:47:06.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5fb95297-47b3-4bc1-acfa-b9e56bf6597a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:47:06.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5fb95297-47b3-4bc1-acfa-b9e56bf6597a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:47:09.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8efdcec1-fd3d-42ae-b109-2a87f18c2ace PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:47:09.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8efdcec1-fd3d-42ae-b109-2a87f18c2ace PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f485b78
2021-06-04T01:47:09.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8efdcec1-fd3d-42ae-b109-2a87f18c2ace PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:47:09.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8efdcec1-fd3d-42ae-b109-2a87f18c2ace PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:47:10.937Z [pool-14-thread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T01:47:10.938Z [pool-14-thread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=200 TargetEntity=getTopics Connection problem towards U-EB server. Reason: 500
2021-06-04T01:47:10.938Z [pool-14-thread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine Error occured during access to U-EB Server. Operation: try retrieve list of topics from U-EB server
2021-06-04T01:47:10.944Z [pool-14-thread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine GET http://message-router.onap:3904/topics (anonymous) ...
2021-06-04T01:47:12.058Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6328814-9763-4d5b-9325-e92989a2fc8d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:47:12.058Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6328814-9763-4d5b-9325-e92989a2fc8d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4d879b63
2021-06-04T01:47:12.058Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6328814-9763-4d5b-9325-e92989a2fc8d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:47:12.058Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6328814-9763-4d5b-9325-e92989a2fc8d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:47:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e38e9bd-55eb-47cd-ae9d-cfb9f76cb0b2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:47:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e38e9bd-55eb-47cd-ae9d-cfb9f76cb0b2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e5c9f13
2021-06-04T01:47:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e38e9bd-55eb-47cd-ae9d-cfb9f76cb0b2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:47:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e38e9bd-55eb-47cd-ae9d-cfb9f76cb0b2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:47:18.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f6776fb-4f61-4042-8aba-1d593f624c20 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:47:18.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f6776fb-4f61-4042-8aba-1d593f624c20 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a4c04c6
2021-06-04T01:47:18.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f6776fb-4f61-4042-8aba-1d593f624c20 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:47:18.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f6776fb-4f61-4042-8aba-1d593f624c20 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:47:20.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b7cbdde-8ba1-4528-ab4d-f6708b64eeda PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:47:20.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b7cbdde-8ba1-4528-ab4d-f6708b64eeda PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47e2036c
2021-06-04T01:47:20.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b7cbdde-8ba1-4528-ab4d-f6708b64eeda PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:47:20.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b7cbdde-8ba1-4528-ab4d-f6708b64eeda PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:47:24.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b6c0c01-db3d-4748-98bf-17026e422828 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:47:24.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b6c0c01-db3d-4748-98bf-17026e422828 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@36cfd470
2021-06-04T01:47:24.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b6c0c01-db3d-4748-98bf-17026e422828 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:47:24.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b6c0c01-db3d-4748-98bf-17026e422828 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:47:27.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ff1c728-865b-4da2-b55a-9f47f3604e5f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:47:27.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ff1c728-865b-4da2-b55a-9f47f3604e5f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c6171bd
2021-06-04T01:47:27.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ff1c728-865b-4da2-b55a-9f47f3604e5f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:47:27.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ff1c728-865b-4da2-b55a-9f47f3604e5f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:47:30.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afd61eb6-cbf8-4f01-9e4d-b1ca8c54f4bf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:47:30.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afd61eb6-cbf8-4f01-9e4d-b1ca8c54f4bf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@261128c3
2021-06-04T01:47:30.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afd61eb6-cbf8-4f01-9e4d-b1ca8c54f4bf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:47:30.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afd61eb6-cbf8-4f01-9e4d-b1ca8c54f4bf PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:47:33.325Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08ff40d0-081d-4a12-915d-4708aa7da3dd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:47:33.325Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08ff40d0-081d-4a12-915d-4708aa7da3dd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71bfb60e
2021-06-04T01:47:33.325Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08ff40d0-081d-4a12-915d-4708aa7da3dd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:47:33.325Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08ff40d0-081d-4a12-915d-4708aa7da3dd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:47:36.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05655730-2f32-4d5e-b956-80be5abd0fe3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:47:36.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05655730-2f32-4d5e-b956-80be5abd0fe3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@399b801d
2021-06-04T01:47:36.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05655730-2f32-4d5e-b956-80be5abd0fe3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:47:36.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05655730-2f32-4d5e-b956-80be5abd0fe3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:47:39.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82abcfd1-41b1-4be0-8240-74a3865bfbc8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:47:39.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82abcfd1-41b1-4be0-8240-74a3865bfbc8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e40f20a
2021-06-04T01:47:39.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82abcfd1-41b1-4be0-8240-74a3865bfbc8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:47:39.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82abcfd1-41b1-4be0-8240-74a3865bfbc8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:47:41.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09706dfa-4736-41f8-bb9c-a7d61f787291 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:47:41.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09706dfa-4736-41f8-bb9c-a7d61f787291 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@21b89431
2021-06-04T01:47:41.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09706dfa-4736-41f8-bb9c-a7d61f787291 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:47:41.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09706dfa-4736-41f8-bb9c-a7d61f787291 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:47:45.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e81c3412-d941-4db4-9339-2c7a2123c181 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:47:45.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e81c3412-d941-4db4-9339-2c7a2123c181 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d3b49ce
2021-06-04T01:47:45.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e81c3412-d941-4db4-9339-2c7a2123c181 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:47:45.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e81c3412-d941-4db4-9339-2c7a2123c181 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:47:48.579Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f03692a-24f2-4187-b590-afc26c14cb3b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:47:48.579Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f03692a-24f2-4187-b590-afc26c14cb3b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4845bf1c
2021-06-04T01:47:48.579Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f03692a-24f2-4187-b590-afc26c14cb3b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:47:48.579Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f03692a-24f2-4187-b590-afc26c14cb3b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:47:51.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7856e82b-c4c9-4a7a-ae07-25e3b763e013 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:47:51.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7856e82b-c4c9-4a7a-ae07-25e3b763e013 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@419cd4bc
2021-06-04T01:47:51.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7856e82b-c4c9-4a7a-ae07-25e3b763e013 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:47:51.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7856e82b-c4c9-4a7a-ae07-25e3b763e013 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:47:54.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fb644da-c27f-45e0-9255-af8eb0c5c269 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:47:54.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fb644da-c27f-45e0-9255-af8eb0c5c269 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@24e0c9a2
2021-06-04T01:47:54.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fb644da-c27f-45e0-9255-af8eb0c5c269 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:47:54.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fb644da-c27f-45e0-9255-af8eb0c5c269 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:47:57.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6336337c-3ff8-463e-a492-5abb4030fed0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:47:57.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6336337c-3ff8-463e-a492-5abb4030fed0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@536291c9
2021-06-04T01:47:57.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6336337c-3ff8-463e-a492-5abb4030fed0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:47:57.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6336337c-3ff8-463e-a492-5abb4030fed0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:48:00.291Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e059972-2c44-4e23-8e15-a6dda0bbdd0e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:48:00.291Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e059972-2c44-4e23-8e15-a6dda0bbdd0e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@363a79e6
2021-06-04T01:48:00.292Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e059972-2c44-4e23-8e15-a6dda0bbdd0e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:48:00.292Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e059972-2c44-4e23-8e15-a6dda0bbdd0e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:48:03.331Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d72d6282-b3ed-42e8-9b4f-c4f5be0faab5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:48:03.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d72d6282-b3ed-42e8-9b4f-c4f5be0faab5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@112462a9
2021-06-04T01:48:03.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d72d6282-b3ed-42e8-9b4f-c4f5be0faab5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:48:03.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d72d6282-b3ed-42e8-9b4f-c4f5be0faab5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:48:06.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=701f0b45-f52c-4f36-ab52-5942ac2fe439 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:48:06.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=701f0b45-f52c-4f36-ab52-5942ac2fe439 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@332b04f6
2021-06-04T01:48:06.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=701f0b45-f52c-4f36-ab52-5942ac2fe439 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:48:06.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=701f0b45-f52c-4f36-ab52-5942ac2fe439 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:48:09.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a330c9a-4e46-486f-8cd4-59852317e8fe PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:48:09.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a330c9a-4e46-486f-8cd4-59852317e8fe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74803783
2021-06-04T01:48:09.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a330c9a-4e46-486f-8cd4-59852317e8fe PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:48:09.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a330c9a-4e46-486f-8cd4-59852317e8fe PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:48:12.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40a984bd-8b3c-4fad-a483-e21d25989242 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:48:12.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40a984bd-8b3c-4fad-a483-e21d25989242 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@111085bc
2021-06-04T01:48:12.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40a984bd-8b3c-4fad-a483-e21d25989242 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:48:12.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40a984bd-8b3c-4fad-a483-e21d25989242 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:48:15.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf89c89c-b24a-4862-84ce-c9eb001158c7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:48:15.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf89c89c-b24a-4862-84ce-c9eb001158c7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23939c1d
2021-06-04T01:48:15.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf89c89c-b24a-4862-84ce-c9eb001158c7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:48:15.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf89c89c-b24a-4862-84ce-c9eb001158c7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:48:18.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14c8ddc8-9a34-4ff6-9896-743387138e8c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:48:18.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14c8ddc8-9a34-4ff6-9896-743387138e8c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@48f4302d
2021-06-04T01:48:18.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14c8ddc8-9a34-4ff6-9896-743387138e8c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:48:18.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14c8ddc8-9a34-4ff6-9896-743387138e8c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:48:20.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6964495-e7f1-403f-b63e-22fb856e60e9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:48:20.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6964495-e7f1-403f-b63e-22fb856e60e9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3dbd3a9f
2021-06-04T01:48:20.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6964495-e7f1-403f-b63e-22fb856e60e9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:48:20.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6964495-e7f1-403f-b63e-22fb856e60e9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:48:24.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8af0506-2d6b-42ed-959d-7871030921f9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:48:24.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8af0506-2d6b-42ed-959d-7871030921f9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@281575f1
2021-06-04T01:48:24.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8af0506-2d6b-42ed-959d-7871030921f9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:48:24.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8af0506-2d6b-42ed-959d-7871030921f9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:48:27.488Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dad1a4f7-5460-4417-b01b-3ec4bb8dcf0c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:48:27.488Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dad1a4f7-5460-4417-b01b-3ec4bb8dcf0c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1759779a
2021-06-04T01:48:27.488Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dad1a4f7-5460-4417-b01b-3ec4bb8dcf0c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:48:27.488Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dad1a4f7-5460-4417-b01b-3ec4bb8dcf0c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:48:30.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5b02709-3466-4e59-8677-188ba0738c58 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:48:30.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5b02709-3466-4e59-8677-188ba0738c58 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e455804
2021-06-04T01:48:30.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5b02709-3466-4e59-8677-188ba0738c58 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:48:30.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5b02709-3466-4e59-8677-188ba0738c58 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:48:33.335Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6446f2e0-29bc-48c6-8916-c39fe8f4147a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:48:33.335Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6446f2e0-29bc-48c6-8916-c39fe8f4147a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a78fc91
2021-06-04T01:48:33.335Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6446f2e0-29bc-48c6-8916-c39fe8f4147a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:48:33.335Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6446f2e0-29bc-48c6-8916-c39fe8f4147a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:48:36.475Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65175df4-9f22-4614-aceb-311860601520 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:48:36.475Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65175df4-9f22-4614-aceb-311860601520 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2941bed2
2021-06-04T01:48:36.475Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65175df4-9f22-4614-aceb-311860601520 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:48:36.475Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65175df4-9f22-4614-aceb-311860601520 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:48:39.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e55698bb-0c1d-4895-83ed-b4237ee776f7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:48:39.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e55698bb-0c1d-4895-83ed-b4237ee776f7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7578e9c7
2021-06-04T01:48:39.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e55698bb-0c1d-4895-83ed-b4237ee776f7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:48:39.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e55698bb-0c1d-4895-83ed-b4237ee776f7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:48:42.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1dbd03b-a7e9-4cae-aa7b-2acda9ecd9c2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:48:42.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1dbd03b-a7e9-4cae-aa7b-2acda9ecd9c2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@21a91a14
2021-06-04T01:48:42.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1dbd03b-a7e9-4cae-aa7b-2acda9ecd9c2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:48:42.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1dbd03b-a7e9-4cae-aa7b-2acda9ecd9c2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:48:45.520Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=98ac29e9-892b-44b5-91e0-751a4c6352f6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:48:45.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=98ac29e9-892b-44b5-91e0-751a4c6352f6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4cd8f6c4
2021-06-04T01:48:45.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=98ac29e9-892b-44b5-91e0-751a4c6352f6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:48:45.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=98ac29e9-892b-44b5-91e0-751a4c6352f6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:48:48.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97b6b29e-90f7-40d3-9195-122b890da63d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:48:48.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97b6b29e-90f7-40d3-9195-122b890da63d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68cb76a3
2021-06-04T01:48:48.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97b6b29e-90f7-40d3-9195-122b890da63d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:48:48.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97b6b29e-90f7-40d3-9195-122b890da63d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:48:50.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a02f4f9a-dc8e-42a8-b01b-374452cf4aca PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:48:50.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a02f4f9a-dc8e-42a8-b01b-374452cf4aca PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a4f9cac
2021-06-04T01:48:50.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a02f4f9a-dc8e-42a8-b01b-374452cf4aca PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:48:50.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a02f4f9a-dc8e-42a8-b01b-374452cf4aca PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:48:54.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95da55f6-5fdf-479a-a70a-b43ef19d92f5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:48:54.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95da55f6-5fdf-479a-a70a-b43ef19d92f5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@335f444b
2021-06-04T01:48:54.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95da55f6-5fdf-479a-a70a-b43ef19d92f5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:48:54.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95da55f6-5fdf-479a-a70a-b43ef19d92f5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:48:57.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e545d519-63d3-4e03-a75d-01f32213fc84 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:48:57.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e545d519-63d3-4e03-a75d-01f32213fc84 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@383aea32
2021-06-04T01:48:57.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e545d519-63d3-4e03-a75d-01f32213fc84 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:48:57.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e545d519-63d3-4e03-a75d-01f32213fc84 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:49:00.271Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc163226-40d2-428b-ae69-cf4cc898202c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:49:00.271Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc163226-40d2-428b-ae69-cf4cc898202c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b77edf8
2021-06-04T01:49:00.271Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc163226-40d2-428b-ae69-cf4cc898202c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:49:00.271Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc163226-40d2-428b-ae69-cf4cc898202c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:49:03.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8a8f87d-e4aa-4b65-9f8f-7dba361ed705 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:49:03.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8a8f87d-e4aa-4b65-9f8f-7dba361ed705 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d7baac6
2021-06-04T01:49:03.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8a8f87d-e4aa-4b65-9f8f-7dba361ed705 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:49:03.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8a8f87d-e4aa-4b65-9f8f-7dba361ed705 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:49:06.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24b03947-b8ad-49a4-ac12-2c940ae5a326 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:49:06.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24b03947-b8ad-49a4-ac12-2c940ae5a326 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@644fce3e
2021-06-04T01:49:06.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24b03947-b8ad-49a4-ac12-2c940ae5a326 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:49:06.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24b03947-b8ad-49a4-ac12-2c940ae5a326 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:49:09.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff699eab-b4a9-425a-a2a0-958dc6462dfd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:49:09.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff699eab-b4a9-425a-a2a0-958dc6462dfd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b4bd3ff
2021-06-04T01:49:09.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff699eab-b4a9-425a-a2a0-958dc6462dfd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:49:09.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff699eab-b4a9-425a-a2a0-958dc6462dfd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:49:12.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=969656df-6605-46ad-8d5f-0b632d9f521b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:49:12.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=969656df-6605-46ad-8d5f-0b632d9f521b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f67e743
2021-06-04T01:49:12.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=969656df-6605-46ad-8d5f-0b632d9f521b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:49:12.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=969656df-6605-46ad-8d5f-0b632d9f521b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:49:15.615Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b19b6dcc-a12c-44ac-bd82-ee587fad907c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:49:15.615Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b19b6dcc-a12c-44ac-bd82-ee587fad907c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4fba57f3
2021-06-04T01:49:15.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b19b6dcc-a12c-44ac-bd82-ee587fad907c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:49:15.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b19b6dcc-a12c-44ac-bd82-ee587fad907c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:49:18.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=521c63e9-5c7d-4d62-9ac4-b39e55078e35 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:49:18.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=521c63e9-5c7d-4d62-9ac4-b39e55078e35 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@559e4e04
2021-06-04T01:49:18.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=521c63e9-5c7d-4d62-9ac4-b39e55078e35 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:49:18.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=521c63e9-5c7d-4d62-9ac4-b39e55078e35 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:49:21.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e7d8f0d-eda5-4882-a932-9037e0054abb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:49:21.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e7d8f0d-eda5-4882-a932-9037e0054abb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1fab63
2021-06-04T01:49:21.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e7d8f0d-eda5-4882-a932-9037e0054abb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:49:21.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e7d8f0d-eda5-4882-a932-9037e0054abb PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:49:22.009Z [pool-14-thread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T01:49:22.011Z [pool-14-thread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=200 TargetEntity=getTopics Connection problem towards U-EB server. Reason: 500
2021-06-04T01:49:22.011Z [pool-14-thread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine Error occured during access to U-EB Server. Operation: try retrieve list of topics from U-EB server
2021-06-04T01:49:22.021Z [pool-14-thread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine GET http://message-router.onap:3904/topics (anonymous) ...
2021-06-04T01:49:24.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59de8567-0b82-4e49-bf9c-52abe552dc24 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:49:24.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59de8567-0b82-4e49-bf9c-52abe552dc24 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4219dc
2021-06-04T01:49:24.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59de8567-0b82-4e49-bf9c-52abe552dc24 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:49:24.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59de8567-0b82-4e49-bf9c-52abe552dc24 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:49:27.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=324a113d-e210-4169-b59a-eabe66f6a6ae PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:49:27.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=324a113d-e210-4169-b59a-eabe66f6a6ae PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d5ac3e8
2021-06-04T01:49:27.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=324a113d-e210-4169-b59a-eabe66f6a6ae PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:49:27.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=324a113d-e210-4169-b59a-eabe66f6a6ae PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:49:30.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95b2388d-60d0-49af-be21-e298b34aa164 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:49:30.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95b2388d-60d0-49af-be21-e298b34aa164 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a935029
2021-06-04T01:49:30.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95b2388d-60d0-49af-be21-e298b34aa164 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:49:30.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95b2388d-60d0-49af-be21-e298b34aa164 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:49:33.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=119afcc4-9a8e-4349-bd49-5e22ea73e83d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:49:33.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=119afcc4-9a8e-4349-bd49-5e22ea73e83d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47aab0ab
2021-06-04T01:49:33.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=119afcc4-9a8e-4349-bd49-5e22ea73e83d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:49:33.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=119afcc4-9a8e-4349-bd49-5e22ea73e83d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:49:36.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=142e06cd-221e-4cc7-959d-87d43068b70d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:49:36.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=142e06cd-221e-4cc7-959d-87d43068b70d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57b6dd7b
2021-06-04T01:49:36.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=142e06cd-221e-4cc7-959d-87d43068b70d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:49:36.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=142e06cd-221e-4cc7-959d-87d43068b70d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:49:39.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0277a362-1252-4c72-aaf6-f57e9b7f1d13 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:49:39.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0277a362-1252-4c72-aaf6-f57e9b7f1d13 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1cb811e6
2021-06-04T01:49:39.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0277a362-1252-4c72-aaf6-f57e9b7f1d13 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:49:39.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0277a362-1252-4c72-aaf6-f57e9b7f1d13 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:49:42.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b0dad83-f067-4a80-a3bb-48f9edc3385d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:49:42.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b0dad83-f067-4a80-a3bb-48f9edc3385d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c8a1840
2021-06-04T01:49:42.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b0dad83-f067-4a80-a3bb-48f9edc3385d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:49:42.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b0dad83-f067-4a80-a3bb-48f9edc3385d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:49:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23f14ee9-3fef-492c-a256-a32b653e83d5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:49:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23f14ee9-3fef-492c-a256-a32b653e83d5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e37d892
2021-06-04T01:49:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23f14ee9-3fef-492c-a256-a32b653e83d5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:49:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23f14ee9-3fef-492c-a256-a32b653e83d5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:49:48.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd6e62cc-78bc-435c-9e51-9052d1aaeb80 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:49:48.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd6e62cc-78bc-435c-9e51-9052d1aaeb80 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f8b952a
2021-06-04T01:49:48.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd6e62cc-78bc-435c-9e51-9052d1aaeb80 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:49:48.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd6e62cc-78bc-435c-9e51-9052d1aaeb80 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:49:50.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a97acc3-3278-4ce6-90bf-63948288bdc3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:49:50.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a97acc3-3278-4ce6-90bf-63948288bdc3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@13608a1c
2021-06-04T01:49:50.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a97acc3-3278-4ce6-90bf-63948288bdc3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:49:50.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a97acc3-3278-4ce6-90bf-63948288bdc3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:49:54.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea610fce-c52d-4fed-992b-da42906ff073 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:49:54.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea610fce-c52d-4fed-992b-da42906ff073 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f44c828
2021-06-04T01:49:54.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea610fce-c52d-4fed-992b-da42906ff073 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:49:54.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea610fce-c52d-4fed-992b-da42906ff073 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:49:57.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be9896d9-1cab-4c3b-8fbd-caf6ff7e3297 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:49:57.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be9896d9-1cab-4c3b-8fbd-caf6ff7e3297 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6fa76c1a
2021-06-04T01:49:57.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be9896d9-1cab-4c3b-8fbd-caf6ff7e3297 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:49:57.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be9896d9-1cab-4c3b-8fbd-caf6ff7e3297 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:50:00.294Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a0066a3-f16a-4454-a2c7-725543ff7956 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:50:00.294Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a0066a3-f16a-4454-a2c7-725543ff7956 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7c969601
2021-06-04T01:50:00.294Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a0066a3-f16a-4454-a2c7-725543ff7956 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:50:00.294Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a0066a3-f16a-4454-a2c7-725543ff7956 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:50:00.322Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=7a0066a3-f16a-4454-a2c7-725543ff7956 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connection reset
2021-06-04T01:50:00.324Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=7a0066a3-f16a-4454-a2c7-725543ff7956 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connection reset
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: javax.net.ssl.SSLException: Connection reset
at java.base/sun.security.ssl.Alert.createSSLException(Unknown Source)
at java.base/sun.security.ssl.TransportContext.fatal(Unknown Source)
at java.base/sun.security.ssl.TransportContext.fatal(Unknown Source)
at java.base/sun.security.ssl.TransportContext.fatal(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.handleException(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Suppressed: java.net.SocketException: Broken pipe (Write failed)
at java.base/java.net.SocketOutputStream.socketWrite0(Native Method)
at java.base/java.net.SocketOutputStream.socketWrite(Unknown Source)
at java.base/java.net.SocketOutputStream.write(Unknown Source)
at java.base/sun.security.ssl.SSLSocketOutputRecord.encodeAlert(Unknown Source)
... 35 common frames omitted
Caused by: java.net.SocketException: Connection reset
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
... 31 common frames omitted
2021-06-04T01:50:03.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c89a39f-d0e4-4258-a468-d7f2fbfe9173 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:50:03.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c89a39f-d0e4-4258-a468-d7f2fbfe9173 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@32ed5323
2021-06-04T01:50:03.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c89a39f-d0e4-4258-a468-d7f2fbfe9173 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:50:03.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c89a39f-d0e4-4258-a468-d7f2fbfe9173 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:50:03.423Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8c89a39f-d0e4-4258-a468-d7f2fbfe9173 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T01:50:03.423Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8c89a39f-d0e4-4258-a468-d7f2fbfe9173 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:50:06.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9788f51d-d4ed-47e3-bbe7-b510e470c696 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:50:06.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9788f51d-d4ed-47e3-bbe7-b510e470c696 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e908a98
2021-06-04T01:50:06.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9788f51d-d4ed-47e3-bbe7-b510e470c696 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:50:06.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9788f51d-d4ed-47e3-bbe7-b510e470c696 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:50:06.475Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=9788f51d-d4ed-47e3-bbe7-b510e470c696 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T01:50:06.475Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=9788f51d-d4ed-47e3-bbe7-b510e470c696 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:50:09.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=614208b5-cd84-412f-b0b6-07a45cbe03a1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:50:09.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=614208b5-cd84-412f-b0b6-07a45cbe03a1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1377fc47
2021-06-04T01:50:09.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=614208b5-cd84-412f-b0b6-07a45cbe03a1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:50:09.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=614208b5-cd84-412f-b0b6-07a45cbe03a1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:50:12.429Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=614208b5-cd84-412f-b0b6-07a45cbe03a1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:50:12.429Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=614208b5-cd84-412f-b0b6-07a45cbe03a1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:50:12.719Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2337fa2-86ea-4354-8870-8ca1c42a03b7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:50:12.719Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2337fa2-86ea-4354-8870-8ca1c42a03b7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e869640
2021-06-04T01:50:12.719Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2337fa2-86ea-4354-8870-8ca1c42a03b7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:50:12.719Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2337fa2-86ea-4354-8870-8ca1c42a03b7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:50:15.730Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=c2337fa2-86ea-4354-8870-8ca1c42a03b7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:50:15.731Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=c2337fa2-86ea-4354-8870-8ca1c42a03b7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:50:16.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60fa5d4a-7b6c-455e-820e-2cf49f7840bd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:50:16.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60fa5d4a-7b6c-455e-820e-2cf49f7840bd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17a3b64e
2021-06-04T01:50:16.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60fa5d4a-7b6c-455e-820e-2cf49f7840bd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:50:16.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60fa5d4a-7b6c-455e-820e-2cf49f7840bd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:50:19.396Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=60fa5d4a-7b6c-455e-820e-2cf49f7840bd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:50:19.396Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=60fa5d4a-7b6c-455e-820e-2cf49f7840bd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:50:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c269002c-bf11-43b1-bb47-3a866da6943d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:50:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c269002c-bf11-43b1-bb47-3a866da6943d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49e1d46a
2021-06-04T01:50:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c269002c-bf11-43b1-bb47-3a866da6943d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:50:19.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c269002c-bf11-43b1-bb47-3a866da6943d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:50:22.928Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=c269002c-bf11-43b1-bb47-3a866da6943d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:50:22.928Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=c269002c-bf11-43b1-bb47-3a866da6943d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:50:23.322Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=176c3426-6703-4ee4-8885-f2b6904cac60 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:50:23.322Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=176c3426-6703-4ee4-8885-f2b6904cac60 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f0991c2
2021-06-04T01:50:23.322Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=176c3426-6703-4ee4-8885-f2b6904cac60 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:50:23.322Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=176c3426-6703-4ee4-8885-f2b6904cac60 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:50:26.337Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=176c3426-6703-4ee4-8885-f2b6904cac60 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:50:26.337Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=176c3426-6703-4ee4-8885-f2b6904cac60 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:50:27.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d900cab-2049-4725-bb05-06251eda05b1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:50:27.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d900cab-2049-4725-bb05-06251eda05b1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@400d2fbd
2021-06-04T01:50:27.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d900cab-2049-4725-bb05-06251eda05b1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:50:27.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d900cab-2049-4725-bb05-06251eda05b1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:50:30.085Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=7d900cab-2049-4725-bb05-06251eda05b1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:50:30.086Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=7d900cab-2049-4725-bb05-06251eda05b1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:50:30.403Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8af8c35-829a-498c-9dab-94482f194a82 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:50:30.403Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8af8c35-829a-498c-9dab-94482f194a82 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@14dbb872
2021-06-04T01:50:30.403Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8af8c35-829a-498c-9dab-94482f194a82 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:50:30.403Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8af8c35-829a-498c-9dab-94482f194a82 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:50:33.416Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=b8af8c35-829a-498c-9dab-94482f194a82 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:50:33.416Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=b8af8c35-829a-498c-9dab-94482f194a82 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:50:33.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf3db2ae-04de-45d6-8f4a-b923475814d9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:50:33.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf3db2ae-04de-45d6-8f4a-b923475814d9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d873bc3
2021-06-04T01:50:33.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf3db2ae-04de-45d6-8f4a-b923475814d9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:50:33.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf3db2ae-04de-45d6-8f4a-b923475814d9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:50:36.930Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=cf3db2ae-04de-45d6-8f4a-b923475814d9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T01:50:36.931Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=cf3db2ae-04de-45d6-8f4a-b923475814d9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T01:50:37.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd54cd0f-b88e-4bc1-b7a4-4462544b8d2a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:50:37.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd54cd0f-b88e-4bc1-b7a4-4462544b8d2a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e65a309
2021-06-04T01:50:37.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd54cd0f-b88e-4bc1-b7a4-4462544b8d2a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:50:37.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd54cd0f-b88e-4bc1-b7a4-4462544b8d2a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:50:42.225Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=fd54cd0f-b88e-4bc1-b7a4-4462544b8d2a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:50:42.226Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=fd54cd0f-b88e-4bc1-b7a4-4462544b8d2a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:50:42.357Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05d50adc-8b59-4555-a06d-69b0f9326edd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:50:42.357Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05d50adc-8b59-4555-a06d-69b0f9326edd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a37b454
2021-06-04T01:50:42.357Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05d50adc-8b59-4555-a06d-69b0f9326edd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:50:42.357Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05d50adc-8b59-4555-a06d-69b0f9326edd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:50:45.423Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=05d50adc-8b59-4555-a06d-69b0f9326edd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:50:45.424Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=05d50adc-8b59-4555-a06d-69b0f9326edd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:50:46.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebde79c7-09de-414a-864f-66e316678357 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:50:46.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebde79c7-09de-414a-864f-66e316678357 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ad354c7
2021-06-04T01:50:46.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebde79c7-09de-414a-864f-66e316678357 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:50:46.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebde79c7-09de-414a-864f-66e316678357 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:50:49.085Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ebde79c7-09de-414a-864f-66e316678357 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:50:49.085Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ebde79c7-09de-414a-864f-66e316678357 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:50:49.674Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b83a9de9-b76f-4c5b-8182-c8be3c0efbb7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:50:49.674Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b83a9de9-b76f-4c5b-8182-c8be3c0efbb7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@352858a2
2021-06-04T01:50:49.675Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b83a9de9-b76f-4c5b-8182-c8be3c0efbb7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:50:49.675Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b83a9de9-b76f-4c5b-8182-c8be3c0efbb7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:50:52.737Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=b83a9de9-b76f-4c5b-8182-c8be3c0efbb7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:50:52.738Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=b83a9de9-b76f-4c5b-8182-c8be3c0efbb7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:50:53.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=021d9ad0-8d91-4ffa-8c74-9bcbad7d1617 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:50:53.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=021d9ad0-8d91-4ffa-8c74-9bcbad7d1617 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@521f2bb0
2021-06-04T01:50:53.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=021d9ad0-8d91-4ffa-8c74-9bcbad7d1617 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:50:53.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=021d9ad0-8d91-4ffa-8c74-9bcbad7d1617 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:50:56.206Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=021d9ad0-8d91-4ffa-8c74-9bcbad7d1617 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:50:56.206Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=021d9ad0-8d91-4ffa-8c74-9bcbad7d1617 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:50:56.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc258570-f54e-482f-9773-7c63d5505f73 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:50:56.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc258570-f54e-482f-9773-7c63d5505f73 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2146c260
2021-06-04T01:50:56.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc258570-f54e-482f-9773-7c63d5505f73 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:50:56.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc258570-f54e-482f-9773-7c63d5505f73 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:50:59.924Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=cc258570-f54e-482f-9773-7c63d5505f73 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:50:59.924Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=cc258570-f54e-482f-9773-7c63d5505f73 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:51:00.292Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7412d4c-dd2d-4607-86a5-36a361d22899 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:51:00.292Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7412d4c-dd2d-4607-86a5-36a361d22899 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9040bd0
2021-06-04T01:51:00.292Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7412d4c-dd2d-4607-86a5-36a361d22899 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:51:00.292Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7412d4c-dd2d-4607-86a5-36a361d22899 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:51:02.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f05fa07-56ef-411e-a441-b9d59f588750 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:51:02.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f05fa07-56ef-411e-a441-b9d59f588750 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2bc55976
2021-06-04T01:51:02.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f05fa07-56ef-411e-a441-b9d59f588750 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:51:02.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f05fa07-56ef-411e-a441-b9d59f588750 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:51:02.147Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fcab3e46-1b12-403c-a16c-719a08ca3bc8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:51:02.147Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fcab3e46-1b12-403c-a16c-719a08ca3bc8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@665153de
2021-06-04T01:51:02.147Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fcab3e46-1b12-403c-a16c-719a08ca3bc8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:51:02.147Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fcab3e46-1b12-403c-a16c-719a08ca3bc8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:51:02.346Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96c2c891-33c7-41a5-bd3d-d3bf786cf5d6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:51:02.346Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96c2c891-33c7-41a5-bd3d-d3bf786cf5d6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f228e4f
2021-06-04T01:51:02.346Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96c2c891-33c7-41a5-bd3d-d3bf786cf5d6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:51:02.346Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96c2c891-33c7-41a5-bd3d-d3bf786cf5d6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:51:03.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8bc42aea-595c-4474-8f8d-ae2652e8b17c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:51:03.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8bc42aea-595c-4474-8f8d-ae2652e8b17c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4d6da396
2021-06-04T01:51:03.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8bc42aea-595c-4474-8f8d-ae2652e8b17c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:51:03.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8bc42aea-595c-4474-8f8d-ae2652e8b17c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:51:06.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1e084dc-5db8-478a-8679-432fbeeb9ae3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:51:06.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1e084dc-5db8-478a-8679-432fbeeb9ae3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ce24da4
2021-06-04T01:51:06.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1e084dc-5db8-478a-8679-432fbeeb9ae3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:51:06.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1e084dc-5db8-478a-8679-432fbeeb9ae3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:51:09.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c7b9c41-583e-42c5-8561-ce7ba2133419 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:51:09.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c7b9c41-583e-42c5-8561-ce7ba2133419 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20c13845
2021-06-04T01:51:09.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c7b9c41-583e-42c5-8561-ce7ba2133419 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:51:09.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c7b9c41-583e-42c5-8561-ce7ba2133419 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:51:11.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f83cd2c-a6d0-4508-a00e-c196b370bda2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:51:11.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f83cd2c-a6d0-4508-a00e-c196b370bda2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7bca9ae4
2021-06-04T01:51:11.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f83cd2c-a6d0-4508-a00e-c196b370bda2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:51:11.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f83cd2c-a6d0-4508-a00e-c196b370bda2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:51:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54beda95-0e1f-427a-baaa-970867a90042 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:51:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54beda95-0e1f-427a-baaa-970867a90042 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b9bf718
2021-06-04T01:51:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54beda95-0e1f-427a-baaa-970867a90042 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:51:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54beda95-0e1f-427a-baaa-970867a90042 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:51:18.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc27365b-bd26-42c3-b824-e3c7ba9d406d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:51:18.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc27365b-bd26-42c3-b824-e3c7ba9d406d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ca1ea2
2021-06-04T01:51:18.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc27365b-bd26-42c3-b824-e3c7ba9d406d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:51:18.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc27365b-bd26-42c3-b824-e3c7ba9d406d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:51:20.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=adf0bbd0-c29f-4865-a2d3-8d0c3668857d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:51:20.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=adf0bbd0-c29f-4865-a2d3-8d0c3668857d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ce01d4e
2021-06-04T01:51:20.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=adf0bbd0-c29f-4865-a2d3-8d0c3668857d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:51:20.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=adf0bbd0-c29f-4865-a2d3-8d0c3668857d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:51:24.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02ae65cf-0f24-4ea3-aabc-0ccc956503da PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:51:24.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02ae65cf-0f24-4ea3-aabc-0ccc956503da PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d2af8c
2021-06-04T01:51:24.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02ae65cf-0f24-4ea3-aabc-0ccc956503da PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:51:24.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02ae65cf-0f24-4ea3-aabc-0ccc956503da PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:51:27.378Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c19ab39-7d14-499f-a176-67aeb703761e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:51:27.378Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c19ab39-7d14-499f-a176-67aeb703761e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@775abd9
2021-06-04T01:51:27.378Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c19ab39-7d14-499f-a176-67aeb703761e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:51:27.378Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c19ab39-7d14-499f-a176-67aeb703761e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:51:30.271Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9d142e6-976f-4004-8e44-0c0ef982313a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:51:30.271Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9d142e6-976f-4004-8e44-0c0ef982313a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@529f9a9b
2021-06-04T01:51:30.271Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9d142e6-976f-4004-8e44-0c0ef982313a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:51:30.271Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9d142e6-976f-4004-8e44-0c0ef982313a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:51:33.080Z [pool-14-thread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection timed out (Connection timed out); blacklisting for 2 minutes
2021-06-04T01:51:33.081Z [pool-14-thread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=200 TargetEntity=getTopics Connection problem towards U-EB server. Reason: 500
2021-06-04T01:51:33.081Z [pool-14-thread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine Error occured during access to U-EB Server. Operation: try retrieve list of topics from U-EB server
2021-06-04T01:51:33.087Z [pool-14-thread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine GET http://message-router.onap:3904/topics (anonymous) ...
2021-06-04T01:51:33.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2d1409d-b994-4c1e-b9ef-36f03c04a37b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:51:33.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2d1409d-b994-4c1e-b9ef-36f03c04a37b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e39e7eb
2021-06-04T01:51:33.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2d1409d-b994-4c1e-b9ef-36f03c04a37b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:51:33.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2d1409d-b994-4c1e-b9ef-36f03c04a37b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:51:36.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=126e3cb7-73d1-4e2e-ba1f-bd274be92a18 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:51:36.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=126e3cb7-73d1-4e2e-ba1f-bd274be92a18 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6881896f
2021-06-04T01:51:36.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=126e3cb7-73d1-4e2e-ba1f-bd274be92a18 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:51:36.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=126e3cb7-73d1-4e2e-ba1f-bd274be92a18 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:51:39.439Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5305012d-1f96-4d18-8209-5e4d79672fbb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:51:39.439Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5305012d-1f96-4d18-8209-5e4d79672fbb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4200ccc5
2021-06-04T01:51:39.439Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5305012d-1f96-4d18-8209-5e4d79672fbb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:51:39.439Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5305012d-1f96-4d18-8209-5e4d79672fbb PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:51:42.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8531f66d-7645-4d91-bd39-1c05ae586f02 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:51:42.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8531f66d-7645-4d91-bd39-1c05ae586f02 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c65dd5c
2021-06-04T01:51:42.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8531f66d-7645-4d91-bd39-1c05ae586f02 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:51:42.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8531f66d-7645-4d91-bd39-1c05ae586f02 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:51:45.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b27b28e-4141-44c0-8dfd-f8c3536f50c1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:51:45.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b27b28e-4141-44c0-8dfd-f8c3536f50c1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5dd27984
2021-06-04T01:51:45.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b27b28e-4141-44c0-8dfd-f8c3536f50c1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:51:45.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b27b28e-4141-44c0-8dfd-f8c3536f50c1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:51:48.673Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29eb7f6a-144d-4575-9a26-96414f8a2db4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:51:48.673Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29eb7f6a-144d-4575-9a26-96414f8a2db4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@397c49a0
2021-06-04T01:51:48.673Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29eb7f6a-144d-4575-9a26-96414f8a2db4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:51:48.673Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29eb7f6a-144d-4575-9a26-96414f8a2db4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:51:50.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bea1071-0ae2-4067-b681-c78719e00032 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:51:50.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bea1071-0ae2-4067-b681-c78719e00032 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ddeccae
2021-06-04T01:51:50.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bea1071-0ae2-4067-b681-c78719e00032 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:51:50.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bea1071-0ae2-4067-b681-c78719e00032 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:51:54.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5c5ffb7-8551-43f4-8b0c-48c526a5267d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:51:54.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5c5ffb7-8551-43f4-8b0c-48c526a5267d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f936174
2021-06-04T01:51:54.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5c5ffb7-8551-43f4-8b0c-48c526a5267d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:51:54.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5c5ffb7-8551-43f4-8b0c-48c526a5267d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:51:57.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5f1ef50-6c9e-4f6d-b1fe-c794d889db4d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:51:57.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5f1ef50-6c9e-4f6d-b1fe-c794d889db4d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7143215b
2021-06-04T01:51:57.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5f1ef50-6c9e-4f6d-b1fe-c794d889db4d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:51:57.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5f1ef50-6c9e-4f6d-b1fe-c794d889db4d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:52:00.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eaf8e0be-714a-4834-9dbc-6932a89926b5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:52:00.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eaf8e0be-714a-4834-9dbc-6932a89926b5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2aa9479a
2021-06-04T01:52:00.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eaf8e0be-714a-4834-9dbc-6932a89926b5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:52:00.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eaf8e0be-714a-4834-9dbc-6932a89926b5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:52:03.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74e6ef8d-c580-4824-8938-ec9aeca21da3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:52:03.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74e6ef8d-c580-4824-8938-ec9aeca21da3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@211945dd
2021-06-04T01:52:03.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74e6ef8d-c580-4824-8938-ec9aeca21da3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:52:03.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74e6ef8d-c580-4824-8938-ec9aeca21da3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:52:06.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03b03894-4d6a-4290-af34-94451441d814 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:52:06.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03b03894-4d6a-4290-af34-94451441d814 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@525184b
2021-06-04T01:52:06.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03b03894-4d6a-4290-af34-94451441d814 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:52:06.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03b03894-4d6a-4290-af34-94451441d814 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:52:09.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d254df3b-7008-4ee0-860d-c4375eea0ef7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:52:09.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d254df3b-7008-4ee0-860d-c4375eea0ef7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d84b84d
2021-06-04T01:52:09.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d254df3b-7008-4ee0-860d-c4375eea0ef7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:52:09.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d254df3b-7008-4ee0-860d-c4375eea0ef7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:52:11.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59290ed7-c6f5-49e5-8388-5926ad362918 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:52:11.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59290ed7-c6f5-49e5-8388-5926ad362918 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d71b7f0
2021-06-04T01:52:11.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59290ed7-c6f5-49e5-8388-5926ad362918 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:52:11.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59290ed7-c6f5-49e5-8388-5926ad362918 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:52:15.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e7ef8f9-2f32-498c-9727-b322e301fd3c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:52:15.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e7ef8f9-2f32-498c-9727-b322e301fd3c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@66ad2c2e
2021-06-04T01:52:15.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e7ef8f9-2f32-498c-9727-b322e301fd3c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:52:15.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e7ef8f9-2f32-498c-9727-b322e301fd3c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:52:18.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9edd8908-86b8-4718-b06c-adf21a9c572f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:52:18.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9edd8908-86b8-4718-b06c-adf21a9c572f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4be797f0
2021-06-04T01:52:18.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9edd8908-86b8-4718-b06c-adf21a9c572f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:52:18.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9edd8908-86b8-4718-b06c-adf21a9c572f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:52:20.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e9483c4-d357-419d-b892-fcdf24acadbe PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:52:20.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e9483c4-d357-419d-b892-fcdf24acadbe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e90811
2021-06-04T01:52:20.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e9483c4-d357-419d-b892-fcdf24acadbe PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:52:20.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e9483c4-d357-419d-b892-fcdf24acadbe PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T01:52:25.949Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9ec87af-81df-4d48-9ffc-fdebc5fa82fe PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:52:25.949Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9ec87af-81df-4d48-9ffc-fdebc5fa82fe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a7f1ab
2021-06-04T01:52:25.949Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9ec87af-81df-4d48-9ffc-fdebc5fa82fe PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:52:25.949Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9ec87af-81df-4d48-9ffc-fdebc5fa82fe PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:52:26.660Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=d9ec87af-81df-4d48-9ffc-fdebc5fa82fe ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:52:26.660Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=d9ec87af-81df-4d48-9ffc-fdebc5fa82fe ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:52:27.647Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7adf0d0-6f79-4748-bfa4-8fc43fe42a92 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:52:27.647Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7adf0d0-6f79-4748-bfa4-8fc43fe42a92 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ce471ad
2021-06-04T01:52:27.647Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7adf0d0-6f79-4748-bfa4-8fc43fe42a92 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:52:27.647Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7adf0d0-6f79-4748-bfa4-8fc43fe42a92 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:52:30.747Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff7828db-66c3-4f13-8d39-11e000998b62 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:52:30.747Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff7828db-66c3-4f13-8d39-11e000998b62 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7bcb3fd6
2021-06-04T01:52:30.747Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff7828db-66c3-4f13-8d39-11e000998b62 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:52:30.747Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff7828db-66c3-4f13-8d39-11e000998b62 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:52:33.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3e4ada7-c3b8-42af-9d9f-0f792b9ad646 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:52:33.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3e4ada7-c3b8-42af-9d9f-0f792b9ad646 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3029193e
2021-06-04T01:52:33.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3e4ada7-c3b8-42af-9d9f-0f792b9ad646 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:52:33.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3e4ada7-c3b8-42af-9d9f-0f792b9ad646 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:52:37.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39698e07-586f-41a4-9b5e-5fcaa575195a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:52:37.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39698e07-586f-41a4-9b5e-5fcaa575195a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@cbf9c39
2021-06-04T01:52:37.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39698e07-586f-41a4-9b5e-5fcaa575195a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:52:37.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39698e07-586f-41a4-9b5e-5fcaa575195a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:52:38.631Z [pool-14-thread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine \t--> HTTP/1.1 200 OK
2021-06-04T01:52:39.239Z [pool-14-thread-1] INFO com.datastax.driver.core.utils.UUIDs RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine PID obtained through native call to getpid(): 117
2021-06-04T01:52:39.325Z [pool-14-thread-1] WARN c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "CreateDistributionTopic" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-NOTIF-TOPIC-AUTO" STATUS = "ALREADY_EXISTS" RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine PUT http://message-router.onap:3904/topics/SDC-DISTR-NOTIF-TOPIC-AUTO/producers/iPIxkpAMI8qTcQj8 will send credentials over a clear channel.
2021-06-04T01:52:39.325Z [pool-14-thread-1] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "CreateDistributionTopic" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-NOTIF-TOPIC-AUTO" STATUS = "ALREADY_EXISTS" RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine PUT http://message-router.onap:3904/topics/SDC-DISTR-NOTIF-TOPIC-AUTO/producers/iPIxkpAMI8qTcQj8 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T01:52:39.348Z [pool-14-thread-1] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "CreateDistributionTopic" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-NOTIF-TOPIC-AUTO" STATUS = "ALREADY_EXISTS" RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine \t--> HTTP/1.1 200 OK
2021-06-04T01:52:39.372Z [pool-14-thread-1] WARN c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "CreateDistributionTopic" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" STATUS = "ALREADY_EXISTS" RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine PUT http://message-router.onap:3904/topics/SDC-DISTR-STATUS-TOPIC-AUTO/consumers/iPIxkpAMI8qTcQj8 will send credentials over a clear channel.
2021-06-04T01:52:39.372Z [pool-14-thread-1] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "CreateDistributionTopic" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" STATUS = "ALREADY_EXISTS" RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine PUT http://message-router.onap:3904/topics/SDC-DISTR-STATUS-TOPIC-AUTO/consumers/iPIxkpAMI8qTcQj8 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T01:52:39.386Z [pool-14-thread-1] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "CreateDistributionTopic" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" STATUS = "ALREADY_EXISTS" RequestID=null ErrorCategory=ERROR ServiceName=getTopics TargetServiceName=null ErrorCode=500 TargetEntity=initDistributionEngine \t--> HTTP/1.1 200 OK
2021-06-04T01:52:39.453Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T01:52:39.453Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T01:52:39.453Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T01:52:39.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75bb29fd-adc4-4a0b-973a-58b386e2bf87 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:52:39.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75bb29fd-adc4-4a0b-973a-58b386e2bf87 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23f9fd1a
2021-06-04T01:52:39.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75bb29fd-adc4-4a0b-973a-58b386e2bf87 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:52:39.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75bb29fd-adc4-4a0b-973a-58b386e2bf87 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:52:42.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=460d0713-1816-4382-9a1b-d54c2cdca4dd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:52:42.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=460d0713-1816-4382-9a1b-d54c2cdca4dd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ee533c
2021-06-04T01:52:42.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=460d0713-1816-4382-9a1b-d54c2cdca4dd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:52:42.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=460d0713-1816-4382-9a1b-d54c2cdca4dd PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:52:44.870Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:52:44.878Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:52:44.880Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL ErrorCategory=INFO RequestID=null ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T01:52:45.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08205f58-b1c2-4e10-a184-3bed9733c7ac PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:52:45.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08205f58-b1c2-4e10-a184-3bed9733c7ac PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79764ad6
2021-06-04T01:52:45.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08205f58-b1c2-4e10-a184-3bed9733c7ac PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:52:45.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08205f58-b1c2-4e10-a184-3bed9733c7ac PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:52:46.222Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=08205f58-b1c2-4e10-a184-3bed9733c7ac ErrorCategory=INFO ServiceName=BE Component DE state changed from UNKNOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UNKNOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:52:46.222Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=08205f58-b1c2-4e10-a184-3bed9733c7ac ErrorCategory=INFO ServiceName=BE Component DE state changed from UNKNOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:52:48.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bac7d681-5027-4294-93a0-07b074f7d311 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:52:48.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bac7d681-5027-4294-93a0-07b074f7d311 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9585f95
2021-06-04T01:52:48.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bac7d681-5027-4294-93a0-07b074f7d311 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:52:48.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bac7d681-5027-4294-93a0-07b074f7d311 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:52:51.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6be57a56-8897-49aa-8174-af54bc95988a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:52:51.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6be57a56-8897-49aa-8174-af54bc95988a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65257289
2021-06-04T01:52:51.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6be57a56-8897-49aa-8174-af54bc95988a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:52:51.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6be57a56-8897-49aa-8174-af54bc95988a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:52:54.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ee5e270-115c-40e7-aaaf-179d7772736b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:52:54.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ee5e270-115c-40e7-aaaf-179d7772736b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@16a1aaa2
2021-06-04T01:52:54.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ee5e270-115c-40e7-aaaf-179d7772736b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:52:54.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ee5e270-115c-40e7-aaaf-179d7772736b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:52:55.118Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:52:57.760Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d07b237-caab-4705-927f-dfaaae229604 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:52:57.761Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d07b237-caab-4705-927f-dfaaae229604 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5dca725a
2021-06-04T01:52:57.761Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d07b237-caab-4705-927f-dfaaae229604 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:52:57.761Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d07b237-caab-4705-927f-dfaaae229604 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:52:59.869Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:52:59.879Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:53:00.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3122ac66-5846-403d-8a3f-45ed5334c74d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:53:00.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3122ac66-5846-403d-8a3f-45ed5334c74d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@16252a81
2021-06-04T01:53:00.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3122ac66-5846-403d-8a3f-45ed5334c74d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:53:00.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3122ac66-5846-403d-8a3f-45ed5334c74d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:53:03.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7d8b058-fba3-4f49-a7f8-e366fb8b14b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:53:03.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7d8b058-fba3-4f49-a7f8-e366fb8b14b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@585aa3f6
2021-06-04T01:53:03.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7d8b058-fba3-4f49-a7f8-e366fb8b14b9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:53:03.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7d8b058-fba3-4f49-a7f8-e366fb8b14b9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:53:06.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b3d0702-9d3d-4e4b-a594-31c507d66550 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:53:06.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b3d0702-9d3d-4e4b-a594-31c507d66550 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43b5f6e5
2021-06-04T01:53:06.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b3d0702-9d3d-4e4b-a594-31c507d66550 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:53:06.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b3d0702-9d3d-4e4b-a594-31c507d66550 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:53:09.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01cfb541-4a3e-4ef5-97e0-3a68be50410d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:53:09.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01cfb541-4a3e-4ef5-97e0-3a68be50410d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4de3146b
2021-06-04T01:53:09.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01cfb541-4a3e-4ef5-97e0-3a68be50410d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:53:09.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01cfb541-4a3e-4ef5-97e0-3a68be50410d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:53:12.254Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd8ab9d8-313d-43d7-8e62-6332731c115d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:53:12.254Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd8ab9d8-313d-43d7-8e62-6332731c115d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@72ad5e74
2021-06-04T01:53:12.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd8ab9d8-313d-43d7-8e62-6332731c115d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:53:12.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd8ab9d8-313d-43d7-8e62-6332731c115d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:53:14.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:53:14.880Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:53:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dbb1f3c3-39b2-4014-b492-6af00faae513 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:53:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dbb1f3c3-39b2-4014-b492-6af00faae513 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7fe516c4
2021-06-04T01:53:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dbb1f3c3-39b2-4014-b492-6af00faae513 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:53:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dbb1f3c3-39b2-4014-b492-6af00faae513 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:53:18.747Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1e0faec-dfe8-4d03-b435-2f712b6afb77 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:53:18.747Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1e0faec-dfe8-4d03-b435-2f712b6afb77 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@138bd503
2021-06-04T01:53:18.747Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1e0faec-dfe8-4d03-b435-2f712b6afb77 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:53:18.747Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1e0faec-dfe8-4d03-b435-2f712b6afb77 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:53:21.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=faba4dbd-efe7-4884-9e56-79b221dcc31d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:53:21.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=faba4dbd-efe7-4884-9e56-79b221dcc31d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@461ecb55
2021-06-04T01:53:21.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=faba4dbd-efe7-4884-9e56-79b221dcc31d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:53:21.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=faba4dbd-efe7-4884-9e56-79b221dcc31d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:53:23.402Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0ioq59n30poy71ji7rjagfhm448
2021-06-04T01:53:23.403Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0xxpkkcbwjwf12sjvra8nfhng9
2021-06-04T01:53:23.403Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node02tge9nclyw2ar8iqmzrt9plu7
2021-06-04T01:53:23.404Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0bp93f0x1zwvp1lmbioh9e45ar6
2021-06-04T01:53:23.404Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0mx6vevkgsfa6pozhvz7fdko35
2021-06-04T01:53:23.404Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0k0nvlmxrdu6j1mgpus149mt034
2021-06-04T01:53:23.404Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01ifxfbeacvio8zbsyiyg59fap13
2021-06-04T01:53:23.405Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0g57sjzbshm3s15jb5yt7csljr0
2021-06-04T01:53:23.405Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node070yx5yuec91d16p9az0btkzee3
2021-06-04T01:53:23.405Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0qprwlwdhhtkciwf96v6ek16811
2021-06-04T01:53:23.405Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0z1t6pc7psgwn11461y54onn0t2
2021-06-04T01:53:23.405Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01v7fbdst9baqe1co3rsm70otuc10
2021-06-04T01:53:23.405Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01ntfxxoyhffjq96k7iddoq6ci1
2021-06-04T01:53:24.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c005d41a-09af-4478-8352-c0ef538bdf0a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:53:24.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c005d41a-09af-4478-8352-c0ef538bdf0a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ed8631c
2021-06-04T01:53:24.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c005d41a-09af-4478-8352-c0ef538bdf0a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:53:24.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c005d41a-09af-4478-8352-c0ef538bdf0a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:53:27.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d266c035-ae7c-4794-aa8a-39a9a1adf1ad PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:53:27.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d266c035-ae7c-4794-aa8a-39a9a1adf1ad PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@95c1d35
2021-06-04T01:53:27.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d266c035-ae7c-4794-aa8a-39a9a1adf1ad PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:53:27.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d266c035-ae7c-4794-aa8a-39a9a1adf1ad PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:53:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:53:29.874Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:53:30.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=264aed55-01fe-4380-a11f-168f8a5b5d8c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:53:30.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=264aed55-01fe-4380-a11f-168f8a5b5d8c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@44b2f2d0
2021-06-04T01:53:30.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=264aed55-01fe-4380-a11f-168f8a5b5d8c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:53:30.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=264aed55-01fe-4380-a11f-168f8a5b5d8c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:53:33.241Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12bc242e-6c3a-45b4-87ce-9297d06c8083 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:53:33.241Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12bc242e-6c3a-45b4-87ce-9297d06c8083 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7446cd70
2021-06-04T01:53:33.241Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12bc242e-6c3a-45b4-87ce-9297d06c8083 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:53:33.241Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12bc242e-6c3a-45b4-87ce-9297d06c8083 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:53:36.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4351638-5d14-4d0c-869b-3f7cbbf7d084 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:53:36.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4351638-5d14-4d0c-869b-3f7cbbf7d084 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@699b8067
2021-06-04T01:53:36.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4351638-5d14-4d0c-869b-3f7cbbf7d084 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:53:36.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4351638-5d14-4d0c-869b-3f7cbbf7d084 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:53:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T01:53:39.454Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T01:53:39.454Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T01:53:39.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f8b262e-f69b-405a-9d38-eb1bcca59971 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:53:39.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f8b262e-f69b-405a-9d38-eb1bcca59971 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@c78dd4
2021-06-04T01:53:39.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f8b262e-f69b-405a-9d38-eb1bcca59971 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:53:39.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f8b262e-f69b-405a-9d38-eb1bcca59971 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:53:42.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f624fb2-c518-4168-a263-c0c91bd35e99 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:53:42.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f624fb2-c518-4168-a263-c0c91bd35e99 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53b0cb6e
2021-06-04T01:53:42.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f624fb2-c518-4168-a263-c0c91bd35e99 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:53:42.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f624fb2-c518-4168-a263-c0c91bd35e99 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:53:44.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:53:44.877Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:53:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33ae95f3-3738-426f-a256-6eea0f0126b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:53:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33ae95f3-3738-426f-a256-6eea0f0126b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@11dfb125
2021-06-04T01:53:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33ae95f3-3738-426f-a256-6eea0f0126b9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:53:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33ae95f3-3738-426f-a256-6eea0f0126b9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:53:48.853Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71498652-dfae-4918-bae1-befd7e17510a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:53:48.853Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71498652-dfae-4918-bae1-befd7e17510a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@24f283c1
2021-06-04T01:53:48.853Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71498652-dfae-4918-bae1-befd7e17510a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:53:48.853Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71498652-dfae-4918-bae1-befd7e17510a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:53:51.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaae60af-03af-4b26-bd2a-b283ab5936e1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:53:51.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaae60af-03af-4b26-bd2a-b283ab5936e1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@18e703a6
2021-06-04T01:53:51.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaae60af-03af-4b26-bd2a-b283ab5936e1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:53:51.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaae60af-03af-4b26-bd2a-b283ab5936e1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:53:53.989Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:53:54.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fc9385f-a55f-4457-bfc8-b73462e97aca PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:53:54.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fc9385f-a55f-4457-bfc8-b73462e97aca PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4d59406f
2021-06-04T01:53:54.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fc9385f-a55f-4457-bfc8-b73462e97aca PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:53:54.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fc9385f-a55f-4457-bfc8-b73462e97aca PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:53:57.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1369ac8d-35fe-46c4-843e-2f97b90bd6ba PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:53:57.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1369ac8d-35fe-46c4-843e-2f97b90bd6ba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@21639678
2021-06-04T01:53:57.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1369ac8d-35fe-46c4-843e-2f97b90bd6ba PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:53:57.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1369ac8d-35fe-46c4-843e-2f97b90bd6ba PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:53:59.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:53:59.896Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:54:00.373Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df43a23b-4682-43b1-a4eb-e7bdbc83b8fa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:54:00.373Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df43a23b-4682-43b1-a4eb-e7bdbc83b8fa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@113fe51e
2021-06-04T01:54:00.373Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df43a23b-4682-43b1-a4eb-e7bdbc83b8fa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:54:00.373Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df43a23b-4682-43b1-a4eb-e7bdbc83b8fa PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:54:03.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97c1d3d9-ca6e-47bb-bba0-8c2e0ee9747a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:54:03.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97c1d3d9-ca6e-47bb-bba0-8c2e0ee9747a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@31652eac
2021-06-04T01:54:03.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97c1d3d9-ca6e-47bb-bba0-8c2e0ee9747a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:54:03.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97c1d3d9-ca6e-47bb-bba0-8c2e0ee9747a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:54:06.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50fbcda3-8257-40ba-8619-2603329b4a2f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:54:06.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50fbcda3-8257-40ba-8619-2603329b4a2f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@36385ad7
2021-06-04T01:54:06.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50fbcda3-8257-40ba-8619-2603329b4a2f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:54:06.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50fbcda3-8257-40ba-8619-2603329b4a2f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:54:09.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96a4059e-a2ad-4da1-b523-3ffda9c2a486 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:54:09.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96a4059e-a2ad-4da1-b523-3ffda9c2a486 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b55ca3e
2021-06-04T01:54:09.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96a4059e-a2ad-4da1-b523-3ffda9c2a486 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:54:09.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96a4059e-a2ad-4da1-b523-3ffda9c2a486 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:54:12.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5aa15b8a-7742-4727-9c73-8998f59768e9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:54:12.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5aa15b8a-7742-4727-9c73-8998f59768e9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65acc95f
2021-06-04T01:54:12.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5aa15b8a-7742-4727-9c73-8998f59768e9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:54:12.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5aa15b8a-7742-4727-9c73-8998f59768e9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:54:14.869Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:54:15.392Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:54:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a23e7ca7-b4eb-4b58-9b55-ab0180a97480 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:54:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a23e7ca7-b4eb-4b58-9b55-ab0180a97480 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d248b08
2021-06-04T01:54:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a23e7ca7-b4eb-4b58-9b55-ab0180a97480 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:54:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a23e7ca7-b4eb-4b58-9b55-ab0180a97480 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:54:18.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60cf83c3-a489-483f-b579-ad91e408a4a7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:54:18.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60cf83c3-a489-483f-b579-ad91e408a4a7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9be8899
2021-06-04T01:54:18.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60cf83c3-a489-483f-b579-ad91e408a4a7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:54:18.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60cf83c3-a489-483f-b579-ad91e408a4a7 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:54:21.167Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=741978f2-77a6-4df9-9d99-b36274309284 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:54:21.167Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=741978f2-77a6-4df9-9d99-b36274309284 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c1fb7aa
2021-06-04T01:54:21.167Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=741978f2-77a6-4df9-9d99-b36274309284 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:54:21.167Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=741978f2-77a6-4df9-9d99-b36274309284 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:54:24.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0034c0a8-a4eb-4976-9abc-fb2c7aed4cb1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:54:24.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0034c0a8-a4eb-4976-9abc-fb2c7aed4cb1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f7a7547
2021-06-04T01:54:24.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0034c0a8-a4eb-4976-9abc-fb2c7aed4cb1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:54:24.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0034c0a8-a4eb-4976-9abc-fb2c7aed4cb1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:54:27.569Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8465434-902e-47dc-bc33-98a6c6603e5c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:54:27.569Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8465434-902e-47dc-bc33-98a6c6603e5c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@765fc76b
2021-06-04T01:54:27.569Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8465434-902e-47dc-bc33-98a6c6603e5c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:54:27.569Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8465434-902e-47dc-bc33-98a6c6603e5c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:54:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:54:30.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80358709-3fc8-4025-82fa-6f7899f0a033 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:54:30.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80358709-3fc8-4025-82fa-6f7899f0a033 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b587379
2021-06-04T01:54:30.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80358709-3fc8-4025-82fa-6f7899f0a033 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:54:30.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80358709-3fc8-4025-82fa-6f7899f0a033 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:54:33.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d99f83e3-b2ee-47d3-b99b-66a29b62c39c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:54:33.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d99f83e3-b2ee-47d3-b99b-66a29b62c39c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5aab275f
2021-06-04T01:54:33.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d99f83e3-b2ee-47d3-b99b-66a29b62c39c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:54:33.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d99f83e3-b2ee-47d3-b99b-66a29b62c39c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:54:33.479Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:54:36.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e02ab76-c187-4e61-a5ce-40c6edd93a2f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:54:36.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e02ab76-c187-4e61-a5ce-40c6edd93a2f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2687a100
2021-06-04T01:54:36.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e02ab76-c187-4e61-a5ce-40c6edd93a2f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:54:36.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e02ab76-c187-4e61-a5ce-40c6edd93a2f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:54:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T01:54:39.454Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T01:54:39.454Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T01:54:39.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ea3d89b-a904-4d4b-a168-c0c2cba0e91e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:54:39.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ea3d89b-a904-4d4b-a168-c0c2cba0e91e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e6b5e24
2021-06-04T01:54:39.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ea3d89b-a904-4d4b-a168-c0c2cba0e91e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:54:39.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ea3d89b-a904-4d4b-a168-c0c2cba0e91e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:54:42.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2bb6659-f7dd-4ef7-bb9b-d5743642629f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:54:42.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2bb6659-f7dd-4ef7-bb9b-d5743642629f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@66e0332b
2021-06-04T01:54:42.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2bb6659-f7dd-4ef7-bb9b-d5743642629f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:54:42.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2bb6659-f7dd-4ef7-bb9b-d5743642629f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:54:44.870Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:54:45.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18b9442e-73ff-4f62-8e21-61da9b17fbba PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:54:45.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18b9442e-73ff-4f62-8e21-61da9b17fbba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65f26177
2021-06-04T01:54:45.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18b9442e-73ff-4f62-8e21-61da9b17fbba PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:54:45.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18b9442e-73ff-4f62-8e21-61da9b17fbba PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:54:48.895Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c3dcca6-ef20-457f-a460-73824083f432 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:54:48.895Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c3dcca6-ef20-457f-a460-73824083f432 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e664368
2021-06-04T01:54:48.895Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c3dcca6-ef20-457f-a460-73824083f432 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:54:48.895Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c3dcca6-ef20-457f-a460-73824083f432 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:54:51.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=faf6bdd7-5d6f-448b-96f5-66382a158f6e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:54:51.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=faf6bdd7-5d6f-448b-96f5-66382a158f6e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a08a8fe
2021-06-04T01:54:51.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=faf6bdd7-5d6f-448b-96f5-66382a158f6e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:54:51.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=faf6bdd7-5d6f-448b-96f5-66382a158f6e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:54:52.870Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T01:54:54.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=90469787-dcca-45e6-8e62-f5f9cdd155a4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:54:54.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=90469787-dcca-45e6-8e62-f5f9cdd155a4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d96abff
2021-06-04T01:54:54.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=90469787-dcca-45e6-8e62-f5f9cdd155a4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:54:54.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=90469787-dcca-45e6-8e62-f5f9cdd155a4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:54:55.528Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=90469787-dcca-45e6-8e62-f5f9cdd155a4 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:54:55.528Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=90469787-dcca-45e6-8e62-f5f9cdd155a4 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:54:57.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=835b9cab-9a46-46e3-948e-e56b5e37c270 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:54:57.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=835b9cab-9a46-46e3-948e-e56b5e37c270 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b9986e3
2021-06-04T01:54:57.779Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=835b9cab-9a46-46e3-948e-e56b5e37c270 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:54:57.779Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=835b9cab-9a46-46e3-948e-e56b5e37c270 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:55:00.286Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc932a63-7fd8-42ec-8570-f33c1cc6cfb8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:55:00.286Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc932a63-7fd8-42ec-8570-f33c1cc6cfb8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57a8ebfb
2021-06-04T01:55:00.286Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc932a63-7fd8-42ec-8570-f33c1cc6cfb8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:55:00.286Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc932a63-7fd8-42ec-8570-f33c1cc6cfb8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:55:03.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4d87c28-6869-41bb-95a0-c73079922ff8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:55:03.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4d87c28-6869-41bb-95a0-c73079922ff8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1828e6a8
2021-06-04T01:55:03.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4d87c28-6869-41bb-95a0-c73079922ff8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:55:03.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4d87c28-6869-41bb-95a0-c73079922ff8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:55:08.843Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:55:08.846Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:55:09.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:55:09.262Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:55:12.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:55:15.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:55:17.566Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eadd98e9-8924-44c9-9b96-8832f6880f71 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:55:17.567Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eadd98e9-8924-44c9-9b96-8832f6880f71 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@40397f01
2021-06-04T01:55:17.567Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eadd98e9-8924-44c9-9b96-8832f6880f71 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:55:17.568Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eadd98e9-8924-44c9-9b96-8832f6880f71 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:55:18.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:55:20.578Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=eadd98e9-8924-44c9-9b96-8832f6880f71 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:55:20.579Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=eadd98e9-8924-44c9-9b96-8832f6880f71 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:55:20.580Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=eadd98e9-8924-44c9-9b96-8832f6880f71 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:55:20.580Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=eadd98e9-8924-44c9-9b96-8832f6880f71 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:55:21.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:55:24.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:55:27.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:55:30.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:55:31.751Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9ee6138-ec58-4d7f-9ad4-f2beef138e66 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:55:31.751Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9ee6138-ec58-4d7f-9ad4-f2beef138e66 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17c0577b
2021-06-04T01:55:31.751Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9ee6138-ec58-4d7f-9ad4-f2beef138e66 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:55:31.751Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9ee6138-ec58-4d7f-9ad4-f2beef138e66 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:55:31.980Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a9ee6138-ec58-4d7f-9ad4-f2beef138e66 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:55:31.981Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=a9ee6138-ec58-4d7f-9ad4-f2beef138e66 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T01:55:32.282Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:55:32.502Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d75769ba-796d-482e-ace8-fb702c08a3b5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:55:32.502Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d75769ba-796d-482e-ace8-fb702c08a3b5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58e53ab1
2021-06-04T01:55:32.502Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d75769ba-796d-482e-ace8-fb702c08a3b5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:55:32.502Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d75769ba-796d-482e-ace8-fb702c08a3b5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:55:32.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3cc5701-edf1-4055-9df9-ddebef658622 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:55:32.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3cc5701-edf1-4055-9df9-ddebef658622 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@532f87db
2021-06-04T01:55:32.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3cc5701-edf1-4055-9df9-ddebef658622 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:55:32.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3cc5701-edf1-4055-9df9-ddebef658622 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:55:32.938Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:55:32.943Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:55:33.052Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a3cc5701-edf1-4055-9df9-ddebef658622 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:55:33.052Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a3cc5701-edf1-4055-9df9-ddebef658622 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:55:33.614Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5950b25a-577e-455c-9f0c-66dfde7fbf48 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:55:33.614Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5950b25a-577e-455c-9f0c-66dfde7fbf48 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@46c1794a
2021-06-04T01:55:33.614Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5950b25a-577e-455c-9f0c-66dfde7fbf48 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:55:33.614Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5950b25a-577e-455c-9f0c-66dfde7fbf48 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:55:33.732Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:55:33.734Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:55:33.753Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:55:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a8a51ab-0863-43cb-a75b-3aa2d7d260dc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:55:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a8a51ab-0863-43cb-a75b-3aa2d7d260dc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d571500
2021-06-04T01:55:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a8a51ab-0863-43cb-a75b-3aa2d7d260dc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:55:34.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a8a51ab-0863-43cb-a75b-3aa2d7d260dc PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:55:37.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=756be530-d441-4639-96ed-502b6d7ef025 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:55:37.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=756be530-d441-4639-96ed-502b6d7ef025 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@c1688a9
2021-06-04T01:55:37.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=756be530-d441-4639-96ed-502b6d7ef025 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:55:37.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=756be530-d441-4639-96ed-502b6d7ef025 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:55:38.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e836f41-5eb7-4b60-852b-cda2d8296427 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:55:38.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e836f41-5eb7-4b60-852b-cda2d8296427 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2328d7af
2021-06-04T01:55:38.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e836f41-5eb7-4b60-852b-cda2d8296427 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:55:38.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e836f41-5eb7-4b60-852b-cda2d8296427 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:55:39.123Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:55:39.125Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:55:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T01:55:39.453Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T01:55:39.453Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T01:55:40.110Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:55:40.112Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:55:40.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb3b4d14-1ce9-482e-b47a-7d393510fe7c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:55:40.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb3b4d14-1ce9-482e-b47a-7d393510fe7c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6eeee1a9
2021-06-04T01:55:40.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb3b4d14-1ce9-482e-b47a-7d393510fe7c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:55:40.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb3b4d14-1ce9-482e-b47a-7d393510fe7c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:55:41.376Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f89fb903-562b-400d-aafa-b9052d79c40d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:55:41.376Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f89fb903-562b-400d-aafa-b9052d79c40d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b540661
2021-06-04T01:55:41.376Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f89fb903-562b-400d-aafa-b9052d79c40d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:55:41.377Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f89fb903-562b-400d-aafa-b9052d79c40d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:55:42.389Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40b27dca-d817-4182-95c0-01289aed4e25 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:55:42.389Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40b27dca-d817-4182-95c0-01289aed4e25 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@133f9062
2021-06-04T01:55:42.389Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40b27dca-d817-4182-95c0-01289aed4e25 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:55:42.389Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40b27dca-d817-4182-95c0-01289aed4e25 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:55:44.247Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b32f1f8-6a7d-4413-ae33-edc1e02189aa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:55:44.247Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b32f1f8-6a7d-4413-ae33-edc1e02189aa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@764fa805
2021-06-04T01:55:44.247Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b32f1f8-6a7d-4413-ae33-edc1e02189aa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:55:44.247Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b32f1f8-6a7d-4413-ae33-edc1e02189aa PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:55:45.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:55:45.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:55:47.253Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=9b32f1f8-6a7d-4413-ae33-edc1e02189aa ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:55:47.253Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=9b32f1f8-6a7d-4413-ae33-edc1e02189aa ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:55:47.253Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9b32f1f8-6a7d-4413-ae33-edc1e02189aa ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:55:47.253Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9b32f1f8-6a7d-4413-ae33-edc1e02189aa ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:55:47.750Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 503 Service Unavailable
2021-06-04T01:55:47.751Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR ErrorCategory=ERROR RequestID=null ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 503
2021-06-04T01:55:47.765Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=503, variables=[]]
2021-06-04T01:55:48.115Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:55:48.487Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=daae6627-26f7-4801-b4f4-ca59e1868d4f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:55:48.487Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=daae6627-26f7-4801-b4f4-ca59e1868d4f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6fb5fccc
2021-06-04T01:55:48.487Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=daae6627-26f7-4801-b4f4-ca59e1868d4f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:55:48.487Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=daae6627-26f7-4801-b4f4-ca59e1868d4f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:55:48.979Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=daae6627-26f7-4801-b4f4-ca59e1868d4f ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:55:48.979Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=daae6627-26f7-4801-b4f4-ca59e1868d4f ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T01:55:49.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ccbca22-4000-4c6d-9c1c-936d9493877e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:55:49.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ccbca22-4000-4c6d-9c1c-936d9493877e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b0ab83c
2021-06-04T01:55:49.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ccbca22-4000-4c6d-9c1c-936d9493877e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:55:49.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ccbca22-4000-4c6d-9c1c-936d9493877e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:55:50.219Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=1ccbca22-4000-4c6d-9c1c-936d9493877e ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:55:50.219Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=1ccbca22-4000-4c6d-9c1c-936d9493877e ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:55:50.781Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:55:50.783Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:55:50.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b14ceac-b0b3-454e-b028-ef68ea188278 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:55:50.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b14ceac-b0b3-454e-b028-ef68ea188278 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@8e26d8
2021-06-04T01:55:50.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b14ceac-b0b3-454e-b028-ef68ea188278 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:55:50.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b14ceac-b0b3-454e-b028-ef68ea188278 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:55:51.590Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e39115ef-428b-4fa7-925b-b3a7f791058d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:55:51.590Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e39115ef-428b-4fa7-925b-b3a7f791058d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@409de999
2021-06-04T01:55:51.590Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e39115ef-428b-4fa7-925b-b3a7f791058d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:55:51.591Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e39115ef-428b-4fa7-925b-b3a7f791058d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:55:57.053Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4ee3cd0-7134-4385-bcb8-69fe1ad3dba8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:55:57.053Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4ee3cd0-7134-4385-bcb8-69fe1ad3dba8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@682edaff
2021-06-04T01:55:57.053Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4ee3cd0-7134-4385-bcb8-69fe1ad3dba8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:55:57.053Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4ee3cd0-7134-4385-bcb8-69fe1ad3dba8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:55:59.643Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f375ad7-ed49-4a21-bb26-e5c43e454560 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:55:59.643Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f375ad7-ed49-4a21-bb26-e5c43e454560 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@363b549e
2021-06-04T01:55:59.643Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f375ad7-ed49-4a21-bb26-e5c43e454560 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:55:59.643Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f375ad7-ed49-4a21-bb26-e5c43e454560 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:56:00.328Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:56:00.330Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:56:00.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2df204b-d8c7-4145-894a-7a0a17edb574 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:56:00.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2df204b-d8c7-4145-894a-7a0a17edb574 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47f20c67
2021-06-04T01:56:00.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2df204b-d8c7-4145-894a-7a0a17edb574 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:56:00.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2df204b-d8c7-4145-894a-7a0a17edb574 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:56:03.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12203672-e606-4eac-aeda-7d2548287007 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:56:03.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12203672-e606-4eac-aeda-7d2548287007 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@688cf421
2021-06-04T01:56:03.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12203672-e606-4eac-aeda-7d2548287007 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:56:03.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12203672-e606-4eac-aeda-7d2548287007 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:56:06.323Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=12203672-e606-4eac-aeda-7d2548287007 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:56:06.324Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=12203672-e606-4eac-aeda-7d2548287007 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:56:06.324Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=12203672-e606-4eac-aeda-7d2548287007 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:56:06.324Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=12203672-e606-4eac-aeda-7d2548287007 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:56:06.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aed277b8-38fb-476c-9930-153dc4b36866 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:56:06.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aed277b8-38fb-476c-9930-153dc4b36866 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@76eb32ed
2021-06-04T01:56:06.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aed277b8-38fb-476c-9930-153dc4b36866 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:56:06.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aed277b8-38fb-476c-9930-153dc4b36866 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:56:07.575Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=aed277b8-38fb-476c-9930-153dc4b36866 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:56:07.575Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=aed277b8-38fb-476c-9930-153dc4b36866 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:56:09.902Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=138d8eed-dd43-40e0-bb0b-41efec1d426e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:56:09.902Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=138d8eed-dd43-40e0-bb0b-41efec1d426e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ddeb10a
2021-06-04T01:56:09.902Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=138d8eed-dd43-40e0-bb0b-41efec1d426e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:56:09.902Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=138d8eed-dd43-40e0-bb0b-41efec1d426e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:56:12.147Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16118657-7dbd-4c6d-a4d6-88d1431a8e5d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:56:12.147Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16118657-7dbd-4c6d-a4d6-88d1431a8e5d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@427c696c
2021-06-04T01:56:12.147Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16118657-7dbd-4c6d-a4d6-88d1431a8e5d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:56:12.147Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16118657-7dbd-4c6d-a4d6-88d1431a8e5d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:56:18.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:56:18.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:56:18.808Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:56:18.809Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:56:21.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:56:23.322Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:56:23.879Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f31e91b0-2312-45b4-b0c1-53a9c36d459a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:56:23.879Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f31e91b0-2312-45b4-b0c1-53a9c36d459a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d2f5794
2021-06-04T01:56:23.879Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f31e91b0-2312-45b4-b0c1-53a9c36d459a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:56:23.879Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f31e91b0-2312-45b4-b0c1-53a9c36d459a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:56:26.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1bcb13ae-72e2-4bb1-9233-15a409f43044 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:56:26.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1bcb13ae-72e2-4bb1-9233-15a409f43044 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@37d5bd6c
2021-06-04T01:56:26.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1bcb13ae-72e2-4bb1-9233-15a409f43044 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:56:26.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1bcb13ae-72e2-4bb1-9233-15a409f43044 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:56:28.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=237c771c-148c-4c71-9e19-cbfdac0186ec PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:56:28.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=237c771c-148c-4c71-9e19-cbfdac0186ec PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@f3b1c7d
2021-06-04T01:56:28.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=237c771c-148c-4c71-9e19-cbfdac0186ec PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:56:28.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=237c771c-148c-4c71-9e19-cbfdac0186ec PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:56:28.340Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:56:28.342Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:56:29.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75d8a3ba-4e95-4f07-b6b4-b6f58e8881eb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:56:29.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75d8a3ba-4e95-4f07-b6b4-b6f58e8881eb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e2d23ff
2021-06-04T01:56:29.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75d8a3ba-4e95-4f07-b6b4-b6f58e8881eb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:56:29.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75d8a3ba-4e95-4f07-b6b4-b6f58e8881eb PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:56:30.618Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32311bd5-6cd5-422d-a7ff-7f92bdb3692f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:56:30.618Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32311bd5-6cd5-422d-a7ff-7f92bdb3692f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@39294259
2021-06-04T01:56:30.618Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32311bd5-6cd5-422d-a7ff-7f92bdb3692f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:56:30.618Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32311bd5-6cd5-422d-a7ff-7f92bdb3692f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:56:31.390Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b7a4733-511f-429d-9ff5-8e718946f82c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:56:31.390Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b7a4733-511f-429d-9ff5-8e718946f82c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@230db6cd
2021-06-04T01:56:31.390Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b7a4733-511f-429d-9ff5-8e718946f82c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:56:31.390Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b7a4733-511f-429d-9ff5-8e718946f82c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:56:33.366Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37329d15-28b7-47c8-b0f9-73f17b56c5dd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:56:33.366Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37329d15-28b7-47c8-b0f9-73f17b56c5dd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74028e25
2021-06-04T01:56:33.366Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37329d15-28b7-47c8-b0f9-73f17b56c5dd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:56:33.366Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37329d15-28b7-47c8-b0f9-73f17b56c5dd PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:56:36.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa2cd2e7-05f3-40a9-9c05-5ee185250228 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:56:36.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa2cd2e7-05f3-40a9-9c05-5ee185250228 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@33776981
2021-06-04T01:56:36.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa2cd2e7-05f3-40a9-9c05-5ee185250228 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:56:36.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa2cd2e7-05f3-40a9-9c05-5ee185250228 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:56:36.940Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:56:36.942Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:56:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T01:56:39.453Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T01:56:39.453Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T01:56:39.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17c21c4a-efe8-48f5-b356-2be54f6ed804 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:56:39.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17c21c4a-efe8-48f5-b356-2be54f6ed804 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@40bfde3c
2021-06-04T01:56:39.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17c21c4a-efe8-48f5-b356-2be54f6ed804 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:56:39.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17c21c4a-efe8-48f5-b356-2be54f6ed804 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:56:42.098Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec873c2e-1a0b-4dde-876a-f6c1bd44049b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:56:42.098Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec873c2e-1a0b-4dde-876a-f6c1bd44049b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ecaa338
2021-06-04T01:56:42.098Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec873c2e-1a0b-4dde-876a-f6c1bd44049b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:56:42.098Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec873c2e-1a0b-4dde-876a-f6c1bd44049b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:56:48.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b99e7917-9b4a-4a8a-8dc0-a1a8a4de3cde PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:56:48.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b99e7917-9b4a-4a8a-8dc0-a1a8a4de3cde PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ed97762
2021-06-04T01:56:48.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b99e7917-9b4a-4a8a-8dc0-a1a8a4de3cde PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:56:48.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b99e7917-9b4a-4a8a-8dc0-a1a8a4de3cde PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:56:50.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41a97fe2-1a15-461d-b4ef-d923ff65797c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:56:50.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41a97fe2-1a15-461d-b4ef-d923ff65797c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@666a2059
2021-06-04T01:56:50.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41a97fe2-1a15-461d-b4ef-d923ff65797c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:56:50.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41a97fe2-1a15-461d-b4ef-d923ff65797c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:56:51.377Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f974044-8802-475e-8ece-ade0f510cc51 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:56:51.377Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f974044-8802-475e-8ece-ade0f510cc51 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@581a4c96
2021-06-04T01:56:51.377Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f974044-8802-475e-8ece-ade0f510cc51 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:56:51.377Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f974044-8802-475e-8ece-ade0f510cc51 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:56:53.896Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:56:53.897Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:56:55.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=075a6b1d-cd9e-4c2c-80f7-d62b7eb052f2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:56:55.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=075a6b1d-cd9e-4c2c-80f7-d62b7eb052f2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@392e7ce
2021-06-04T01:56:55.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=075a6b1d-cd9e-4c2c-80f7-d62b7eb052f2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:56:55.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=075a6b1d-cd9e-4c2c-80f7-d62b7eb052f2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:56:58.379Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b7042e9-443a-4fbf-85da-056d211defb6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:56:58.379Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b7042e9-443a-4fbf-85da-056d211defb6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2655f2b9
2021-06-04T01:56:58.379Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b7042e9-443a-4fbf-85da-056d211defb6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:56:58.379Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b7042e9-443a-4fbf-85da-056d211defb6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:57:00.510Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:57:00.510Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:57:00.598Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47a117b1-4883-43b4-a9b8-0656357ba1bd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:57:00.598Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47a117b1-4883-43b4-a9b8-0656357ba1bd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@118a76c2
2021-06-04T01:57:00.598Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47a117b1-4883-43b4-a9b8-0656357ba1bd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:57:00.598Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47a117b1-4883-43b4-a9b8-0656357ba1bd PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:57:01.511Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:57:01.513Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:57:03.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=381893ba-d238-4aa4-96f9-098a0bfa145e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:57:03.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=381893ba-d238-4aa4-96f9-098a0bfa145e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1bfee699
2021-06-04T01:57:03.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=381893ba-d238-4aa4-96f9-098a0bfa145e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:57:03.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=381893ba-d238-4aa4-96f9-098a0bfa145e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:57:07.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd08bf29-2ca6-4623-a3bd-3b5faa81b855 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:57:07.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd08bf29-2ca6-4623-a3bd-3b5faa81b855 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@f46cebf
2021-06-04T01:57:07.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd08bf29-2ca6-4623-a3bd-3b5faa81b855 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:57:07.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd08bf29-2ca6-4623-a3bd-3b5faa81b855 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:57:09.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7569e053-152f-43c8-9046-a4c6d4f86c7c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:57:09.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7569e053-152f-43c8-9046-a4c6d4f86c7c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60f25d4
2021-06-04T01:57:09.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7569e053-152f-43c8-9046-a4c6d4f86c7c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:57:09.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7569e053-152f-43c8-9046-a4c6d4f86c7c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:57:12.202Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af37e2f6-7856-4697-af67-495960c3d900 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:57:12.202Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af37e2f6-7856-4697-af67-495960c3d900 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@44f17fb1
2021-06-04T01:57:12.202Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af37e2f6-7856-4697-af67-495960c3d900 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:57:12.202Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af37e2f6-7856-4697-af67-495960c3d900 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:57:18.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:57:18.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:57:21.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:57:24.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:57:25.120Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:57:25.121Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:57:27.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:57:28.539Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 503 Service Unavailable
2021-06-04T01:57:28.540Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 503
2021-06-04T01:57:28.540Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=503, variables=[]]
2021-06-04T01:57:30.016Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:57:30.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15a73a63-dbf5-4982-93bd-c3d79bc80c00 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:57:30.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15a73a63-dbf5-4982-93bd-c3d79bc80c00 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28578398
2021-06-04T01:57:30.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15a73a63-dbf5-4982-93bd-c3d79bc80c00 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:57:30.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15a73a63-dbf5-4982-93bd-c3d79bc80c00 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:57:32.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d336bf0-c54e-4fa9-ac8a-ea7034f06093 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:57:32.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d336bf0-c54e-4fa9-ac8a-ea7034f06093 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@11dd931b
2021-06-04T01:57:32.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d336bf0-c54e-4fa9-ac8a-ea7034f06093 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:57:32.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d336bf0-c54e-4fa9-ac8a-ea7034f06093 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:57:33.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b36b3c6d-5ce8-4226-8e30-8930ae92b095 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:57:33.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b36b3c6d-5ce8-4226-8e30-8930ae92b095 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e833571
2021-06-04T01:57:33.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b36b3c6d-5ce8-4226-8e30-8930ae92b095 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:57:33.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b36b3c6d-5ce8-4226-8e30-8930ae92b095 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:57:36.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:57:36.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:57:37.298Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1602e0ea-c6b0-4fc2-acda-d7e55566052a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:57:37.299Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1602e0ea-c6b0-4fc2-acda-d7e55566052a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@21c0c3e7
2021-06-04T01:57:37.299Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1602e0ea-c6b0-4fc2-acda-d7e55566052a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:57:37.299Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1602e0ea-c6b0-4fc2-acda-d7e55566052a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:57:38.675Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:57:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T01:57:39.453Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T01:57:39.453Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T01:57:40.304Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=1602e0ea-c6b0-4fc2-acda-d7e55566052a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T01:57:40.304Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=1602e0ea-c6b0-4fc2-acda-d7e55566052a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T01:57:40.304Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=1602e0ea-c6b0-4fc2-acda-d7e55566052a ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:57:40.304Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=1602e0ea-c6b0-4fc2-acda-d7e55566052a ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:57:42.660Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15dfa9ab-13d4-4566-931f-32f6e3b58d93 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:57:42.660Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15dfa9ab-13d4-4566-931f-32f6e3b58d93 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@359fcf04
2021-06-04T01:57:42.660Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15dfa9ab-13d4-4566-931f-32f6e3b58d93 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:57:42.660Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15dfa9ab-13d4-4566-931f-32f6e3b58d93 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:57:44.021Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=15dfa9ab-13d4-4566-931f-32f6e3b58d93 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:57:44.021Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=15dfa9ab-13d4-4566-931f-32f6e3b58d93 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:57:44.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb39cf70-489a-4e36-9cb7-b7430ee23a2d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:57:44.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb39cf70-489a-4e36-9cb7-b7430ee23a2d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f784b2f
2021-06-04T01:57:44.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb39cf70-489a-4e36-9cb7-b7430ee23a2d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:57:44.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb39cf70-489a-4e36-9cb7-b7430ee23a2d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:57:45.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=474e25a7-7e6c-4f3c-9789-b365b63c2852 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:57:45.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=474e25a7-7e6c-4f3c-9789-b365b63c2852 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@188078dc
2021-06-04T01:57:45.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=474e25a7-7e6c-4f3c-9789-b365b63c2852 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:57:45.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=474e25a7-7e6c-4f3c-9789-b365b63c2852 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:57:45.811Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T01:57:45.811Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T01:57:45.915Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:57:45.918Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:57:45.950Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 503 Service Unavailable
2021-06-04T01:57:45.950Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 503
2021-06-04T01:57:45.951Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=503, variables=[]]
2021-06-04T01:57:46.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:57:46.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:57:46.464Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:57:46.466Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:57:46.484Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:57:46.485Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:57:46.507Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:57:46.509Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:57:46.532Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:57:46.533Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:57:46.551Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:57:46.552Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:57:46.573Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:57:46.574Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:57:46.586Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:57:46.588Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:57:46.602Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:57:46.603Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:57:46.625Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:57:46.626Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:57:46.632Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:57:46.633Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:57:46.641Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:57:46.642Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T01:57:46.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82e3ca36-0989-40a6-88dc-0e000ab1fc70 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:57:46.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82e3ca36-0989-40a6-88dc-0e000ab1fc70 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53ac6327
2021-06-04T01:57:46.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82e3ca36-0989-40a6-88dc-0e000ab1fc70 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:57:46.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82e3ca36-0989-40a6-88dc-0e000ab1fc70 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:57:47.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba163078-5e6d-4c34-a694-c47c12e43eb3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:57:47.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba163078-5e6d-4c34-a694-c47c12e43eb3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@25428e4a
2021-06-04T01:57:47.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba163078-5e6d-4c34-a694-c47c12e43eb3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:57:47.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba163078-5e6d-4c34-a694-c47c12e43eb3 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:57:48.273Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ba163078-5e6d-4c34-a694-c47c12e43eb3 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:57:48.274Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ba163078-5e6d-4c34-a694-c47c12e43eb3 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:57:48.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11fff1a6-5e2b-49f3-a29b-605e82da0a3f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:57:48.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11fff1a6-5e2b-49f3-a29b-605e82da0a3f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@581e88fe
2021-06-04T01:57:48.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11fff1a6-5e2b-49f3-a29b-605e82da0a3f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:57:48.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11fff1a6-5e2b-49f3-a29b-605e82da0a3f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:57:50.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b2040f7-7f0e-4f5f-87ae-ac1e5c345fbe PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:57:50.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b2040f7-7f0e-4f5f-87ae-ac1e5c345fbe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43c34db9
2021-06-04T01:57:50.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b2040f7-7f0e-4f5f-87ae-ac1e5c345fbe PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:57:50.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b2040f7-7f0e-4f5f-87ae-ac1e5c345fbe PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:57:52.151Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69c8683e-0091-4b2c-9822-6089864b18de PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:57:52.152Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69c8683e-0091-4b2c-9822-6089864b18de PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7346abbd
2021-06-04T01:57:52.152Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69c8683e-0091-4b2c-9822-6089864b18de PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:57:52.152Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69c8683e-0091-4b2c-9822-6089864b18de PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:57:53.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5151e66-6047-4b3a-8c74-d83cc0e8ed74 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:57:53.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5151e66-6047-4b3a-8c74-d83cc0e8ed74 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42c74b41
2021-06-04T01:57:53.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5151e66-6047-4b3a-8c74-d83cc0e8ed74 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:57:53.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5151e66-6047-4b3a-8c74-d83cc0e8ed74 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:57:54.853Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=414e86b9-1225-44a0-9b2d-2e6151f30bd0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:57:54.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=414e86b9-1225-44a0-9b2d-2e6151f30bd0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6eb2729f
2021-06-04T01:57:54.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=414e86b9-1225-44a0-9b2d-2e6151f30bd0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:57:54.855Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=414e86b9-1225-44a0-9b2d-2e6151f30bd0 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:57:57.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=336e928d-50e1-42ed-8983-4963442b5eef PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:57:57.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=336e928d-50e1-42ed-8983-4963442b5eef PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@37454475
2021-06-04T01:57:57.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=336e928d-50e1-42ed-8983-4963442b5eef PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:57:57.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=336e928d-50e1-42ed-8983-4963442b5eef PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:57:59.875Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:57:59.883Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:58:00.746Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9641e072-bd6a-4d4d-af9b-a828577d6cad PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:58:00.746Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9641e072-bd6a-4d4d-af9b-a828577d6cad PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71180a63
2021-06-04T01:58:00.746Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9641e072-bd6a-4d4d-af9b-a828577d6cad PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:58:00.746Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9641e072-bd6a-4d4d-af9b-a828577d6cad PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:58:03.751Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=289143ed-3979-49be-931b-dd65671ac88c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:58:03.751Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=289143ed-3979-49be-931b-dd65671ac88c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@97dca42
2021-06-04T01:58:03.751Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=289143ed-3979-49be-931b-dd65671ac88c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:58:03.751Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=289143ed-3979-49be-931b-dd65671ac88c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:58:06.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28898f43-6030-4c55-b726-48dc032ccc72 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:58:06.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28898f43-6030-4c55-b726-48dc032ccc72 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74266778
2021-06-04T01:58:06.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28898f43-6030-4c55-b726-48dc032ccc72 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:58:06.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28898f43-6030-4c55-b726-48dc032ccc72 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:58:09.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b2bf635-e012-4701-8ec3-642791749d64 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:58:09.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b2bf635-e012-4701-8ec3-642791749d64 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69dde365
2021-06-04T01:58:09.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b2bf635-e012-4701-8ec3-642791749d64 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:58:09.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b2bf635-e012-4701-8ec3-642791749d64 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:58:12.466Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8b8c1bf-4991-4f43-8bb1-953a4df33301 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:58:12.466Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8b8c1bf-4991-4f43-8bb1-953a4df33301 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58a7a72f
2021-06-04T01:58:12.466Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8b8c1bf-4991-4f43-8bb1-953a4df33301 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:58:12.466Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8b8c1bf-4991-4f43-8bb1-953a4df33301 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:58:14.869Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:58:14.876Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T01:58:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13e98a78-36e5-4b8f-a835-0f39e12c0df0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:58:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13e98a78-36e5-4b8f-a835-0f39e12c0df0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f6f49a3
2021-06-04T01:58:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13e98a78-36e5-4b8f-a835-0f39e12c0df0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:58:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13e98a78-36e5-4b8f-a835-0f39e12c0df0 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:58:18.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2f54c76-52c6-47af-8bd8-ef869307440f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:58:18.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2f54c76-52c6-47af-8bd8-ef869307440f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7835f491
2021-06-04T01:58:18.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2f54c76-52c6-47af-8bd8-ef869307440f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:58:18.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2f54c76-52c6-47af-8bd8-ef869307440f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:58:21.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c87f665-ad95-4a9e-a57a-d7128535c289 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:58:21.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c87f665-ad95-4a9e-a57a-d7128535c289 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ef5f639
2021-06-04T01:58:21.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c87f665-ad95-4a9e-a57a-d7128535c289 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:58:21.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c87f665-ad95-4a9e-a57a-d7128535c289 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:58:24.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b83f7e1-b9e5-410d-9ceb-6173461409cb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:58:24.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b83f7e1-b9e5-410d-9ceb-6173461409cb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b8eb817
2021-06-04T01:58:24.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b83f7e1-b9e5-410d-9ceb-6173461409cb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:58:24.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b83f7e1-b9e5-410d-9ceb-6173461409cb PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:58:27.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7aca9ce9-97b5-4c31-a667-bd3cc6256017 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:58:27.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7aca9ce9-97b5-4c31-a667-bd3cc6256017 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ee9d894
2021-06-04T01:58:27.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7aca9ce9-97b5-4c31-a667-bd3cc6256017 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:58:27.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7aca9ce9-97b5-4c31-a667-bd3cc6256017 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:58:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:58:29.870Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T01:58:29.872Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:58:29.873Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T01:58:29.874Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T01:58:30.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4c518f7-a8aa-4979-9b8a-1b2e24c2c2f8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:58:30.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4c518f7-a8aa-4979-9b8a-1b2e24c2c2f8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9af2ea4
2021-06-04T01:58:30.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4c518f7-a8aa-4979-9b8a-1b2e24c2c2f8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:58:30.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4c518f7-a8aa-4979-9b8a-1b2e24c2c2f8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:58:30.882Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c4c518f7-a8aa-4979-9b8a-1b2e24c2c2f8 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:58:30.882Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c4c518f7-a8aa-4979-9b8a-1b2e24c2c2f8 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T01:58:33.446Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8403598f-3ca2-45ef-9521-a97f912d8c1d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:58:33.446Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8403598f-3ca2-45ef-9521-a97f912d8c1d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@583a5596
2021-06-04T01:58:33.446Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8403598f-3ca2-45ef-9521-a97f912d8c1d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:58:33.446Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8403598f-3ca2-45ef-9521-a97f912d8c1d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:58:36.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00dfddae-c25d-44af-b532-33f1d35f19ec PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:58:36.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00dfddae-c25d-44af-b532-33f1d35f19ec PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@369a0086
2021-06-04T01:58:36.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00dfddae-c25d-44af-b532-33f1d35f19ec PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:58:36.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00dfddae-c25d-44af-b532-33f1d35f19ec PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:58:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T01:58:39.454Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T01:58:39.454Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T01:58:39.458Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T01:58:39.458Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T01:58:39.458Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T01:58:39.678Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6290ac6-c368-4d30-9770-25bfe3f37263 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:58:39.679Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6290ac6-c368-4d30-9770-25bfe3f37263 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@262753b9
2021-06-04T01:58:39.679Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6290ac6-c368-4d30-9770-25bfe3f37263 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:58:39.679Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6290ac6-c368-4d30-9770-25bfe3f37263 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:58:42.703Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7c5cb06-a42c-4e92-931c-0c3f660ac3fc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:58:42.703Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7c5cb06-a42c-4e92-931c-0c3f660ac3fc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@568d93d7
2021-06-04T01:58:42.703Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7c5cb06-a42c-4e92-931c-0c3f660ac3fc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:58:42.703Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7c5cb06-a42c-4e92-931c-0c3f660ac3fc PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:58:44.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:58:44.870Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T01:58:44.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:58:44.873Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T01:58:46.602Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8af25f5d-0501-4125-a2fb-0556e7da3c2f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:58:46.602Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8af25f5d-0501-4125-a2fb-0556e7da3c2f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c11fa75
2021-06-04T01:58:46.602Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8af25f5d-0501-4125-a2fb-0556e7da3c2f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:58:46.602Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8af25f5d-0501-4125-a2fb-0556e7da3c2f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:58:48.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=318d0df6-e738-404d-a177-9e4ad6b56bd7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:58:48.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=318d0df6-e738-404d-a177-9e4ad6b56bd7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a694f41
2021-06-04T01:58:48.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=318d0df6-e738-404d-a177-9e4ad6b56bd7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:58:48.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=318d0df6-e738-404d-a177-9e4ad6b56bd7 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:58:51.254Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53eb1077-92e0-4101-ac09-a47ee3a3a8ca PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:58:51.254Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53eb1077-92e0-4101-ac09-a47ee3a3a8ca PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@264f692e
2021-06-04T01:58:51.254Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53eb1077-92e0-4101-ac09-a47ee3a3a8ca PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:58:51.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53eb1077-92e0-4101-ac09-a47ee3a3a8ca PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:58:54.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=058dc6e1-6e66-4c07-82ec-e0c1fd09a8e2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:58:54.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=058dc6e1-6e66-4c07-82ec-e0c1fd09a8e2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ce6451b
2021-06-04T01:58:54.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=058dc6e1-6e66-4c07-82ec-e0c1fd09a8e2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:58:54.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=058dc6e1-6e66-4c07-82ec-e0c1fd09a8e2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:58:58.062Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ed6ef35-6a3a-4636-bc80-a8b188104802 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:58:58.062Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ed6ef35-6a3a-4636-bc80-a8b188104802 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f77d6a0
2021-06-04T01:58:58.062Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ed6ef35-6a3a-4636-bc80-a8b188104802 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:58:58.062Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ed6ef35-6a3a-4636-bc80-a8b188104802 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:58:59.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:58:59.870Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T01:58:59.872Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:58:59.873Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T01:59:00.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf73bb1c-7d0b-4b98-8a3f-4958682e5784 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:59:00.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf73bb1c-7d0b-4b98-8a3f-4958682e5784 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f148b48
2021-06-04T01:59:00.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf73bb1c-7d0b-4b98-8a3f-4958682e5784 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:59:00.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf73bb1c-7d0b-4b98-8a3f-4958682e5784 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:59:03.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48a29db3-f970-4ac9-8fc2-435f1d6eb646 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:59:03.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48a29db3-f970-4ac9-8fc2-435f1d6eb646 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@62cf939d
2021-06-04T01:59:03.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48a29db3-f970-4ac9-8fc2-435f1d6eb646 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:59:03.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48a29db3-f970-4ac9-8fc2-435f1d6eb646 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:59:06.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T01:59:06.262Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T01:59:08.373Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T01:59:08.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef0ee60d-88fb-453b-be6a-26033a416141 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:59:08.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef0ee60d-88fb-453b-be6a-26033a416141 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c2fdc42
2021-06-04T01:59:08.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef0ee60d-88fb-453b-be6a-26033a416141 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:59:08.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef0ee60d-88fb-453b-be6a-26033a416141 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:59:10.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a448dd5f-dfe5-40ac-8496-b83ef47a441e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:59:10.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a448dd5f-dfe5-40ac-8496-b83ef47a441e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d1cd1b1
2021-06-04T01:59:10.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a448dd5f-dfe5-40ac-8496-b83ef47a441e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:59:10.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a448dd5f-dfe5-40ac-8496-b83ef47a441e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:59:12.655Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88f19add-d891-4557-a4eb-d558d0bc40a6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:59:12.655Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88f19add-d891-4557-a4eb-d558d0bc40a6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@26c95391
2021-06-04T01:59:12.655Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88f19add-d891-4557-a4eb-d558d0bc40a6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:59:12.655Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88f19add-d891-4557-a4eb-d558d0bc40a6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:59:14.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:59:14.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T01:59:14.872Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:59:14.873Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T01:59:15.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29243c3e-3139-4ada-b65a-8530071a8f47 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:59:15.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29243c3e-3139-4ada-b65a-8530071a8f47 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38046fae
2021-06-04T01:59:15.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29243c3e-3139-4ada-b65a-8530071a8f47 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:59:15.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29243c3e-3139-4ada-b65a-8530071a8f47 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:59:18.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2755e1dc-ab5f-4eb4-a60e-fad9165f61b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:59:18.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2755e1dc-ab5f-4eb4-a60e-fad9165f61b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a7b6920
2021-06-04T01:59:18.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2755e1dc-ab5f-4eb4-a60e-fad9165f61b9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:59:18.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2755e1dc-ab5f-4eb4-a60e-fad9165f61b9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:59:21.259Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=692003d7-f381-4e0b-9add-c711e209ff25 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:59:21.259Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=692003d7-f381-4e0b-9add-c711e209ff25 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5131b087
2021-06-04T01:59:21.259Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=692003d7-f381-4e0b-9add-c711e209ff25 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:59:21.259Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=692003d7-f381-4e0b-9add-c711e209ff25 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:59:24.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ba781ef-0fa5-4911-aa22-c439fe638efe PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:59:24.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ba781ef-0fa5-4911-aa22-c439fe638efe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d8834eb
2021-06-04T01:59:24.755Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ba781ef-0fa5-4911-aa22-c439fe638efe PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:59:24.755Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ba781ef-0fa5-4911-aa22-c439fe638efe PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:59:27.698Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61379b4d-a9db-44fc-983f-49a82b8bb27c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:59:27.699Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61379b4d-a9db-44fc-983f-49a82b8bb27c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@26ea45eb
2021-06-04T01:59:27.699Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61379b4d-a9db-44fc-983f-49a82b8bb27c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:59:27.699Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61379b4d-a9db-44fc-983f-49a82b8bb27c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:59:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:59:29.870Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T01:59:29.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:59:29.872Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T01:59:30.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba0e9c0a-1e6b-4ffb-80af-f1decafd419f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:59:30.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba0e9c0a-1e6b-4ffb-80af-f1decafd419f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@77890a7f
2021-06-04T01:59:30.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba0e9c0a-1e6b-4ffb-80af-f1decafd419f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:59:30.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba0e9c0a-1e6b-4ffb-80af-f1decafd419f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:59:39.453Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T01:59:39.454Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T01:59:39.455Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T01:59:39.456Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T01:59:39.457Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T01:59:39.457Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T01:59:39.458Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T01:59:39.960Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28b2e750-93b0-4da8-a68a-567aece217d9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:59:39.960Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28b2e750-93b0-4da8-a68a-567aece217d9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2be02981
2021-06-04T01:59:39.960Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28b2e750-93b0-4da8-a68a-567aece217d9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:59:39.960Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28b2e750-93b0-4da8-a68a-567aece217d9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:59:41.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d670ede-c6bc-4805-b07f-35790cac6ffb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:59:41.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d670ede-c6bc-4805-b07f-35790cac6ffb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57336f7a
2021-06-04T01:59:41.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d670ede-c6bc-4805-b07f-35790cac6ffb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:59:41.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d670ede-c6bc-4805-b07f-35790cac6ffb PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:59:42.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34b85fbf-c1c8-4b69-98bd-5081f625b57f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:59:42.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34b85fbf-c1c8-4b69-98bd-5081f625b57f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2302ad6a
2021-06-04T01:59:42.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34b85fbf-c1c8-4b69-98bd-5081f625b57f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:59:42.097Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34b85fbf-c1c8-4b69-98bd-5081f625b57f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:59:42.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a83e755d-a3f2-4db7-98b3-ee508852ad94 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:59:42.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a83e755d-a3f2-4db7-98b3-ee508852ad94 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c678187
2021-06-04T01:59:42.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a83e755d-a3f2-4db7-98b3-ee508852ad94 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:59:42.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a83e755d-a3f2-4db7-98b3-ee508852ad94 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:59:44.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:59:44.869Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T01:59:44.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:59:44.874Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T01:59:45.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35359e3d-0edc-4eda-aa74-344ec28039cb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:59:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35359e3d-0edc-4eda-aa74-344ec28039cb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@36e11fab
2021-06-04T01:59:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35359e3d-0edc-4eda-aa74-344ec28039cb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:59:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35359e3d-0edc-4eda-aa74-344ec28039cb PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:59:48.702Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9dc972bd-c2f5-49c5-9cb5-625d77834417 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:59:48.702Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9dc972bd-c2f5-49c5-9cb5-625d77834417 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ae5feb2
2021-06-04T01:59:48.702Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9dc972bd-c2f5-49c5-9cb5-625d77834417 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:59:48.702Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9dc972bd-c2f5-49c5-9cb5-625d77834417 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:59:52.288Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88ff8b64-352c-4fbe-a2b2-b067dfdd4b5a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:59:52.288Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88ff8b64-352c-4fbe-a2b2-b067dfdd4b5a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4cba7579
2021-06-04T01:59:52.288Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88ff8b64-352c-4fbe-a2b2-b067dfdd4b5a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:59:52.288Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88ff8b64-352c-4fbe-a2b2-b067dfdd4b5a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:59:54.844Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fba25c6-57f6-4d8d-9c43-2c5e4e430e93 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:59:54.844Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fba25c6-57f6-4d8d-9c43-2c5e4e430e93 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c71bed0
2021-06-04T01:59:54.844Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fba25c6-57f6-4d8d-9c43-2c5e4e430e93 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:59:54.845Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fba25c6-57f6-4d8d-9c43-2c5e4e430e93 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:59:57.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9cf09634-15d0-45da-bcd1-dde5b8607bb1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T01:59:57.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9cf09634-15d0-45da-bcd1-dde5b8607bb1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@52d3e8b2
2021-06-04T01:59:57.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9cf09634-15d0-45da-bcd1-dde5b8607bb1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T01:59:57.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9cf09634-15d0-45da-bcd1-dde5b8607bb1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T01:59:59.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:59:59.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T01:59:59.872Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T01:59:59.873Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:00:00.281Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24b5170c-1d5b-4522-b673-8dc448455443 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:00:00.281Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24b5170c-1d5b-4522-b673-8dc448455443 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7168c34
2021-06-04T02:00:00.281Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24b5170c-1d5b-4522-b673-8dc448455443 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:00:00.281Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24b5170c-1d5b-4522-b673-8dc448455443 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:00:05.279Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebb6733d-055c-4398-903f-88cd4167472f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:00:05.279Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebb6733d-055c-4398-903f-88cd4167472f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@18182012
2021-06-04T02:00:05.279Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebb6733d-055c-4398-903f-88cd4167472f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:00:05.279Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebb6733d-055c-4398-903f-88cd4167472f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:00:06.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db230ed9-559b-408b-aee7-e0ec56914841 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:00:06.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db230ed9-559b-408b-aee7-e0ec56914841 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@797e9aff
2021-06-04T02:00:06.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db230ed9-559b-408b-aee7-e0ec56914841 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:00:06.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db230ed9-559b-408b-aee7-e0ec56914841 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:00:09.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56708091-5df2-431e-89ec-a3f2a3c70bee PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:00:09.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56708091-5df2-431e-89ec-a3f2a3c70bee PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34a56b1a
2021-06-04T02:00:09.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56708091-5df2-431e-89ec-a3f2a3c70bee PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:00:09.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56708091-5df2-431e-89ec-a3f2a3c70bee PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:00:12.659Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c04f6881-0b0b-4124-b468-13b27619387b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:00:12.659Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c04f6881-0b0b-4124-b468-13b27619387b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7612696
2021-06-04T02:00:12.659Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c04f6881-0b0b-4124-b468-13b27619387b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:00:12.659Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c04f6881-0b0b-4124-b468-13b27619387b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:00:14.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:00:14.869Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:00:14.870Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:00:14.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:00:15.523Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e87d945a-133a-4e33-8bd4-72ffef333f53 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:00:15.524Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e87d945a-133a-4e33-8bd4-72ffef333f53 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ea08ed8
2021-06-04T02:00:15.524Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e87d945a-133a-4e33-8bd4-72ffef333f53 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:00:15.524Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e87d945a-133a-4e33-8bd4-72ffef333f53 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:00:18.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31e2fb94-270b-45db-bde3-38931936b257 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:00:18.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31e2fb94-270b-45db-bde3-38931936b257 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53045e91
2021-06-04T02:00:18.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31e2fb94-270b-45db-bde3-38931936b257 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:00:18.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31e2fb94-270b-45db-bde3-38931936b257 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:00:21.093Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99270177-3cd3-447d-a5b6-0f7eb85d55ef PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:00:21.093Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99270177-3cd3-447d-a5b6-0f7eb85d55ef PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c660250
2021-06-04T02:00:21.093Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99270177-3cd3-447d-a5b6-0f7eb85d55ef PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:00:21.093Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99270177-3cd3-447d-a5b6-0f7eb85d55ef PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:00:24.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4fa907e-44db-4a54-a0d4-0bb74762a44e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:00:24.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4fa907e-44db-4a54-a0d4-0bb74762a44e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@423dc8dc
2021-06-04T02:00:24.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4fa907e-44db-4a54-a0d4-0bb74762a44e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:00:24.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4fa907e-44db-4a54-a0d4-0bb74762a44e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:00:27.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:00:27.262Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:00:29.778Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:00:29.873Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:00:29.879Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:00:29.880Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:00:29.881Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:00:30.066Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1622848c-d75d-46e2-bd16-a33575b8dcef PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:00:30.066Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1622848c-d75d-46e2-bd16-a33575b8dcef PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1831580d
2021-06-04T02:00:30.066Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1622848c-d75d-46e2-bd16-a33575b8dcef PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:00:30.067Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1622848c-d75d-46e2-bd16-a33575b8dcef PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:00:30.690Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d546f0e9-44bf-453d-85d2-e4bfc690306f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:00:30.690Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d546f0e9-44bf-453d-85d2-e4bfc690306f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69306d4c
2021-06-04T02:00:30.690Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d546f0e9-44bf-453d-85d2-e4bfc690306f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:00:30.690Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d546f0e9-44bf-453d-85d2-e4bfc690306f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:00:33.756Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92ff299d-0746-4137-a431-ab41ffd10768 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:00:33.756Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92ff299d-0746-4137-a431-ab41ffd10768 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@153896b8
2021-06-04T02:00:33.756Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92ff299d-0746-4137-a431-ab41ffd10768 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:00:33.756Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92ff299d-0746-4137-a431-ab41ffd10768 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:00:36.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:00:36.262Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:00:36.764Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=92ff299d-0746-4137-a431-ab41ffd10768 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:00:36.765Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=92ff299d-0746-4137-a431-ab41ffd10768 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:00:36.765Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=92ff299d-0746-4137-a431-ab41ffd10768 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:00:36.765Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=92ff299d-0746-4137-a431-ab41ffd10768 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:00:37.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e854011a-3b21-4da6-bd0a-e155c324bfbd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:00:37.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e854011a-3b21-4da6-bd0a-e155c324bfbd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@39efc7eb
2021-06-04T02:00:37.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e854011a-3b21-4da6-bd0a-e155c324bfbd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:00:37.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e854011a-3b21-4da6-bd0a-e155c324bfbd PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:00:38.759Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:00:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:00:39.453Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T02:00:39.454Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:00:39.454Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:00:39.456Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:00:39.457Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T02:00:39.457Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T02:00:40.841Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e854011a-3b21-4da6-bd0a-e155c324bfbd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:00:40.842Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e854011a-3b21-4da6-bd0a-e155c324bfbd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:00:40.842Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e854011a-3b21-4da6-bd0a-e155c324bfbd ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:00:40.843Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=e854011a-3b21-4da6-bd0a-e155c324bfbd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:00:42.248Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61d3ea00-aadb-494c-b736-7cbdf7bd2367 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:00:42.249Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61d3ea00-aadb-494c-b736-7cbdf7bd2367 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41bc53cb
2021-06-04T02:00:42.249Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61d3ea00-aadb-494c-b736-7cbdf7bd2367 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:00:42.249Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61d3ea00-aadb-494c-b736-7cbdf7bd2367 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:00:42.385Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=61d3ea00-aadb-494c-b736-7cbdf7bd2367 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:00:42.386Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=61d3ea00-aadb-494c-b736-7cbdf7bd2367 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:00:43.168Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9fcb3527-9d41-4f2a-a14b-2533bdeef7ed PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:00:43.168Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9fcb3527-9d41-4f2a-a14b-2533bdeef7ed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57f7dd7a
2021-06-04T02:00:43.168Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9fcb3527-9d41-4f2a-a14b-2533bdeef7ed PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:00:43.169Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9fcb3527-9d41-4f2a-a14b-2533bdeef7ed PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:00:44.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:00:44.870Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:00:44.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:00:44.872Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:00:46.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c65e4ce-3947-4f2a-848f-88071e21b50a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:00:46.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c65e4ce-3947-4f2a-848f-88071e21b50a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1cbf1d26
2021-06-04T02:00:46.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c65e4ce-3947-4f2a-848f-88071e21b50a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:00:46.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c65e4ce-3947-4f2a-848f-88071e21b50a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:00:48.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:00:48.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:00:49.060Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=1c65e4ce-3947-4f2a-848f-88071e21b50a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:00:49.060Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=1c65e4ce-3947-4f2a-848f-88071e21b50a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:00:49.060Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=1c65e4ce-3947-4f2a-848f-88071e21b50a ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:00:49.060Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=1c65e4ce-3947-4f2a-848f-88071e21b50a ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:00:51.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:00:52.811Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9629dbe2-0959-4312-ab8d-ee3e8dba4ac6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:00:52.811Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9629dbe2-0959-4312-ab8d-ee3e8dba4ac6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f3e2771
2021-06-04T02:00:52.811Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9629dbe2-0959-4312-ab8d-ee3e8dba4ac6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:00:52.811Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9629dbe2-0959-4312-ab8d-ee3e8dba4ac6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:00:53.422Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9629dbe2-0959-4312-ab8d-ee3e8dba4ac6 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:00:53.423Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=9629dbe2-0959-4312-ab8d-ee3e8dba4ac6 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:00:53.518Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:00:54.300Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c3e7851-4a58-4171-bb1d-a13ad060847b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:00:54.300Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c3e7851-4a58-4171-bb1d-a13ad060847b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42bfd48a
2021-06-04T02:00:54.300Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c3e7851-4a58-4171-bb1d-a13ad060847b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:00:54.300Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c3e7851-4a58-4171-bb1d-a13ad060847b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:00:56.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09a62ece-4b92-4ea1-8fe5-5c8b228fa471 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:00:56.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09a62ece-4b92-4ea1-8fe5-5c8b228fa471 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@268da7d6
2021-06-04T02:00:56.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09a62ece-4b92-4ea1-8fe5-5c8b228fa471 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:00:56.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09a62ece-4b92-4ea1-8fe5-5c8b228fa471 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:00:56.520Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=09a62ece-4b92-4ea1-8fe5-5c8b228fa471 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:00:56.520Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=09a62ece-4b92-4ea1-8fe5-5c8b228fa471 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:00:57.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d0c71e4-3f2e-43aa-962c-a33581e86fba PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:00:57.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d0c71e4-3f2e-43aa-962c-a33581e86fba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@684609d9
2021-06-04T02:00:57.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d0c71e4-3f2e-43aa-962c-a33581e86fba PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:00:57.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d0c71e4-3f2e-43aa-962c-a33581e86fba PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:00:59.869Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:00:59.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:00:59.872Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:00:59.873Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:01:00.614Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0035c6c1-6b0a-4ac8-af00-1bf8251f8a95 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:01:00.614Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0035c6c1-6b0a-4ac8-af00-1bf8251f8a95 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1575aa35
2021-06-04T02:01:00.615Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0035c6c1-6b0a-4ac8-af00-1bf8251f8a95 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:01:00.615Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0035c6c1-6b0a-4ac8-af00-1bf8251f8a95 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:01:03.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f26b8dd0-6a20-4a31-a5a4-b76bb890e54f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:01:03.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f26b8dd0-6a20-4a31-a5a4-b76bb890e54f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29d23795
2021-06-04T02:01:03.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f26b8dd0-6a20-4a31-a5a4-b76bb890e54f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:01:03.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f26b8dd0-6a20-4a31-a5a4-b76bb890e54f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:01:06.421Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f26b8dd0-6a20-4a31-a5a4-b76bb890e54f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:01:06.421Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f26b8dd0-6a20-4a31-a5a4-b76bb890e54f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:01:06.422Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f26b8dd0-6a20-4a31-a5a4-b76bb890e54f ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:01:06.422Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f26b8dd0-6a20-4a31-a5a4-b76bb890e54f ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:01:08.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1a8f649-d1dd-40d9-9c02-547ecb50a43e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:01:08.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1a8f649-d1dd-40d9-9c02-547ecb50a43e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@622a866e
2021-06-04T02:01:08.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1a8f649-d1dd-40d9-9c02-547ecb50a43e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:01:08.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1a8f649-d1dd-40d9-9c02-547ecb50a43e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:01:09.318Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b1a8f649-d1dd-40d9-9c02-547ecb50a43e ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:01:09.318Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b1a8f649-d1dd-40d9-9c02-547ecb50a43e ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:01:09.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75199b84-116f-412e-a7cc-946dd23a1424 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:01:09.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75199b84-116f-412e-a7cc-946dd23a1424 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@266725b
2021-06-04T02:01:09.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75199b84-116f-412e-a7cc-946dd23a1424 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:01:09.873Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75199b84-116f-412e-a7cc-946dd23a1424 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:01:12.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bce36873-abfc-4916-9632-0f4ff9ee3914 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:01:12.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bce36873-abfc-4916-9632-0f4ff9ee3914 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a30931d
2021-06-04T02:01:12.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bce36873-abfc-4916-9632-0f4ff9ee3914 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:01:12.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bce36873-abfc-4916-9632-0f4ff9ee3914 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:01:14.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:01:14.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:01:14.872Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:01:14.873Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:01:15.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf0bd6a5-a2ae-429e-a4f9-94c38ec4d202 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:01:15.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf0bd6a5-a2ae-429e-a4f9-94c38ec4d202 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@c9f6bc3
2021-06-04T02:01:15.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf0bd6a5-a2ae-429e-a4f9-94c38ec4d202 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:01:15.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf0bd6a5-a2ae-429e-a4f9-94c38ec4d202 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:01:18.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c794ffb7-eb06-4c30-9947-33fe2a6d4cf2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:01:18.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c794ffb7-eb06-4c30-9947-33fe2a6d4cf2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6414c2a8
2021-06-04T02:01:18.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c794ffb7-eb06-4c30-9947-33fe2a6d4cf2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:01:18.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c794ffb7-eb06-4c30-9947-33fe2a6d4cf2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:01:21.440Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f52b59cc-26b1-4234-b572-9faba48d49fc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:01:21.440Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f52b59cc-26b1-4234-b572-9faba48d49fc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@555180db
2021-06-04T02:01:21.440Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f52b59cc-26b1-4234-b572-9faba48d49fc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:01:21.440Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f52b59cc-26b1-4234-b572-9faba48d49fc PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:01:24.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af204285-ce2b-40a3-8982-b2389df06e62 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:01:24.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af204285-ce2b-40a3-8982-b2389df06e62 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6bc75917
2021-06-04T02:01:24.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af204285-ce2b-40a3-8982-b2389df06e62 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:01:24.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af204285-ce2b-40a3-8982-b2389df06e62 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:01:28.285Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4900372-6ac0-41dc-b87b-0ee66edd03f0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:01:28.285Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4900372-6ac0-41dc-b87b-0ee66edd03f0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1cf1e6df
2021-06-04T02:01:28.285Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4900372-6ac0-41dc-b87b-0ee66edd03f0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:01:28.285Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4900372-6ac0-41dc-b87b-0ee66edd03f0 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:01:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:01:29.870Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:01:29.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:01:29.873Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:01:30.379Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ae20a7e-4e02-4554-b110-bd9373def340 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:01:30.379Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ae20a7e-4e02-4554-b110-bd9373def340 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5eb2766b
2021-06-04T02:01:30.379Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ae20a7e-4e02-4554-b110-bd9373def340 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:01:30.379Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ae20a7e-4e02-4554-b110-bd9373def340 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:01:33.722Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8322c067-8f6f-497e-b571-89752d27d177 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:01:33.722Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8322c067-8f6f-497e-b571-89752d27d177 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@73c623e
2021-06-04T02:01:33.722Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8322c067-8f6f-497e-b571-89752d27d177 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:01:33.722Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8322c067-8f6f-497e-b571-89752d27d177 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:01:36.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52569147-16c4-4889-b5a3-ae0c3cbc391c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:01:36.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52569147-16c4-4889-b5a3-ae0c3cbc391c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@56628c2f
2021-06-04T02:01:36.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52569147-16c4-4889-b5a3-ae0c3cbc391c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:01:36.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52569147-16c4-4889-b5a3-ae0c3cbc391c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:01:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:01:39.452Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T02:01:39.453Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:01:39.453Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:01:39.455Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:01:39.455Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T02:01:39.456Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T02:01:39.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3453b07-d007-455b-b1e5-410ff7e0f535 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:01:39.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3453b07-d007-455b-b1e5-410ff7e0f535 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45b65f22
2021-06-04T02:01:39.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3453b07-d007-455b-b1e5-410ff7e0f535 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:01:39.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3453b07-d007-455b-b1e5-410ff7e0f535 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:01:42.246Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54d90e4c-feb3-4150-b3fc-97d31ab8cc84 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:01:42.246Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54d90e4c-feb3-4150-b3fc-97d31ab8cc84 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@8fa78d1
2021-06-04T02:01:42.246Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54d90e4c-feb3-4150-b3fc-97d31ab8cc84 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:01:42.246Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54d90e4c-feb3-4150-b3fc-97d31ab8cc84 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:01:44.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:01:44.869Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:01:44.870Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:01:44.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:01:45.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a181339c-8f09-40ab-b7a9-d1d65f9d6287 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:01:45.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a181339c-8f09-40ab-b7a9-d1d65f9d6287 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c33c662
2021-06-04T02:01:45.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a181339c-8f09-40ab-b7a9-d1d65f9d6287 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:01:45.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a181339c-8f09-40ab-b7a9-d1d65f9d6287 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:01:48.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fa1cf62-d281-4efe-b87f-ac1325460289 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:01:48.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fa1cf62-d281-4efe-b87f-ac1325460289 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e722c3f
2021-06-04T02:01:48.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fa1cf62-d281-4efe-b87f-ac1325460289 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:01:48.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fa1cf62-d281-4efe-b87f-ac1325460289 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:01:51.154Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6505857-5da4-4f43-905e-2e759a0d917a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:01:51.154Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6505857-5da4-4f43-905e-2e759a0d917a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@59ca399c
2021-06-04T02:01:51.154Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6505857-5da4-4f43-905e-2e759a0d917a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:01:51.154Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6505857-5da4-4f43-905e-2e759a0d917a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:01:54.906Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42c7b819-4bf6-4bb7-abe3-f0ee0e2263e6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:01:54.906Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42c7b819-4bf6-4bb7-abe3-f0ee0e2263e6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22dfe84
2021-06-04T02:01:54.906Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42c7b819-4bf6-4bb7-abe3-f0ee0e2263e6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:01:54.906Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42c7b819-4bf6-4bb7-abe3-f0ee0e2263e6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:01:57.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19181d4d-c870-4152-bf66-9c4ac06ebc33 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:01:57.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19181d4d-c870-4152-bf66-9c4ac06ebc33 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@705f3875
2021-06-04T02:01:57.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19181d4d-c870-4152-bf66-9c4ac06ebc33 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:01:57.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19181d4d-c870-4152-bf66-9c4ac06ebc33 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:01:59.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:01:59.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:01:59.872Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:01:59.872Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:02:00.422Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=baf44d78-713c-4442-bdb1-202e2427462c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:02:00.422Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=baf44d78-713c-4442-bdb1-202e2427462c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f73e195
2021-06-04T02:02:00.422Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=baf44d78-713c-4442-bdb1-202e2427462c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:02:00.422Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=baf44d78-713c-4442-bdb1-202e2427462c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:02:03.238Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6002828d-f640-4cab-91cc-a6128ffc07d8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:02:03.238Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6002828d-f640-4cab-91cc-a6128ffc07d8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@477d273e
2021-06-04T02:02:03.238Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6002828d-f640-4cab-91cc-a6128ffc07d8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:02:03.238Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6002828d-f640-4cab-91cc-a6128ffc07d8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:02:06.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e695d37d-feac-4997-a6a2-8c407275bb21 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:02:06.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e695d37d-feac-4997-a6a2-8c407275bb21 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a49388b
2021-06-04T02:02:06.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e695d37d-feac-4997-a6a2-8c407275bb21 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:02:06.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e695d37d-feac-4997-a6a2-8c407275bb21 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:02:09.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:02:09.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:02:09.520Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e695d37d-feac-4997-a6a2-8c407275bb21 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:02:09.521Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e695d37d-feac-4997-a6a2-8c407275bb21 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:02:09.521Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e695d37d-feac-4997-a6a2-8c407275bb21 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:02:09.521Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e695d37d-feac-4997-a6a2-8c407275bb21 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:02:10.762Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35efbabd-8e31-41a1-9236-ba9b384c4971 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:02:10.762Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35efbabd-8e31-41a1-9236-ba9b384c4971 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23dc3127
2021-06-04T02:02:10.762Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35efbabd-8e31-41a1-9236-ba9b384c4971 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:02:10.763Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35efbabd-8e31-41a1-9236-ba9b384c4971 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:02:10.875Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=35efbabd-8e31-41a1-9236-ba9b384c4971 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:02:10.876Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=35efbabd-8e31-41a1-9236-ba9b384c4971 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:02:11.285Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:02:12.055Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae7b87d4-39a4-46d4-a76a-6dbb96267ca9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:02:12.055Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae7b87d4-39a4-46d4-a76a-6dbb96267ca9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d999e17
2021-06-04T02:02:12.055Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae7b87d4-39a4-46d4-a76a-6dbb96267ca9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:02:12.055Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae7b87d4-39a4-46d4-a76a-6dbb96267ca9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:02:12.485Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ae7b87d4-39a4-46d4-a76a-6dbb96267ca9 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:02:12.485Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ae7b87d4-39a4-46d4-a76a-6dbb96267ca9 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:02:14.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:02:14.870Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:02:14.872Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:02:14.873Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:02:15.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=924a9bd7-7271-4506-a10f-e7cffdc4f451 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:02:15.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=924a9bd7-7271-4506-a10f-e7cffdc4f451 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e77784f
2021-06-04T02:02:15.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=924a9bd7-7271-4506-a10f-e7cffdc4f451 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:02:15.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=924a9bd7-7271-4506-a10f-e7cffdc4f451 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:02:19.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fa2f15b-9e2e-42b5-ba56-e764cf8376a7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:02:19.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fa2f15b-9e2e-42b5-ba56-e764cf8376a7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ce023af
2021-06-04T02:02:19.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fa2f15b-9e2e-42b5-ba56-e764cf8376a7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:02:19.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fa2f15b-9e2e-42b5-ba56-e764cf8376a7 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:02:23.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=635b1feb-ab78-47fc-8f76-3f5fc95c3264 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:02:23.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=635b1feb-ab78-47fc-8f76-3f5fc95c3264 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17e4d0b0
2021-06-04T02:02:23.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=635b1feb-ab78-47fc-8f76-3f5fc95c3264 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:02:23.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=635b1feb-ab78-47fc-8f76-3f5fc95c3264 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:02:25.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c86dbf7e-06d4-4fbb-8679-b00e13e7cd39 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:02:25.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c86dbf7e-06d4-4fbb-8679-b00e13e7cd39 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@61c9d7d
2021-06-04T02:02:25.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c86dbf7e-06d4-4fbb-8679-b00e13e7cd39 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:02:25.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c86dbf7e-06d4-4fbb-8679-b00e13e7cd39 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:02:27.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6531d0eb-7b4b-4e02-b3d0-c81ce78d758f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:02:27.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6531d0eb-7b4b-4e02-b3d0-c81ce78d758f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@32c38f1
2021-06-04T02:02:27.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6531d0eb-7b4b-4e02-b3d0-c81ce78d758f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:02:27.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6531d0eb-7b4b-4e02-b3d0-c81ce78d758f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:02:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:02:29.870Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:02:29.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:02:29.874Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:02:30.967Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01f1aa31-47af-411d-ae21-2c1fd6826ecc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:02:30.967Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01f1aa31-47af-411d-ae21-2c1fd6826ecc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e2c9e60
2021-06-04T02:02:30.967Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01f1aa31-47af-411d-ae21-2c1fd6826ecc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:02:30.968Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01f1aa31-47af-411d-ae21-2c1fd6826ecc PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:02:33.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd2bef6c-8fca-4304-8051-0573b6cf00dc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:02:33.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd2bef6c-8fca-4304-8051-0573b6cf00dc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f7cb045
2021-06-04T02:02:33.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd2bef6c-8fca-4304-8051-0573b6cf00dc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:02:33.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd2bef6c-8fca-4304-8051-0573b6cf00dc PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:02:36.706Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33f69f44-5ad2-4543-8138-4cce8ab823e5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:02:36.707Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33f69f44-5ad2-4543-8138-4cce8ab823e5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2de92ba2
2021-06-04T02:02:36.707Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33f69f44-5ad2-4543-8138-4cce8ab823e5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:02:36.707Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33f69f44-5ad2-4543-8138-4cce8ab823e5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:02:39.453Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:02:39.454Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T02:02:39.454Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:02:39.454Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:02:39.456Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:02:39.457Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T02:02:39.457Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T02:02:39.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fe4bb27-5d61-44f5-8100-044ef58c176d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:02:39.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fe4bb27-5d61-44f5-8100-044ef58c176d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f60655e
2021-06-04T02:02:39.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fe4bb27-5d61-44f5-8100-044ef58c176d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:02:39.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fe4bb27-5d61-44f5-8100-044ef58c176d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:02:42.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53407935-1816-496c-9126-f713def1336d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:02:42.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53407935-1816-496c-9126-f713def1336d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@55253d4c
2021-06-04T02:02:42.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53407935-1816-496c-9126-f713def1336d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:02:42.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53407935-1816-496c-9126-f713def1336d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:02:44.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:02:44.869Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:02:44.870Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:02:44.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:02:45.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:02:45.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:02:45.696Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=53407935-1816-496c-9126-f713def1336d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:02:45.696Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=53407935-1816-496c-9126-f713def1336d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:02:45.697Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=53407935-1816-496c-9126-f713def1336d ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:02:45.697Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=53407935-1816-496c-9126-f713def1336d ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:02:48.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:02:50.371Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:02:50.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ffb141ef-63f2-4ac3-8b79-9550a1a3d878 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:02:50.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ffb141ef-63f2-4ac3-8b79-9550a1a3d878 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ff15135
2021-06-04T02:02:50.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ffb141ef-63f2-4ac3-8b79-9550a1a3d878 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:02:50.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ffb141ef-63f2-4ac3-8b79-9550a1a3d878 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:02:51.153Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ffb141ef-63f2-4ac3-8b79-9550a1a3d878 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:02:51.154Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=ffb141ef-63f2-4ac3-8b79-9550a1a3d878 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:02:51.602Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=051641e7-09b9-4882-8699-20e740241f25 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:02:51.602Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=051641e7-09b9-4882-8699-20e740241f25 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57271ded
2021-06-04T02:02:51.602Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=051641e7-09b9-4882-8699-20e740241f25 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:02:51.603Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=051641e7-09b9-4882-8699-20e740241f25 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:02:52.855Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=051641e7-09b9-4882-8699-20e740241f25 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:02:52.855Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=051641e7-09b9-4882-8699-20e740241f25 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:02:53.595Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9af44c40-3c0a-4ed6-a58d-bad20669f88b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:02:53.595Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9af44c40-3c0a-4ed6-a58d-bad20669f88b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b948518
2021-06-04T02:02:53.595Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9af44c40-3c0a-4ed6-a58d-bad20669f88b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:02:53.595Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9af44c40-3c0a-4ed6-a58d-bad20669f88b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:02:55.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fb3d68b-106c-4d91-9252-1d436dd70129 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:02:55.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fb3d68b-106c-4d91-9252-1d436dd70129 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e1901a6
2021-06-04T02:02:55.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fb3d68b-106c-4d91-9252-1d436dd70129 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:02:55.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fb3d68b-106c-4d91-9252-1d436dd70129 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:02:57.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:02:57.262Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:02:58.125Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8fb3d68b-106c-4d91-9252-1d436dd70129 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:02:58.126Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8fb3d68b-106c-4d91-9252-1d436dd70129 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:02:58.128Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8fb3d68b-106c-4d91-9252-1d436dd70129 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:02:58.128Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8fb3d68b-106c-4d91-9252-1d436dd70129 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:02:59.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:02:59.873Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:02:59.874Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:02:59.877Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:03:00.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:03:03.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:03:06.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:03:09.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:03:11.550Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:03:12.158Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bf7621b-c894-4085-82d7-846dacab4b77 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:03:12.159Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bf7621b-c894-4085-82d7-846dacab4b77 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ba77076
2021-06-04T02:03:12.159Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bf7621b-c894-4085-82d7-846dacab4b77 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:03:12.159Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bf7621b-c894-4085-82d7-846dacab4b77 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:03:14.869Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:03:14.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:03:14.873Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:03:14.874Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:03:15.204Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=5bf7621b-c894-4085-82d7-846dacab4b77 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:03:15.204Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=5bf7621b-c894-4085-82d7-846dacab4b77 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:03:15.205Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=5bf7621b-c894-4085-82d7-846dacab4b77 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:03:15.205Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=5bf7621b-c894-4085-82d7-846dacab4b77 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:03:18.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:03:18.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:03:18.466Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=765f90ea-e46f-4e51-ab75-38481fd6d686 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:03:18.466Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=765f90ea-e46f-4e51-ab75-38481fd6d686 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b333947
2021-06-04T02:03:18.466Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=765f90ea-e46f-4e51-ab75-38481fd6d686 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:03:18.466Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=765f90ea-e46f-4e51-ab75-38481fd6d686 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:03:20.797Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:03:21.291Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=765f90ea-e46f-4e51-ab75-38481fd6d686 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:03:21.291Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=765f90ea-e46f-4e51-ab75-38481fd6d686 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:03:22.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d8c5680-ce48-4ae1-833a-74cfef7a2c22 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:03:22.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d8c5680-ce48-4ae1-833a-74cfef7a2c22 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4d65faa6
2021-06-04T02:03:22.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d8c5680-ce48-4ae1-833a-74cfef7a2c22 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:03:22.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d8c5680-ce48-4ae1-833a-74cfef7a2c22 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:03:23.630Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=952b9f29-60c8-4c7b-a7cb-4606db7013b7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:03:23.630Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=952b9f29-60c8-4c7b-a7cb-4606db7013b7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f63d384
2021-06-04T02:03:23.630Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=952b9f29-60c8-4c7b-a7cb-4606db7013b7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:03:23.630Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=952b9f29-60c8-4c7b-a7cb-4606db7013b7 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:03:24.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e45b40a-b75a-4538-82b2-cc16c7a2e134 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:03:24.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e45b40a-b75a-4538-82b2-cc16c7a2e134 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5da8362e
2021-06-04T02:03:24.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e45b40a-b75a-4538-82b2-cc16c7a2e134 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:03:24.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e45b40a-b75a-4538-82b2-cc16c7a2e134 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:03:25.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f680870e-0be7-4b7a-bbf8-4032dae3b54b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:03:25.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f680870e-0be7-4b7a-bbf8-4032dae3b54b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68e1e894
2021-06-04T02:03:25.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f680870e-0be7-4b7a-bbf8-4032dae3b54b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:03:25.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f680870e-0be7-4b7a-bbf8-4032dae3b54b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:03:29.259Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d770429-7e5b-449f-8dda-8e02669e1978 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:03:29.259Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d770429-7e5b-449f-8dda-8e02669e1978 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ab38fe4
2021-06-04T02:03:29.259Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d770429-7e5b-449f-8dda-8e02669e1978 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:03:29.259Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d770429-7e5b-449f-8dda-8e02669e1978 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:03:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:03:29.870Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:03:29.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:03:29.873Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:03:31.863Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16efa9ce-88e9-463a-a624-205dc23997c0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:03:31.863Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16efa9ce-88e9-463a-a624-205dc23997c0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7bbd82c5
2021-06-04T02:03:31.863Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16efa9ce-88e9-463a-a624-205dc23997c0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:03:31.863Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16efa9ce-88e9-463a-a624-205dc23997c0 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:03:32.660Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b546b152-6cf2-496d-857c-7dde708beb0f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:03:32.660Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b546b152-6cf2-496d-857c-7dde708beb0f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6738c2da
2021-06-04T02:03:32.660Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b546b152-6cf2-496d-857c-7dde708beb0f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:03:32.660Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b546b152-6cf2-496d-857c-7dde708beb0f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:03:35.664Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=b546b152-6cf2-496d-857c-7dde708beb0f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:03:35.665Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=b546b152-6cf2-496d-857c-7dde708beb0f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:03:35.665Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b546b152-6cf2-496d-857c-7dde708beb0f ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:03:35.665Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b546b152-6cf2-496d-857c-7dde708beb0f ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:03:36.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:03:36.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:03:39.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:03:39.453Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:03:39.453Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T02:03:39.455Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:03:39.455Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:03:39.460Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:03:39.460Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T02:03:39.461Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T02:03:42.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:03:44.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:03:44.870Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:03:44.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:03:44.872Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:03:45.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:03:48.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:03:51.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:03:54.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:03:55.758Z [cluster1-timeouter-0] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.138.69:9042] Operation timed out
at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:03:55.758Z [cluster1-timeouter-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.ConnectionException: [cassandra.onap/10.242.138.69:9042] Pool was closed during initialization
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:173)
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:158)
at com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1080)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.google.common.util.concurrent.CollectionFuture.handleAllCompleted(CollectionFuture.java:69)
at com.google.common.util.concurrent.AggregateFuture.processCompleted(AggregateFuture.java:282)
at com.google.common.util.concurrent.AggregateFuture.decrementCountAndMaybeComplete(AggregateFuture.java:264)
at com.google.common.util.concurrent.AggregateFuture.access$200(AggregateFuture.java:42)
at com.google.common.util.concurrent.AggregateFuture$1.run(AggregateFuture.java:147)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179)
at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179)
at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:100)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771)
at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:03:55.759Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=757624df-b26f-4a2b-8b34-c820b245d0c8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:03:55.759Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=757624df-b26f-4a2b-8b34-c820b245d0c8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a23e1
2021-06-04T02:03:55.759Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=757624df-b26f-4a2b-8b34-c820b245d0c8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:03:55.759Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=757624df-b26f-4a2b-8b34-c820b245d0c8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:03:57.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:03:58.803Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=757624df-b26f-4a2b-8b34-c820b245d0c8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:03:58.803Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=757624df-b26f-4a2b-8b34-c820b245d0c8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:03:59.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da2dc3d0-858d-4f3e-b7d5-5680057bae57 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:03:59.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da2dc3d0-858d-4f3e-b7d5-5680057bae57 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@19c530e
2021-06-04T02:03:59.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da2dc3d0-858d-4f3e-b7d5-5680057bae57 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:03:59.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da2dc3d0-858d-4f3e-b7d5-5680057bae57 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:03:59.869Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:03:59.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:03:59.872Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:03:59.873Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:04:00.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:04:02.461Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=da2dc3d0-858d-4f3e-b7d5-5680057bae57 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:04:02.461Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=da2dc3d0-858d-4f3e-b7d5-5680057bae57 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:04:02.461Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=da2dc3d0-858d-4f3e-b7d5-5680057bae57 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:04:02.461Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=da2dc3d0-858d-4f3e-b7d5-5680057bae57 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:04:02.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e80856d-445a-4ff6-ba16-eeaeaac7af58 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:02.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e80856d-445a-4ff6-ba16-eeaeaac7af58 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7127353d
2021-06-04T02:04:02.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e80856d-445a-4ff6-ba16-eeaeaac7af58 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:02.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e80856d-445a-4ff6-ba16-eeaeaac7af58 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:03.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:04:05.773Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3e80856d-445a-4ff6-ba16-eeaeaac7af58 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:04:05.773Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3e80856d-445a-4ff6-ba16-eeaeaac7af58 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:04:06.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:04:06.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac3316c1-2ace-4f64-9db9-fa121e9f7161 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:06.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac3316c1-2ace-4f64-9db9-fa121e9f7161 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@671cd5b
2021-06-04T02:04:06.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac3316c1-2ace-4f64-9db9-fa121e9f7161 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:06.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac3316c1-2ace-4f64-9db9-fa121e9f7161 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:09.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:04:09.325Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ac3316c1-2ace-4f64-9db9-fa121e9f7161 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:04:09.325Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ac3316c1-2ace-4f64-9db9-fa121e9f7161 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:04:10.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b714b5b-35d1-4305-b11c-6fa6f2bbd443 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:10.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b714b5b-35d1-4305-b11c-6fa6f2bbd443 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@756032e3
2021-06-04T02:04:10.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b714b5b-35d1-4305-b11c-6fa6f2bbd443 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:10.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b714b5b-35d1-4305-b11c-6fa6f2bbd443 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:12.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:04:13.052Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=4b714b5b-35d1-4305-b11c-6fa6f2bbd443 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:04:13.052Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=4b714b5b-35d1-4305-b11c-6fa6f2bbd443 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:04:13.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=adf475c0-fb1d-4b85-82c2-003a2caa11f1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:13.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=adf475c0-fb1d-4b85-82c2-003a2caa11f1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f81c0f1
2021-06-04T02:04:13.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=adf475c0-fb1d-4b85-82c2-003a2caa11f1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:13.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=adf475c0-fb1d-4b85-82c2-003a2caa11f1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:14.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:04:14.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:04:14.872Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:04:14.873Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:04:15.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:04:15.582Z [cluster1-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T02:04:15.584Z [cluster1-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 2000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:04:16.546Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=adf475c0-fb1d-4b85-82c2-003a2caa11f1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:04:16.547Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=adf475c0-fb1d-4b85-82c2-003a2caa11f1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:04:17.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1fd2cbfc-9eb5-4e64-b193-d32c50763837 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:17.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1fd2cbfc-9eb5-4e64-b193-d32c50763837 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@559f5102
2021-06-04T02:04:17.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1fd2cbfc-9eb5-4e64-b193-d32c50763837 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:17.174Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1fd2cbfc-9eb5-4e64-b193-d32c50763837 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:18.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:04:20.218Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=1fd2cbfc-9eb5-4e64-b193-d32c50763837 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:04:20.218Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=1fd2cbfc-9eb5-4e64-b193-d32c50763837 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:04:20.342Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eda32998-d7e8-4350-8633-58175027487e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:20.342Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eda32998-d7e8-4350-8633-58175027487e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45c96bea
2021-06-04T02:04:20.342Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eda32998-d7e8-4350-8633-58175027487e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:20.342Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eda32998-d7e8-4350-8633-58175027487e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:21.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:04:23.381Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=eda32998-d7e8-4350-8633-58175027487e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:04:23.381Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=eda32998-d7e8-4350-8633-58175027487e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:04:23.406Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01v91fzrhhw1es8z06rqhu4qxi23
2021-06-04T02:04:23.406Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0gejic2xmakya1lvgsry0vo6wd24
2021-06-04T02:04:23.406Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01d5h4mjt070mul8iirijt0a5n22
2021-06-04T02:04:23.406Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0k5ap44vkft8lyunn0u71578j20
2021-06-04T02:04:23.406Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01p2gto85i0d58zmub0iyclioa21
2021-06-04T02:04:23.406Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01lxddsri1eukx1hrjw5ay5sqyo15
2021-06-04T02:04:23.407Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0107itetg88mjg1ajeqs1e6mlds18
2021-06-04T02:04:23.407Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0198s1orxtmc4g19j85iopz54ni16
2021-06-04T02:04:23.407Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0u6tpti0a2zrn1q3yqhvxdz2114
2021-06-04T02:04:23.407Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0gntn5wgmau40wp0od8pytwrj17
2021-06-04T02:04:23.407Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node02a4nq6zfsffg10u0xhq9beul919
2021-06-04T02:04:23.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5f2866c-15b3-47ab-b27b-d1a170678753 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:23.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5f2866c-15b3-47ab-b27b-d1a170678753 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2fefb6ba
2021-06-04T02:04:23.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5f2866c-15b3-47ab-b27b-d1a170678753 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:23.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5f2866c-15b3-47ab-b27b-d1a170678753 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:24.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:04:26.864Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e5f2866c-15b3-47ab-b27b-d1a170678753 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:04:26.865Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e5f2866c-15b3-47ab-b27b-d1a170678753 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:04:27.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:04:27.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8253bb6-c22f-40cf-a529-a33050e7a7d1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:27.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8253bb6-c22f-40cf-a529-a33050e7a7d1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30c6e0da
2021-06-04T02:04:27.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8253bb6-c22f-40cf-a529-a33050e7a7d1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:27.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8253bb6-c22f-40cf-a529-a33050e7a7d1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:04:29.869Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:04:29.870Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:04:29.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:04:30.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:04:30.628Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a8253bb6-c22f-40cf-a529-a33050e7a7d1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:04:30.629Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a8253bb6-c22f-40cf-a529-a33050e7a7d1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:04:30.753Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0023601-8b2b-4d32-a474-75358a37d959 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:30.753Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0023601-8b2b-4d32-a474-75358a37d959 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5da1e3f0
2021-06-04T02:04:30.753Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0023601-8b2b-4d32-a474-75358a37d959 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:30.753Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0023601-8b2b-4d32-a474-75358a37d959 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:32.167Z [cluster2-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
2021-06-04T02:04:32.168Z [cluster2-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 30000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:04:33.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:04:33.798Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f0023601-8b2b-4d32-a474-75358a37d959 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:04:33.798Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f0023601-8b2b-4d32-a474-75358a37d959 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:04:34.225Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4db66b41-0392-42cf-819c-5ec6a74c6adb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:34.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4db66b41-0392-42cf-819c-5ec6a74c6adb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1622c898
2021-06-04T02:04:34.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4db66b41-0392-42cf-819c-5ec6a74c6adb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:34.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4db66b41-0392-42cf-819c-5ec6a74c6adb PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:36.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:04:37.268Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=4db66b41-0392-42cf-819c-5ec6a74c6adb ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:04:37.269Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=4db66b41-0392-42cf-819c-5ec6a74c6adb ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:04:37.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c0468ef-5602-4760-a867-4084e2831f77 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:37.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c0468ef-5602-4760-a867-4084e2831f77 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@550d4f7
2021-06-04T02:04:37.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c0468ef-5602-4760-a867-4084e2831f77 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:37.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c0468ef-5602-4760-a867-4084e2831f77 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:39.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:04:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:04:39.452Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T02:04:39.454Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:04:39.454Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:04:39.456Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:04:39.456Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T02:04:39.456Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T02:04:40.850Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0c0468ef-5602-4760-a867-4084e2831f77 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:04:40.850Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0c0468ef-5602-4760-a867-4084e2831f77 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:04:40.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea0b9358-b8a0-4eea-9cc7-4807116601c1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:40.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea0b9358-b8a0-4eea-9cc7-4807116601c1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3db94072
2021-06-04T02:04:40.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea0b9358-b8a0-4eea-9cc7-4807116601c1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:40.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea0b9358-b8a0-4eea-9cc7-4807116601c1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:42.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:04:44.018Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ea0b9358-b8a0-4eea-9cc7-4807116601c1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:04:44.019Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ea0b9358-b8a0-4eea-9cc7-4807116601c1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:04:44.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbe30ef0-fc2c-489d-9308-b1b239dfd562 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:44.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbe30ef0-fc2c-489d-9308-b1b239dfd562 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9daf683
2021-06-04T02:04:44.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbe30ef0-fc2c-489d-9308-b1b239dfd562 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:44.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbe30ef0-fc2c-489d-9308-b1b239dfd562 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:44.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:04:44.869Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:04:44.870Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:04:44.873Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:04:45.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:04:46.521Z [BE-Health-Check-Task] INFO o.a.http.impl.execchain.RetryExec RequestID=fbe30ef0-fc2c-489d-9308-b1b239dfd562 PartnerName=SDC.BE I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {s}->https://sdc-onboarding-be.onap:8445: The target server failed to respond
2021-06-04T02:04:46.522Z [BE-Health-Check-Task] INFO o.a.http.impl.execchain.RetryExec RequestID=fbe30ef0-fc2c-489d-9308-b1b239dfd562 PartnerName=SDC.BE Retrying request to {s}->https://sdc-onboarding-be.onap:8445
2021-06-04T02:04:46.522Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=fbe30ef0-fc2c-489d-9308-b1b239dfd562 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T02:04:46.523Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=fbe30ef0-fc2c-489d-9308-b1b239dfd562 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:04:47.074Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=347370c2-691b-401f-aa5e-f7cdbc8b6052 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:47.074Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=347370c2-691b-401f-aa5e-f7cdbc8b6052 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43f32f12
2021-06-04T02:04:47.074Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=347370c2-691b-401f-aa5e-f7cdbc8b6052 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:47.074Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=347370c2-691b-401f-aa5e-f7cdbc8b6052 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:47.075Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=347370c2-691b-401f-aa5e-f7cdbc8b6052 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T02:04:47.076Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=347370c2-691b-401f-aa5e-f7cdbc8b6052 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:04:47.676Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f9e4fd5-a975-405b-a085-10c26b41f306 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:47.676Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f9e4fd5-a975-405b-a085-10c26b41f306 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@cc5a03a
2021-06-04T02:04:47.676Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f9e4fd5-a975-405b-a085-10c26b41f306 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:47.676Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f9e4fd5-a975-405b-a085-10c26b41f306 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:47.678Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3f9e4fd5-a975-405b-a085-10c26b41f306 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T02:04:47.678Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3f9e4fd5-a975-405b-a085-10c26b41f306 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:04:48.263Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:04:48.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f117244b-b444-451b-9d8b-cc19123e1bb4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:48.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f117244b-b444-451b-9d8b-cc19123e1bb4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5bdbafd5
2021-06-04T02:04:48.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f117244b-b444-451b-9d8b-cc19123e1bb4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:48.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f117244b-b444-451b-9d8b-cc19123e1bb4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:48.285Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f117244b-b444-451b-9d8b-cc19123e1bb4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T02:04:48.286Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f117244b-b444-451b-9d8b-cc19123e1bb4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:04:48.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77a9c8ae-382a-4cb7-995f-85307b9195e7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:48.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77a9c8ae-382a-4cb7-995f-85307b9195e7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a455f3e
2021-06-04T02:04:48.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77a9c8ae-382a-4cb7-995f-85307b9195e7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:48.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77a9c8ae-382a-4cb7-995f-85307b9195e7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:48.886Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=77a9c8ae-382a-4cb7-995f-85307b9195e7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T02:04:48.886Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=77a9c8ae-382a-4cb7-995f-85307b9195e7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:04:49.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2b5b279-fa77-4605-baf1-2d37a985e807 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:49.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2b5b279-fa77-4605-baf1-2d37a985e807 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29e37456
2021-06-04T02:04:49.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2b5b279-fa77-4605-baf1-2d37a985e807 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:49.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2b5b279-fa77-4605-baf1-2d37a985e807 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:49.522Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e2b5b279-fa77-4605-baf1-2d37a985e807 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T02:04:49.522Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e2b5b279-fa77-4605-baf1-2d37a985e807 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:04:50.273Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=838bad5c-b15e-4144-bda4-61830910c6b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:50.273Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=838bad5c-b15e-4144-bda4-61830910c6b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@25f32c38
2021-06-04T02:04:50.273Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=838bad5c-b15e-4144-bda4-61830910c6b9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:50.273Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=838bad5c-b15e-4144-bda4-61830910c6b9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:50.275Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=838bad5c-b15e-4144-bda4-61830910c6b9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T02:04:50.275Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=838bad5c-b15e-4144-bda4-61830910c6b9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:04:50.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49097f4f-eed8-4ace-9c88-501e1b7f8947 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:50.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49097f4f-eed8-4ace-9c88-501e1b7f8947 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ef244db
2021-06-04T02:04:50.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49097f4f-eed8-4ace-9c88-501e1b7f8947 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:50.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49097f4f-eed8-4ace-9c88-501e1b7f8947 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:50.818Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=49097f4f-eed8-4ace-9c88-501e1b7f8947 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T02:04:50.819Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=49097f4f-eed8-4ace-9c88-501e1b7f8947 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:04:51.191Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fbca1e5-42d2-476a-b08c-409cca28b857 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:51.192Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fbca1e5-42d2-476a-b08c-409cca28b857 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ec7dd67
2021-06-04T02:04:51.192Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fbca1e5-42d2-476a-b08c-409cca28b857 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:51.192Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fbca1e5-42d2-476a-b08c-409cca28b857 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:51.193Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8fbca1e5-42d2-476a-b08c-409cca28b857 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T02:04:51.193Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8fbca1e5-42d2-476a-b08c-409cca28b857 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:04:51.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:04:51.600Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ec495cf-e3e4-4b97-a949-cfd5ec9c0ee6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:51.600Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ec495cf-e3e4-4b97-a949-cfd5ec9c0ee6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@203a1aa1
2021-06-04T02:04:51.600Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ec495cf-e3e4-4b97-a949-cfd5ec9c0ee6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:51.600Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ec495cf-e3e4-4b97-a949-cfd5ec9c0ee6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:51.601Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=4ec495cf-e3e4-4b97-a949-cfd5ec9c0ee6 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T02:04:51.602Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=4ec495cf-e3e4-4b97-a949-cfd5ec9c0ee6 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:04:51.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5a02ceef-e5da-44fd-83c0-e19f12518380 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:51.736Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5a02ceef-e5da-44fd-83c0-e19f12518380 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f9f4f7f
2021-06-04T02:04:51.736Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5a02ceef-e5da-44fd-83c0-e19f12518380 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:51.736Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5a02ceef-e5da-44fd-83c0-e19f12518380 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:51.737Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=5a02ceef-e5da-44fd-83c0-e19f12518380 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T02:04:51.737Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=5a02ceef-e5da-44fd-83c0-e19f12518380 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:04:51.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ced10697-11c7-4f5e-b50b-b3aa301178e3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:51.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ced10697-11c7-4f5e-b50b-b3aa301178e3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@147cb49
2021-06-04T02:04:51.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ced10697-11c7-4f5e-b50b-b3aa301178e3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:51.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ced10697-11c7-4f5e-b50b-b3aa301178e3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:51.889Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ced10697-11c7-4f5e-b50b-b3aa301178e3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T02:04:51.889Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ced10697-11c7-4f5e-b50b-b3aa301178e3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:04:52.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb5d14a7-81e8-473c-9574-3768c215c0a3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:52.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb5d14a7-81e8-473c-9574-3768c215c0a3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@571e1e8c
2021-06-04T02:04:52.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb5d14a7-81e8-473c-9574-3768c215c0a3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:52.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb5d14a7-81e8-473c-9574-3768c215c0a3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:52.017Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=fb5d14a7-81e8-473c-9574-3768c215c0a3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T02:04:52.017Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=fb5d14a7-81e8-473c-9574-3768c215c0a3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:04:52.176Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eaac2cdd-3b72-4068-ab63-fa46b552ae40 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:52.176Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eaac2cdd-3b72-4068-ab63-fa46b552ae40 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58123832
2021-06-04T02:04:52.176Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eaac2cdd-3b72-4068-ab63-fa46b552ae40 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:52.176Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eaac2cdd-3b72-4068-ab63-fa46b552ae40 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:52.181Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=eaac2cdd-3b72-4068-ab63-fa46b552ae40 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T02:04:52.181Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=eaac2cdd-3b72-4068-ab63-fa46b552ae40 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:04:52.328Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd8cb29e-c691-4e4a-aabd-a5569c373997 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:52.328Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd8cb29e-c691-4e4a-aabd-a5569c373997 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@472061db
2021-06-04T02:04:52.328Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd8cb29e-c691-4e4a-aabd-a5569c373997 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:52.328Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd8cb29e-c691-4e4a-aabd-a5569c373997 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:52.330Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=cd8cb29e-c691-4e4a-aabd-a5569c373997 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T02:04:52.330Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=cd8cb29e-c691-4e4a-aabd-a5569c373997 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:04:52.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8293d5e-f342-45b5-b6a7-6e057f7a8510 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:52.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8293d5e-f342-45b5-b6a7-6e057f7a8510 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6cb83c55
2021-06-04T02:04:52.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8293d5e-f342-45b5-b6a7-6e057f7a8510 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:52.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8293d5e-f342-45b5-b6a7-6e057f7a8510 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:52.524Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e8293d5e-f342-45b5-b6a7-6e057f7a8510 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T02:04:52.525Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e8293d5e-f342-45b5-b6a7-6e057f7a8510 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:04:54.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:04:54.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65b7bffc-828b-4273-8106-d59f75db3769 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:54.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65b7bffc-828b-4273-8106-d59f75db3769 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2779572f
2021-06-04T02:04:54.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65b7bffc-828b-4273-8106-d59f75db3769 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:54.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65b7bffc-828b-4273-8106-d59f75db3769 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:57.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:04:57.328Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=65b7bffc-828b-4273-8106-d59f75db3769 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T02:04:57.328Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=65b7bffc-828b-4273-8106-d59f75db3769 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:04:58.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d47b798-4d2c-4c04-a983-64edefe4157b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:04:58.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d47b798-4d2c-4c04-a983-64edefe4157b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d003def
2021-06-04T02:04:58.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d47b798-4d2c-4c04-a983-64edefe4157b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:04:58.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d47b798-4d2c-4c04-a983-64edefe4157b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:04:59.867Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:04:59.869Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:04:59.869Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:04:59.870Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:05:00.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:05:01.088Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=1d47b798-4d2c-4c04-a983-64edefe4157b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T02:05:01.089Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=1d47b798-4d2c-4c04-a983-64edefe4157b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:05:01.258Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23d31aca-f9a5-498b-8ff7-db840b84c1bc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:05:01.258Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23d31aca-f9a5-498b-8ff7-db840b84c1bc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d228bd5
2021-06-04T02:05:01.258Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23d31aca-f9a5-498b-8ff7-db840b84c1bc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:05:01.258Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23d31aca-f9a5-498b-8ff7-db840b84c1bc PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:05:03.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:05:04.269Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=23d31aca-f9a5-498b-8ff7-db840b84c1bc ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T02:05:04.269Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=23d31aca-f9a5-498b-8ff7-db840b84c1bc ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:05:04.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7cd49b33-ffbe-490e-bffb-7380f6fb7e6a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:05:04.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7cd49b33-ffbe-490e-bffb-7380f6fb7e6a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ea03bc4
2021-06-04T02:05:04.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7cd49b33-ffbe-490e-bffb-7380f6fb7e6a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:05:04.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7cd49b33-ffbe-490e-bffb-7380f6fb7e6a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:05:06.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:05:07.664Z [cluster1-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
2021-06-04T02:05:07.665Z [cluster1-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 8000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:05:07.728Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=7cd49b33-ffbe-490e-bffb-7380f6fb7e6a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T02:05:07.729Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=7cd49b33-ffbe-490e-bffb-7380f6fb7e6a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:05:08.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a38fac82-b945-4034-ba24-a0cf8bc94d6c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:05:08.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a38fac82-b945-4034-ba24-a0cf8bc94d6c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3cb746d0
2021-06-04T02:05:08.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a38fac82-b945-4034-ba24-a0cf8bc94d6c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:05:08.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a38fac82-b945-4034-ba24-a0cf8bc94d6c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:05:08.772Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:05:10.206Z [cluster2-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
2021-06-04T02:05:10.212Z [cluster2-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 30000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:05:10.862Z [JanusGraph Cluster-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host /10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
2021-06-04T02:05:10.863Z [JanusGraph Cluster-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to /10.242.138.69:9042, scheduling retry in 2000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:05:11.590Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a38fac82-b945-4034-ba24-a0cf8bc94d6c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T02:05:11.590Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a38fac82-b945-4034-ba24-a0cf8bc94d6c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:05:11.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b93c7624-5fc9-4bdf-85e9-1cd3885ec910 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:05:11.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b93c7624-5fc9-4bdf-85e9-1cd3885ec910 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d925bf2
2021-06-04T02:05:11.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b93c7624-5fc9-4bdf-85e9-1cd3885ec910 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:05:11.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b93c7624-5fc9-4bdf-85e9-1cd3885ec910 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:05:14.761Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=b93c7624-5fc9-4bdf-85e9-1cd3885ec910 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T02:05:14.761Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=b93c7624-5fc9-4bdf-85e9-1cd3885ec910 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:05:14.762Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b93c7624-5fc9-4bdf-85e9-1cd3885ec910 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:05:14.762Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b93c7624-5fc9-4bdf-85e9-1cd3885ec910 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:05:14.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:05:14.873Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:05:14.874Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:05:14.877Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:05:15.188Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c696f1f-9fb3-412e-a76d-602def2bd0f0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:05:15.188Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c696f1f-9fb3-412e-a76d-602def2bd0f0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e3ee990
2021-06-04T02:05:15.188Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c696f1f-9fb3-412e-a76d-602def2bd0f0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:05:15.188Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c696f1f-9fb3-412e-a76d-602def2bd0f0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:05:19.860Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8c696f1f-9fb3-412e-a76d-602def2bd0f0 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:05:19.861Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8c696f1f-9fb3-412e-a76d-602def2bd0f0 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:05:19.943Z [JanusGraph Cluster-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host /10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
2021-06-04T02:05:19.943Z [JanusGraph Cluster-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to /10.242.138.69:9042, scheduling retry in 4000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:05:20.163Z [cluster1-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
2021-06-04T02:05:20.164Z [cluster1-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 16000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:05:20.270Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22d8c8c4-910d-448b-83e8-fe6aea6eedb9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:05:20.270Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22d8c8c4-910d-448b-83e8-fe6aea6eedb9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a47faab
2021-06-04T02:05:20.270Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22d8c8c4-910d-448b-83e8-fe6aea6eedb9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:05:20.270Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22d8c8c4-910d-448b-83e8-fe6aea6eedb9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:05:23.619Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75833e8f-e24f-4c91-8794-2b31d5156554 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:05:23.619Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75833e8f-e24f-4c91-8794-2b31d5156554 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6cc1b44
2021-06-04T02:05:23.619Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75833e8f-e24f-4c91-8794-2b31d5156554 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:05:23.620Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75833e8f-e24f-4c91-8794-2b31d5156554 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:05:24.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a326628-9c48-424b-a926-5f7b8a937bb0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:05:24.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a326628-9c48-424b-a926-5f7b8a937bb0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1806a555
2021-06-04T02:05:24.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a326628-9c48-424b-a926-5f7b8a937bb0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:05:24.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a326628-9c48-424b-a926-5f7b8a937bb0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:05:24.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33a68e1d-d152-4ce0-ab31-e18aae1fb85e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:05:24.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33a68e1d-d152-4ce0-ab31-e18aae1fb85e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d11965c
2021-06-04T02:05:24.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33a68e1d-d152-4ce0-ab31-e18aae1fb85e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:05:24.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33a68e1d-d152-4ce0-ab31-e18aae1fb85e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:05:25.067Z [JanusGraph Cluster-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host /10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
2021-06-04T02:05:25.068Z [JanusGraph Cluster-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to /10.242.138.69:9042, scheduling retry in 8000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:05:27.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afc3ebba-92e9-4d9b-af05-487e4d76959b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:05:27.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afc3ebba-92e9-4d9b-af05-487e4d76959b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a6b1f0c
2021-06-04T02:05:27.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afc3ebba-92e9-4d9b-af05-487e4d76959b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:05:27.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afc3ebba-92e9-4d9b-af05-487e4d76959b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:05:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:05:29.869Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:05:29.870Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:05:29.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:05:30.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76f44386-2aa7-481f-ab75-efd316f530f7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:05:30.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76f44386-2aa7-481f-ab75-efd316f530f7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c9b293e
2021-06-04T02:05:30.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76f44386-2aa7-481f-ab75-efd316f530f7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:05:30.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76f44386-2aa7-481f-ab75-efd316f530f7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:05:33.335Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47e687c1-e632-416b-bda6-e4b3525e12f5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:05:33.335Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47e687c1-e632-416b-bda6-e4b3525e12f5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@119a0ff5
2021-06-04T02:05:33.335Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47e687c1-e632-416b-bda6-e4b3525e12f5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:05:33.335Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47e687c1-e632-416b-bda6-e4b3525e12f5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:05:36.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c314ba05-8f58-4724-b9c4-b11a97655dfc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:05:36.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c314ba05-8f58-4724-b9c4-b11a97655dfc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28d8ec
2021-06-04T02:05:36.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c314ba05-8f58-4724-b9c4-b11a97655dfc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:05:36.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c314ba05-8f58-4724-b9c4-b11a97655dfc PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:05:38.469Z [JanusGraph Cluster-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host /10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T02:05:38.476Z [JanusGraph Cluster-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to /10.242.138.69:9042, scheduling retry in 16000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:05:38.490Z [cluster1-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T02:05:38.491Z [cluster1-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 32000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:05:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:05:39.452Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T02:05:39.456Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:05:39.456Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:05:39.457Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:05:39.458Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T02:05:39.458Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T02:05:39.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ecd99605-8a40-431d-84d9-7ee07b80e818 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:05:39.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ecd99605-8a40-431d-84d9-7ee07b80e818 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@239349a
2021-06-04T02:05:39.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ecd99605-8a40-431d-84d9-7ee07b80e818 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:05:39.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ecd99605-8a40-431d-84d9-7ee07b80e818 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:05:41.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3251d41-21bc-466e-9425-06417fe28373 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:05:41.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3251d41-21bc-466e-9425-06417fe28373 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@670e2f3a
2021-06-04T02:05:41.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3251d41-21bc-466e-9425-06417fe28373 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:05:41.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3251d41-21bc-466e-9425-06417fe28373 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:05:44.867Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:05:44.869Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:05:44.870Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:05:44.870Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:05:46.658Z [cluster2-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T02:05:46.658Z [cluster2-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 30000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:05:46.699Z [cluster1-nio-worker-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:05:46.699Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c63dc3b8-ccc8-4f28-8be1-ecba0fdd3ae9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:05:46.699Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c63dc3b8-ccc8-4f28-8be1-ecba0fdd3ae9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@262a6189
2021-06-04T02:05:46.699Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c63dc3b8-ccc8-4f28-8be1-ecba0fdd3ae9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:05:46.699Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c63dc3b8-ccc8-4f28-8be1-ecba0fdd3ae9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:05:48.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0125c39-e24c-4501-80b8-f79d59de03ff PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:05:48.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0125c39-e24c-4501-80b8-f79d59de03ff PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60832218
2021-06-04T02:05:48.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0125c39-e24c-4501-80b8-f79d59de03ff PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:05:48.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0125c39-e24c-4501-80b8-f79d59de03ff PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:05:50.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a39b84a-575e-45d6-857a-eeed45c8ad67 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:05:50.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a39b84a-575e-45d6-857a-eeed45c8ad67 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b554776
2021-06-04T02:05:50.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a39b84a-575e-45d6-857a-eeed45c8ad67 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:05:50.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a39b84a-575e-45d6-857a-eeed45c8ad67 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:05:51.755Z [cluster2-nio-worker-1] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:05:52.563Z [cluster2-nio-worker-1] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:05:52.654Z [cluster1-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T02:05:52.655Z [cluster1-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 2000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:05:52.771Z [cluster2-nio-worker-1] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:05:52.772Z [JanusGraph Cluster-nio-worker-0] WARN com.datastax.driver.core.Session Error creating pool to /10.242.138.69:9042
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:05:53.082Z [cluster2-nio-worker-1] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:05:53.278Z [cluster2-nio-worker-1] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:05:54.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cefe831a-113b-45f6-b2f4-fc77ac305277 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:05:54.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cefe831a-113b-45f6-b2f4-fc77ac305277 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d34dad9
2021-06-04T02:05:54.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cefe831a-113b-45f6-b2f4-fc77ac305277 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:05:54.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cefe831a-113b-45f6-b2f4-fc77ac305277 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:05:57.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a7c0553-606e-41f4-8e26-39c941c73196 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:05:57.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a7c0553-606e-41f4-8e26-39c941c73196 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@48e7c2df
2021-06-04T02:05:57.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a7c0553-606e-41f4-8e26-39c941c73196 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:05:57.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a7c0553-606e-41f4-8e26-39c941c73196 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:05:59.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:05:59.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:05:59.873Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:05:59.875Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:05:59.978Z [cluster1-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T02:05:59.979Z [cluster1-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 4000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:06:00.049Z [JanusGraph Cluster-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host /10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T02:06:00.050Z [JanusGraph Cluster-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to /10.242.138.69:9042, scheduling retry in 2000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:06:00.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec1d7b50-415a-4ba5-bfa0-86c11825e97d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:06:00.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec1d7b50-415a-4ba5-bfa0-86c11825e97d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@318dba39
2021-06-04T02:06:00.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec1d7b50-415a-4ba5-bfa0-86c11825e97d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:06:00.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec1d7b50-415a-4ba5-bfa0-86c11825e97d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:06:03.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d305c87f-2441-4448-b529-1d33f43bdadd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:06:03.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d305c87f-2441-4448-b529-1d33f43bdadd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30e23589
2021-06-04T02:06:03.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d305c87f-2441-4448-b529-1d33f43bdadd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:06:03.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d305c87f-2441-4448-b529-1d33f43bdadd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:06:06.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95e9e4ce-3800-4564-97e6-efc1b3a45928 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:06:06.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95e9e4ce-3800-4564-97e6-efc1b3a45928 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b1bd35e
2021-06-04T02:06:06.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95e9e4ce-3800-4564-97e6-efc1b3a45928 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:06:06.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95e9e4ce-3800-4564-97e6-efc1b3a45928 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:06:12.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07363a5a-b4c5-4315-8e7a-d29959e5ca40 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:06:12.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07363a5a-b4c5-4315-8e7a-d29959e5ca40 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d9c0dd8
2021-06-04T02:06:12.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07363a5a-b4c5-4315-8e7a-d29959e5ca40 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:06:12.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07363a5a-b4c5-4315-8e7a-d29959e5ca40 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:06:13.370Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dce8e349-27f4-4b00-b3d4-541161afc879 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:06:13.370Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dce8e349-27f4-4b00-b3d4-541161afc879 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@11c3820
2021-06-04T02:06:13.370Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dce8e349-27f4-4b00-b3d4-541161afc879 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:06:13.370Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dce8e349-27f4-4b00-b3d4-541161afc879 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:06:14.869Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:06:14.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:06:14.872Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:06:14.873Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:06:15.824Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7b31444-afb0-4361-bf45-bda0d285a77d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:06:15.824Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7b31444-afb0-4361-bf45-bda0d285a77d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20f30bf7
2021-06-04T02:06:15.824Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7b31444-afb0-4361-bf45-bda0d285a77d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:06:15.825Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7b31444-afb0-4361-bf45-bda0d285a77d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:06:18.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=407711fe-78ef-4bb4-86c8-d1786e14360b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:06:18.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=407711fe-78ef-4bb4-86c8-d1786e14360b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5507bd94
2021-06-04T02:06:18.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=407711fe-78ef-4bb4-86c8-d1786e14360b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:06:18.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=407711fe-78ef-4bb4-86c8-d1786e14360b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:06:22.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59594940-bf0a-474e-9ffb-5fac8ce3d368 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:06:22.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59594940-bf0a-474e-9ffb-5fac8ce3d368 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68c89821
2021-06-04T02:06:22.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59594940-bf0a-474e-9ffb-5fac8ce3d368 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:06:22.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59594940-bf0a-474e-9ffb-5fac8ce3d368 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:06:25.074Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=698fbde0-236b-40ba-be9f-840f4ccd6e13 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:06:25.074Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=698fbde0-236b-40ba-be9f-840f4ccd6e13 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@8f56020
2021-06-04T02:06:25.074Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=698fbde0-236b-40ba-be9f-840f4ccd6e13 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:06:25.074Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=698fbde0-236b-40ba-be9f-840f4ccd6e13 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:06:28.267Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce5299b6-e4fc-4088-8af8-6894019ea762 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:06:28.267Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce5299b6-e4fc-4088-8af8-6894019ea762 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30617e7a
2021-06-04T02:06:28.267Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce5299b6-e4fc-4088-8af8-6894019ea762 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:06:28.267Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce5299b6-e4fc-4088-8af8-6894019ea762 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:06:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:06:29.870Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:06:29.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:06:29.874Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:06:30.692Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a64698d-2c29-4839-8b81-a8561d0967ae PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:06:30.693Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a64698d-2c29-4839-8b81-a8561d0967ae PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58628eff
2021-06-04T02:06:30.693Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a64698d-2c29-4839-8b81-a8561d0967ae PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:06:30.693Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a64698d-2c29-4839-8b81-a8561d0967ae PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:06:33.333Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=764e607e-c247-456c-997b-81614fdf0696 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:06:33.333Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=764e607e-c247-456c-997b-81614fdf0696 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74c70c42
2021-06-04T02:06:33.333Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=764e607e-c247-456c-997b-81614fdf0696 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:06:33.333Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=764e607e-c247-456c-997b-81614fdf0696 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:06:36.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6d54767-1b9b-4e52-afc9-09fd5b060ef1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:06:36.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6d54767-1b9b-4e52-afc9-09fd5b060ef1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5790969a
2021-06-04T02:06:36.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6d54767-1b9b-4e52-afc9-09fd5b060ef1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:06:36.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6d54767-1b9b-4e52-afc9-09fd5b060ef1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:06:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:06:39.452Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T02:06:39.453Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:06:39.453Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:06:39.455Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:06:39.455Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T02:06:39.456Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T02:06:39.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0fca135-3d89-40a3-9a77-d8c6505058d6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:06:39.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0fca135-3d89-40a3-9a77-d8c6505058d6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c39b0bc
2021-06-04T02:06:39.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0fca135-3d89-40a3-9a77-d8c6505058d6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:06:39.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0fca135-3d89-40a3-9a77-d8c6505058d6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:06:42.149Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a957aaf0-fd99-4ea2-9c3b-65c52abe37ac PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:06:42.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a957aaf0-fd99-4ea2-9c3b-65c52abe37ac PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20e0ceb2
2021-06-04T02:06:42.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a957aaf0-fd99-4ea2-9c3b-65c52abe37ac PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:06:42.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a957aaf0-fd99-4ea2-9c3b-65c52abe37ac PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:06:44.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:06:44.870Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:06:44.872Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:06:44.873Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:06:45.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:06:45.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:06:45.906Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b64dfeb0-442f-4c8e-a641-2cc4db7400d2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:06:45.906Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b64dfeb0-442f-4c8e-a641-2cc4db7400d2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c0973f0
2021-06-04T02:06:45.906Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b64dfeb0-442f-4c8e-a641-2cc4db7400d2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:06:45.906Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b64dfeb0-442f-4c8e-a641-2cc4db7400d2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:06:47.571Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:06:48.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af17c769-1b67-44be-a58e-35c2f8cb94a6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:06:48.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af17c769-1b67-44be-a58e-35c2f8cb94a6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f7e1cad
2021-06-04T02:06:48.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af17c769-1b67-44be-a58e-35c2f8cb94a6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:06:48.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af17c769-1b67-44be-a58e-35c2f8cb94a6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:06:52.154Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=06ae752b-db89-48cc-a5b7-14d58decbddb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:06:52.154Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=06ae752b-db89-48cc-a5b7-14d58decbddb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ee3f7ae
2021-06-04T02:06:52.154Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=06ae752b-db89-48cc-a5b7-14d58decbddb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:06:52.154Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=06ae752b-db89-48cc-a5b7-14d58decbddb PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:06:54.690Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=794d1b4a-ed30-4bf7-85ac-53dbb5554f66 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:06:54.690Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=794d1b4a-ed30-4bf7-85ac-53dbb5554f66 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38503f9e
2021-06-04T02:06:54.690Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=794d1b4a-ed30-4bf7-85ac-53dbb5554f66 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:06:54.690Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=794d1b4a-ed30-4bf7-85ac-53dbb5554f66 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:06:57.579Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=019cabb2-bbda-4137-8c72-1ca72c62b7a9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:06:57.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=019cabb2-bbda-4137-8c72-1ca72c62b7a9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1fe15d97
2021-06-04T02:06:57.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=019cabb2-bbda-4137-8c72-1ca72c62b7a9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:06:57.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=019cabb2-bbda-4137-8c72-1ca72c62b7a9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:06:59.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:06:59.869Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:06:59.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:06:59.872Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:07:00.380Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5cdf65b-3219-4074-ab09-0b57e33a02d5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:07:00.380Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5cdf65b-3219-4074-ab09-0b57e33a02d5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50b5b1b2
2021-06-04T02:07:00.380Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5cdf65b-3219-4074-ab09-0b57e33a02d5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:07:00.380Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5cdf65b-3219-4074-ab09-0b57e33a02d5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:07:03.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d87e3e0d-16d6-4f93-8460-e81509221aea PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:07:03.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d87e3e0d-16d6-4f93-8460-e81509221aea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@51ea728d
2021-06-04T02:07:03.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d87e3e0d-16d6-4f93-8460-e81509221aea PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:07:03.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d87e3e0d-16d6-4f93-8460-e81509221aea PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:07:06.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b069009-8866-4fab-a234-89feebc39155 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:07:06.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b069009-8866-4fab-a234-89feebc39155 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68ff0be1
2021-06-04T02:07:06.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b069009-8866-4fab-a234-89feebc39155 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:07:06.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b069009-8866-4fab-a234-89feebc39155 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:07:09.523Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dba40bf8-27ef-4bd0-a24e-a65166df21e6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:07:09.523Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dba40bf8-27ef-4bd0-a24e-a65166df21e6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7de7ee8c
2021-06-04T02:07:09.523Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dba40bf8-27ef-4bd0-a24e-a65166df21e6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:07:09.524Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dba40bf8-27ef-4bd0-a24e-a65166df21e6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:07:12.206Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c97380e1-0201-403e-a652-0c93a0e76c74 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:07:12.206Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c97380e1-0201-403e-a652-0c93a0e76c74 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a2f8a3
2021-06-04T02:07:12.206Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c97380e1-0201-403e-a652-0c93a0e76c74 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:07:12.206Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c97380e1-0201-403e-a652-0c93a0e76c74 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:07:14.869Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:07:14.873Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:07:14.875Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:07:14.876Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:07:15.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c25088a7-9259-455a-be9a-5042cee87e1c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:07:15.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c25088a7-9259-455a-be9a-5042cee87e1c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@25e9c20
2021-06-04T02:07:15.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c25088a7-9259-455a-be9a-5042cee87e1c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:07:15.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c25088a7-9259-455a-be9a-5042cee87e1c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:07:19.505Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=515899d1-25e7-49b1-a134-6726ed4c2cdc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:07:19.505Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=515899d1-25e7-49b1-a134-6726ed4c2cdc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@126e2f89
2021-06-04T02:07:19.505Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=515899d1-25e7-49b1-a134-6726ed4c2cdc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:07:19.505Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=515899d1-25e7-49b1-a134-6726ed4c2cdc PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:07:22.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb2577f7-99d7-42b8-83b4-3e929e482ea5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:07:22.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb2577f7-99d7-42b8-83b4-3e929e482ea5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50bf30c6
2021-06-04T02:07:22.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb2577f7-99d7-42b8-83b4-3e929e482ea5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:07:22.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb2577f7-99d7-42b8-83b4-3e929e482ea5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:07:26.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77543ce7-c642-4d5f-9c08-01a60d5bf50e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:07:26.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77543ce7-c642-4d5f-9c08-01a60d5bf50e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47cfbd92
2021-06-04T02:07:26.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77543ce7-c642-4d5f-9c08-01a60d5bf50e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:07:26.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77543ce7-c642-4d5f-9c08-01a60d5bf50e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:07:27.862Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbc6f5de-bd1d-49ad-b026-c975deb710eb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:07:27.862Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbc6f5de-bd1d-49ad-b026-c975deb710eb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@310696d7
2021-06-04T02:07:27.862Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbc6f5de-bd1d-49ad-b026-c975deb710eb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:07:27.862Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbc6f5de-bd1d-49ad-b026-c975deb710eb PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:07:29.872Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:07:29.875Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:07:29.876Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:07:29.878Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:07:30.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0da8a3c-5563-4f1d-9b23-3db5aa449fa4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:07:30.285Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0da8a3c-5563-4f1d-9b23-3db5aa449fa4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5277e519
2021-06-04T02:07:30.285Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0da8a3c-5563-4f1d-9b23-3db5aa449fa4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:07:30.285Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0da8a3c-5563-4f1d-9b23-3db5aa449fa4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:07:33.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20e80338-a6ea-4a6e-a988-e43cc9c1d408 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:07:33.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20e80338-a6ea-4a6e-a988-e43cc9c1d408 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7be7d691
2021-06-04T02:07:33.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20e80338-a6ea-4a6e-a988-e43cc9c1d408 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:07:33.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20e80338-a6ea-4a6e-a988-e43cc9c1d408 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:07:36.480Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25035aec-be85-4f0d-8909-aec37408afce PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:07:36.480Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25035aec-be85-4f0d-8909-aec37408afce PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41fec752
2021-06-04T02:07:36.480Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25035aec-be85-4f0d-8909-aec37408afce PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:07:36.480Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25035aec-be85-4f0d-8909-aec37408afce PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:07:39.453Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:07:39.453Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T02:07:39.455Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:07:39.455Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:07:39.458Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:07:39.460Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T02:07:39.460Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T02:07:39.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7336149-6c19-4b0c-88c1-ae6a98dc3954 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:07:39.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7336149-6c19-4b0c-88c1-ae6a98dc3954 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@444b4194
2021-06-04T02:07:39.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7336149-6c19-4b0c-88c1-ae6a98dc3954 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:07:39.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7336149-6c19-4b0c-88c1-ae6a98dc3954 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:07:43.065Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8adf2911-dcac-4da7-a0e8-e6c51149e8d4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:07:43.065Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8adf2911-dcac-4da7-a0e8-e6c51149e8d4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29f92b29
2021-06-04T02:07:43.065Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8adf2911-dcac-4da7-a0e8-e6c51149e8d4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:07:43.065Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8adf2911-dcac-4da7-a0e8-e6c51149e8d4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:07:44.869Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:07:44.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:07:44.872Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:07:44.875Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:07:46.455Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e79a31e-eb0b-4493-bece-afb9f0f83d5d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:07:46.455Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e79a31e-eb0b-4493-bece-afb9f0f83d5d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c6f23d9
2021-06-04T02:07:46.455Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e79a31e-eb0b-4493-bece-afb9f0f83d5d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:07:46.455Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e79a31e-eb0b-4493-bece-afb9f0f83d5d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:07:48.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf9d6a43-9988-4151-938d-4c10a32eb731 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:07:48.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf9d6a43-9988-4151-938d-4c10a32eb731 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b9cad51
2021-06-04T02:07:48.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf9d6a43-9988-4151-938d-4c10a32eb731 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:07:48.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf9d6a43-9988-4151-938d-4c10a32eb731 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:07:51.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:07:51.262Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:07:52.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27d8b276-20c9-4af7-a087-5f5e1a2f0691 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:07:52.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27d8b276-20c9-4af7-a087-5f5e1a2f0691 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45451057
2021-06-04T02:07:52.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27d8b276-20c9-4af7-a087-5f5e1a2f0691 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:07:52.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27d8b276-20c9-4af7-a087-5f5e1a2f0691 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:07:53.325Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:07:54.475Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6cc22777-8b7b-4e99-8553-b64fd4206a78 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:07:54.475Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6cc22777-8b7b-4e99-8553-b64fd4206a78 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2505dbb5
2021-06-04T02:07:54.475Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6cc22777-8b7b-4e99-8553-b64fd4206a78 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:07:54.475Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6cc22777-8b7b-4e99-8553-b64fd4206a78 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:07:57.481Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=6cc22777-8b7b-4e99-8553-b64fd4206a78 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:07:57.482Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=6cc22777-8b7b-4e99-8553-b64fd4206a78 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:07:58.910Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cd5fdea-80e9-44fa-8cb3-f43c03da9076 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:07:58.910Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cd5fdea-80e9-44fa-8cb3-f43c03da9076 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30e15527
2021-06-04T02:07:58.910Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cd5fdea-80e9-44fa-8cb3-f43c03da9076 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:07:58.910Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cd5fdea-80e9-44fa-8cb3-f43c03da9076 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:07:59.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:07:59.870Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:07:59.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:07:59.873Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:08:01.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96893a50-2e9e-4562-a238-212c80e100d5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:08:01.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96893a50-2e9e-4562-a238-212c80e100d5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6383ee75
2021-06-04T02:08:01.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96893a50-2e9e-4562-a238-212c80e100d5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:08:01.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96893a50-2e9e-4562-a238-212c80e100d5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:08:03.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e441ba2e-8e24-409a-b3d8-9fa2776b26dd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:08:03.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e441ba2e-8e24-409a-b3d8-9fa2776b26dd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68d049c3
2021-06-04T02:08:03.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e441ba2e-8e24-409a-b3d8-9fa2776b26dd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:08:03.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e441ba2e-8e24-409a-b3d8-9fa2776b26dd PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:08:07.294Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30928d9d-4b2d-4871-a39c-9ada73b59292 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:08:07.294Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30928d9d-4b2d-4871-a39c-9ada73b59292 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@52a27193
2021-06-04T02:08:07.295Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30928d9d-4b2d-4871-a39c-9ada73b59292 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:08:07.295Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30928d9d-4b2d-4871-a39c-9ada73b59292 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:08:09.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:08:09.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:08:11.330Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:08:13.103Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba237bd5-c101-4677-956a-54568550e6b1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:08:13.103Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba237bd5-c101-4677-956a-54568550e6b1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@10cbb870
2021-06-04T02:08:13.103Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba237bd5-c101-4677-956a-54568550e6b1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:08:13.103Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba237bd5-c101-4677-956a-54568550e6b1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:08:13.675Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbdc495e-4993-4b08-81b4-ef9ef56b6885 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:08:13.675Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbdc495e-4993-4b08-81b4-ef9ef56b6885 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c471c5a
2021-06-04T02:08:13.675Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbdc495e-4993-4b08-81b4-ef9ef56b6885 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:08:13.675Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbdc495e-4993-4b08-81b4-ef9ef56b6885 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:08:14.869Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:08:14.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:08:14.872Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:08:14.873Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:08:16.715Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22423717-5eae-47c0-99cc-e00e90c99dad PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:08:16.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22423717-5eae-47c0-99cc-e00e90c99dad PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b3ce40
2021-06-04T02:08:16.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22423717-5eae-47c0-99cc-e00e90c99dad PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:08:16.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22423717-5eae-47c0-99cc-e00e90c99dad PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:08:18.579Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c4bfbba-1e94-4bb3-ab39-46f9e6035771 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:08:18.579Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c4bfbba-1e94-4bb3-ab39-46f9e6035771 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@475c19ec
2021-06-04T02:08:18.579Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c4bfbba-1e94-4bb3-ab39-46f9e6035771 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:08:18.579Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c4bfbba-1e94-4bb3-ab39-46f9e6035771 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:08:21.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbbc8434-fb06-4770-9758-fdf929b609fc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:08:21.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbbc8434-fb06-4770-9758-fdf929b609fc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a99214f
2021-06-04T02:08:21.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbbc8434-fb06-4770-9758-fdf929b609fc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:08:21.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbbc8434-fb06-4770-9758-fdf929b609fc PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:08:24.714Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3b778c4-7b30-4cf4-b587-97038c2138fc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:08:24.714Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3b778c4-7b30-4cf4-b587-97038c2138fc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ee8598a
2021-06-04T02:08:24.714Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3b778c4-7b30-4cf4-b587-97038c2138fc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:08:24.714Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3b778c4-7b30-4cf4-b587-97038c2138fc PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:08:28.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bcbf663-7af6-4bf0-8a79-d28fb55e80ec PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:08:28.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bcbf663-7af6-4bf0-8a79-d28fb55e80ec PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@46315dd9
2021-06-04T02:08:28.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bcbf663-7af6-4bf0-8a79-d28fb55e80ec PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:08:28.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bcbf663-7af6-4bf0-8a79-d28fb55e80ec PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:08:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:08:29.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:08:29.872Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:08:29.873Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:08:30.903Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca95af50-35b7-4be1-a9aa-595310f40bd4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:08:30.903Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca95af50-35b7-4be1-a9aa-595310f40bd4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6105bf8a
2021-06-04T02:08:30.903Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca95af50-35b7-4be1-a9aa-595310f40bd4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:08:30.903Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca95af50-35b7-4be1-a9aa-595310f40bd4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:08:33.729Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bd0fcd1-b626-4a33-8c5d-8d5a11a6705a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:08:33.730Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bd0fcd1-b626-4a33-8c5d-8d5a11a6705a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22d569bc
2021-06-04T02:08:33.730Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bd0fcd1-b626-4a33-8c5d-8d5a11a6705a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:08:33.730Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bd0fcd1-b626-4a33-8c5d-8d5a11a6705a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:08:37.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70319410-4a8c-41fe-9afe-81106d59814e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:08:37.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70319410-4a8c-41fe-9afe-81106d59814e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3eed5065
2021-06-04T02:08:37.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70319410-4a8c-41fe-9afe-81106d59814e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:08:37.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70319410-4a8c-41fe-9afe-81106d59814e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:08:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:08:39.452Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T02:08:39.453Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:08:39.453Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:08:39.455Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:08:39.456Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T02:08:39.456Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T02:08:39.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61b039cb-91a5-4931-ade8-3202f7549d18 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:08:39.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61b039cb-91a5-4931-ade8-3202f7549d18 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@72fe0df4
2021-06-04T02:08:39.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61b039cb-91a5-4931-ade8-3202f7549d18 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:08:39.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61b039cb-91a5-4931-ade8-3202f7549d18 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:08:42.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2db93bf-4190-483b-af2a-aab15e4813fe PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:08:42.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2db93bf-4190-483b-af2a-aab15e4813fe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ecb15ce
2021-06-04T02:08:42.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2db93bf-4190-483b-af2a-aab15e4813fe PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:08:42.779Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2db93bf-4190-483b-af2a-aab15e4813fe PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:08:44.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:08:44.870Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:08:44.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:08:44.872Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:08:45.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f98de87-02ac-4964-8ac8-36557f7d6a5f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:08:45.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f98de87-02ac-4964-8ac8-36557f7d6a5f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@375a1322
2021-06-04T02:08:45.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f98de87-02ac-4964-8ac8-36557f7d6a5f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:08:45.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f98de87-02ac-4964-8ac8-36557f7d6a5f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:08:54.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:08:54.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:08:55.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=899efd73-36b1-4b93-95bc-fd71b68435a2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:08:55.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=899efd73-36b1-4b93-95bc-fd71b68435a2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@63e013d4
2021-06-04T02:08:55.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=899efd73-36b1-4b93-95bc-fd71b68435a2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:08:55.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=899efd73-36b1-4b93-95bc-fd71b68435a2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:08:56.359Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:08:57.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96e3a58d-69cf-4e35-899e-0090946f0d53 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:08:57.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96e3a58d-69cf-4e35-899e-0090946f0d53 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@61f323f1
2021-06-04T02:08:57.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96e3a58d-69cf-4e35-899e-0090946f0d53 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:08:57.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96e3a58d-69cf-4e35-899e-0090946f0d53 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:08:57.776Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=96e3a58d-69cf-4e35-899e-0090946f0d53 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:08:57.776Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=96e3a58d-69cf-4e35-899e-0090946f0d53 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:08:59.869Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:08:59.870Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:08:59.872Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:08:59.875Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:09:00.263Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:09:00.263Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:09:03.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:09:06.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:09:09.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:09:12.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:09:14.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:09:14.870Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:09:14.872Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:09:14.873Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:09:15.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:09:17.857Z [cluster1-timeouter-0] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.138.69:9042] Operation timed out
at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:09:17.858Z [cluster1-timeouter-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.ConnectionException: [cassandra.onap/10.242.138.69:9042] Pool was closed during initialization
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:173)
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:158)
at com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1080)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.google.common.util.concurrent.CollectionFuture.handleAllCompleted(CollectionFuture.java:69)
at com.google.common.util.concurrent.AggregateFuture.processCompleted(AggregateFuture.java:282)
at com.google.common.util.concurrent.AggregateFuture.decrementCountAndMaybeComplete(AggregateFuture.java:264)
at com.google.common.util.concurrent.AggregateFuture.access$200(AggregateFuture.java:42)
at com.google.common.util.concurrent.AggregateFuture$1.run(AggregateFuture.java:147)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179)
at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179)
at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:100)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771)
at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:09:17.858Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09d9c323-3615-4c93-955f-9846e7540552 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:09:17.858Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09d9c323-3615-4c93-955f-9846e7540552 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7703f64
2021-06-04T02:09:17.858Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09d9c323-3615-4c93-955f-9846e7540552 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:09:17.858Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09d9c323-3615-4c93-955f-9846e7540552 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:09:18.021Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=09d9c323-3615-4c93-955f-9846e7540552 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:09:18.021Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=09d9c323-3615-4c93-955f-9846e7540552 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:09:18.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:09:18.678Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f512c5e-254d-475c-88ef-ee05a075441c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:09:18.678Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f512c5e-254d-475c-88ef-ee05a075441c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60d4ffab
2021-06-04T02:09:18.678Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f512c5e-254d-475c-88ef-ee05a075441c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:09:18.678Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f512c5e-254d-475c-88ef-ee05a075441c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:09:21.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:09:21.682Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=9f512c5e-254d-475c-88ef-ee05a075441c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:09:21.682Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=9f512c5e-254d-475c-88ef-ee05a075441c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:09:21.683Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9f512c5e-254d-475c-88ef-ee05a075441c ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:09:21.683Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=9f512c5e-254d-475c-88ef-ee05a075441c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:09:21.789Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6ec7d2b-3e7e-408f-af66-bcc0705809fa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:09:21.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6ec7d2b-3e7e-408f-af66-bcc0705809fa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c93ed6
2021-06-04T02:09:21.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6ec7d2b-3e7e-408f-af66-bcc0705809fa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:09:21.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6ec7d2b-3e7e-408f-af66-bcc0705809fa PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:09:24.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:09:24.844Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=c6ec7d2b-3e7e-408f-af66-bcc0705809fa ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:09:24.844Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=c6ec7d2b-3e7e-408f-af66-bcc0705809fa ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:09:25.059Z [cluster1-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T02:09:25.060Z [cluster1-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 2000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:09:25.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c9d8ac2-3057-4b84-9f20-4cf1373e2447 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:09:25.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c9d8ac2-3057-4b84-9f20-4cf1373e2447 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d50e2e5
2021-06-04T02:09:25.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c9d8ac2-3057-4b84-9f20-4cf1373e2447 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:09:25.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c9d8ac2-3057-4b84-9f20-4cf1373e2447 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:09:27.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:09:27.382Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation RequestID=null ErrorCategory=INFO ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=500 TargetEntity=ReplaceDataTypesCache Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177)
at org.apache.tinkerpop.gremlin.structure.Element.keys(Element.java:69)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getProperties(JanusGraphGenericDao.java:1491)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getByCriteria(JanusGraphGenericDao.java:759)
at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypeNodes(PropertyOperation.java:1566)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.findAllDataTypesLazy(ApplicationDataTypeCache.java:309)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.hasDataTypesChanged(ApplicationDataTypeCache.java:220)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:200)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T02:09:28.679Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2c9d8ac2-3057-4b84-9f20-4cf1373e2447 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:09:28.680Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2c9d8ac2-3057-4b84-9f20-4cf1373e2447 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:09:29.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8514bd9-ae65-48c5-b03c-f20e52f8838f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:09:29.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8514bd9-ae65-48c5-b03c-f20e52f8838f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@70cbc54c
2021-06-04T02:09:29.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8514bd9-ae65-48c5-b03c-f20e52f8838f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:09:29.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8514bd9-ae65-48c5-b03c-f20e52f8838f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:09:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:09:29.869Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:09:29.870Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:09:29.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:09:30.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:09:30.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d21da1e0-0d2a-4d69-b3ff-596bf41df523 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:09:30.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d21da1e0-0d2a-4d69-b3ff-596bf41df523 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1af41947
2021-06-04T02:09:30.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d21da1e0-0d2a-4d69-b3ff-596bf41df523 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:09:30.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d21da1e0-0d2a-4d69-b3ff-596bf41df523 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:09:33.119Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:09:33.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa2fb1a3-91b6-469c-8496-8bb9170c504d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:09:33.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa2fb1a3-91b6-469c-8496-8bb9170c504d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53194531
2021-06-04T02:09:33.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa2fb1a3-91b6-469c-8496-8bb9170c504d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:09:33.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa2fb1a3-91b6-469c-8496-8bb9170c504d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:09:35.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=712839b0-1302-4670-a4bb-33306c2f82e4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:09:35.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=712839b0-1302-4670-a4bb-33306c2f82e4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7dd60bbb
2021-06-04T02:09:35.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=712839b0-1302-4670-a4bb-33306c2f82e4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:09:35.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=712839b0-1302-4670-a4bb-33306c2f82e4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:09:35.218Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=712839b0-1302-4670-a4bb-33306c2f82e4 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:09:35.218Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=712839b0-1302-4670-a4bb-33306c2f82e4 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:09:36.251Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f9297a2-e8eb-4a3b-a415-3724190a929e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:09:36.251Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f9297a2-e8eb-4a3b-a415-3724190a929e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@51f08e70
2021-06-04T02:09:36.251Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f9297a2-e8eb-4a3b-a415-3724190a929e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:09:36.251Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f9297a2-e8eb-4a3b-a415-3724190a929e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:09:38.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=73dfe28b-7f7a-447e-86dd-b97463f81535 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:09:38.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=73dfe28b-7f7a-447e-86dd-b97463f81535 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6bf48b28
2021-06-04T02:09:38.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=73dfe28b-7f7a-447e-86dd-b97463f81535 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:09:38.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=73dfe28b-7f7a-447e-86dd-b97463f81535 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:09:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:09:39.452Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T02:09:39.453Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:09:39.453Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:09:39.456Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:09:39.456Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T02:09:39.456Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T02:09:39.771Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a1dd654-575d-44f4-8e05-380477171e2d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:09:39.771Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a1dd654-575d-44f4-8e05-380477171e2d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@725d6baa
2021-06-04T02:09:39.771Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a1dd654-575d-44f4-8e05-380477171e2d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:09:39.771Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a1dd654-575d-44f4-8e05-380477171e2d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:09:42.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=198de491-df3c-453d-badb-7ea074600395 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:09:42.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=198de491-df3c-453d-badb-7ea074600395 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f1b3d89
2021-06-04T02:09:42.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=198de491-df3c-453d-badb-7ea074600395 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:09:42.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=198de491-df3c-453d-badb-7ea074600395 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:09:42.962Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79f8c01e-6df3-4f37-bb57-0ac02c020f79 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:09:42.962Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79f8c01e-6df3-4f37-bb57-0ac02c020f79 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6acda714
2021-06-04T02:09:42.962Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79f8c01e-6df3-4f37-bb57-0ac02c020f79 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:09:42.962Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79f8c01e-6df3-4f37-bb57-0ac02c020f79 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:09:43.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=797957b8-e08d-4f79-8f88-ecc4a3ff4fea PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:09:43.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=797957b8-e08d-4f79-8f88-ecc4a3ff4fea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@252fdcae
2021-06-04T02:09:43.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=797957b8-e08d-4f79-8f88-ecc4a3ff4fea PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:09:43.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=797957b8-e08d-4f79-8f88-ecc4a3ff4fea PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:09:43.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a47fc28c-3c34-4650-97c4-5df8251f599c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:09:43.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a47fc28c-3c34-4650-97c4-5df8251f599c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3cb6f39a
2021-06-04T02:09:43.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a47fc28c-3c34-4650-97c4-5df8251f599c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:09:43.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a47fc28c-3c34-4650-97c4-5df8251f599c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:09:44.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aeeb82bd-3ac9-4cd1-aef3-2c17458e7df4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:09:44.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aeeb82bd-3ac9-4cd1-aef3-2c17458e7df4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a2776f0
2021-06-04T02:09:44.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aeeb82bd-3ac9-4cd1-aef3-2c17458e7df4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:09:44.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aeeb82bd-3ac9-4cd1-aef3-2c17458e7df4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:09:44.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:09:44.870Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:09:44.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:09:44.872Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:09:45.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbb6a5ba-32c2-4f89-8a9b-336c2a072e58 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:09:45.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbb6a5ba-32c2-4f89-8a9b-336c2a072e58 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d558fa7
2021-06-04T02:09:45.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbb6a5ba-32c2-4f89-8a9b-336c2a072e58 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:09:45.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbb6a5ba-32c2-4f89-8a9b-336c2a072e58 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:09:46.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65bb6fde-46a2-415c-9720-2e34f7327e65 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:09:46.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65bb6fde-46a2-415c-9720-2e34f7327e65 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@644f20f
2021-06-04T02:09:46.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65bb6fde-46a2-415c-9720-2e34f7327e65 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:09:46.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65bb6fde-46a2-415c-9720-2e34f7327e65 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:09:48.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ad4f81e-d15e-46be-9487-ff4117f92553 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:09:48.952Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ad4f81e-d15e-46be-9487-ff4117f92553 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@de5fb7e
2021-06-04T02:09:48.952Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ad4f81e-d15e-46be-9487-ff4117f92553 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:09:48.952Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ad4f81e-d15e-46be-9487-ff4117f92553 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:09:51.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09d9dc24-7c52-4d90-88e3-1cc8c12f3605 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:09:51.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09d9dc24-7c52-4d90-88e3-1cc8c12f3605 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c148cc4
2021-06-04T02:09:51.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09d9dc24-7c52-4d90-88e3-1cc8c12f3605 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:09:51.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09d9dc24-7c52-4d90-88e3-1cc8c12f3605 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:09:54.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d3eda01-9b92-4548-8d12-0f26d1a38f2b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:09:54.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d3eda01-9b92-4548-8d12-0f26d1a38f2b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d4d0e56
2021-06-04T02:09:54.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d3eda01-9b92-4548-8d12-0f26d1a38f2b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:09:54.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d3eda01-9b92-4548-8d12-0f26d1a38f2b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:09:57.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9344de3-ecad-4c3e-a423-04e3480a8ae7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:09:57.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9344de3-ecad-4c3e-a423-04e3480a8ae7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3cb8437a
2021-06-04T02:09:57.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9344de3-ecad-4c3e-a423-04e3480a8ae7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:09:57.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9344de3-ecad-4c3e-a423-04e3480a8ae7 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:09:59.873Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:09:59.877Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:09:59.878Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:09:59.879Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:10:01.074Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26ab0745-57f1-4050-b9d4-3ff391892ed2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:10:01.074Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26ab0745-57f1-4050-b9d4-3ff391892ed2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e246198
2021-06-04T02:10:01.074Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26ab0745-57f1-4050-b9d4-3ff391892ed2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:10:01.074Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26ab0745-57f1-4050-b9d4-3ff391892ed2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:10:03.422Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ecd0a764-12b0-4dff-bcfc-d43bf99987de PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:10:03.422Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ecd0a764-12b0-4dff-bcfc-d43bf99987de PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@561ebc34
2021-06-04T02:10:03.422Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ecd0a764-12b0-4dff-bcfc-d43bf99987de PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:10:03.422Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ecd0a764-12b0-4dff-bcfc-d43bf99987de PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:10:06.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af8ed09a-6792-41c9-b196-f05a0afafc92 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:10:06.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af8ed09a-6792-41c9-b196-f05a0afafc92 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23d4371f
2021-06-04T02:10:06.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af8ed09a-6792-41c9-b196-f05a0afafc92 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:10:06.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af8ed09a-6792-41c9-b196-f05a0afafc92 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:10:09.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c143df55-ecef-4ad3-9eda-129e58cb31f3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:10:09.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c143df55-ecef-4ad3-9eda-129e58cb31f3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d09138c
2021-06-04T02:10:09.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c143df55-ecef-4ad3-9eda-129e58cb31f3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:10:09.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c143df55-ecef-4ad3-9eda-129e58cb31f3 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:10:12.259Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a43d68d4-2380-4ed1-aef5-ac6cbb2be08d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:10:12.259Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a43d68d4-2380-4ed1-aef5-ac6cbb2be08d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@601c8114
2021-06-04T02:10:12.259Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a43d68d4-2380-4ed1-aef5-ac6cbb2be08d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:10:12.259Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a43d68d4-2380-4ed1-aef5-ac6cbb2be08d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:10:14.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:10:14.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:10:14.872Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:10:14.873Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:10:18.568Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2d670f9-9658-4dfe-b917-24f228fcac94 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:10:18.568Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2d670f9-9658-4dfe-b917-24f228fcac94 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43407e3f
2021-06-04T02:10:18.568Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2d670f9-9658-4dfe-b917-24f228fcac94 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:10:18.568Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2d670f9-9658-4dfe-b917-24f228fcac94 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:10:20.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4e2862f-5bba-4c63-9b5d-e86bd7f40051 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:10:20.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4e2862f-5bba-4c63-9b5d-e86bd7f40051 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@412ed587
2021-06-04T02:10:20.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4e2862f-5bba-4c63-9b5d-e86bd7f40051 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:10:20.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4e2862f-5bba-4c63-9b5d-e86bd7f40051 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:10:21.462Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa1236fd-48e6-4807-95a8-045a5eed825f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:10:21.462Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa1236fd-48e6-4807-95a8-045a5eed825f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@542e3b5d
2021-06-04T02:10:21.462Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa1236fd-48e6-4807-95a8-045a5eed825f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:10:21.462Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa1236fd-48e6-4807-95a8-045a5eed825f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:10:27.956Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07294f98-7a46-4df7-904d-587527333335 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:10:27.956Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07294f98-7a46-4df7-904d-587527333335 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@503e14ed
2021-06-04T02:10:27.956Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07294f98-7a46-4df7-904d-587527333335 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:10:27.956Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07294f98-7a46-4df7-904d-587527333335 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:10:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:10:29.873Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:10:29.874Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:10:29.875Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:10:36.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:10:36.262Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:10:36.963Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=592009c0-ee10-44a5-a8a7-8a516dc85dec PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:10:36.963Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=592009c0-ee10-44a5-a8a7-8a516dc85dec PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@10cf3953
2021-06-04T02:10:36.963Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=592009c0-ee10-44a5-a8a7-8a516dc85dec PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:10:36.963Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=592009c0-ee10-44a5-a8a7-8a516dc85dec PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:10:38.651Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:10:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:10:39.453Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T02:10:39.454Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:10:39.454Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:10:39.456Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:10:39.457Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T02:10:39.457Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T02:10:42.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:10:42.262Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:10:44.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:10:44.869Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:10:44.870Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:10:44.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:10:45.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:10:46.359Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=052cf716-f51a-4ab4-b623-164e86f68b75 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:10:46.360Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=052cf716-f51a-4ab4-b623-164e86f68b75 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@277a4420
2021-06-04T02:10:46.360Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=052cf716-f51a-4ab4-b623-164e86f68b75 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:10:46.360Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=052cf716-f51a-4ab4-b623-164e86f68b75 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:10:46.478Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=052cf716-f51a-4ab4-b623-164e86f68b75 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:10:46.479Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=052cf716-f51a-4ab4-b623-164e86f68b75 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:10:48.250Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5ad046d-4531-4b64-a4ce-e057b33f110c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:10:48.250Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5ad046d-4531-4b64-a4ce-e057b33f110c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22b7741
2021-06-04T02:10:48.250Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5ad046d-4531-4b64-a4ce-e057b33f110c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:10:48.250Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5ad046d-4531-4b64-a4ce-e057b33f110c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:10:48.451Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:10:49.258Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19d2c1ae-83c7-4045-a850-423ece83853c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:10:49.258Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19d2c1ae-83c7-4045-a850-423ece83853c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22929295
2021-06-04T02:10:49.258Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19d2c1ae-83c7-4045-a850-423ece83853c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:10:49.258Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19d2c1ae-83c7-4045-a850-423ece83853c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:10:49.421Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=19d2c1ae-83c7-4045-a850-423ece83853c ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:10:49.421Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=19d2c1ae-83c7-4045-a850-423ece83853c ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:10:53.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83c3d4fd-6b35-479f-b295-afe65393484a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:10:53.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83c3d4fd-6b35-479f-b295-afe65393484a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b7e3235
2021-06-04T02:10:53.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83c3d4fd-6b35-479f-b295-afe65393484a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:10:53.972Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83c3d4fd-6b35-479f-b295-afe65393484a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:10:57.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:10:57.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:10:58.738Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=832f8859-4205-4dd6-a0e7-1964a70f690f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:10:58.738Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=832f8859-4205-4dd6-a0e7-1964a70f690f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e50343e
2021-06-04T02:10:58.738Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=832f8859-4205-4dd6-a0e7-1964a70f690f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:10:58.738Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=832f8859-4205-4dd6-a0e7-1964a70f690f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:10:59.417Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:10:59.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:10:59.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:10:59.872Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:10:59.873Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:11:00.599Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1426f8ba-c5af-4a34-aee3-c4cc4b9cff54 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:11:00.599Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1426f8ba-c5af-4a34-aee3-c4cc4b9cff54 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6798cdca
2021-06-04T02:11:00.599Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1426f8ba-c5af-4a34-aee3-c4cc4b9cff54 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:11:00.599Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1426f8ba-c5af-4a34-aee3-c4cc4b9cff54 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:11:04.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44f876b2-4cc7-4c44-b1e5-76bfdfea383d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:11:04.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44f876b2-4cc7-4c44-b1e5-76bfdfea383d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5128ed96
2021-06-04T02:11:04.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44f876b2-4cc7-4c44-b1e5-76bfdfea383d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:11:04.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44f876b2-4cc7-4c44-b1e5-76bfdfea383d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:11:09.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:11:09.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:11:11.570Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:11:13.169Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdf396de-689d-4d6f-8994-d66714b375bd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:11:13.169Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdf396de-689d-4d6f-8994-d66714b375bd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6bfd921c
2021-06-04T02:11:13.169Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdf396de-689d-4d6f-8994-d66714b375bd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:11:13.169Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdf396de-689d-4d6f-8994-d66714b375bd PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:11:14.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc76c286-c337-455a-af3f-6986f6f1c5e7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:11:14.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc76c286-c337-455a-af3f-6986f6f1c5e7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5433aa99
2021-06-04T02:11:14.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc76c286-c337-455a-af3f-6986f6f1c5e7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:11:14.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc76c286-c337-455a-af3f-6986f6f1c5e7 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:11:14.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:11:14.869Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:11:14.870Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:11:14.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:11:17.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9405cc6-fcb3-4f5c-9871-cb6449eae4e1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:11:17.855Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9405cc6-fcb3-4f5c-9871-cb6449eae4e1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@75e4cb48
2021-06-04T02:11:17.855Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9405cc6-fcb3-4f5c-9871-cb6449eae4e1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:11:17.855Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9405cc6-fcb3-4f5c-9871-cb6449eae4e1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:11:21.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:11:21.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:11:21.687Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ea90db4-2f21-4429-9186-364089badd6e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:11:21.687Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ea90db4-2f21-4429-9186-364089badd6e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@63b6dc3f
2021-06-04T02:11:21.687Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ea90db4-2f21-4429-9186-364089badd6e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:11:21.687Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ea90db4-2f21-4429-9186-364089badd6e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:11:24.170Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:11:24.446Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85e1acf9-43b7-4940-88b6-e3720a79aaaf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:11:24.446Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85e1acf9-43b7-4940-88b6-e3720a79aaaf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@645ccf27
2021-06-04T02:11:24.446Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85e1acf9-43b7-4940-88b6-e3720a79aaaf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:11:24.446Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85e1acf9-43b7-4940-88b6-e3720a79aaaf PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:11:25.314Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=85e1acf9-43b7-4940-88b6-e3720a79aaaf ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:11:25.314Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=85e1acf9-43b7-4940-88b6-e3720a79aaaf ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:11:27.296Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f6e0888-109c-44a8-baa8-243924fb1e55 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:11:27.296Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f6e0888-109c-44a8-baa8-243924fb1e55 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2df2d657
2021-06-04T02:11:27.296Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f6e0888-109c-44a8-baa8-243924fb1e55 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:11:27.296Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f6e0888-109c-44a8-baa8-243924fb1e55 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:11:27.475Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3f6e0888-109c-44a8-baa8-243924fb1e55 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:11:27.475Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3f6e0888-109c-44a8-baa8-243924fb1e55 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:11:28.266Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91fda9e9-3bb6-4645-b921-33533be44f40 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:11:28.266Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91fda9e9-3bb6-4645-b921-33533be44f40 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e1fe62a
2021-06-04T02:11:28.266Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91fda9e9-3bb6-4645-b921-33533be44f40 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:11:28.266Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91fda9e9-3bb6-4645-b921-33533be44f40 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:11:29.075Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4854d964-9996-403f-a9d3-454d8318da36 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:11:29.075Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4854d964-9996-403f-a9d3-454d8318da36 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b9d9af2
2021-06-04T02:11:29.075Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4854d964-9996-403f-a9d3-454d8318da36 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:11:29.075Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4854d964-9996-403f-a9d3-454d8318da36 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:11:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:11:29.869Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:11:29.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:11:29.874Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:11:31.166Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=064a75ab-8b75-4dae-bf9f-d1c8b3278474 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:11:31.166Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=064a75ab-8b75-4dae-bf9f-d1c8b3278474 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29ba5d51
2021-06-04T02:11:31.166Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=064a75ab-8b75-4dae-bf9f-d1c8b3278474 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:11:31.166Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=064a75ab-8b75-4dae-bf9f-d1c8b3278474 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:11:35.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1256e38e-fbd3-45b4-8dbd-0689ba436ffd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:11:35.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1256e38e-fbd3-45b4-8dbd-0689ba436ffd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1241665f
2021-06-04T02:11:35.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1256e38e-fbd3-45b4-8dbd-0689ba436ffd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:11:35.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1256e38e-fbd3-45b4-8dbd-0689ba436ffd PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:11:38.580Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=1256e38e-fbd3-45b4-8dbd-0689ba436ffd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:11:38.581Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=1256e38e-fbd3-45b4-8dbd-0689ba436ffd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:11:39.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:11:39.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:11:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:11:39.452Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T02:11:39.453Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:11:39.453Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:11:39.455Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:11:39.456Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T02:11:39.456Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T02:11:42.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:11:44.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:11:44.869Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:11:44.870Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:11:44.872Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:11:45.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:11:48.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:11:51.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:11:54.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:11:57.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:11:58.657Z [cluster1-timeouter-0] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.138.69:9042] Operation timed out
at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:11:58.657Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=baa1db45-1d94-4c12-a5dd-3374d003b003 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:11:58.657Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=baa1db45-1d94-4c12-a5dd-3374d003b003 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@13eefc8b
2021-06-04T02:11:58.657Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=baa1db45-1d94-4c12-a5dd-3374d003b003 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:11:58.657Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=baa1db45-1d94-4c12-a5dd-3374d003b003 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:11:59.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:11:59.869Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:11:59.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:11:59.872Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:12:00.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:12:01.710Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=baa1db45-1d94-4c12-a5dd-3374d003b003 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:12:01.710Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=baa1db45-1d94-4c12-a5dd-3374d003b003 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:12:01.868Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b400cc3-6c30-45d3-90ff-55056e07e5b0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:01.868Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b400cc3-6c30-45d3-90ff-55056e07e5b0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2fc83116
2021-06-04T02:12:01.868Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b400cc3-6c30-45d3-90ff-55056e07e5b0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:01.868Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b400cc3-6c30-45d3-90ff-55056e07e5b0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:01.927Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=1b400cc3-6c30-45d3-90ff-55056e07e5b0 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:12:01.927Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=1b400cc3-6c30-45d3-90ff-55056e07e5b0 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:12:02.056Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=965f5af5-8c72-41f0-b66b-fd5a2b0d8ad9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:02.056Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=965f5af5-8c72-41f0-b66b-fd5a2b0d8ad9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@524c71d5
2021-06-04T02:12:02.056Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=965f5af5-8c72-41f0-b66b-fd5a2b0d8ad9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:02.056Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=965f5af5-8c72-41f0-b66b-fd5a2b0d8ad9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:03.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:12:05.060Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=965f5af5-8c72-41f0-b66b-fd5a2b0d8ad9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:12:05.060Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=965f5af5-8c72-41f0-b66b-fd5a2b0d8ad9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:12:05.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c237dcb-0106-43d0-b881-e7e53f73f041 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:05.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c237dcb-0106-43d0-b881-e7e53f73f041 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b16364c
2021-06-04T02:12:05.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c237dcb-0106-43d0-b881-e7e53f73f041 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:05.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c237dcb-0106-43d0-b881-e7e53f73f041 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:06.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:12:06.379Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a71c1189-8866-4915-a912-972777138b92 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:06.379Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a71c1189-8866-4915-a912-972777138b92 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@55f3b899
2021-06-04T02:12:06.379Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a71c1189-8866-4915-a912-972777138b92 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:06.379Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a71c1189-8866-4915-a912-972777138b92 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:06.651Z [cluster1-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T02:12:06.652Z [cluster1-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 2000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:12:07.515Z [JanusGraph-Health-Check-Thread] INFO o.j.d.util.BackendOperation Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.execute(VertexCentricQueryBuilder.java:73)
at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.properties(VertexCentricQueryBuilder.java:100)
at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177)
at org.apache.tinkerpop.gremlin.structure.Vertex.property(Vertex.java:70)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:341)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:336)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
... 4 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T02:12:08.369Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation RequestID=null ErrorCategory=INFO ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=500 TargetEntity=ReplaceDataTypesCache Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177)
at org.apache.tinkerpop.gremlin.structure.Element.keys(Element.java:69)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getProperties(JanusGraphGenericDao.java:1491)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getByCriteria(JanusGraphGenericDao.java:759)
at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypeNodes(PropertyOperation.java:1566)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.findAllDataTypesLazy(ApplicationDataTypeCache.java:309)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.hasDataTypesChanged(ApplicationDataTypeCache.java:220)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:200)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T02:12:08.571Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:12:09.384Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a71c1189-8866-4915-a912-972777138b92 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:12:09.384Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a71c1189-8866-4915-a912-972777138b92 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:12:10.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7cc21335-387e-4b5d-aacf-410f1c6d5b2f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:10.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7cc21335-387e-4b5d-aacf-410f1c6d5b2f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6400b92b
2021-06-04T02:12:10.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7cc21335-387e-4b5d-aacf-410f1c6d5b2f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:10.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7cc21335-387e-4b5d-aacf-410f1c6d5b2f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:10.175Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=7cc21335-387e-4b5d-aacf-410f1c6d5b2f ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:12:10.176Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=7cc21335-387e-4b5d-aacf-410f1c6d5b2f ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:12:10.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a811147f-43d0-4214-af1a-4983ee4fd965 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:10.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a811147f-43d0-4214-af1a-4983ee4fd965 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ca1fff5
2021-06-04T02:12:10.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a811147f-43d0-4214-af1a-4983ee4fd965 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:10.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a811147f-43d0-4214-af1a-4983ee4fd965 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:11.190Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6918c8fa-115d-4dc1-b562-17ee39d7a727 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:11.190Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6918c8fa-115d-4dc1-b562-17ee39d7a727 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34deb788
2021-06-04T02:12:11.190Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6918c8fa-115d-4dc1-b562-17ee39d7a727 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:11.191Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6918c8fa-115d-4dc1-b562-17ee39d7a727 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:11.397Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12583b7a-a7a5-4cbb-b3f7-7738fb91bc2c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:11.397Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12583b7a-a7a5-4cbb-b3f7-7738fb91bc2c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@55f699d9
2021-06-04T02:12:11.397Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12583b7a-a7a5-4cbb-b3f7-7738fb91bc2c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:11.397Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12583b7a-a7a5-4cbb-b3f7-7738fb91bc2c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:11.652Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b11a1348-6653-474c-8d33-38fbd1fb2cda PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:11.652Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b11a1348-6653-474c-8d33-38fbd1fb2cda PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69796f09
2021-06-04T02:12:11.652Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b11a1348-6653-474c-8d33-38fbd1fb2cda PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:11.652Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b11a1348-6653-474c-8d33-38fbd1fb2cda PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:11.839Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f544e51a-596e-4c96-811b-808179e2a738 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:11.839Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f544e51a-596e-4c96-811b-808179e2a738 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a546b84
2021-06-04T02:12:11.839Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f544e51a-596e-4c96-811b-808179e2a738 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:11.839Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f544e51a-596e-4c96-811b-808179e2a738 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:11.864Z [cluster1-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
2021-06-04T02:12:11.865Z [cluster1-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 4000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:12:12.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b41b1eee-278a-4c0a-932b-40e25d2203d6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:12.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b41b1eee-278a-4c0a-932b-40e25d2203d6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5bf7fdb1
2021-06-04T02:12:12.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b41b1eee-278a-4c0a-932b-40e25d2203d6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:12.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b41b1eee-278a-4c0a-932b-40e25d2203d6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:12.192Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=330dff4d-ef94-4936-8aa3-acc998ca039a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:12.192Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=330dff4d-ef94-4936-8aa3-acc998ca039a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3aae8f47
2021-06-04T02:12:12.192Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=330dff4d-ef94-4936-8aa3-acc998ca039a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:12.192Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=330dff4d-ef94-4936-8aa3-acc998ca039a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:12.340Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae1815b5-811c-4824-a0be-4630ca3e8020 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:12.340Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae1815b5-811c-4824-a0be-4630ca3e8020 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@180dbe3c
2021-06-04T02:12:12.340Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae1815b5-811c-4824-a0be-4630ca3e8020 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:12.340Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae1815b5-811c-4824-a0be-4630ca3e8020 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:12.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50541122-2a7e-4263-acc6-8bbb8367bdd6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:12.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50541122-2a7e-4263-acc6-8bbb8367bdd6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@21bcfef2
2021-06-04T02:12:12.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50541122-2a7e-4263-acc6-8bbb8367bdd6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:12.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50541122-2a7e-4263-acc6-8bbb8367bdd6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:13.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab8df5fb-6985-4dfd-9d86-d95705223cbb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:13.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab8df5fb-6985-4dfd-9d86-d95705223cbb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45c28501
2021-06-04T02:12:13.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab8df5fb-6985-4dfd-9d86-d95705223cbb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:13.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab8df5fb-6985-4dfd-9d86-d95705223cbb PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:13.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1ebda19-e87d-4e73-b1cb-bb81bdaad68a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:13.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1ebda19-e87d-4e73-b1cb-bb81bdaad68a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@bd8fe49
2021-06-04T02:12:13.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1ebda19-e87d-4e73-b1cb-bb81bdaad68a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:13.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1ebda19-e87d-4e73-b1cb-bb81bdaad68a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:14.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8dd63dfb-7b00-443a-aaa8-3105781cf4e6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:14.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8dd63dfb-7b00-443a-aaa8-3105781cf4e6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e515d50
2021-06-04T02:12:14.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8dd63dfb-7b00-443a-aaa8-3105781cf4e6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:14.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8dd63dfb-7b00-443a-aaa8-3105781cf4e6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:14.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:12:14.875Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:12:14.877Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:12:14.878Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:12:15.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9213ece-5d36-4722-b6ce-3f7a1ca426ca PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:15.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9213ece-5d36-4722-b6ce-3f7a1ca426ca PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@385c7706
2021-06-04T02:12:15.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9213ece-5d36-4722-b6ce-3f7a1ca426ca PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:15.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9213ece-5d36-4722-b6ce-3f7a1ca426ca PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:18.477Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=c9213ece-5d36-4722-b6ce-3f7a1ca426ca ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:12:18.478Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=c9213ece-5d36-4722-b6ce-3f7a1ca426ca ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:12:19.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78e238f6-dc40-48da-82f9-b422fa010af8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:19.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78e238f6-dc40-48da-82f9-b422fa010af8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69671781
2021-06-04T02:12:19.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78e238f6-dc40-48da-82f9-b422fa010af8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:19.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78e238f6-dc40-48da-82f9-b422fa010af8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:22.237Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=78e238f6-dc40-48da-82f9-b422fa010af8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:12:22.237Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=78e238f6-dc40-48da-82f9-b422fa010af8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:12:22.356Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6319399a-60d6-4114-b39c-ca5ec1f3c789 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:22.356Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6319399a-60d6-4114-b39c-ca5ec1f3c789 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@51cef46f
2021-06-04T02:12:22.356Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6319399a-60d6-4114-b39c-ca5ec1f3c789 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:22.356Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6319399a-60d6-4114-b39c-ca5ec1f3c789 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:25.399Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=6319399a-60d6-4114-b39c-ca5ec1f3c789 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:12:25.400Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=6319399a-60d6-4114-b39c-ca5ec1f3c789 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:12:26.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3dc66279-8a77-4829-9f1d-bb494c1b1468 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:26.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3dc66279-8a77-4829-9f1d-bb494c1b1468 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5bfb88d7
2021-06-04T02:12:26.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3dc66279-8a77-4829-9f1d-bb494c1b1468 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:26.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3dc66279-8a77-4829-9f1d-bb494c1b1468 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:29.126Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3dc66279-8a77-4829-9f1d-bb494c1b1468 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:12:29.127Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3dc66279-8a77-4829-9f1d-bb494c1b1468 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:12:29.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93fd8c18-8d2e-4d34-a2ad-03cc338dd7dd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:29.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93fd8c18-8d2e-4d34-a2ad-03cc338dd7dd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@542a5943
2021-06-04T02:12:29.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93fd8c18-8d2e-4d34-a2ad-03cc338dd7dd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:29.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93fd8c18-8d2e-4d34-a2ad-03cc338dd7dd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:29.869Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:12:29.870Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:12:29.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:12:29.872Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:12:30.376Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf95653a-3a07-4022-9172-899015a6623d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:30.376Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf95653a-3a07-4022-9172-899015a6623d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5389a845
2021-06-04T02:12:30.376Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf95653a-3a07-4022-9172-899015a6623d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:30.376Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf95653a-3a07-4022-9172-899015a6623d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:30.870Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:12:30.871Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:12:31.871Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:12:32.871Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:12:33.381Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=bf95653a-3a07-4022-9172-899015a6623d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:12:33.382Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=bf95653a-3a07-4022-9172-899015a6623d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:12:33.871Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:12:33.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc40467e-32ca-45ff-82a8-67aa6ac51738 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:33.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc40467e-32ca-45ff-82a8-67aa6ac51738 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ca0228e
2021-06-04T02:12:33.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc40467e-32ca-45ff-82a8-67aa6ac51738 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:33.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc40467e-32ca-45ff-82a8-67aa6ac51738 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:34.020Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fc40467e-32ca-45ff-82a8-67aa6ac51738 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:12:34.020Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=fc40467e-32ca-45ff-82a8-67aa6ac51738 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:12:34.872Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:12:36.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:12:36.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d00553d6-23e6-446a-9ce5-5f0d9ea70ffc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:36.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d00553d6-23e6-446a-9ce5-5f0d9ea70ffc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@67c1566b
2021-06-04T02:12:36.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d00553d6-23e6-446a-9ce5-5f0d9ea70ffc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:36.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d00553d6-23e6-446a-9ce5-5f0d9ea70ffc PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:39.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:12:39.453Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:12:39.453Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T02:12:39.454Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:12:39.454Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:12:39.456Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:12:39.456Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T02:12:39.457Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T02:12:39.485Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d00553d6-23e6-446a-9ce5-5f0d9ea70ffc ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:12:39.485Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d00553d6-23e6-446a-9ce5-5f0d9ea70ffc ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:12:40.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89c48b2b-4a54-47dc-9bbd-cd4402675a1d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:40.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89c48b2b-4a54-47dc-9bbd-cd4402675a1d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79941156
2021-06-04T02:12:40.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89c48b2b-4a54-47dc-9bbd-cd4402675a1d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:40.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89c48b2b-4a54-47dc-9bbd-cd4402675a1d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:42.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:12:43.064Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=89c48b2b-4a54-47dc-9bbd-cd4402675a1d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:12:43.065Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=89c48b2b-4a54-47dc-9bbd-cd4402675a1d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:12:43.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3447c56c-4e2d-4cf4-bddf-c8540db4af27 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:43.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3447c56c-4e2d-4cf4-bddf-c8540db4af27 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a65c267
2021-06-04T02:12:43.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3447c56c-4e2d-4cf4-bddf-c8540db4af27 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:43.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3447c56c-4e2d-4cf4-bddf-c8540db4af27 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:44.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:12:44.869Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:12:44.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:12:44.872Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:12:45.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:12:45.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04a8d236-1b07-4075-854f-93f896d6caff PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:45.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04a8d236-1b07-4075-854f-93f896d6caff PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e3d0c56
2021-06-04T02:12:45.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04a8d236-1b07-4075-854f-93f896d6caff PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:45.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04a8d236-1b07-4075-854f-93f896d6caff PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:48.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:12:48.521Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=04a8d236-1b07-4075-854f-93f896d6caff ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:12:48.522Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=04a8d236-1b07-4075-854f-93f896d6caff ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:12:49.271Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df707e76-54ad-4cf7-be3b-9ab875e14aa3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:49.271Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df707e76-54ad-4cf7-be3b-9ab875e14aa3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45ce7301
2021-06-04T02:12:49.271Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df707e76-54ad-4cf7-be3b-9ab875e14aa3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:49.271Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df707e76-54ad-4cf7-be3b-9ab875e14aa3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:50.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4bd1788e-5d01-4ec1-b02c-699fbda9c033 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:50.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4bd1788e-5d01-4ec1-b02c-699fbda9c033 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@536e7497
2021-06-04T02:12:50.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4bd1788e-5d01-4ec1-b02c-699fbda9c033 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:50.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4bd1788e-5d01-4ec1-b02c-699fbda9c033 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:51.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:12:54.002Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=4bd1788e-5d01-4ec1-b02c-699fbda9c033 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:12:54.003Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=4bd1788e-5d01-4ec1-b02c-699fbda9c033 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:12:54.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:12:54.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b22f922-be35-42aa-92e5-1251946daec5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:54.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b22f922-be35-42aa-92e5-1251946daec5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45278d10
2021-06-04T02:12:54.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b22f922-be35-42aa-92e5-1251946daec5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:54.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b22f922-be35-42aa-92e5-1251946daec5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:57.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:12:57.365Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0b22f922-be35-42aa-92e5-1251946daec5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:12:57.365Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0b22f922-be35-42aa-92e5-1251946daec5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:12:58.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=828f729c-bbbb-48d0-b7c2-9d64f3af3d26 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:12:58.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=828f729c-bbbb-48d0-b7c2-9d64f3af3d26 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35e49c5c
2021-06-04T02:12:58.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=828f729c-bbbb-48d0-b7c2-9d64f3af3d26 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:12:58.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=828f729c-bbbb-48d0-b7c2-9d64f3af3d26 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:12:59.786Z [cluster1-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
2021-06-04T02:12:59.787Z [cluster1-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 16000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:12:59.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:12:59.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:12:59.872Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:12:59.874Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:13:00.181Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:13:00.285Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31f6ef29-963e-4fb2-87d1-7692631d5e39 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:13:00.285Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31f6ef29-963e-4fb2-87d1-7692631d5e39 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c38cc17
2021-06-04T02:13:00.285Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31f6ef29-963e-4fb2-87d1-7692631d5e39 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:13:00.285Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31f6ef29-963e-4fb2-87d1-7692631d5e39 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:13:03.325Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbddb76b-d401-4b0b-90b9-f25ada7dcacb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:13:03.325Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbddb76b-d401-4b0b-90b9-f25ada7dcacb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22779896
2021-06-04T02:13:03.325Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbddb76b-d401-4b0b-90b9-f25ada7dcacb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:13:03.325Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbddb76b-d401-4b0b-90b9-f25ada7dcacb PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:13:03.355Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fbddb76b-d401-4b0b-90b9-f25ada7dcacb ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:13:03.356Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fbddb76b-d401-4b0b-90b9-f25ada7dcacb ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:13:06.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dded5f7f-a092-4384-8d6e-9bb2c4bfee5a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:13:06.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dded5f7f-a092-4384-8d6e-9bb2c4bfee5a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@33e0e6f8
2021-06-04T02:13:06.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dded5f7f-a092-4384-8d6e-9bb2c4bfee5a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:13:06.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dded5f7f-a092-4384-8d6e-9bb2c4bfee5a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:13:09.488Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=dded5f7f-a092-4384-8d6e-9bb2c4bfee5a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:13:09.489Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=dded5f7f-a092-4384-8d6e-9bb2c4bfee5a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:13:10.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edc1e2c9-1643-4f1b-84ab-74faa47e391c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:13:10.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edc1e2c9-1643-4f1b-84ab-74faa47e391c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@526a4f6b
2021-06-04T02:13:10.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edc1e2c9-1643-4f1b-84ab-74faa47e391c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:13:10.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edc1e2c9-1643-4f1b-84ab-74faa47e391c PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:13:12.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d785bee-1edb-4681-80d3-611cb3ca8955 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:13:12.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d785bee-1edb-4681-80d3-611cb3ca8955 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6635fdf8
2021-06-04T02:13:12.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d785bee-1edb-4681-80d3-611cb3ca8955 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:13:12.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d785bee-1edb-4681-80d3-611cb3ca8955 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:13:14.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:13:14.869Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:13:14.870Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:13:14.872Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:13:15.020Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8d785bee-1edb-4681-80d3-611cb3ca8955 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:13:15.021Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8d785bee-1edb-4681-80d3-611cb3ca8955 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:13:15.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1570fe25-6bfd-453e-9b9c-f75e2ef5c629 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:13:15.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1570fe25-6bfd-453e-9b9c-f75e2ef5c629 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@525600e0
2021-06-04T02:13:15.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1570fe25-6bfd-453e-9b9c-f75e2ef5c629 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:13:15.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1570fe25-6bfd-453e-9b9c-f75e2ef5c629 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:13:18.477Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc6341e4-dffd-402d-be19-ea43812db993 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:13:18.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc6341e4-dffd-402d-be19-ea43812db993 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@692e959a
2021-06-04T02:13:18.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc6341e4-dffd-402d-be19-ea43812db993 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:13:18.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc6341e4-dffd-402d-be19-ea43812db993 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:13:21.483Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=dc6341e4-dffd-402d-be19-ea43812db993 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:13:21.484Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=dc6341e4-dffd-402d-be19-ea43812db993 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:13:21.630Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be75d5f9-5082-412c-9e58-6c8e820de7c5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:13:21.630Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be75d5f9-5082-412c-9e58-6c8e820de7c5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@203d7f7a
2021-06-04T02:13:21.630Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be75d5f9-5082-412c-9e58-6c8e820de7c5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:13:21.630Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be75d5f9-5082-412c-9e58-6c8e820de7c5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:13:24.675Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=be75d5f9-5082-412c-9e58-6c8e820de7c5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:13:24.676Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=be75d5f9-5082-412c-9e58-6c8e820de7c5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:13:25.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e0b78ef-e6fd-47be-b781-ec709dd68d23 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:13:25.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e0b78ef-e6fd-47be-b781-ec709dd68d23 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2845afa6
2021-06-04T02:13:25.217Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e0b78ef-e6fd-47be-b781-ec709dd68d23 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:13:25.217Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e0b78ef-e6fd-47be-b781-ec709dd68d23 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:13:28.248Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=7e0b78ef-e6fd-47be-b781-ec709dd68d23 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:13:28.249Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=7e0b78ef-e6fd-47be-b781-ec709dd68d23 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:13:29.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb2a2f65-0f5b-4d85-8315-581f66722b67 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:13:29.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb2a2f65-0f5b-4d85-8315-581f66722b67 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e57021f
2021-06-04T02:13:29.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb2a2f65-0f5b-4d85-8315-581f66722b67 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:13:29.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb2a2f65-0f5b-4d85-8315-581f66722b67 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:13:29.378Z [cluster1-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
2021-06-04T02:13:29.379Z [cluster1-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 32000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:13:29.391Z [cluster2-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
2021-06-04T02:13:29.392Z [cluster2-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 30000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:13:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:13:29.870Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:13:29.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:13:29.874Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:13:30.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a561b6c-98e3-413c-9e89-cb13825cffc7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:13:30.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a561b6c-98e3-413c-9e89-cb13825cffc7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4883bb04
2021-06-04T02:13:30.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a561b6c-98e3-413c-9e89-cb13825cffc7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:13:30.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a561b6c-98e3-413c-9e89-cb13825cffc7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:13:33.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3d27c59-6852-4892-b687-e635932c8dfb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:13:33.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3d27c59-6852-4892-b687-e635932c8dfb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ed46690
2021-06-04T02:13:33.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3d27c59-6852-4892-b687-e635932c8dfb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:13:33.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3d27c59-6852-4892-b687-e635932c8dfb PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:13:36.480Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64654452-9354-4868-ab7d-48e0d7ad30b4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:13:36.480Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64654452-9354-4868-ab7d-48e0d7ad30b4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68d5ceaf
2021-06-04T02:13:36.480Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64654452-9354-4868-ab7d-48e0d7ad30b4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:13:36.480Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64654452-9354-4868-ab7d-48e0d7ad30b4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:13:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:13:39.452Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T02:13:39.453Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:13:39.453Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:13:39.455Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:13:39.455Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T02:13:39.455Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T02:13:39.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f92d4a88-ffd0-4e93-9795-4bdbf150bdf8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:13:39.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f92d4a88-ffd0-4e93-9795-4bdbf150bdf8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@55fa84ea
2021-06-04T02:13:39.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f92d4a88-ffd0-4e93-9795-4bdbf150bdf8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:13:39.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f92d4a88-ffd0-4e93-9795-4bdbf150bdf8 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:13:42.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d47922c-883e-4f97-903e-f0ea58902a58 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:13:42.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d47922c-883e-4f97-903e-f0ea58902a58 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@744eca
2021-06-04T02:13:42.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d47922c-883e-4f97-903e-f0ea58902a58 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:13:42.054Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d47922c-883e-4f97-903e-f0ea58902a58 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:13:44.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:13:44.870Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:13:44.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:13:44.872Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:13:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f24a766-7433-447e-b168-bde5f6b0bd87 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:13:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f24a766-7433-447e-b168-bde5f6b0bd87 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d9958b2
2021-06-04T02:13:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f24a766-7433-447e-b168-bde5f6b0bd87 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:13:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f24a766-7433-447e-b168-bde5f6b0bd87 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:13:48.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8d132c8-d4ef-487e-a86d-bc1fc4825238 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:13:48.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8d132c8-d4ef-487e-a86d-bc1fc4825238 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b7f5f18
2021-06-04T02:13:48.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8d132c8-d4ef-487e-a86d-bc1fc4825238 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:13:48.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8d132c8-d4ef-487e-a86d-bc1fc4825238 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:13:51.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2194b24f-601d-4f05-835f-66d5c3be8fdc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:13:51.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2194b24f-601d-4f05-835f-66d5c3be8fdc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a234f49
2021-06-04T02:13:51.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2194b24f-601d-4f05-835f-66d5c3be8fdc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:13:51.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2194b24f-601d-4f05-835f-66d5c3be8fdc PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:13:54.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:13:54.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:13:54.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=979d5d1d-8c48-472d-b970-80835f89ab05 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:13:54.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=979d5d1d-8c48-472d-b970-80835f89ab05 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68035ad9
2021-06-04T02:13:54.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=979d5d1d-8c48-472d-b970-80835f89ab05 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:13:54.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=979d5d1d-8c48-472d-b970-80835f89ab05 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:13:57.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60b5c822-b8ab-44a6-a44d-179dcfc53d5e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:13:57.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60b5c822-b8ab-44a6-a44d-179dcfc53d5e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f18c3a3
2021-06-04T02:13:57.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60b5c822-b8ab-44a6-a44d-179dcfc53d5e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:13:57.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60b5c822-b8ab-44a6-a44d-179dcfc53d5e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:13:57.619Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=60b5c822-b8ab-44a6-a44d-179dcfc53d5e ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:13:57.619Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=60b5c822-b8ab-44a6-a44d-179dcfc53d5e ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:13:59.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:13:59.869Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:13:59.870Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:13:59.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:14:00.276Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1a1a3d9-7d0f-4b1b-a7bc-ecb009df72c7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:14:00.276Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1a1a3d9-7d0f-4b1b-a7bc-ecb009df72c7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1eaedec7
2021-06-04T02:14:00.276Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1a1a3d9-7d0f-4b1b-a7bc-ecb009df72c7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:14:00.276Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1a1a3d9-7d0f-4b1b-a7bc-ecb009df72c7 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:14:03.281Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d1a1a3d9-7d0f-4b1b-a7bc-ecb009df72c7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:14:03.281Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d1a1a3d9-7d0f-4b1b-a7bc-ecb009df72c7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:14:03.380Z [cluster2-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
2021-06-04T02:14:03.380Z [cluster2-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 30000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:14:03.451Z [cluster1-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
2021-06-04T02:14:03.452Z [cluster1-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 64000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:14:03.518Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:14:03.723Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52afa041-3cc6-4bd9-95e7-78e2d29bef8b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:14:03.723Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52afa041-3cc6-4bd9-95e7-78e2d29bef8b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ea7835c
2021-06-04T02:14:03.723Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52afa041-3cc6-4bd9-95e7-78e2d29bef8b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:14:03.723Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52afa041-3cc6-4bd9-95e7-78e2d29bef8b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:14:06.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:14:06.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:14:06.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56dc06a9-8da3-4719-9cd8-819271054bf2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:14:06.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56dc06a9-8da3-4719-9cd8-819271054bf2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@55ec143b
2021-06-04T02:14:06.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56dc06a9-8da3-4719-9cd8-819271054bf2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:14:06.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56dc06a9-8da3-4719-9cd8-819271054bf2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:14:07.063Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=56dc06a9-8da3-4719-9cd8-819271054bf2 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:14:07.063Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=56dc06a9-8da3-4719-9cd8-819271054bf2 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:14:08.814Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:14:09.423Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b09a6f6a-8aeb-4143-8a67-08c87936a44f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:14:09.423Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b09a6f6a-8aeb-4143-8a67-08c87936a44f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ddcb0a7
2021-06-04T02:14:09.423Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b09a6f6a-8aeb-4143-8a67-08c87936a44f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:14:09.423Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b09a6f6a-8aeb-4143-8a67-08c87936a44f PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:14:12.427Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=b09a6f6a-8aeb-4143-8a67-08c87936a44f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:14:12.427Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=b09a6f6a-8aeb-4143-8a67-08c87936a44f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:14:12.725Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=730696c5-87d2-4245-8d96-ccf4daf5e068 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:14:12.725Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=730696c5-87d2-4245-8d96-ccf4daf5e068 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f137923
2021-06-04T02:14:12.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=730696c5-87d2-4245-8d96-ccf4daf5e068 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:14:12.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=730696c5-87d2-4245-8d96-ccf4daf5e068 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:14:14.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:14:14.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:14:14.872Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:14:14.873Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:14:15.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbbfc0cc-a05f-4f0a-af5b-68bce45d5370 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:14:15.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbbfc0cc-a05f-4f0a-af5b-68bce45d5370 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@40bf4488
2021-06-04T02:14:15.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbbfc0cc-a05f-4f0a-af5b-68bce45d5370 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:14:15.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbbfc0cc-a05f-4f0a-af5b-68bce45d5370 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:14:18.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7260e6a-9ad2-4d90-a589-fa5437d51ca2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:14:18.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7260e6a-9ad2-4d90-a589-fa5437d51ca2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@18be9db0
2021-06-04T02:14:18.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7260e6a-9ad2-4d90-a589-fa5437d51ca2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:14:18.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7260e6a-9ad2-4d90-a589-fa5437d51ca2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:14:20.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74323ca7-6ed0-4237-8f35-208907b61d36 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:14:20.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74323ca7-6ed0-4237-8f35-208907b61d36 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c3025e5
2021-06-04T02:14:20.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74323ca7-6ed0-4237-8f35-208907b61d36 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:14:20.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74323ca7-6ed0-4237-8f35-208907b61d36 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:14:24.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:14:24.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:14:24.414Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd34751e-4e43-45a9-af38-b6bb9955ecf0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:14:24.414Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd34751e-4e43-45a9-af38-b6bb9955ecf0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@762d6d7
2021-06-04T02:14:24.414Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd34751e-4e43-45a9-af38-b6bb9955ecf0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:14:24.414Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd34751e-4e43-45a9-af38-b6bb9955ecf0 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:14:27.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:14:27.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2338f9d0-325b-40cb-8ae6-6246d08294dc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:14:27.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2338f9d0-325b-40cb-8ae6-6246d08294dc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d4359b7
2021-06-04T02:14:27.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2338f9d0-325b-40cb-8ae6-6246d08294dc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:14:27.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2338f9d0-325b-40cb-8ae6-6246d08294dc PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:14:27.655Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=2338f9d0-325b-40cb-8ae6-6246d08294dc ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:14:27.655Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=2338f9d0-325b-40cb-8ae6-6246d08294dc ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:14:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:14:29.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:14:29.872Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:14:29.873Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:14:30.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:14:30.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebccb1e0-a09a-4755-9d71-0f398a0f9fc4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:14:30.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebccb1e0-a09a-4755-9d71-0f398a0f9fc4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@51fc10b2
2021-06-04T02:14:30.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebccb1e0-a09a-4755-9d71-0f398a0f9fc4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:14:30.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebccb1e0-a09a-4755-9d71-0f398a0f9fc4 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:14:32.270Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:14:33.464Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5c92ec0-b5fd-4e67-8031-800bde3645d2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:14:33.464Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5c92ec0-b5fd-4e67-8031-800bde3645d2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c2e1865
2021-06-04T02:14:33.464Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5c92ec0-b5fd-4e67-8031-800bde3645d2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:14:33.464Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5c92ec0-b5fd-4e67-8031-800bde3645d2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:14:33.620Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b5c92ec0-b5fd-4e67-8031-800bde3645d2 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:14:33.620Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b5c92ec0-b5fd-4e67-8031-800bde3645d2 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:14:36.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6cf034b-8f0a-4d45-834e-2028a5dcc522 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:14:36.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6cf034b-8f0a-4d45-834e-2028a5dcc522 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d6ba159
2021-06-04T02:14:36.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6cf034b-8f0a-4d45-834e-2028a5dcc522 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:14:36.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6cf034b-8f0a-4d45-834e-2028a5dcc522 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:14:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:14:39.452Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T02:14:39.453Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:14:39.453Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:14:39.456Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:14:39.457Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T02:14:39.457Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T02:14:40.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d822cf0-466a-497d-80f9-bafe41d61cc7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:14:40.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d822cf0-466a-497d-80f9-bafe41d61cc7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ac2dfa2
2021-06-04T02:14:40.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d822cf0-466a-497d-80f9-bafe41d61cc7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:14:40.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d822cf0-466a-497d-80f9-bafe41d61cc7 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:14:43.148Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b231217-2759-4c97-a44a-2478227cd2e1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:14:43.148Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b231217-2759-4c97-a44a-2478227cd2e1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b8a33c8
2021-06-04T02:14:43.148Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b231217-2759-4c97-a44a-2478227cd2e1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:14:43.148Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b231217-2759-4c97-a44a-2478227cd2e1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:14:44.869Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:14:44.890Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:14:44.891Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T02:14:46.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77230353-6070-431d-964d-ca89abbaa4b5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:14:46.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77230353-6070-431d-964d-ca89abbaa4b5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@770bfdec
2021-06-04T02:14:46.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77230353-6070-431d-964d-ca89abbaa4b5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:14:46.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77230353-6070-431d-964d-ca89abbaa4b5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:14:49.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=807cbfd8-ee12-468c-ba30-5063dc87f5be PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:14:49.449Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=807cbfd8-ee12-468c-ba30-5063dc87f5be PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27baeb3d
2021-06-04T02:14:49.449Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=807cbfd8-ee12-468c-ba30-5063dc87f5be PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:14:49.449Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=807cbfd8-ee12-468c-ba30-5063dc87f5be PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:14:49.622Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=807cbfd8-ee12-468c-ba30-5063dc87f5be ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:14:49.622Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=807cbfd8-ee12-468c-ba30-5063dc87f5be ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:14:52.155Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a46ccdc5-8bf7-4249-a134-3ffcf17a034a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:14:52.155Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a46ccdc5-8bf7-4249-a134-3ffcf17a034a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b391fa7
2021-06-04T02:14:52.155Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a46ccdc5-8bf7-4249-a134-3ffcf17a034a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:14:52.155Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a46ccdc5-8bf7-4249-a134-3ffcf17a034a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:14:54.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d2e4da3-4faa-4388-8337-51c8cab112e1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:14:54.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d2e4da3-4faa-4388-8337-51c8cab112e1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@51e76b7b
2021-06-04T02:14:54.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d2e4da3-4faa-4388-8337-51c8cab112e1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:14:54.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d2e4da3-4faa-4388-8337-51c8cab112e1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:14:57.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa164e59-934b-48c1-8fbf-c745f7e3f873 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:14:57.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa164e59-934b-48c1-8fbf-c745f7e3f873 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79ab1836
2021-06-04T02:14:57.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa164e59-934b-48c1-8fbf-c745f7e3f873 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:14:57.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa164e59-934b-48c1-8fbf-c745f7e3f873 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:14:59.872Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:14:59.887Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:15:00.346Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ee5fb6b-494b-4c72-b44d-e0ad1044fe92 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:15:00.346Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ee5fb6b-494b-4c72-b44d-e0ad1044fe92 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9b8e73d
2021-06-04T02:15:00.346Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ee5fb6b-494b-4c72-b44d-e0ad1044fe92 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:15:00.346Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ee5fb6b-494b-4c72-b44d-e0ad1044fe92 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:15:03.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b41d2f2c-410c-403f-a557-865672c3349d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:15:03.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b41d2f2c-410c-403f-a557-865672c3349d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a2f058a
2021-06-04T02:15:03.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b41d2f2c-410c-403f-a557-865672c3349d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:15:03.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b41d2f2c-410c-403f-a557-865672c3349d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:15:06.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5e47e4e-2e41-488c-9c63-8755bd458e05 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:15:06.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5e47e4e-2e41-488c-9c63-8755bd458e05 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30f90107
2021-06-04T02:15:06.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5e47e4e-2e41-488c-9c63-8755bd458e05 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:15:06.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5e47e4e-2e41-488c-9c63-8755bd458e05 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:15:09.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5564313f-122a-43ab-9e24-b38a0b432ad5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:15:09.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5564313f-122a-43ab-9e24-b38a0b432ad5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1132c586
2021-06-04T02:15:09.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5564313f-122a-43ab-9e24-b38a0b432ad5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:15:09.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5564313f-122a-43ab-9e24-b38a0b432ad5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:15:12.359Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79420c88-9507-4400-bb54-1af3ba490c20 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:15:12.359Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79420c88-9507-4400-bb54-1af3ba490c20 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f7d5992
2021-06-04T02:15:12.359Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79420c88-9507-4400-bb54-1af3ba490c20 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:15:12.359Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79420c88-9507-4400-bb54-1af3ba490c20 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:15:14.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:15:14.869Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:15:14.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:15:14.872Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:15:14.872Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T02:15:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58b3a287-44db-4dba-8964-8647157f3d00 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:15:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58b3a287-44db-4dba-8964-8647157f3d00 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d5c04a2
2021-06-04T02:15:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58b3a287-44db-4dba-8964-8647157f3d00 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:15:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58b3a287-44db-4dba-8964-8647157f3d00 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:15:15.575Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=58b3a287-44db-4dba-8964-8647157f3d00 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:15:15.575Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=58b3a287-44db-4dba-8964-8647157f3d00 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:15:18.651Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9fd1579-bc6b-400d-8e5f-e3c9ca26bfa9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:15:18.651Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9fd1579-bc6b-400d-8e5f-e3c9ca26bfa9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@555c337
2021-06-04T02:15:18.651Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9fd1579-bc6b-400d-8e5f-e3c9ca26bfa9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:15:18.651Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9fd1579-bc6b-400d-8e5f-e3c9ca26bfa9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:15:21.363Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bd0acf7-c3fd-4fb9-8d45-07ec16bddd8e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:15:21.363Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bd0acf7-c3fd-4fb9-8d45-07ec16bddd8e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@24c38ee
2021-06-04T02:15:21.363Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bd0acf7-c3fd-4fb9-8d45-07ec16bddd8e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:15:21.363Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bd0acf7-c3fd-4fb9-8d45-07ec16bddd8e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:15:23.409Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0no8rzbieo65t4lonf2xi4wrh29
2021-06-04T02:15:23.409Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node015wq1yllec3v11l1os9254pjl134
2021-06-04T02:15:23.409Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node019edm29thw37iv7j1fsp0mve027
2021-06-04T02:15:23.409Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0pdrka0yujif97n8zhtx1opve33
2021-06-04T02:15:23.409Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0eq062q6fouk4133a80t5qhhkk32
2021-06-04T02:15:23.409Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0ugj5mk9etw0s12v17m0entuis26
2021-06-04T02:15:23.409Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node019j0vfcva7q9z18c0fr3jjfpu528
2021-06-04T02:15:23.409Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0u8o56gymjyavwlaipnlo2gjf25
2021-06-04T02:15:23.410Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01binxpcb3zpxe15bmr2xz0lv9g31
2021-06-04T02:15:23.410Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01db0v2xh52z6d13xivu8g6jcg630
2021-06-04T02:15:23.410Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01sosh1zx7xocq1tdry6hlsaipe35
2021-06-04T02:15:24.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ea0f9ab-6ca9-4e1d-b995-22649c4bfec5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:15:24.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ea0f9ab-6ca9-4e1d-b995-22649c4bfec5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@374850fc
2021-06-04T02:15:24.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ea0f9ab-6ca9-4e1d-b995-22649c4bfec5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:15:24.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ea0f9ab-6ca9-4e1d-b995-22649c4bfec5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:15:27.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8cecde8d-8197-494f-a4d2-019b45dc69d4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:15:27.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8cecde8d-8197-494f-a4d2-019b45dc69d4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2aac3ba3
2021-06-04T02:15:27.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8cecde8d-8197-494f-a4d2-019b45dc69d4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:15:27.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8cecde8d-8197-494f-a4d2-019b45dc69d4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:15:27.652Z [BE-Health-Check-Task] INFO o.a.http.impl.execchain.RetryExec RequestID=8cecde8d-8197-494f-a4d2-019b45dc69d4 PartnerName=SDC.BE I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {s}->https://sdc-onboarding-be.onap:8445: The target server failed to respond
2021-06-04T02:15:27.652Z [BE-Health-Check-Task] INFO o.a.http.impl.execchain.RetryExec RequestID=8cecde8d-8197-494f-a4d2-019b45dc69d4 PartnerName=SDC.BE Retrying request to {s}->https://sdc-onboarding-be.onap:8445
2021-06-04T02:15:27.655Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8cecde8d-8197-494f-a4d2-019b45dc69d4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T02:15:27.655Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8cecde8d-8197-494f-a4d2-019b45dc69d4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:15:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:15:29.869Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:15:29.870Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:15:29.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:15:30.662Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24f8f0e6-fa82-4eef-b692-617b94368a44 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:15:30.662Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24f8f0e6-fa82-4eef-b692-617b94368a44 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@62a3ca25
2021-06-04T02:15:30.662Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24f8f0e6-fa82-4eef-b692-617b94368a44 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:15:30.662Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24f8f0e6-fa82-4eef-b692-617b94368a44 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:15:30.664Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=24f8f0e6-fa82-4eef-b692-617b94368a44 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T02:15:30.665Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=24f8f0e6-fa82-4eef-b692-617b94368a44 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:15:33.649Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d4ba574-364f-427e-8c8e-247223f9cfc1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:15:33.649Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d4ba574-364f-427e-8c8e-247223f9cfc1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ca3e95e
2021-06-04T02:15:33.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d4ba574-364f-427e-8c8e-247223f9cfc1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:15:33.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d4ba574-364f-427e-8c8e-247223f9cfc1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:15:36.661Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0d4ba574-364f-427e-8c8e-247223f9cfc1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T02:15:36.661Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0d4ba574-364f-427e-8c8e-247223f9cfc1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:15:37.196Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d96b151-6fb9-49c3-8748-78dfe91a5ce6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:15:37.196Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d96b151-6fb9-49c3-8748-78dfe91a5ce6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79f22dd1
2021-06-04T02:15:37.196Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d96b151-6fb9-49c3-8748-78dfe91a5ce6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:15:37.196Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d96b151-6fb9-49c3-8748-78dfe91a5ce6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:15:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:15:39.453Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T02:15:39.454Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:15:39.454Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:15:39.457Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:15:39.458Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T02:15:39.458Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T02:15:40.204Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=9d96b151-6fb9-49c3-8748-78dfe91a5ce6 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T02:15:40.204Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=9d96b151-6fb9-49c3-8748-78dfe91a5ce6 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:15:40.652Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84e547e1-c82e-43ca-9ff5-c441af38d9bd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:15:40.652Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84e547e1-c82e-43ca-9ff5-c441af38d9bd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60d247bb
2021-06-04T02:15:40.652Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84e547e1-c82e-43ca-9ff5-c441af38d9bd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:15:40.652Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84e547e1-c82e-43ca-9ff5-c441af38d9bd PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:15:43.663Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=84e547e1-c82e-43ca-9ff5-c441af38d9bd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T02:15:43.663Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=84e547e1-c82e-43ca-9ff5-c441af38d9bd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:15:44.290Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2e7f4b9-c5ae-46d4-acab-bf283ddcbc31 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:15:44.290Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2e7f4b9-c5ae-46d4-acab-bf283ddcbc31 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6cd3060d
2021-06-04T02:15:44.290Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2e7f4b9-c5ae-46d4-acab-bf283ddcbc31 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:15:44.290Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2e7f4b9-c5ae-46d4-acab-bf283ddcbc31 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:15:44.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:15:44.870Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:15:44.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:15:44.872Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:15:47.309Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f2e7f4b9-c5ae-46d4-acab-bf283ddcbc31 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T02:15:47.310Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f2e7f4b9-c5ae-46d4-acab-bf283ddcbc31 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:15:48.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0844286b-0339-479f-a41e-e64be6c776db PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:15:48.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0844286b-0339-479f-a41e-e64be6c776db PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@784c25c1
2021-06-04T02:15:48.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0844286b-0339-479f-a41e-e64be6c776db PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:15:48.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0844286b-0339-479f-a41e-e64be6c776db PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:15:51.100Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0844286b-0339-479f-a41e-e64be6c776db ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T02:15:51.100Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0844286b-0339-479f-a41e-e64be6c776db ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:15:51.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52eb4023-cf4a-4e17-a759-57b756123fb1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:15:51.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52eb4023-cf4a-4e17-a759-57b756123fb1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@313e20a4
2021-06-04T02:15:51.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52eb4023-cf4a-4e17-a759-57b756123fb1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:15:51.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52eb4023-cf4a-4e17-a759-57b756123fb1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:15:56.570Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=52eb4023-cf4a-4e17-a759-57b756123fb1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:15:56.571Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=52eb4023-cf4a-4e17-a759-57b756123fb1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:15:57.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fdfeb86-5a03-4653-95ff-6aef201fbd79 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:15:57.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fdfeb86-5a03-4653-95ff-6aef201fbd79 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28b1a7c5
2021-06-04T02:15:57.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fdfeb86-5a03-4653-95ff-6aef201fbd79 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:15:57.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fdfeb86-5a03-4653-95ff-6aef201fbd79 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:15:58.624Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0fdfeb86-5a03-4653-95ff-6aef201fbd79 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:15:58.624Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0fdfeb86-5a03-4653-95ff-6aef201fbd79 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:15:59.254Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=604902c7-fdcb-4db4-bc1f-13a3bfb1994f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:15:59.254Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=604902c7-fdcb-4db4-bc1f-13a3bfb1994f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60c02ab7
2021-06-04T02:15:59.254Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=604902c7-fdcb-4db4-bc1f-13a3bfb1994f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:15:59.254Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=604902c7-fdcb-4db4-bc1f-13a3bfb1994f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:15:59.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:15:59.869Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:15:59.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:15:59.872Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:16:01.809Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc12e7eb-f41b-47b0-afd3-9dc023037d72 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:16:01.809Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc12e7eb-f41b-47b0-afd3-9dc023037d72 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69ce241
2021-06-04T02:16:01.809Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc12e7eb-f41b-47b0-afd3-9dc023037d72 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:16:01.809Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc12e7eb-f41b-47b0-afd3-9dc023037d72 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:16:02.466Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf17ddc2-3fa5-4deb-8521-d15ac1271627 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:16:02.466Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf17ddc2-3fa5-4deb-8521-d15ac1271627 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2336f2d8
2021-06-04T02:16:02.466Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf17ddc2-3fa5-4deb-8521-d15ac1271627 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:16:02.466Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf17ddc2-3fa5-4deb-8521-d15ac1271627 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:16:05.254Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95907023-de43-446a-99ab-6793c9295cca PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:16:05.254Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95907023-de43-446a-99ab-6793c9295cca PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5bdd509f
2021-06-04T02:16:05.254Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95907023-de43-446a-99ab-6793c9295cca PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:16:05.254Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95907023-de43-446a-99ab-6793c9295cca PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:16:06.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c44908cd-2631-4fe7-87a8-8d98635d8fbe PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:16:06.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c44908cd-2631-4fe7-87a8-8d98635d8fbe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3aa94cc1
2021-06-04T02:16:06.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c44908cd-2631-4fe7-87a8-8d98635d8fbe PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:16:06.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c44908cd-2631-4fe7-87a8-8d98635d8fbe PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:16:10.762Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=072b46a5-4068-41a4-9907-c6f562548ba0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:16:10.762Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=072b46a5-4068-41a4-9907-c6f562548ba0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b462f3f
2021-06-04T02:16:10.762Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=072b46a5-4068-41a4-9907-c6f562548ba0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:16:10.762Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=072b46a5-4068-41a4-9907-c6f562548ba0 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:16:12.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84bf2fe0-a5b7-46b0-a754-51657e645824 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:16:12.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84bf2fe0-a5b7-46b0-a754-51657e645824 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ff2b6bd
2021-06-04T02:16:12.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84bf2fe0-a5b7-46b0-a754-51657e645824 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:16:12.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84bf2fe0-a5b7-46b0-a754-51657e645824 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:16:14.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:16:14.871Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:16:14.872Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:16:14.873Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:16:15.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4dd0f3eb-77e3-4a4b-b4f6-9d28c522c135 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:16:15.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4dd0f3eb-77e3-4a4b-b4f6-9d28c522c135 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e9a4e74
2021-06-04T02:16:15.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4dd0f3eb-77e3-4a4b-b4f6-9d28c522c135 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:16:15.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4dd0f3eb-77e3-4a4b-b4f6-9d28c522c135 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:16:18.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec56cc33-1532-4b7d-853e-e652eb6d68ff PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:16:18.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec56cc33-1532-4b7d-853e-e652eb6d68ff PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e25ca22
2021-06-04T02:16:18.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec56cc33-1532-4b7d-853e-e652eb6d68ff PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:16:18.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec56cc33-1532-4b7d-853e-e652eb6d68ff PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:16:21.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:16:21.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:16:21.579Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ec56cc33-1532-4b7d-853e-e652eb6d68ff ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:16:21.579Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ec56cc33-1532-4b7d-853e-e652eb6d68ff ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:16:21.580Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ec56cc33-1532-4b7d-853e-e652eb6d68ff ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:16:21.580Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ec56cc33-1532-4b7d-853e-e652eb6d68ff ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:16:22.798Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f534319-1d11-4de3-85ef-a13ffd911c6d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:16:22.798Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f534319-1d11-4de3-85ef-a13ffd911c6d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6470230e
2021-06-04T02:16:22.799Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f534319-1d11-4de3-85ef-a13ffd911c6d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:16:22.799Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f534319-1d11-4de3-85ef-a13ffd911c6d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:16:23.174Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=5f534319-1d11-4de3-85ef-a13ffd911c6d ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:16:23.175Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=5f534319-1d11-4de3-85ef-a13ffd911c6d ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:16:23.332Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:16:24.958Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70730181-5af5-43c8-a3bb-769f67e66fa6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:16:24.958Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70730181-5af5-43c8-a3bb-769f67e66fa6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@12a82624
2021-06-04T02:16:24.958Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70730181-5af5-43c8-a3bb-769f67e66fa6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:16:24.958Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70730181-5af5-43c8-a3bb-769f67e66fa6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:16:25.663Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=70730181-5af5-43c8-a3bb-769f67e66fa6 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:16:25.664Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=70730181-5af5-43c8-a3bb-769f67e66fa6 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:16:27.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c93bcd18-a6ef-4d31-9106-d5bec4ebd282 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:16:27.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c93bcd18-a6ef-4d31-9106-d5bec4ebd282 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@32fc8a89
2021-06-04T02:16:27.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c93bcd18-a6ef-4d31-9106-d5bec4ebd282 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:16:27.776Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c93bcd18-a6ef-4d31-9106-d5bec4ebd282 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:16:29.870Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:16:29.872Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:16:29.873Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:16:29.874Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:16:30.674Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5bd11c9-2bb2-4965-ba7e-1fbb4a7017df PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:16:30.674Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5bd11c9-2bb2-4965-ba7e-1fbb4a7017df PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5771b78b
2021-06-04T02:16:30.674Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5bd11c9-2bb2-4965-ba7e-1fbb4a7017df PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:16:30.674Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5bd11c9-2bb2-4965-ba7e-1fbb4a7017df PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:16:34.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=307548c9-12b2-4e22-a29b-cdf582cea9fa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:16:34.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=307548c9-12b2-4e22-a29b-cdf582cea9fa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@f8dd28
2021-06-04T02:16:34.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=307548c9-12b2-4e22-a29b-cdf582cea9fa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:16:34.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=307548c9-12b2-4e22-a29b-cdf582cea9fa PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:16:36.954Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=073bb6ae-8bb5-412a-b593-61af5a330d86 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:16:36.955Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=073bb6ae-8bb5-412a-b593-61af5a330d86 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53324215
2021-06-04T02:16:36.955Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=073bb6ae-8bb5-412a-b593-61af5a330d86 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:16:36.955Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=073bb6ae-8bb5-412a-b593-61af5a330d86 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:16:39.453Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:16:39.454Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T02:16:39.456Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:16:39.456Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:16:39.459Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:16:39.460Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T02:16:39.461Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T02:16:40.857Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=699c6441-8902-448a-b369-5caf661f71b3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:16:40.857Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=699c6441-8902-448a-b369-5caf661f71b3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54c2238
2021-06-04T02:16:40.857Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=699c6441-8902-448a-b369-5caf661f71b3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:16:40.857Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=699c6441-8902-448a-b369-5caf661f71b3 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:16:42.776Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a33d2323-b78d-4d2c-b71e-36c29fa801f5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:16:42.776Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a33d2323-b78d-4d2c-b71e-36c29fa801f5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5fdb10f5
2021-06-04T02:16:42.776Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a33d2323-b78d-4d2c-b71e-36c29fa801f5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:16:42.776Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a33d2323-b78d-4d2c-b71e-36c29fa801f5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:16:44.870Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:16:44.874Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:16:44.877Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:16:44.878Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:16:45.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=017c5067-3fa4-411e-87ed-e6e43a03186e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:16:45.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=017c5067-3fa4-411e-87ed-e6e43a03186e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@190c87bb
2021-06-04T02:16:45.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=017c5067-3fa4-411e-87ed-e6e43a03186e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:16:45.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=017c5067-3fa4-411e-87ed-e6e43a03186e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:16:51.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:16:51.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:16:52.986Z [cluster1-nio-worker-1] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:16:52.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcc19572-461f-463f-a7e2-3319345fb737 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:16:52.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcc19572-461f-463f-a7e2-3319345fb737 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58ef4c65
2021-06-04T02:16:52.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcc19572-461f-463f-a7e2-3319345fb737 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:16:52.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcc19572-461f-463f-a7e2-3319345fb737 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:16:53.816Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:16:55.992Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=dcc19572-461f-463f-a7e2-3319345fb737 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:16:55.993Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=dcc19572-461f-463f-a7e2-3319345fb737 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:16:55.993Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=dcc19572-461f-463f-a7e2-3319345fb737 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:16:55.993Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=dcc19572-461f-463f-a7e2-3319345fb737 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:16:57.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:16:57.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:16:59.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:16:59.870Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:16:59.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:16:59.872Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:17:00.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:17:01.952Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation RequestID=null ErrorCategory=INFO ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=500 TargetEntity=ReplaceDataTypesCache Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272)
at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269)
at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90)
at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120)
at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77)
at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47)
at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45)
at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177)
at org.apache.tinkerpop.gremlin.structure.Element.keys(Element.java:69)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getProperties(JanusGraphGenericDao.java:1491)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getByCriteria(JanusGraphGenericDao.java:759)
at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypeNodes(PropertyOperation.java:1566)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.findAllDataTypesLazy(ApplicationDataTypeCache.java:309)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.hasDataTypesChanged(ApplicationDataTypeCache.java:220)
at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:200)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 0 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 0 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 0 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T02:17:02.393Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:17:02.504Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=790e175b-f195-4da7-ba15-d85adf653482 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:17:02.504Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=790e175b-f195-4da7-ba15-d85adf653482 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c56e8a2
2021-06-04T02:17:02.504Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=790e175b-f195-4da7-ba15-d85adf653482 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:17:02.504Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=790e175b-f195-4da7-ba15-d85adf653482 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:17:02.844Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=790e175b-f195-4da7-ba15-d85adf653482 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:17:02.844Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=790e175b-f195-4da7-ba15-d85adf653482 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:17:03.334Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47bcf362-8647-446f-a80a-525d01e98de9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:17:03.334Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47bcf362-8647-446f-a80a-525d01e98de9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@464162e0
2021-06-04T02:17:03.334Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47bcf362-8647-446f-a80a-525d01e98de9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:17:03.335Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47bcf362-8647-446f-a80a-525d01e98de9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:17:05.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4ca726d-6dce-40a4-8875-91b4616fef20 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:17:05.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4ca726d-6dce-40a4-8875-91b4616fef20 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@646f8229
2021-06-04T02:17:05.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4ca726d-6dce-40a4-8875-91b4616fef20 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:17:05.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4ca726d-6dce-40a4-8875-91b4616fef20 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:17:07.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=154aeefd-f83c-4b96-aebb-d272a4e51426 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:17:07.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=154aeefd-f83c-4b96-aebb-d272a4e51426 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ff775fe
2021-06-04T02:17:07.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=154aeefd-f83c-4b96-aebb-d272a4e51426 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:17:07.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=154aeefd-f83c-4b96-aebb-d272a4e51426 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:17:09.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8401687a-ea6f-4b2b-8221-af0056c60e20 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:17:09.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8401687a-ea6f-4b2b-8221-af0056c60e20 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3cf20d46
2021-06-04T02:17:09.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8401687a-ea6f-4b2b-8221-af0056c60e20 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:17:09.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8401687a-ea6f-4b2b-8221-af0056c60e20 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:17:11.955Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fbd3acd-0464-4f1a-931d-c77a0a3c48f7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:17:11.955Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fbd3acd-0464-4f1a-931d-c77a0a3c48f7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71e93e5a
2021-06-04T02:17:11.955Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fbd3acd-0464-4f1a-931d-c77a0a3c48f7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:17:11.955Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fbd3acd-0464-4f1a-931d-c77a0a3c48f7 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:17:14.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5eff689e-857f-4695-a395-7ea7e7609295 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:17:14.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5eff689e-857f-4695-a395-7ea7e7609295 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@690f8484
2021-06-04T02:17:14.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5eff689e-857f-4695-a395-7ea7e7609295 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:17:14.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5eff689e-857f-4695-a395-7ea7e7609295 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:17:14.867Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:17:14.870Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:17:14.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:17:14.872Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:17:17.359Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42904a1d-449b-42e1-9971-d739e49049b4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:17:17.359Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42904a1d-449b-42e1-9971-d739e49049b4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d8344de
2021-06-04T02:17:17.359Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42904a1d-449b-42e1-9971-d739e49049b4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:17:17.359Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42904a1d-449b-42e1-9971-d739e49049b4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:17:19.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b87139e7-424f-4eb2-adcc-39e754dd238e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:17:19.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b87139e7-424f-4eb2-adcc-39e754dd238e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@11b7e615
2021-06-04T02:17:19.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b87139e7-424f-4eb2-adcc-39e754dd238e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:17:19.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b87139e7-424f-4eb2-adcc-39e754dd238e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:17:20.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08f7f4e2-b9ba-464a-bb07-ba73374bac5d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:17:20.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08f7f4e2-b9ba-464a-bb07-ba73374bac5d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29940197
2021-06-04T02:17:20.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08f7f4e2-b9ba-464a-bb07-ba73374bac5d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:17:20.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08f7f4e2-b9ba-464a-bb07-ba73374bac5d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:17:22.449Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f75103b9-bb35-4dda-92a8-d079b1a8ce5b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:17:22.449Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f75103b9-bb35-4dda-92a8-d079b1a8ce5b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c2a9b85
2021-06-04T02:17:22.449Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f75103b9-bb35-4dda-92a8-d079b1a8ce5b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:17:22.449Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f75103b9-bb35-4dda-92a8-d079b1a8ce5b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:17:25.386Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8024bcae-e103-4392-a1f4-8ecfcf2a0a81 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:17:25.386Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8024bcae-e103-4392-a1f4-8ecfcf2a0a81 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ba88d6a
2021-06-04T02:17:25.386Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8024bcae-e103-4392-a1f4-8ecfcf2a0a81 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:17:25.386Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8024bcae-e103-4392-a1f4-8ecfcf2a0a81 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:17:27.475Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=226d8a6e-f6c6-43fe-9f2f-0307f0efd594 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:17:27.475Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=226d8a6e-f6c6-43fe-9f2f-0307f0efd594 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35014744
2021-06-04T02:17:27.475Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=226d8a6e-f6c6-43fe-9f2f-0307f0efd594 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:17:27.475Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=226d8a6e-f6c6-43fe-9f2f-0307f0efd594 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:17:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:17:29.872Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:17:29.873Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:17:29.874Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.114.131] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2021-06-04T02:17:30.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8dd2eb6-7d09-4480-8048-124ed625e7d3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:17:30.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8dd2eb6-7d09-4480-8048-124ed625e7d3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c9060ca
2021-06-04T02:17:30.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8dd2eb6-7d09-4480-8048-124ed625e7d3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:17:30.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8dd2eb6-7d09-4480-8048-124ed625e7d3 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:17:34.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fb65ec5-7266-4953-97d6-81399b85f4c5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:17:34.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fb65ec5-7266-4953-97d6-81399b85f4c5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@540e226e
2021-06-04T02:17:34.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fb65ec5-7266-4953-97d6-81399b85f4c5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:17:34.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fb65ec5-7266-4953-97d6-81399b85f4c5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:17:36.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=680b4d18-6e51-4c63-bcfb-a6a882a82288 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:17:36.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=680b4d18-6e51-4c63-bcfb-a6a882a82288 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b923658
2021-06-04T02:17:36.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=680b4d18-6e51-4c63-bcfb-a6a882a82288 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:17:36.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=680b4d18-6e51-4c63-bcfb-a6a882a82288 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:17:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:17:39.452Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T02:17:39.453Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:17:39.453Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:17:39.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=931df4f1-14be-43b8-a059-738524d4b49e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:17:39.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=931df4f1-14be-43b8-a059-738524d4b49e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34966b09
2021-06-04T02:17:39.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=931df4f1-14be-43b8-a059-738524d4b49e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:17:39.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=931df4f1-14be-43b8-a059-738524d4b49e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:17:42.952Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db6fc456-920d-4b14-89a5-abb773274b9a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:17:42.953Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db6fc456-920d-4b14-89a5-abb773274b9a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@bbfcb61
2021-06-04T02:17:42.953Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db6fc456-920d-4b14-89a5-abb773274b9a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:17:42.953Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db6fc456-920d-4b14-89a5-abb773274b9a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:17:44.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:17:44.890Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:17:44.891Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T02:17:45.656Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5aeafa2-2533-4103-bbee-dbfaafb3b20e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:17:45.657Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5aeafa2-2533-4103-bbee-dbfaafb3b20e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e87952a
2021-06-04T02:17:45.657Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5aeafa2-2533-4103-bbee-dbfaafb3b20e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:17:45.657Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5aeafa2-2533-4103-bbee-dbfaafb3b20e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:17:48.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b0b52cf-d3e1-486f-817b-3abd334abcbc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:17:48.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b0b52cf-d3e1-486f-817b-3abd334abcbc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@343d5654
2021-06-04T02:17:48.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b0b52cf-d3e1-486f-817b-3abd334abcbc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:17:48.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b0b52cf-d3e1-486f-817b-3abd334abcbc PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:17:49.252Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9b0b52cf-d3e1-486f-817b-3abd334abcbc ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:17:49.252Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9b0b52cf-d3e1-486f-817b-3abd334abcbc ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:17:51.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e7a4eda-4ada-4365-a385-f6aa1c1122fa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:17:51.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e7a4eda-4ada-4365-a385-f6aa1c1122fa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3374bdf9
2021-06-04T02:17:51.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e7a4eda-4ada-4365-a385-f6aa1c1122fa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:17:51.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e7a4eda-4ada-4365-a385-f6aa1c1122fa PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:17:54.447Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc3b1a14-24f9-496a-aea4-efccc3a7664d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:17:54.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc3b1a14-24f9-496a-aea4-efccc3a7664d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@46e58c35
2021-06-04T02:17:54.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc3b1a14-24f9-496a-aea4-efccc3a7664d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:17:54.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc3b1a14-24f9-496a-aea4-efccc3a7664d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:17:54.590Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T02:17:57.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0854907-4276-47be-b826-2a51aade1e5d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:17:57.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0854907-4276-47be-b826-2a51aade1e5d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54597f06
2021-06-04T02:17:57.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0854907-4276-47be-b826-2a51aade1e5d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:17:57.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0854907-4276-47be-b826-2a51aade1e5d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:17:59.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:17:59.875Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:18:00.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=187c8a12-c73f-4da2-94c2-cb9899677b66 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:18:00.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=187c8a12-c73f-4da2-94c2-cb9899677b66 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a080c2f
2021-06-04T02:18:00.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=187c8a12-c73f-4da2-94c2-cb9899677b66 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:18:00.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=187c8a12-c73f-4da2-94c2-cb9899677b66 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:18:03.327Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ddfd1703-96f1-48e3-8069-5955ccf570eb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:18:03.327Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ddfd1703-96f1-48e3-8069-5955ccf570eb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c85f3e2
2021-06-04T02:18:03.328Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ddfd1703-96f1-48e3-8069-5955ccf570eb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:18:03.328Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ddfd1703-96f1-48e3-8069-5955ccf570eb PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:18:06.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38026cdb-4bed-4700-879c-b827cc5fdc33 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:18:06.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38026cdb-4bed-4700-879c-b827cc5fdc33 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@76eb4063
2021-06-04T02:18:06.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38026cdb-4bed-4700-879c-b827cc5fdc33 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:18:06.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38026cdb-4bed-4700-879c-b827cc5fdc33 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:18:09.651Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acf7fa23-9f80-4cf7-a596-d05912054dae PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:18:09.651Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acf7fa23-9f80-4cf7-a596-d05912054dae PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69d5a0f7
2021-06-04T02:18:09.651Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acf7fa23-9f80-4cf7-a596-d05912054dae PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:18:09.651Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acf7fa23-9f80-4cf7-a596-d05912054dae PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:18:12.173Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d281c2aa-f605-49bc-82dd-57b1d8b32a99 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:18:12.173Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d281c2aa-f605-49bc-82dd-57b1d8b32a99 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2376a096
2021-06-04T02:18:12.173Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d281c2aa-f605-49bc-82dd-57b1d8b32a99 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:18:12.173Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d281c2aa-f605-49bc-82dd-57b1d8b32a99 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:18:14.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:18:14.894Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:18:15.378Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71cc94e3-010a-48ec-ad6b-3aa60e65e1dc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:18:15.378Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71cc94e3-010a-48ec-ad6b-3aa60e65e1dc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@10df5df9
2021-06-04T02:18:15.378Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71cc94e3-010a-48ec-ad6b-3aa60e65e1dc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:18:15.378Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71cc94e3-010a-48ec-ad6b-3aa60e65e1dc PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:18:18.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3009c93c-d741-4d85-9ae3-6d0fad31f2a2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:18:18.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3009c93c-d741-4d85-9ae3-6d0fad31f2a2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c1bffd9
2021-06-04T02:18:18.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3009c93c-d741-4d85-9ae3-6d0fad31f2a2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:18:18.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3009c93c-d741-4d85-9ae3-6d0fad31f2a2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:18:21.349Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=786d3b9d-586b-4263-a506-1080b966ecc2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:18:21.349Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=786d3b9d-586b-4263-a506-1080b966ecc2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@788d22b5
2021-06-04T02:18:21.349Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=786d3b9d-586b-4263-a506-1080b966ecc2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:18:21.349Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=786d3b9d-586b-4263-a506-1080b966ecc2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:18:24.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2fb114a7-9f51-4158-9d18-23e6f606218b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:18:24.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2fb114a7-9f51-4158-9d18-23e6f606218b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e695f22
2021-06-04T02:18:24.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2fb114a7-9f51-4158-9d18-23e6f606218b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:18:24.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2fb114a7-9f51-4158-9d18-23e6f606218b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:18:27.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db6ef519-7b89-49fb-ace5-dda2de4f73a0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:18:27.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db6ef519-7b89-49fb-ace5-dda2de4f73a0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@433f783
2021-06-04T02:18:27.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db6ef519-7b89-49fb-ace5-dda2de4f73a0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:18:27.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db6ef519-7b89-49fb-ace5-dda2de4f73a0 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:18:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:18:29.875Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:18:30.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e065bf9c-7576-48f7-b314-738b0dfb2ae1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:18:30.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e065bf9c-7576-48f7-b314-738b0dfb2ae1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@67b525eb
2021-06-04T02:18:30.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e065bf9c-7576-48f7-b314-738b0dfb2ae1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:18:30.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e065bf9c-7576-48f7-b314-738b0dfb2ae1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:18:33.359Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=034b669a-8b50-43aa-9847-a6697a9ff6c9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:18:33.359Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=034b669a-8b50-43aa-9847-a6697a9ff6c9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@76bc3b22
2021-06-04T02:18:33.359Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=034b669a-8b50-43aa-9847-a6697a9ff6c9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:18:33.359Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=034b669a-8b50-43aa-9847-a6697a9ff6c9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:18:37.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0bf562a-70c1-46ff-9cf0-df415366c430 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:18:37.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0bf562a-70c1-46ff-9cf0-df415366c430 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5208fa98
2021-06-04T02:18:37.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0bf562a-70c1-46ff-9cf0-df415366c430 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:18:37.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0bf562a-70c1-46ff-9cf0-df415366c430 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:18:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:18:39.453Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:18:39.453Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:18:39.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83905ceb-e089-41de-897c-dc3793bb0356 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:18:39.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83905ceb-e089-41de-897c-dc3793bb0356 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@491c80b5
2021-06-04T02:18:39.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83905ceb-e089-41de-897c-dc3793bb0356 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:18:39.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83905ceb-e089-41de-897c-dc3793bb0356 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:18:42.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b13d928-4dab-4e09-9e4e-60cb9d8c0dfa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:18:42.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b13d928-4dab-4e09-9e4e-60cb9d8c0dfa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7486e00
2021-06-04T02:18:42.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b13d928-4dab-4e09-9e4e-60cb9d8c0dfa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:18:42.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b13d928-4dab-4e09-9e4e-60cb9d8c0dfa PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:18:44.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:18:45.108Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:18:46.106Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b7d4745-8394-406b-a773-0d5bc2601fa2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:18:46.106Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b7d4745-8394-406b-a773-0d5bc2601fa2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@103a30e0
2021-06-04T02:18:46.106Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b7d4745-8394-406b-a773-0d5bc2601fa2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:18:46.106Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b7d4745-8394-406b-a773-0d5bc2601fa2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:18:48.679Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca3bc5ec-5090-48f0-90cf-7cf72f25b160 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:18:48.679Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca3bc5ec-5090-48f0-90cf-7cf72f25b160 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@573c445
2021-06-04T02:18:48.679Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca3bc5ec-5090-48f0-90cf-7cf72f25b160 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:18:48.679Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca3bc5ec-5090-48f0-90cf-7cf72f25b160 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:18:51.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c98e9e53-6290-4866-841a-1fa43161c7ed PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:18:51.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c98e9e53-6290-4866-841a-1fa43161c7ed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28c7f576
2021-06-04T02:18:51.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c98e9e53-6290-4866-841a-1fa43161c7ed PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:18:51.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c98e9e53-6290-4866-841a-1fa43161c7ed PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:18:55.351Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6624786-03ef-4cc4-b4db-091a5f381b1e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:18:55.351Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6624786-03ef-4cc4-b4db-091a5f381b1e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c3bb600
2021-06-04T02:18:55.351Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6624786-03ef-4cc4-b4db-091a5f381b1e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:18:55.352Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6624786-03ef-4cc4-b4db-091a5f381b1e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:18:58.686Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c10fddb-11c2-46fa-b24c-7b6e36006b45 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:18:58.686Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c10fddb-11c2-46fa-b24c-7b6e36006b45 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2dc73657
2021-06-04T02:18:58.686Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c10fddb-11c2-46fa-b24c-7b6e36006b45 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:18:58.686Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c10fddb-11c2-46fa-b24c-7b6e36006b45 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:18:59.870Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:19:00.657Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abd38288-3f0e-49cc-a40e-f303c2205b63 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:19:00.657Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abd38288-3f0e-49cc-a40e-f303c2205b63 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@360d8e46
2021-06-04T02:19:00.657Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abd38288-3f0e-49cc-a40e-f303c2205b63 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:19:00.657Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abd38288-3f0e-49cc-a40e-f303c2205b63 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:19:03.663Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=abd38288-3f0e-49cc-a40e-f303c2205b63 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:19:03.664Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=abd38288-3f0e-49cc-a40e-f303c2205b63 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:19:03.664Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=abd38288-3f0e-49cc-a40e-f303c2205b63 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:19:03.664Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=abd38288-3f0e-49cc-a40e-f303c2205b63 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:19:07.678Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ab6f370-b69e-4493-adf0-c14d4b59cd81 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:19:07.678Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ab6f370-b69e-4493-adf0-c14d4b59cd81 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@21f6b1b4
2021-06-04T02:19:07.678Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ab6f370-b69e-4493-adf0-c14d4b59cd81 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:19:07.678Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ab6f370-b69e-4493-adf0-c14d4b59cd81 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:19:07.867Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T02:19:08.222Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=4ab6f370-b69e-4493-adf0-c14d4b59cd81 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:19:08.222Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=4ab6f370-b69e-4493-adf0-c14d4b59cd81 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:19:08.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9036910-ac82-42b1-94f6-d9e49660cf21 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:19:08.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9036910-ac82-42b1-94f6-d9e49660cf21 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ad61fc
2021-06-04T02:19:08.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9036910-ac82-42b1-94f6-d9e49660cf21 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:19:08.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9036910-ac82-42b1-94f6-d9e49660cf21 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:19:09.457Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c9036910-ac82-42b1-94f6-d9e49660cf21 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:19:09.457Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c9036910-ac82-42b1-94f6-d9e49660cf21 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:19:10.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7a5214b-62b5-44ec-92d8-f2046123604b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:19:10.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7a5214b-62b5-44ec-92d8-f2046123604b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e08b091
2021-06-04T02:19:10.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7a5214b-62b5-44ec-92d8-f2046123604b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:19:10.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7a5214b-62b5-44ec-92d8-f2046123604b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:19:12.200Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T02:19:12.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=862a8160-91f5-4ac9-898f-4a080ef54fa8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:19:12.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=862a8160-91f5-4ac9-898f-4a080ef54fa8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ae7d1f5
2021-06-04T02:19:12.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=862a8160-91f5-4ac9-898f-4a080ef54fa8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:19:12.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=862a8160-91f5-4ac9-898f-4a080ef54fa8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:19:15.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4722af3-2d41-464f-b310-fb994b38a42f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:19:15.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4722af3-2d41-464f-b310-fb994b38a42f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e9e2dfd
2021-06-04T02:19:15.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4722af3-2d41-464f-b310-fb994b38a42f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:19:15.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4722af3-2d41-464f-b310-fb994b38a42f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:19:17.953Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:19:17.957Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:19:17.968Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:19:17.968Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:19:17.978Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:19:17.978Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:19:18.651Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07ff00c0-19da-47be-86cb-a2e6abeeccbf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:19:18.651Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07ff00c0-19da-47be-86cb-a2e6abeeccbf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@51d30953
2021-06-04T02:19:18.651Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07ff00c0-19da-47be-86cb-a2e6abeeccbf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:19:18.652Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07ff00c0-19da-47be-86cb-a2e6abeeccbf PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:19:21.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62109939-849c-4242-a24f-ba4ca946f735 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:19:21.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62109939-849c-4242-a24f-ba4ca946f735 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a44a7c0
2021-06-04T02:19:21.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62109939-849c-4242-a24f-ba4ca946f735 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:19:21.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62109939-849c-4242-a24f-ba4ca946f735 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:19:24.520Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63329f93-c4d7-4320-8365-8b079ab3b2dd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:19:24.520Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63329f93-c4d7-4320-8365-8b079ab3b2dd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ed8af04
2021-06-04T02:19:24.520Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63329f93-c4d7-4320-8365-8b079ab3b2dd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:19:24.520Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63329f93-c4d7-4320-8365-8b079ab3b2dd PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:19:30.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fde98679-ec88-472f-9b42-4b0ccac8b6c1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:19:30.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fde98679-ec88-472f-9b42-4b0ccac8b6c1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71e69ce7
2021-06-04T02:19:30.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fde98679-ec88-472f-9b42-4b0ccac8b6c1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:19:30.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fde98679-ec88-472f-9b42-4b0ccac8b6c1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:19:39.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:19:39.262Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:19:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:19:39.453Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:19:39.453Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:19:42.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:19:45.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:19:48.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:19:49.804Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://message-router.onap:3904: The target server failed to respond
2021-06-04T02:19:49.804Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:19:51.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:19:51.958Z [cluster1-timeouter-0] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.138.69:9042] Operation timed out
at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:19:51.959Z [cluster1-timeouter-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.ConnectionException: [cassandra.onap/10.242.138.69:9042] Pool was closed during initialization
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:173)
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:158)
at com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1080)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.google.common.util.concurrent.CollectionFuture.handleAllCompleted(CollectionFuture.java:69)
at com.google.common.util.concurrent.AggregateFuture.processCompleted(AggregateFuture.java:282)
at com.google.common.util.concurrent.AggregateFuture.decrementCountAndMaybeComplete(AggregateFuture.java:264)
at com.google.common.util.concurrent.AggregateFuture.access$200(AggregateFuture.java:42)
at com.google.common.util.concurrent.AggregateFuture$1.run(AggregateFuture.java:147)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179)
at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179)
at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:100)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771)
at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:19:51.959Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3651c59d-9578-4296-b1e3-1dd27e777bc1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:19:51.959Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3651c59d-9578-4296-b1e3-1dd27e777bc1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38368a19
2021-06-04T02:19:51.959Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3651c59d-9578-4296-b1e3-1dd27e777bc1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:19:51.959Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3651c59d-9578-4296-b1e3-1dd27e777bc1 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:19:54.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:19:54.965Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3651c59d-9578-4296-b1e3-1dd27e777bc1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:19:54.965Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3651c59d-9578-4296-b1e3-1dd27e777bc1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:19:54.965Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3651c59d-9578-4296-b1e3-1dd27e777bc1 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:19:54.965Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3651c59d-9578-4296-b1e3-1dd27e777bc1 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:19:55.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74d0b461-e7fc-42c0-9a24-7272651b2a86 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:19:55.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74d0b461-e7fc-42c0-9a24-7272651b2a86 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57a34078
2021-06-04T02:19:55.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74d0b461-e7fc-42c0-9a24-7272651b2a86 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:19:55.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74d0b461-e7fc-42c0-9a24-7272651b2a86 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:19:57.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:19:58.613Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=74d0b461-e7fc-42c0-9a24-7272651b2a86 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:19:58.613Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=74d0b461-e7fc-42c0-9a24-7272651b2a86 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:19:58.613Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=74d0b461-e7fc-42c0-9a24-7272651b2a86 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:19:58.613Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=74d0b461-e7fc-42c0-9a24-7272651b2a86 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:20:00.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:20:03.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:20:04.850Z [cluster1-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T02:20:04.851Z [cluster1-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 2000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:20:06.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:20:08.882Z [JanusGraph-Health-Check-Thread] INFO o.j.d.util.BackendOperation Temporary exception during backend operation [VertexIndexQuery]. Attempting backoff retry.
org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77)
at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:399)
at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:396)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54)
at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470)
at org.janusgraph.diskstorage.BackendTransaction.indexQuery(BackendTransaction.java:396)
at org.janusgraph.graphdb.query.graph.MultiKeySliceQuery.execute(MultiKeySliceQuery.java:51)
at org.janusgraph.graphdb.database.IndexSerializer.query(IndexSerializer.java:512)
at org.janusgraph.graphdb.util.SubqueryIterator.(SubqueryIterator.java:66)
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1295)
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1190)
at org.janusgraph.graphdb.query.QueryProcessor$LimitAdjustingIterator.getNewIterator(QueryProcessor.java:194)
at org.janusgraph.graphdb.query.LimitAdjustingIterator.hasNext(LimitAdjustingIterator.java:68)
at org.janusgraph.graphdb.query.ResultSetIterator.nextInternal(ResultSetIterator.java:54)
at org.janusgraph.graphdb.query.ResultSetIterator.(ResultSetIterator.java:44)
at org.janusgraph.graphdb.query.QueryProcessor.iterator(QueryProcessor.java:66)
at com.google.common.collect.Iterables$4.iterator(Iterables.java:559)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:340)
at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:336)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadFailureException: Cassandra failure during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded, 2 failed)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
... 4 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadFailureException: Cassandra failure during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded, 2 failed)
at com.datastax.driver.core.exceptions.ReadFailureException.copy(ReadFailureException.java:192)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:173)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadFailureException: Cassandra failure during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded, 2 failed)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:117)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T02:20:08.895Z [cluster1-nio-worker-1] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:20:08.895Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a29b86d-6c05-4bb4-9262-4ebb494b7a6d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:20:08.895Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a29b86d-6c05-4bb4-9262-4ebb494b7a6d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@693cd5db
2021-06-04T02:20:08.895Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a29b86d-6c05-4bb4-9262-4ebb494b7a6d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:20:08.895Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a29b86d-6c05-4bb4-9262-4ebb494b7a6d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:20:09.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:20:11.260Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=4a29b86d-6c05-4bb4-9262-4ebb494b7a6d ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:20:11.260Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=4a29b86d-6c05-4bb4-9262-4ebb494b7a6d ErrorCategory=ERROR ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:20:11.384Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6cffd51-13f4-4b4c-922a-8281bbfc6f68 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:20:11.384Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6cffd51-13f4-4b4c-922a-8281bbfc6f68 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28bbd0f5
2021-06-04T02:20:11.384Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6cffd51-13f4-4b4c-922a-8281bbfc6f68 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:20:11.384Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6cffd51-13f4-4b4c-922a-8281bbfc6f68 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:20:11.466Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:20:12.739Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc70931a-c805-494a-8659-5f909d724256 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:20:12.739Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc70931a-c805-494a-8659-5f909d724256 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@470458b8
2021-06-04T02:20:12.739Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc70931a-c805-494a-8659-5f909d724256 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:20:12.739Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc70931a-c805-494a-8659-5f909d724256 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:20:13.626Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fc70931a-c805-494a-8659-5f909d724256 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:20:13.626Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fc70931a-c805-494a-8659-5f909d724256 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:20:16.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbb20a2d-c651-4c7a-b963-c96667d02a52 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:20:16.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbb20a2d-c651-4c7a-b963-c96667d02a52 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4819cf8e
2021-06-04T02:20:16.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbb20a2d-c651-4c7a-b963-c96667d02a52 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:20:16.979Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbb20a2d-c651-4c7a-b963-c96667d02a52 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:20:19.984Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=fbb20a2d-c651-4c7a-b963-c96667d02a52 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:20:19.984Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=fbb20a2d-c651-4c7a-b963-c96667d02a52 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:20:19.985Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fbb20a2d-c651-4c7a-b963-c96667d02a52 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:20:19.985Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fbb20a2d-c651-4c7a-b963-c96667d02a52 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:20:21.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:20:21.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:20:24.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:20:26.276Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:20:26.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=274271c4-2830-4049-8f58-b62115bdbe98 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:20:26.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=274271c4-2830-4049-8f58-b62115bdbe98 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a78a1ee
2021-06-04T02:20:26.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=274271c4-2830-4049-8f58-b62115bdbe98 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:20:26.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=274271c4-2830-4049-8f58-b62115bdbe98 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:20:26.575Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=274271c4-2830-4049-8f58-b62115bdbe98 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:20:26.575Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=274271c4-2830-4049-8f58-b62115bdbe98 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:20:27.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bef2125-0c5a-4203-8bf0-efb5f40c8eac PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:20:27.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bef2125-0c5a-4203-8bf0-efb5f40c8eac PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@916a29a
2021-06-04T02:20:27.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bef2125-0c5a-4203-8bf0-efb5f40c8eac PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:20:27.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bef2125-0c5a-4203-8bf0-efb5f40c8eac PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:20:30.560Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3bef2125-0c5a-4203-8bf0-efb5f40c8eac ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:20:30.561Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3bef2125-0c5a-4203-8bf0-efb5f40c8eac ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:20:30.561Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3bef2125-0c5a-4203-8bf0-efb5f40c8eac ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:20:30.561Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3bef2125-0c5a-4203-8bf0-efb5f40c8eac ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:20:31.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3fe6d0e-a29b-447d-8f51-a7f0a7972b95 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:20:31.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3fe6d0e-a29b-447d-8f51-a7f0a7972b95 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@f756989
2021-06-04T02:20:31.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3fe6d0e-a29b-447d-8f51-a7f0a7972b95 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:20:31.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3fe6d0e-a29b-447d-8f51-a7f0a7972b95 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:20:33.325Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c3fe6d0e-a29b-447d-8f51-a7f0a7972b95 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:20:33.325Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c3fe6d0e-a29b-447d-8f51-a7f0a7972b95 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:20:34.660Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29bf3ea7-53da-4966-a7e1-0fd0e69b58f8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:20:34.660Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29bf3ea7-53da-4966-a7e1-0fd0e69b58f8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b25d1e9
2021-06-04T02:20:34.660Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29bf3ea7-53da-4966-a7e1-0fd0e69b58f8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:20:34.660Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29bf3ea7-53da-4966-a7e1-0fd0e69b58f8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:20:49.564Z [cluster1-nio-worker-1] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:20:53.350Z [cluster1-nio-worker-1] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.ConnectionException: [cassandra.onap/10.242.138.69:9042] Pool was closed during initialization
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:173)
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:158)
at com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1080)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.google.common.util.concurrent.CollectionFuture.handleAllCompleted(CollectionFuture.java:69)
at com.google.common.util.concurrent.AggregateFuture.processCompleted(AggregateFuture.java:282)
at com.google.common.util.concurrent.AggregateFuture.decrementCountAndMaybeComplete(AggregateFuture.java:264)
at com.google.common.util.concurrent.AggregateFuture.access$200(AggregateFuture.java:42)
at com.google.common.util.concurrent.AggregateFuture$1.run(AggregateFuture.java:147)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:110)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:110)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.setResult(AbstractTransformFuture.java:224)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.setResult(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:163)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.DefaultResultSetFuture.onSet(DefaultResultSetFuture.java:210)
at com.datastax.driver.core.DefaultResultSetFuture.onSet(DefaultResultSetFuture.java:242)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:20:53.350Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e73e1fbf-28a7-4c8c-adb9-fbe7256a8b7d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:20:53.350Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e73e1fbf-28a7-4c8c-adb9-fbe7256a8b7d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@171ba465
2021-06-04T02:20:53.350Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e73e1fbf-28a7-4c8c-adb9-fbe7256a8b7d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:20:53.350Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e73e1fbf-28a7-4c8c-adb9-fbe7256a8b7d PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:20:56.360Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e73e1fbf-28a7-4c8c-adb9-fbe7256a8b7d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T02:20:56.360Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e73e1fbf-28a7-4c8c-adb9-fbe7256a8b7d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:20:56.360Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e73e1fbf-28a7-4c8c-adb9-fbe7256a8b7d ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:20:56.360Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e73e1fbf-28a7-4c8c-adb9-fbe7256a8b7d ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:20:59.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50eb56f5-2bdc-4acd-b482-e4864eb34f7e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:20:59.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50eb56f5-2bdc-4acd-b482-e4864eb34f7e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d978908
2021-06-04T02:20:59.280Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50eb56f5-2bdc-4acd-b482-e4864eb34f7e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:20:59.281Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50eb56f5-2bdc-4acd-b482-e4864eb34f7e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:21:02.305Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=50eb56f5-2bdc-4acd-b482-e4864eb34f7e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T02:21:02.305Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=50eb56f5-2bdc-4acd-b482-e4864eb34f7e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:21:03.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e93fafa6-766a-43a6-b021-a98cdbd7616c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:21:03.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e93fafa6-766a-43a6-b021-a98cdbd7616c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42ca0e24
2021-06-04T02:21:03.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e93fafa6-766a-43a6-b021-a98cdbd7616c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:21:03.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e93fafa6-766a-43a6-b021-a98cdbd7616c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:21:06.795Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e93fafa6-766a-43a6-b021-a98cdbd7616c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T02:21:06.796Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e93fafa6-766a-43a6-b021-a98cdbd7616c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:21:08.759Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b727263-c779-4f0d-874b-a6ae71e7fe21 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:21:08.759Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b727263-c779-4f0d-874b-a6ae71e7fe21 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@75d521db
2021-06-04T02:21:08.759Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b727263-c779-4f0d-874b-a6ae71e7fe21 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:21:08.759Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b727263-c779-4f0d-874b-a6ae71e7fe21 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:21:11.777Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2b727263-c779-4f0d-874b-a6ae71e7fe21 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T02:21:11.777Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2b727263-c779-4f0d-874b-a6ae71e7fe21 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:21:12.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:21:12.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:21:15.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:21:16.377Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d8c2026-db19-4d18-b6d7-5c6247c51c23 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:21:16.377Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d8c2026-db19-4d18-b6d7-5c6247c51c23 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a572045
2021-06-04T02:21:16.377Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d8c2026-db19-4d18-b6d7-5c6247c51c23 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:21:16.377Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d8c2026-db19-4d18-b6d7-5c6247c51c23 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:21:17.414Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:21:19.457Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=6d8c2026-db19-4d18-b6d7-5c6247c51c23 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:21:19.457Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=6d8c2026-db19-4d18-b6d7-5c6247c51c23 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:21:21.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e66f9a70-c3f1-4d76-8334-78cc13fc7700 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:21:21.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e66f9a70-c3f1-4d76-8334-78cc13fc7700 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b0a0186
2021-06-04T02:21:21.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e66f9a70-c3f1-4d76-8334-78cc13fc7700 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:21:21.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e66f9a70-c3f1-4d76-8334-78cc13fc7700 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:21:22.361Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e66f9a70-c3f1-4d76-8334-78cc13fc7700 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:21:22.361Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e66f9a70-c3f1-4d76-8334-78cc13fc7700 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:21:25.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e5d8db1-c3d3-49dd-9543-6388389a3fe3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:21:25.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e5d8db1-c3d3-49dd-9543-6388389a3fe3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@356d1b1d
2021-06-04T02:21:25.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e5d8db1-c3d3-49dd-9543-6388389a3fe3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:21:25.755Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e5d8db1-c3d3-49dd-9543-6388389a3fe3 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:21:29.746Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2325cf9-d079-432f-b54f-14ceb3dead2d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:21:29.747Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2325cf9-d079-432f-b54f-14ceb3dead2d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b14a7e8
2021-06-04T02:21:29.747Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2325cf9-d079-432f-b54f-14ceb3dead2d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:21:29.747Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2325cf9-d079-432f-b54f-14ceb3dead2d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:21:31.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df2c5192-c130-4253-a1f4-dc986667f88e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:21:31.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df2c5192-c130-4253-a1f4-dc986667f88e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50298d3d
2021-06-04T02:21:31.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df2c5192-c130-4253-a1f4-dc986667f88e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:21:31.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df2c5192-c130-4253-a1f4-dc986667f88e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:21:37.590Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ca4651d-5ab4-4a05-ab98-9d76b62c5d79 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:21:37.590Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ca4651d-5ab4-4a05-ab98-9d76b62c5d79 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2cead2c7
2021-06-04T02:21:37.590Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ca4651d-5ab4-4a05-ab98-9d76b62c5d79 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:21:37.590Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ca4651d-5ab4-4a05-ab98-9d76b62c5d79 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:21:45.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:21:45.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:21:48.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:21:50.372Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:21:52.968Z [cluster1-nio-worker-0] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ONE (timeout while waiting for repair of inconsistent replica)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.DefaultResultSetFuture.onSet(DefaultResultSetFuture.java:215)
at com.datastax.driver.core.DefaultResultSetFuture.onSet(DefaultResultSetFuture.java:242)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ONE (timeout while waiting for repair of inconsistent replica)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 24 common frames omitted
2021-06-04T02:21:52.968Z [cluster1-nio-worker-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.ConnectionException: [cassandra.onap/10.242.138.69:9042] Pool was closed during initialization
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:173)
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:158)
at com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1080)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.google.common.util.concurrent.CollectionFuture.handleAllCompleted(CollectionFuture.java:69)
at com.google.common.util.concurrent.AggregateFuture.processCompleted(AggregateFuture.java:282)
at com.google.common.util.concurrent.AggregateFuture.decrementCountAndMaybeComplete(AggregateFuture.java:264)
at com.google.common.util.concurrent.AggregateFuture.access$200(AggregateFuture.java:42)
at com.google.common.util.concurrent.AggregateFuture$1.run(AggregateFuture.java:147)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179)
at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179)
at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:100)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771)
at com.datastax.driver.core.DefaultResultSetFuture.onSet(DefaultResultSetFuture.java:215)
at com.datastax.driver.core.DefaultResultSetFuture.onSet(DefaultResultSetFuture.java:242)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:21:52.968Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6421b9f6-effb-4b91-8fe1-77b0c903f660 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:21:52.968Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6421b9f6-effb-4b91-8fe1-77b0c903f660 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@710291b4
2021-06-04T02:21:52.968Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6421b9f6-effb-4b91-8fe1-77b0c903f660 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:21:52.968Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6421b9f6-effb-4b91-8fe1-77b0c903f660 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:21:55.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b6375dc-b267-4a8b-9456-3b166bf5c8a7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:21:55.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b6375dc-b267-4a8b-9456-3b166bf5c8a7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f67539b
2021-06-04T02:21:55.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b6375dc-b267-4a8b-9456-3b166bf5c8a7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:21:55.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b6375dc-b267-4a8b-9456-3b166bf5c8a7 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:21:59.254Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=510919d6-8b6f-448d-9a89-ae7f49a0336e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:21:59.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=510919d6-8b6f-448d-9a89-ae7f49a0336e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23bb712f
2021-06-04T02:21:59.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=510919d6-8b6f-448d-9a89-ae7f49a0336e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:21:59.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=510919d6-8b6f-448d-9a89-ae7f49a0336e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:01.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f3ac54b-6679-4525-ad45-2a9d47922b0f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:01.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f3ac54b-6679-4525-ad45-2a9d47922b0f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@59bdf375
2021-06-04T02:22:01.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f3ac54b-6679-4525-ad45-2a9d47922b0f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:01.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f3ac54b-6679-4525-ad45-2a9d47922b0f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:02.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e960cf7c-7fff-46f0-909c-8627a8e22c0e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:02.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e960cf7c-7fff-46f0-909c-8627a8e22c0e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c5756c7
2021-06-04T02:22:02.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e960cf7c-7fff-46f0-909c-8627a8e22c0e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:02.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e960cf7c-7fff-46f0-909c-8627a8e22c0e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:05.184Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e960cf7c-7fff-46f0-909c-8627a8e22c0e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:22:05.185Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e960cf7c-7fff-46f0-909c-8627a8e22c0e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:22:05.185Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e960cf7c-7fff-46f0-909c-8627a8e22c0e ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:22:05.185Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e960cf7c-7fff-46f0-909c-8627a8e22c0e ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:22:08.352Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da6444fc-5f5b-4cdc-9cf0-55172ca2d196 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:08.352Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da6444fc-5f5b-4cdc-9cf0-55172ca2d196 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@39a9315d
2021-06-04T02:22:08.352Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da6444fc-5f5b-4cdc-9cf0-55172ca2d196 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:08.352Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da6444fc-5f5b-4cdc-9cf0-55172ca2d196 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:09.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:22:09.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:22:11.400Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=da6444fc-5f5b-4cdc-9cf0-55172ca2d196 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:22:11.401Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=da6444fc-5f5b-4cdc-9cf0-55172ca2d196 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:22:14.733Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:22:14.733Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:22:14.749Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:22:14.749Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:22:14.759Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T02:22:14.759Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T02:22:14.760Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T02:22:14.760Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:22:14.760Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T02:22:14.761Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:22:14.761Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:22:14.763Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:22:14.763Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:22:14.885Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:22:15.430Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:22:15.433Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:22:15.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ac2919e-267c-4c11-9a78-66308210727d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:15.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ac2919e-267c-4c11-9a78-66308210727d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@77f3785c
2021-06-04T02:22:15.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ac2919e-267c-4c11-9a78-66308210727d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:15.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ac2919e-267c-4c11-9a78-66308210727d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:15.629Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:22:15.631Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:22:15.678Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:22:15.680Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:22:15.694Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:22:15.696Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:22:15.763Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:22:15.765Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:22:15.781Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:22:15.783Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:22:16.047Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 503 Service Unavailable
2021-06-04T02:22:16.047Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 503
2021-06-04T02:22:16.048Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=503, variables=[]]
2021-06-04T02:22:16.048Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:22:16.048Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T02:22:16.048Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:22:16.048Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:22:16.054Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=7ac2919e-267c-4c11-9a78-66308210727d ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:22:16.054Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=7ac2919e-267c-4c11-9a78-66308210727d ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:22:16.163Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:22:16.164Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:22:16.184Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 503 Service Unavailable
2021-06-04T02:22:16.184Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 503
2021-06-04T02:22:16.184Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=503, variables=[]]
2021-06-04T02:22:16.204Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:22:16.206Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:22:16.230Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:22:16.231Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:22:16.262Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:22:16.264Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:22:16.323Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:22:16.325Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:22:16.338Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:22:16.340Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:22:16.359Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:22:16.360Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:22:16.370Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:22:16.371Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:22:16.385Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:22:16.386Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:22:16.402Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:22:16.402Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:22:16.410Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:22:16.411Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:22:16.421Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:22:16.422Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:22:16.430Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:22:16.431Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:22:16.437Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:22:16.438Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:22:16.451Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:22:16.452Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:22:16.458Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:22:16.459Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:22:16.466Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:22:16.467Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:22:16.474Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:22:16.475Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:22:16.494Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:22:16.496Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:22:16.504Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:22:16.504Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T02:22:16.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8eba9b94-9d72-44db-af9f-51d001a2abc0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:16.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8eba9b94-9d72-44db-af9f-51d001a2abc0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c70dad
2021-06-04T02:22:16.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8eba9b94-9d72-44db-af9f-51d001a2abc0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:16.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8eba9b94-9d72-44db-af9f-51d001a2abc0 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:16.882Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8eba9b94-9d72-44db-af9f-51d001a2abc0 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:22:16.882Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8eba9b94-9d72-44db-af9f-51d001a2abc0 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:22:17.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa53981f-5a06-4803-b79b-58ed690fc0aa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:17.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa53981f-5a06-4803-b79b-58ed690fc0aa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@581769b6
2021-06-04T02:22:17.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa53981f-5a06-4803-b79b-58ed690fc0aa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:17.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa53981f-5a06-4803-b79b-58ed690fc0aa PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:17.925Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=aa53981f-5a06-4803-b79b-58ed690fc0aa ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:22:17.925Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=aa53981f-5a06-4803-b79b-58ed690fc0aa ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:22:18.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=287fa389-558e-44b2-9cce-70b7bb5a3924 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:18.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=287fa389-558e-44b2-9cce-70b7bb5a3924 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@344adb70
2021-06-04T02:22:18.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=287fa389-558e-44b2-9cce-70b7bb5a3924 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:18.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=287fa389-558e-44b2-9cce-70b7bb5a3924 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:19.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c752175-b8c6-44c3-90c1-f9539b86c06b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:19.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c752175-b8c6-44c3-90c1-f9539b86c06b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@62402043
2021-06-04T02:22:19.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c752175-b8c6-44c3-90c1-f9539b86c06b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:19.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c752175-b8c6-44c3-90c1-f9539b86c06b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:21.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce377e72-6c81-47d4-9a89-83d543cbe1a5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:21.052Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce377e72-6c81-47d4-9a89-83d543cbe1a5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5bd3f3c3
2021-06-04T02:22:21.052Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce377e72-6c81-47d4-9a89-83d543cbe1a5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:21.052Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce377e72-6c81-47d4-9a89-83d543cbe1a5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:21.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cf2e773-421b-4cdd-9dc6-64ca50f22590 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:21.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cf2e773-421b-4cdd-9dc6-64ca50f22590 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38ea6bd6
2021-06-04T02:22:21.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cf2e773-421b-4cdd-9dc6-64ca50f22590 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:21.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cf2e773-421b-4cdd-9dc6-64ca50f22590 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:22.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5ff5902-004c-42f4-8ad7-a29819fb937f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:22.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5ff5902-004c-42f4-8ad7-a29819fb937f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a99b6e0
2021-06-04T02:22:22.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5ff5902-004c-42f4-8ad7-a29819fb937f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:22.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5ff5902-004c-42f4-8ad7-a29819fb937f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:23.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43100ace-e8e3-43fb-84f1-3b552a8b7965 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:23.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43100ace-e8e3-43fb-84f1-3b552a8b7965 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3938c7c8
2021-06-04T02:22:23.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43100ace-e8e3-43fb-84f1-3b552a8b7965 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:23.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43100ace-e8e3-43fb-84f1-3b552a8b7965 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:24.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61437b69-4508-46ea-af0c-7811cfa1b98d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:24.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61437b69-4508-46ea-af0c-7811cfa1b98d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d3176c7
2021-06-04T02:22:24.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61437b69-4508-46ea-af0c-7811cfa1b98d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:24.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61437b69-4508-46ea-af0c-7811cfa1b98d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:26.147Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=074fffde-b82c-4449-a747-3c94e6efd71e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:26.148Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=074fffde-b82c-4449-a747-3c94e6efd71e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@166e066c
2021-06-04T02:22:26.148Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=074fffde-b82c-4449-a747-3c94e6efd71e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:26.148Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=074fffde-b82c-4449-a747-3c94e6efd71e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:27.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b4212c2-4c66-45e3-975a-e381a4ad770a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:27.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b4212c2-4c66-45e3-975a-e381a4ad770a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d79cf7
2021-06-04T02:22:27.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b4212c2-4c66-45e3-975a-e381a4ad770a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:27.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b4212c2-4c66-45e3-975a-e381a4ad770a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:28.753Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce02517d-bf1d-4971-a821-554944e2cbdd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:28.753Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce02517d-bf1d-4971-a821-554944e2cbdd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7eae0d82
2021-06-04T02:22:28.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce02517d-bf1d-4971-a821-554944e2cbdd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:28.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce02517d-bf1d-4971-a821-554944e2cbdd PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:22:29.877Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:22:29.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6b58470-d715-463f-88d4-24718b7892ad PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:29.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6b58470-d715-463f-88d4-24718b7892ad PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@85fdbde
2021-06-04T02:22:29.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6b58470-d715-463f-88d4-24718b7892ad PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:29.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6b58470-d715-463f-88d4-24718b7892ad PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:31.256Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa71e5f0-03b0-4d4e-af01-3abcc2ccd40c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:31.256Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa71e5f0-03b0-4d4e-af01-3abcc2ccd40c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e64f1df
2021-06-04T02:22:31.256Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa71e5f0-03b0-4d4e-af01-3abcc2ccd40c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:31.256Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa71e5f0-03b0-4d4e-af01-3abcc2ccd40c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:32.351Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5efead0-32dc-4570-85ad-5a1359ce1fb0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:32.351Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5efead0-32dc-4570-85ad-5a1359ce1fb0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5369f8c0
2021-06-04T02:22:32.351Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5efead0-32dc-4570-85ad-5a1359ce1fb0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:32.352Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5efead0-32dc-4570-85ad-5a1359ce1fb0 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:33.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ce5317b-5d0e-4053-a3bf-3b963023d643 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:33.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ce5317b-5d0e-4053-a3bf-3b963023d643 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d253d32
2021-06-04T02:22:33.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ce5317b-5d0e-4053-a3bf-3b963023d643 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:33.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ce5317b-5d0e-4053-a3bf-3b963023d643 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:34.248Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abbec4a5-33c0-4b44-bb44-e1fd1fcb899e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:34.249Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abbec4a5-33c0-4b44-bb44-e1fd1fcb899e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2bd29c63
2021-06-04T02:22:34.249Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abbec4a5-33c0-4b44-bb44-e1fd1fcb899e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:34.249Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abbec4a5-33c0-4b44-bb44-e1fd1fcb899e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:35.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0726e514-6a28-4fa3-ae8f-9080ad795220 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:35.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0726e514-6a28-4fa3-ae8f-9080ad795220 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@62f17acf
2021-06-04T02:22:35.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0726e514-6a28-4fa3-ae8f-9080ad795220 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:35.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0726e514-6a28-4fa3-ae8f-9080ad795220 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:36.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b597294-42d4-4197-a8e6-bb64d06c4e2d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:36.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b597294-42d4-4197-a8e6-bb64d06c4e2d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ec231a9
2021-06-04T02:22:36.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b597294-42d4-4197-a8e6-bb64d06c4e2d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:36.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b597294-42d4-4197-a8e6-bb64d06c4e2d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:38.270Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=255caded-6de6-4d3e-9233-502d465f88e2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:38.270Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=255caded-6de6-4d3e-9233-502d465f88e2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a7a5fee
2021-06-04T02:22:38.270Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=255caded-6de6-4d3e-9233-502d465f88e2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:38.270Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=255caded-6de6-4d3e-9233-502d465f88e2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:22:39.453Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:22:39.453Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:22:39.653Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1f6fda8-79e7-4ff4-8220-26e7230de314 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:39.653Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1f6fda8-79e7-4ff4-8220-26e7230de314 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35f4eb46
2021-06-04T02:22:39.653Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1f6fda8-79e7-4ff4-8220-26e7230de314 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:39.653Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1f6fda8-79e7-4ff4-8220-26e7230de314 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:40.653Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f57d5da-c346-4cae-b0b1-081d2633297b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:40.653Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f57d5da-c346-4cae-b0b1-081d2633297b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5cbad835
2021-06-04T02:22:40.653Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f57d5da-c346-4cae-b0b1-081d2633297b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:40.653Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f57d5da-c346-4cae-b0b1-081d2633297b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:41.954Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3da4192b-52dc-4527-88c1-28fc72c9c671 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:41.954Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3da4192b-52dc-4527-88c1-28fc72c9c671 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@339af572
2021-06-04T02:22:41.954Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3da4192b-52dc-4527-88c1-28fc72c9c671 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:41.955Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3da4192b-52dc-4527-88c1-28fc72c9c671 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:42.956Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b82fdbe-28bc-4d1e-9fbd-3c67170fe527 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:42.956Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b82fdbe-28bc-4d1e-9fbd-3c67170fe527 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6bc749c0
2021-06-04T02:22:42.956Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b82fdbe-28bc-4d1e-9fbd-3c67170fe527 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:42.956Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b82fdbe-28bc-4d1e-9fbd-3c67170fe527 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:43.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df4bfb89-9dd8-4d91-b976-97eeede10bc8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:43.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df4bfb89-9dd8-4d91-b976-97eeede10bc8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@797b3125
2021-06-04T02:22:43.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df4bfb89-9dd8-4d91-b976-97eeede10bc8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:43.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df4bfb89-9dd8-4d91-b976-97eeede10bc8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:44.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:22:44.879Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:22:45.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0fa5a51-adac-4020-acda-c57a16fe2547 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:45.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0fa5a51-adac-4020-acda-c57a16fe2547 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@730a354f
2021-06-04T02:22:45.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0fa5a51-adac-4020-acda-c57a16fe2547 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:45.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0fa5a51-adac-4020-acda-c57a16fe2547 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:46.246Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3c57ccd-0526-4579-9b84-5e0ba913d7eb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:46.246Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3c57ccd-0526-4579-9b84-5e0ba913d7eb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@175f6f39
2021-06-04T02:22:46.246Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3c57ccd-0526-4579-9b84-5e0ba913d7eb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:46.246Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3c57ccd-0526-4579-9b84-5e0ba913d7eb PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:47.676Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d341264-68ee-440b-852e-d9d4db479ef4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:47.676Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d341264-68ee-440b-852e-d9d4db479ef4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4687ad5b
2021-06-04T02:22:47.676Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d341264-68ee-440b-852e-d9d4db479ef4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:47.676Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d341264-68ee-440b-852e-d9d4db479ef4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:49.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d753b809-a1f9-4f22-806a-e236e4db4e7c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:49.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d753b809-a1f9-4f22-806a-e236e4db4e7c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@66d54eb7
2021-06-04T02:22:49.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d753b809-a1f9-4f22-806a-e236e4db4e7c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:49.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d753b809-a1f9-4f22-806a-e236e4db4e7c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:50.175Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bedb548-b1e6-466d-90f3-099b423f605f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:50.175Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bedb548-b1e6-466d-90f3-099b423f605f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4457bf6f
2021-06-04T02:22:50.175Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bedb548-b1e6-466d-90f3-099b423f605f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:50.175Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bedb548-b1e6-466d-90f3-099b423f605f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:51.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01511f4c-cc8e-4376-adee-08017d6f0b7f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:51.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01511f4c-cc8e-4376-adee-08017d6f0b7f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@289d267b
2021-06-04T02:22:51.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01511f4c-cc8e-4376-adee-08017d6f0b7f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:51.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01511f4c-cc8e-4376-adee-08017d6f0b7f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:52.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3514350d-afb9-4a75-a4f7-68ca9bb398f6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:52.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3514350d-afb9-4a75-a4f7-68ca9bb398f6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@530bbb46
2021-06-04T02:22:52.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3514350d-afb9-4a75-a4f7-68ca9bb398f6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:52.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3514350d-afb9-4a75-a4f7-68ca9bb398f6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:53.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef08db07-ff2a-491f-a38e-d0f2163c1adf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:53.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef08db07-ff2a-491f-a38e-d0f2163c1adf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1fe7e766
2021-06-04T02:22:53.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef08db07-ff2a-491f-a38e-d0f2163c1adf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:53.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef08db07-ff2a-491f-a38e-d0f2163c1adf PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:54.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a65c4e3e-208a-4dc2-832b-aefdb3973267 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:54.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a65c4e3e-208a-4dc2-832b-aefdb3973267 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@66328f32
2021-06-04T02:22:54.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a65c4e3e-208a-4dc2-832b-aefdb3973267 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:54.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a65c4e3e-208a-4dc2-832b-aefdb3973267 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:55.097Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T02:22:55.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81f005ab-6416-41fd-bcda-0df37b9b2b97 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:55.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81f005ab-6416-41fd-bcda-0df37b9b2b97 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@275dd371
2021-06-04T02:22:55.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81f005ab-6416-41fd-bcda-0df37b9b2b97 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:55.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81f005ab-6416-41fd-bcda-0df37b9b2b97 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:56.248Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=655f0d1d-b419-46f8-9fd3-dc18a2a76fdc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:56.248Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=655f0d1d-b419-46f8-9fd3-dc18a2a76fdc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29829d57
2021-06-04T02:22:56.248Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=655f0d1d-b419-46f8-9fd3-dc18a2a76fdc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:56.248Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=655f0d1d-b419-46f8-9fd3-dc18a2a76fdc PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:57.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=008460e2-17d3-4c37-b253-c0fc68e418f9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:57.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=008460e2-17d3-4c37-b253-c0fc68e418f9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@97e83d6
2021-06-04T02:22:57.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=008460e2-17d3-4c37-b253-c0fc68e418f9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:57.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=008460e2-17d3-4c37-b253-c0fc68e418f9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:58.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=909d4312-cbf6-4f88-b636-fe2ab5b8b417 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:22:58.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=909d4312-cbf6-4f88-b636-fe2ab5b8b417 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7bc7c6d4
2021-06-04T02:22:58.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=909d4312-cbf6-4f88-b636-fe2ab5b8b417 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:22:58.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=909d4312-cbf6-4f88-b636-fe2ab5b8b417 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:22:59.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:22:59.875Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:23:00.179Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ef27eab-92d0-4e6a-afe6-3e9c3d39e65c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:23:00.179Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ef27eab-92d0-4e6a-afe6-3e9c3d39e65c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@32485486
2021-06-04T02:23:00.179Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ef27eab-92d0-4e6a-afe6-3e9c3d39e65c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:23:00.179Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ef27eab-92d0-4e6a-afe6-3e9c3d39e65c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:23:01.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db43b0b0-71f4-460e-9add-df43790cf8be PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:23:01.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db43b0b0-71f4-460e-9add-df43790cf8be PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@f9d1fbd
2021-06-04T02:23:01.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db43b0b0-71f4-460e-9add-df43790cf8be PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:23:01.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db43b0b0-71f4-460e-9add-df43790cf8be PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:23:02.773Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25369e4b-a919-4287-8ee3-82992eb445ef PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:23:02.773Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25369e4b-a919-4287-8ee3-82992eb445ef PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@72805dab
2021-06-04T02:23:02.773Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25369e4b-a919-4287-8ee3-82992eb445ef PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:23:02.773Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25369e4b-a919-4287-8ee3-82992eb445ef PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:23:03.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ab2736b-ea85-4ba9-9ebb-045e92de5478 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:23:03.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ab2736b-ea85-4ba9-9ebb-045e92de5478 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3734d449
2021-06-04T02:23:03.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ab2736b-ea85-4ba9-9ebb-045e92de5478 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:23:03.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ab2736b-ea85-4ba9-9ebb-045e92de5478 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:23:04.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dde875b6-bc16-4896-95d8-a9d6aa18a3eb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:23:04.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dde875b6-bc16-4896-95d8-a9d6aa18a3eb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47a84a4d
2021-06-04T02:23:04.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dde875b6-bc16-4896-95d8-a9d6aa18a3eb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:23:04.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dde875b6-bc16-4896-95d8-a9d6aa18a3eb PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:23:05.877Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=885a674d-6845-4cea-b441-6f383a3cd510 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:23:05.877Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=885a674d-6845-4cea-b441-6f383a3cd510 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20afc5f2
2021-06-04T02:23:05.877Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=885a674d-6845-4cea-b441-6f383a3cd510 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:23:05.877Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=885a674d-6845-4cea-b441-6f383a3cd510 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:23:07.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1772be0a-560e-46ed-a08c-1bbc5bbfdabe PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:23:07.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1772be0a-560e-46ed-a08c-1bbc5bbfdabe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5032b949
2021-06-04T02:23:07.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1772be0a-560e-46ed-a08c-1bbc5bbfdabe PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:23:07.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1772be0a-560e-46ed-a08c-1bbc5bbfdabe PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:23:08.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9dbc46a3-eb6c-47b1-bb63-c85249116704 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:23:08.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9dbc46a3-eb6c-47b1-bb63-c85249116704 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41b5b99a
2021-06-04T02:23:08.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9dbc46a3-eb6c-47b1-bb63-c85249116704 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:23:08.470Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9dbc46a3-eb6c-47b1-bb63-c85249116704 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:23:09.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c82ec427-0dd2-46a0-a04c-1ed56a602c43 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:23:09.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c82ec427-0dd2-46a0-a04c-1ed56a602c43 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@44ca69c3
2021-06-04T02:23:09.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c82ec427-0dd2-46a0-a04c-1ed56a602c43 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:23:09.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c82ec427-0dd2-46a0-a04c-1ed56a602c43 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:23:12.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12a767bc-1b90-4efa-b60a-bb487baa51c1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:23:12.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12a767bc-1b90-4efa-b60a-bb487baa51c1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a94a4fd
2021-06-04T02:23:12.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12a767bc-1b90-4efa-b60a-bb487baa51c1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:23:12.384Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12a767bc-1b90-4efa-b60a-bb487baa51c1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:23:14.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:23:16.277Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4cd50f3-915a-4a7d-8d0b-4f59512d3268 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:23:16.278Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4cd50f3-915a-4a7d-8d0b-4f59512d3268 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5fa9ae17
2021-06-04T02:23:16.278Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4cd50f3-915a-4a7d-8d0b-4f59512d3268 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:23:16.278Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4cd50f3-915a-4a7d-8d0b-4f59512d3268 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:23:16.542Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:23:18.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:23:18.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:23:19.282Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a4cd50f3-915a-4a7d-8d0b-4f59512d3268 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:23:19.282Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a4cd50f3-915a-4a7d-8d0b-4f59512d3268 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:23:19.282Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a4cd50f3-915a-4a7d-8d0b-4f59512d3268 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:23:19.283Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a4cd50f3-915a-4a7d-8d0b-4f59512d3268 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:23:20.876Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:23:21.069Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5a88a2e-6191-4cbe-8471-01bc160de151 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:23:21.069Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5a88a2e-6191-4cbe-8471-01bc160de151 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@333ca511
2021-06-04T02:23:21.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5a88a2e-6191-4cbe-8471-01bc160de151 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:23:21.070Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5a88a2e-6191-4cbe-8471-01bc160de151 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:23:21.570Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e5a88a2e-6191-4cbe-8471-01bc160de151 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:23:21.570Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=e5a88a2e-6191-4cbe-8471-01bc160de151 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:23:22.751Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f145cf6a-ff29-46f2-9f9d-1737bba3a174 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:23:22.751Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f145cf6a-ff29-46f2-9f9d-1737bba3a174 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b23bdf0
2021-06-04T02:23:22.751Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f145cf6a-ff29-46f2-9f9d-1737bba3a174 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:23:22.751Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f145cf6a-ff29-46f2-9f9d-1737bba3a174 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:23:23.871Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f145cf6a-ff29-46f2-9f9d-1737bba3a174 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:23:23.871Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f145cf6a-ff29-46f2-9f9d-1737bba3a174 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:23:25.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d53e007-2b2e-4655-bf35-79a84632992e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:23:25.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d53e007-2b2e-4655-bf35-79a84632992e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9687195
2021-06-04T02:23:25.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d53e007-2b2e-4655-bf35-79a84632992e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:23:25.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d53e007-2b2e-4655-bf35-79a84632992e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:23:28.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56d62ba4-17a8-4ba4-8487-a319dc17b4d1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:23:28.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56d62ba4-17a8-4ba4-8487-a319dc17b4d1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5faa5984
2021-06-04T02:23:28.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56d62ba4-17a8-4ba4-8487-a319dc17b4d1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:23:28.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56d62ba4-17a8-4ba4-8487-a319dc17b4d1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:23:29.870Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:23:29.935Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:23:30.379Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fc48951-3033-4ce4-a249-0986f18ab198 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:23:30.380Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fc48951-3033-4ce4-a249-0986f18ab198 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1edbdc3
2021-06-04T02:23:30.380Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fc48951-3033-4ce4-a249-0986f18ab198 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:23:30.380Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fc48951-3033-4ce4-a249-0986f18ab198 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:23:36.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=823517bf-3c67-4602-97d9-fe3381d23fde PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:23:36.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=823517bf-3c67-4602-97d9-fe3381d23fde PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7275c33
2021-06-04T02:23:36.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=823517bf-3c67-4602-97d9-fe3381d23fde PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:23:36.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=823517bf-3c67-4602-97d9-fe3381d23fde PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:23:38.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c259d5fd-35c2-4405-bc06-2890cd8b7be6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:23:38.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c259d5fd-35c2-4405-bc06-2890cd8b7be6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4d09719b
2021-06-04T02:23:38.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c259d5fd-35c2-4405-bc06-2890cd8b7be6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:23:38.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c259d5fd-35c2-4405-bc06-2890cd8b7be6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:23:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:23:39.453Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:23:39.453Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:23:39.762Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe5c24c7-f46e-45c8-95d5-48967403e1d0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:23:39.762Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe5c24c7-f46e-45c8-95d5-48967403e1d0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@406267c7
2021-06-04T02:23:39.762Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe5c24c7-f46e-45c8-95d5-48967403e1d0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:23:39.762Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe5c24c7-f46e-45c8-95d5-48967403e1d0 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:23:42.355Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acfd1762-9138-4620-966c-bce82239e3a9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:23:42.355Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acfd1762-9138-4620-966c-bce82239e3a9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c8dc9ad
2021-06-04T02:23:42.355Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acfd1762-9138-4620-966c-bce82239e3a9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:23:42.355Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acfd1762-9138-4620-966c-bce82239e3a9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:23:44.870Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:23:45.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96127d2d-43f5-4580-b561-0c7ff4c62d72 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:23:45.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96127d2d-43f5-4580-b561-0c7ff4c62d72 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@11f6decb
2021-06-04T02:23:45.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96127d2d-43f5-4580-b561-0c7ff4c62d72 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:23:45.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96127d2d-43f5-4580-b561-0c7ff4c62d72 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:23:49.350Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2044ab33-cda4-4454-ae0b-ca7c9ef07e99 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:23:49.350Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2044ab33-cda4-4454-ae0b-ca7c9ef07e99 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1775f0c7
2021-06-04T02:23:49.350Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2044ab33-cda4-4454-ae0b-ca7c9ef07e99 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:23:49.350Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2044ab33-cda4-4454-ae0b-ca7c9ef07e99 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:23:52.357Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2044ab33-cda4-4454-ae0b-ca7c9ef07e99 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:23:52.358Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2044ab33-cda4-4454-ae0b-ca7c9ef07e99 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:23:52.358Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=2044ab33-cda4-4454-ae0b-ca7c9ef07e99 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:23:52.358Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=2044ab33-cda4-4454-ae0b-ca7c9ef07e99 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:23:52.867Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T02:23:53.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbeee08a-cdf1-4434-a49f-36558b168429 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:23:53.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbeee08a-cdf1-4434-a49f-36558b168429 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@447af1b1
2021-06-04T02:23:53.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbeee08a-cdf1-4434-a49f-36558b168429 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:23:53.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbeee08a-cdf1-4434-a49f-36558b168429 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:23:53.921Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fbeee08a-cdf1-4434-a49f-36558b168429 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:23:53.921Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fbeee08a-cdf1-4434-a49f-36558b168429 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:23:56.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf592a49-8e1d-40b0-af42-694cd7e11f0b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:23:56.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf592a49-8e1d-40b0-af42-694cd7e11f0b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@21df0eb0
2021-06-04T02:23:56.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf592a49-8e1d-40b0-af42-694cd7e11f0b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:23:56.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf592a49-8e1d-40b0-af42-694cd7e11f0b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:23:58.374Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=bf592a49-8e1d-40b0-af42-694cd7e11f0b ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:23:58.374Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=bf592a49-8e1d-40b0-af42-694cd7e11f0b ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:23:59.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec581d98-3f9a-42f1-a493-77fd811d114f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:23:59.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec581d98-3f9a-42f1-a493-77fd811d114f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@19943184
2021-06-04T02:23:59.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec581d98-3f9a-42f1-a493-77fd811d114f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:23:59.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec581d98-3f9a-42f1-a493-77fd811d114f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:24:00.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=caa23b29-c40b-4065-91d9-df79ec5f7def PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:24:00.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=caa23b29-c40b-4065-91d9-df79ec5f7def PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@af0ac7e
2021-06-04T02:24:00.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=caa23b29-c40b-4065-91d9-df79ec5f7def PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:24:00.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=caa23b29-c40b-4065-91d9-df79ec5f7def PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:24:04.253Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5606a23e-31ee-450b-bd87-322717e5bf07 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:24:04.253Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5606a23e-31ee-450b-bd87-322717e5bf07 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@480b1c1a
2021-06-04T02:24:04.253Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5606a23e-31ee-450b-bd87-322717e5bf07 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:24:04.253Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5606a23e-31ee-450b-bd87-322717e5bf07 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:24:08.566Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9213228a-b628-4223-b427-2dcf40d5eef3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:24:08.566Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9213228a-b628-4223-b427-2dcf40d5eef3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@11783125
2021-06-04T02:24:08.566Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9213228a-b628-4223-b427-2dcf40d5eef3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:24:08.566Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9213228a-b628-4223-b427-2dcf40d5eef3 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:24:10.690Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47cd4a86-ad29-4e95-8ae9-c6af73bf719f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:24:10.690Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47cd4a86-ad29-4e95-8ae9-c6af73bf719f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29582a9f
2021-06-04T02:24:10.690Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47cd4a86-ad29-4e95-8ae9-c6af73bf719f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:24:10.690Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47cd4a86-ad29-4e95-8ae9-c6af73bf719f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:24:14.169Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30a072d4-5ed4-418f-b1ef-9aceca62d7fa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:24:14.169Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30a072d4-5ed4-418f-b1ef-9aceca62d7fa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2644f096
2021-06-04T02:24:14.169Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30a072d4-5ed4-418f-b1ef-9aceca62d7fa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:24:14.169Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30a072d4-5ed4-418f-b1ef-9aceca62d7fa PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:24:24.361Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1b398ad-cba0-4509-b5a4-554d76ab6fa8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:24:24.361Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1b398ad-cba0-4509-b5a4-554d76ab6fa8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@36bfd388
2021-06-04T02:24:24.361Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1b398ad-cba0-4509-b5a4-554d76ab6fa8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:24:24.361Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1b398ad-cba0-4509-b5a4-554d76ab6fa8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:24:25.777Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b17b3370-0cb9-4068-ae7a-107c79dc34e3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:24:25.777Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b17b3370-0cb9-4068-ae7a-107c79dc34e3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@661e3d63
2021-06-04T02:24:25.777Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b17b3370-0cb9-4068-ae7a-107c79dc34e3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:24:25.777Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b17b3370-0cb9-4068-ae7a-107c79dc34e3 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:24:27.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e67ac797-d5df-4e90-9153-dbc822724bb6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:24:27.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e67ac797-d5df-4e90-9153-dbc822724bb6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e7aefed
2021-06-04T02:24:27.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e67ac797-d5df-4e90-9153-dbc822724bb6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:24:27.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e67ac797-d5df-4e90-9153-dbc822724bb6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:24:30.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d936b589-b2ef-4039-ad68-162f15e42bc7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:24:30.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d936b589-b2ef-4039-ad68-162f15e42bc7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@fbb6ef4
2021-06-04T02:24:30.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d936b589-b2ef-4039-ad68-162f15e42bc7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:24:30.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d936b589-b2ef-4039-ad68-162f15e42bc7 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:24:32.275Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0052c7cf-c6ca-4466-9392-9b3e5e79b392 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:24:32.275Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0052c7cf-c6ca-4466-9392-9b3e5e79b392 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4750df18
2021-06-04T02:24:32.275Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0052c7cf-c6ca-4466-9392-9b3e5e79b392 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:24:32.275Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0052c7cf-c6ca-4466-9392-9b3e5e79b392 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:24:34.712Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:24:34.714Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:24:34.732Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 503 Service Unavailable
2021-06-04T02:24:34.732Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 503
2021-06-04T02:24:34.733Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=503, variables=[]]
2021-06-04T02:24:35.280Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0052c7cf-c6ca-4466-9392-9b3e5e79b392 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:24:35.280Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0052c7cf-c6ca-4466-9392-9b3e5e79b392 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:24:35.280Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0052c7cf-c6ca-4466-9392-9b3e5e79b392 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:24:35.280Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0052c7cf-c6ca-4466-9392-9b3e5e79b392 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:24:37.254Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=522963a6-f3ab-46c4-8a30-f1a527f48a77 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:24:37.254Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=522963a6-f3ab-46c4-8a30-f1a527f48a77 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@503217b4
2021-06-04T02:24:37.254Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=522963a6-f3ab-46c4-8a30-f1a527f48a77 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:24:37.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=522963a6-f3ab-46c4-8a30-f1a527f48a77 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:24:38.956Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=522963a6-f3ab-46c4-8a30-f1a527f48a77 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:24:38.956Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=522963a6-f3ab-46c4-8a30-f1a527f48a77 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:24:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:24:39.452Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T02:24:39.453Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:24:39.453Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:24:39.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f034c3b5-ff76-4d04-86f9-334cef96ec27 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:24:39.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f034c3b5-ff76-4d04-86f9-334cef96ec27 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5df68cdf
2021-06-04T02:24:39.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f034c3b5-ff76-4d04-86f9-334cef96ec27 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:24:39.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f034c3b5-ff76-4d04-86f9-334cef96ec27 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:24:40.245Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:24:40.246Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:24:40.958Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8da45afe-3a68-4165-880d-3f0f46b7b56c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:24:40.958Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8da45afe-3a68-4165-880d-3f0f46b7b56c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c1f3066
2021-06-04T02:24:40.958Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8da45afe-3a68-4165-880d-3f0f46b7b56c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:24:40.958Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8da45afe-3a68-4165-880d-3f0f46b7b56c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:24:41.910Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa68a9d5-1c95-4fe6-b3f6-9b0ab029b573 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:24:41.910Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa68a9d5-1c95-4fe6-b3f6-9b0ab029b573 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c500be6
2021-06-04T02:24:41.910Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa68a9d5-1c95-4fe6-b3f6-9b0ab029b573 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:24:41.910Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa68a9d5-1c95-4fe6-b3f6-9b0ab029b573 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:24:42.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f1e0b33-5d9f-409b-8ab7-a96000b3c198 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:24:42.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f1e0b33-5d9f-409b-8ab7-a96000b3c198 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@21bd5feb
2021-06-04T02:24:42.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f1e0b33-5d9f-409b-8ab7-a96000b3c198 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:24:42.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f1e0b33-5d9f-409b-8ab7-a96000b3c198 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:24:45.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:24:45.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:24:48.270Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:24:51.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:24:54.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:24:57.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:25:00.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:25:03.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:25:04.957Z [cluster1-timeouter-0] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.138.69:9042] Operation timed out
at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:25:04.957Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=349f74b1-5938-4b81-b852-bebefae1a18b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:25:04.957Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=349f74b1-5938-4b81-b852-bebefae1a18b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@48c4bf77
2021-06-04T02:25:04.957Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=349f74b1-5938-4b81-b852-bebefae1a18b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:25:04.957Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=349f74b1-5938-4b81-b852-bebefae1a18b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:25:06.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:25:07.964Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=349f74b1-5938-4b81-b852-bebefae1a18b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:25:07.964Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=349f74b1-5938-4b81-b852-bebefae1a18b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:25:07.964Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=349f74b1-5938-4b81-b852-bebefae1a18b ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:25:07.964Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=349f74b1-5938-4b81-b852-bebefae1a18b ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:25:09.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b4d8c4c-8b5e-4a29-a63c-1e55b3dd8377 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:25:09.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b4d8c4c-8b5e-4a29-a63c-1e55b3dd8377 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2dbd3a09
2021-06-04T02:25:09.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b4d8c4c-8b5e-4a29-a63c-1e55b3dd8377 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:25:09.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b4d8c4c-8b5e-4a29-a63c-1e55b3dd8377 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:25:09.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:25:12.221Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8b4d8c4c-8b5e-4a29-a63c-1e55b3dd8377 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:25:12.221Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8b4d8c4c-8b5e-4a29-a63c-1e55b3dd8377 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:25:12.221Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8b4d8c4c-8b5e-4a29-a63c-1e55b3dd8377 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:25:12.222Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=8b4d8c4c-8b5e-4a29-a63c-1e55b3dd8377 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:25:12.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:25:12.380Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d86a64d-c205-4048-a36d-025cc8affb65 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:25:12.380Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d86a64d-c205-4048-a36d-025cc8affb65 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a6740b2
2021-06-04T02:25:12.380Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d86a64d-c205-4048-a36d-025cc8affb65 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:25:12.380Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d86a64d-c205-4048-a36d-025cc8affb65 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:25:15.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:25:15.436Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=9d86a64d-c205-4048-a36d-025cc8affb65 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:25:15.436Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=9d86a64d-c205-4048-a36d-025cc8affb65 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:25:15.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65d34ae3-8f2a-4465-b8ee-41254f70d40a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:25:15.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65d34ae3-8f2a-4465-b8ee-41254f70d40a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@131c7a03
2021-06-04T02:25:15.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65d34ae3-8f2a-4465-b8ee-41254f70d40a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:25:15.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65d34ae3-8f2a-4465-b8ee-41254f70d40a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:25:18.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:25:19.023Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=65d34ae3-8f2a-4465-b8ee-41254f70d40a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:25:19.023Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=65d34ae3-8f2a-4465-b8ee-41254f70d40a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:25:19.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a06956a-23c5-41af-86a8-5a4a16fcbfc5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:25:19.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a06956a-23c5-41af-86a8-5a4a16fcbfc5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@124a6e27
2021-06-04T02:25:19.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a06956a-23c5-41af-86a8-5a4a16fcbfc5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:25:19.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a06956a-23c5-41af-86a8-5a4a16fcbfc5 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:25:21.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:25:22.581Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8a06956a-23c5-41af-86a8-5a4a16fcbfc5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:25:22.582Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8a06956a-23c5-41af-86a8-5a4a16fcbfc5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:25:22.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c319203d-c051-40d0-959f-a27513e070cb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:25:22.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c319203d-c051-40d0-959f-a27513e070cb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ec30951
2021-06-04T02:25:22.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c319203d-c051-40d0-959f-a27513e070cb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:25:22.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c319203d-c051-40d0-959f-a27513e070cb PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:25:23.634Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:25:25.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a406685d-f4d9-461b-843f-ae390ecb149b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:25:25.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a406685d-f4d9-461b-843f-ae390ecb149b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@bb5e8ff
2021-06-04T02:25:25.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a406685d-f4d9-461b-843f-ae390ecb149b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:25:25.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a406685d-f4d9-461b-843f-ae390ecb149b PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:25:25.519Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a406685d-f4d9-461b-843f-ae390ecb149b ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:25:25.520Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a406685d-f4d9-461b-843f-ae390ecb149b ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:25:26.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad6cab23-f0f8-4f64-8ea7-f21f9b446984 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:25:26.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad6cab23-f0f8-4f64-8ea7-f21f9b446984 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@180e0334
2021-06-04T02:25:26.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad6cab23-f0f8-4f64-8ea7-f21f9b446984 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:25:26.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad6cab23-f0f8-4f64-8ea7-f21f9b446984 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:25:27.171Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3aab8e6b-73d7-4415-b246-a742ba7f0e24 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:25:27.171Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3aab8e6b-73d7-4415-b246-a742ba7f0e24 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e0108e5
2021-06-04T02:25:27.171Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3aab8e6b-73d7-4415-b246-a742ba7f0e24 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:25:27.171Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3aab8e6b-73d7-4415-b246-a742ba7f0e24 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:25:27.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc445d4e-e86a-4b77-81f4-456eec8aca98 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:25:27.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc445d4e-e86a-4b77-81f4-456eec8aca98 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@289e86c6
2021-06-04T02:25:27.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc445d4e-e86a-4b77-81f4-456eec8aca98 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:25:27.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc445d4e-e86a-4b77-81f4-456eec8aca98 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:25:29.177Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a2afcae-34ad-4d9f-9870-63a6ed86b362 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:25:29.177Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a2afcae-34ad-4d9f-9870-63a6ed86b362 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@cc8713a
2021-06-04T02:25:29.177Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a2afcae-34ad-4d9f-9870-63a6ed86b362 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:25:29.177Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a2afcae-34ad-4d9f-9870-63a6ed86b362 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:25:30.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58725a67-5c41-45b0-8493-c020f7ddf4ce PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:25:30.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58725a67-5c41-45b0-8493-c020f7ddf4ce PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@64b7c434
2021-06-04T02:25:30.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58725a67-5c41-45b0-8493-c020f7ddf4ce PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:25:30.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58725a67-5c41-45b0-8493-c020f7ddf4ce PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:25:30.840Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://message-router.onap:3904: The target server failed to respond
2021-06-04T02:25:30.840Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:25:30.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a414bef9-2172-44a5-95bf-cb907a1f3482 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:25:30.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a414bef9-2172-44a5-95bf-cb907a1f3482 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7267ae67
2021-06-04T02:25:30.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a414bef9-2172-44a5-95bf-cb907a1f3482 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:25:30.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a414bef9-2172-44a5-95bf-cb907a1f3482 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:25:31.391Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=492b7464-503c-470c-83c5-b9ecb5e55cb2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:25:31.391Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=492b7464-503c-470c-83c5-b9ecb5e55cb2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e93ae5b
2021-06-04T02:25:31.391Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=492b7464-503c-470c-83c5-b9ecb5e55cb2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:25:31.391Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=492b7464-503c-470c-83c5-b9ecb5e55cb2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:25:31.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccf9cd00-596e-4cf1-9328-b4975035dcad PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:25:31.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccf9cd00-596e-4cf1-9328-b4975035dcad PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@619d5b12
2021-06-04T02:25:31.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccf9cd00-596e-4cf1-9328-b4975035dcad PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:25:31.880Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccf9cd00-596e-4cf1-9328-b4975035dcad PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:25:32.209Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17cd539a-1dd5-40a9-aeda-71deb465be5a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:25:32.209Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17cd539a-1dd5-40a9-aeda-71deb465be5a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3bd1b571
2021-06-04T02:25:32.209Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17cd539a-1dd5-40a9-aeda-71deb465be5a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:25:32.209Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17cd539a-1dd5-40a9-aeda-71deb465be5a PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:25:33.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdfa793b-f59f-453d-a6bc-398a41aa5c92 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:25:33.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdfa793b-f59f-453d-a6bc-398a41aa5c92 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@740a30fa
2021-06-04T02:25:33.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdfa793b-f59f-453d-a6bc-398a41aa5c92 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:25:33.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdfa793b-f59f-453d-a6bc-398a41aa5c92 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:25:36.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=408ab1f5-cf92-46ee-94fa-0f6a2e5b220e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:25:36.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=408ab1f5-cf92-46ee-94fa-0f6a2e5b220e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47d8b956
2021-06-04T02:25:36.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=408ab1f5-cf92-46ee-94fa-0f6a2e5b220e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:25:36.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=408ab1f5-cf92-46ee-94fa-0f6a2e5b220e PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:25:39.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83e0ecf1-42f3-475b-9e6c-1b0613eef773 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:25:39.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83e0ecf1-42f3-475b-9e6c-1b0613eef773 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c962f74
2021-06-04T02:25:39.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83e0ecf1-42f3-475b-9e6c-1b0613eef773 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:25:39.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83e0ecf1-42f3-475b-9e6c-1b0613eef773 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:25:42.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75434474-9d3a-441f-9a1d-eb441a4df1be PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:25:42.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75434474-9d3a-441f-9a1d-eb441a4df1be PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a5a71aa
2021-06-04T02:25:42.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75434474-9d3a-441f-9a1d-eb441a4df1be PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:25:42.049Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75434474-9d3a-441f-9a1d-eb441a4df1be PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:25:45.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8cfee9b-a195-41ae-a2ca-378cdcc61cb9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:25:45.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8cfee9b-a195-41ae-a2ca-378cdcc61cb9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f7213fb
2021-06-04T02:25:45.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8cfee9b-a195-41ae-a2ca-378cdcc61cb9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:25:45.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8cfee9b-a195-41ae-a2ca-378cdcc61cb9 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:25:46.479Z [JanusGraph Cluster-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host /10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T02:25:46.480Z [JanusGraph Cluster-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to /10.242.138.69:9042, scheduling retry in 4000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:25:46.550Z [cluster1-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T02:25:46.551Z [cluster1-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 4000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:25:48.477Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23c6cbf5-be37-474a-9107-87930cead9a6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:25:48.477Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23c6cbf5-be37-474a-9107-87930cead9a6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d62134a
2021-06-04T02:25:48.477Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23c6cbf5-be37-474a-9107-87930cead9a6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:25:48.477Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23c6cbf5-be37-474a-9107-87930cead9a6 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:25:51.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f14441a4-f2e8-41d9-9d85-0925ae4b46ce PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:25:51.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f14441a4-f2e8-41d9-9d85-0925ae4b46ce PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20f26a1d
2021-06-04T02:25:51.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f14441a4-f2e8-41d9-9d85-0925ae4b46ce PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:25:51.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f14441a4-f2e8-41d9-9d85-0925ae4b46ce PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:25:54.423Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a56f96f5-155c-41b0-af80-bf091a07ed50 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:25:54.424Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a56f96f5-155c-41b0-af80-bf091a07ed50 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@98c8888
2021-06-04T02:25:54.424Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a56f96f5-155c-41b0-af80-bf091a07ed50 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:25:54.425Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a56f96f5-155c-41b0-af80-bf091a07ed50 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:25:54.428Z [BE-Health-Check-Task] INFO o.a.http.impl.execchain.RetryExec RequestID=a56f96f5-155c-41b0-af80-bf091a07ed50 PartnerName=SDC.BE I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {s}->https://sdc-onboarding-be.onap:8445: The target server failed to respond
2021-06-04T02:25:54.428Z [BE-Health-Check-Task] INFO o.a.http.impl.execchain.RetryExec RequestID=a56f96f5-155c-41b0-af80-bf091a07ed50 PartnerName=SDC.BE Retrying request to {s}->https://sdc-onboarding-be.onap:8445
2021-06-04T02:25:54.432Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a56f96f5-155c-41b0-af80-bf091a07ed50 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T02:25:54.433Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a56f96f5-155c-41b0-af80-bf091a07ed50 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:25:56.573Z [JanusGraph Cluster-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host /10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T02:25:56.575Z [JanusGraph Cluster-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to /10.242.138.69:9042, scheduling retry in 8000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:25:56.580Z [cluster2-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T02:25:56.580Z [cluster2-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 30000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:25:56.952Z [cluster1-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-06-04T02:25:56.953Z [cluster1-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.138.69:9042, scheduling retry in 8000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.138.69:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$9.apply(Connection.java:518)
at com.datastax.driver.core.Connection$9.apply(Connection.java:480)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:25:57.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=719fe6ba-4eac-4324-a8e9-f545b6d39744 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:25:57.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=719fe6ba-4eac-4324-a8e9-f545b6d39744 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b1b1c45
2021-06-04T02:25:57.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=719fe6ba-4eac-4324-a8e9-f545b6d39744 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:25:57.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=719fe6ba-4eac-4324-a8e9-f545b6d39744 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:25:57.578Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=719fe6ba-4eac-4324-a8e9-f545b6d39744 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
2021-06-04T02:25:57.578Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=719fe6ba-4eac-4324-a8e9-f545b6d39744 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:26:01.447Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67345b36-0fb6-49b9-9a8d-9f53bf8ed031 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:26:01.447Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67345b36-0fb6-49b9-9a8d-9f53bf8ed031 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@552f3ae8
2021-06-04T02:26:01.447Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67345b36-0fb6-49b9-9a8d-9f53bf8ed031 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:26:01.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67345b36-0fb6-49b9-9a8d-9f53bf8ed031 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:26:04.461Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=67345b36-0fb6-49b9-9a8d-9f53bf8ed031 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T02:26:04.461Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=67345b36-0fb6-49b9-9a8d-9f53bf8ed031 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:26:05.524Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7a70988-9c56-48c9-aa29-288955e4d323 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:26:05.524Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7a70988-9c56-48c9-aa29-288955e4d323 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35e4449b
2021-06-04T02:26:05.524Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7a70988-9c56-48c9-aa29-288955e4d323 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:26:05.524Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7a70988-9c56-48c9-aa29-288955e4d323 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:26:08.538Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e7a70988-9c56-48c9-aa29-288955e4d323 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T02:26:08.538Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e7a70988-9c56-48c9-aa29-288955e4d323 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:26:09.275Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71cda8a3-6e8f-4736-8a0e-48380d6c6f64 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:26:09.275Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71cda8a3-6e8f-4736-8a0e-48380d6c6f64 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@70bed974
2021-06-04T02:26:09.275Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71cda8a3-6e8f-4736-8a0e-48380d6c6f64 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:26:09.275Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71cda8a3-6e8f-4736-8a0e-48380d6c6f64 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:26:10.684Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:26:10.684Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:26:10.706Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:26:10.706Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:26:10.719Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:26:10.719Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:26:10.721Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T02:26:10.724Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:26:10.724Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:26:10.725Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:26:10.727Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:26:10.728Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:26:10.729Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. message-router.onap:3904 failed to respond; blacklisting for 2 minutes
2021-06-04T02:26:10.729Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T02:26:10.729Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T02:26:10.729Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:26:10.729Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T02:26:10.730Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:26:10.730Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:26:10.733Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:26:10.733Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:26:10.734Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:26:10.734Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:26:10.734Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:26:10.734Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:26:10.736Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:26:10.736Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:26:10.737Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T02:26:10.738Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:26:10.738Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:26:10.739Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:26:10.741Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T02:26:10.741Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:26:10.741Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:26:10.741Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T02:26:10.741Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T02:26:10.745Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:26:10.745Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:26:10.748Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:26:10.748Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:26:10.751Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T02:26:10.753Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:26:10.761Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:26:10.761Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:26:10.765Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:26:10.765Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:26:10.769Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:26:10.769Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:26:10.772Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T02:26:10.774Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:26:10.790Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:26:10.791Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:26:10.794Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:26:10.794Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:26:10.796Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:26:10.796Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:26:11.291Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:26:11.292Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:26:11.511Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:26:11.512Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:26:11.526Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:26:11.527Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:26:11.583Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:26:11.584Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:26:11.627Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:26:11.628Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:26:11.646Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:26:11.648Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:26:11.684Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:26:11.688Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:26:11.712Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:26:11.713Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:26:11.718Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:26:11.719Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:26:11.740Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:26:11.742Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:26:11.758Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:26:11.759Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:26:11.800Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:26:11.801Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:26:11.816Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:26:11.817Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:26:11.826Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:26:11.827Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:26:11.867Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:26:12.286Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=71cda8a3-6e8f-4736-8a0e-48380d6c6f64 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T02:26:12.287Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=71cda8a3-6e8f-4736-8a0e-48380d6c6f64 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:26:13.059Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8538c8b3-0a07-4e1f-87db-1fc4e704be64 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:26:13.059Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8538c8b3-0a07-4e1f-87db-1fc4e704be64 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@759cfd93
2021-06-04T02:26:13.059Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8538c8b3-0a07-4e1f-87db-1fc4e704be64 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:26:13.059Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8538c8b3-0a07-4e1f-87db-1fc4e704be64 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:26:14.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:26:14.876Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:26:14.877Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T02:26:16.078Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8538c8b3-0a07-4e1f-87db-1fc4e704be64 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T02:26:16.078Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8538c8b3-0a07-4e1f-87db-1fc4e704be64 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:26:16.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a21aa9c-b028-4ec9-86c5-38b8bec12a0e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:26:16.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a21aa9c-b028-4ec9-86c5-38b8bec12a0e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d8811a1
2021-06-04T02:26:16.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a21aa9c-b028-4ec9-86c5-38b8bec12a0e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:26:16.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a21aa9c-b028-4ec9-86c5-38b8bec12a0e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:26:19.955Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0a21aa9c-b028-4ec9-86c5-38b8bec12a0e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
2021-06-04T02:26:19.956Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0a21aa9c-b028-4ec9-86c5-38b8bec12a0e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.135.150] failed: Read timed out
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source)
at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
... 22 common frames omitted
2021-06-04T02:26:19.956Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0a21aa9c-b028-4ec9-86c5-38b8bec12a0e ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:26:19.956Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0a21aa9c-b028-4ec9-86c5-38b8bec12a0e ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:26:20.649Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21ffaaaa-355a-4f5f-9b2b-b0af6120175f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:26:20.649Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21ffaaaa-355a-4f5f-9b2b-b0af6120175f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@507063ac
2021-06-04T02:26:20.649Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21ffaaaa-355a-4f5f-9b2b-b0af6120175f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:26:20.649Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21ffaaaa-355a-4f5f-9b2b-b0af6120175f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:26:22.326Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=21ffaaaa-355a-4f5f-9b2b-b0af6120175f ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:26:22.326Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=21ffaaaa-355a-4f5f-9b2b-b0af6120175f ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:26:23.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ed3ac0c-3379-4773-82e2-4916a598878f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:26:23.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ed3ac0c-3379-4773-82e2-4916a598878f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e060c24
2021-06-04T02:26:23.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ed3ac0c-3379-4773-82e2-4916a598878f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:26:23.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ed3ac0c-3379-4773-82e2-4916a598878f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:26:23.410Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01vjgep8q9640r1vn604jclfoxy39
2021-06-04T02:26:23.411Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01cd6jnmu5c7gr4kkrtpzpl0jn43
2021-06-04T02:26:23.411Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node02p7rnay1lshw1u1h31ynhr18s44
2021-06-04T02:26:23.411Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01j4l2i7w6r1v3xsza6nqe399s41
2021-06-04T02:26:23.411Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01w3gj70w7g1v9osscru8ig9v738
2021-06-04T02:26:23.411Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01a9ehj0mhpu0rimlru1bf3u0240
2021-06-04T02:26:23.411Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0a97cr51e584x1uce8usys8i7v42
2021-06-04T02:26:23.411Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node06jwo6g7bmmb48utklyyt9fm445
2021-06-04T02:26:23.411Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0y9hif95gquoh1f5x5m7mf8rto37
2021-06-04T02:26:23.411Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0rp2k1q56pquz1qrqggyqexeoi46
2021-06-04T02:26:23.411Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0tk636gnjk0q1pqxijalef4v036
2021-06-04T02:26:24.248Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=891965bd-982a-4a95-8622-58a2700316e5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:26:24.248Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=891965bd-982a-4a95-8622-58a2700316e5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f35c952
2021-06-04T02:26:24.248Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=891965bd-982a-4a95-8622-58a2700316e5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:26:24.248Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=891965bd-982a-4a95-8622-58a2700316e5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:26:25.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8ff8a6c-f4b9-416a-83ad-a7d34c434089 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:26:25.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8ff8a6c-f4b9-416a-83ad-a7d34c434089 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c0ba41b
2021-06-04T02:26:25.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8ff8a6c-f4b9-416a-83ad-a7d34c434089 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:26:25.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8ff8a6c-f4b9-416a-83ad-a7d34c434089 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:26:27.651Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01f065d1-203f-43eb-99c4-104861bab059 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:26:27.651Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01f065d1-203f-43eb-99c4-104861bab059 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4fc13227
2021-06-04T02:26:27.651Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01f065d1-203f-43eb-99c4-104861bab059 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:26:27.651Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01f065d1-203f-43eb-99c4-104861bab059 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:26:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:26:29.875Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:26:30.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=287a9fec-a2f9-4879-a73d-09e059e7314a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:26:30.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=287a9fec-a2f9-4879-a73d-09e059e7314a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@31d870d7
2021-06-04T02:26:30.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=287a9fec-a2f9-4879-a73d-09e059e7314a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:26:30.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=287a9fec-a2f9-4879-a73d-09e059e7314a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:26:33.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0971177-cfc6-400d-898e-0886b8b936b6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:26:33.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0971177-cfc6-400d-898e-0886b8b936b6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1650e7
2021-06-04T02:26:33.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0971177-cfc6-400d-898e-0886b8b936b6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:26:33.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0971177-cfc6-400d-898e-0886b8b936b6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:26:36.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d67bc1cd-8948-4232-9c8a-48933ad0bc25 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:26:36.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d67bc1cd-8948-4232-9c8a-48933ad0bc25 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@112c1782
2021-06-04T02:26:36.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d67bc1cd-8948-4232-9c8a-48933ad0bc25 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:26:36.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d67bc1cd-8948-4232-9c8a-48933ad0bc25 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:26:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:26:39.452Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T02:26:39.453Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:26:39.453Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:26:39.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e2461e2-3b99-4e94-81bc-2af4ea72071a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:26:39.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e2461e2-3b99-4e94-81bc-2af4ea72071a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@573a5f8a
2021-06-04T02:26:39.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e2461e2-3b99-4e94-81bc-2af4ea72071a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:26:39.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e2461e2-3b99-4e94-81bc-2af4ea72071a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:26:42.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4234799d-4024-4af8-a0b5-d5a08197bbc3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:26:42.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4234799d-4024-4af8-a0b5-d5a08197bbc3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2596d372
2021-06-04T02:26:42.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4234799d-4024-4af8-a0b5-d5a08197bbc3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:26:42.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4234799d-4024-4af8-a0b5-d5a08197bbc3 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:26:44.869Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:26:44.877Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:26:45.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5dc8985-00e0-4080-a655-942b679b8b5c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:26:45.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5dc8985-00e0-4080-a655-942b679b8b5c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17352e4f
2021-06-04T02:26:45.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5dc8985-00e0-4080-a655-942b679b8b5c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:26:45.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5dc8985-00e0-4080-a655-942b679b8b5c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:26:48.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e815fc9c-6ca3-42c8-be7b-8fc70fc225de PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:26:48.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e815fc9c-6ca3-42c8-be7b-8fc70fc225de PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6654bb2c
2021-06-04T02:26:48.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e815fc9c-6ca3-42c8-be7b-8fc70fc225de PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:26:48.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e815fc9c-6ca3-42c8-be7b-8fc70fc225de PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:26:51.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3ba1f40-6b51-407b-9b0b-afff174c4415 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:26:51.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3ba1f40-6b51-407b-9b0b-afff174c4415 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@63976e63
2021-06-04T02:26:51.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3ba1f40-6b51-407b-9b0b-afff174c4415 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:26:51.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3ba1f40-6b51-407b-9b0b-afff174c4415 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:26:54.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a63dccde-4935-460a-b29b-dadf8ca39588 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:26:54.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a63dccde-4935-460a-b29b-dadf8ca39588 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@70093c20
2021-06-04T02:26:54.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a63dccde-4935-460a-b29b-dadf8ca39588 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:26:54.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a63dccde-4935-460a-b29b-dadf8ca39588 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:26:54.540Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T02:26:57.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2abf22e7-de04-45e2-9508-1f71021fbafa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:26:57.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2abf22e7-de04-45e2-9508-1f71021fbafa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ef02338
2021-06-04T02:26:57.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2abf22e7-de04-45e2-9508-1f71021fbafa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:26:57.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2abf22e7-de04-45e2-9508-1f71021fbafa PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:26:59.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:26:59.875Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:27:00.752Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=380df232-47b3-4c2f-bcc7-fde1a9d1c4bd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:27:00.752Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=380df232-47b3-4c2f-bcc7-fde1a9d1c4bd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d3e6c11
2021-06-04T02:27:00.752Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=380df232-47b3-4c2f-bcc7-fde1a9d1c4bd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:27:00.752Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=380df232-47b3-4c2f-bcc7-fde1a9d1c4bd PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:27:03.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9590fb25-c6b5-47e1-b838-a04531d7a1bf PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:27:03.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9590fb25-c6b5-47e1-b838-a04531d7a1bf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5582efa3
2021-06-04T02:27:03.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9590fb25-c6b5-47e1-b838-a04531d7a1bf PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:27:03.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9590fb25-c6b5-47e1-b838-a04531d7a1bf PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:27:06.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b059f35-8ced-4b60-b063-356390f46da6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:27:06.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b059f35-8ced-4b60-b063-356390f46da6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c53210f
2021-06-04T02:27:06.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b059f35-8ced-4b60-b063-356390f46da6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:27:06.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b059f35-8ced-4b60-b063-356390f46da6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:27:09.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20f21a21-24e5-4334-95e4-bcecfb80b43e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:27:09.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20f21a21-24e5-4334-95e4-bcecfb80b43e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23f5365e
2021-06-04T02:27:09.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20f21a21-24e5-4334-95e4-bcecfb80b43e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:27:09.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20f21a21-24e5-4334-95e4-bcecfb80b43e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:27:12.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:27:12.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:27:12.532Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=20f21a21-24e5-4334-95e4-bcecfb80b43e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:27:12.533Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=20f21a21-24e5-4334-95e4-bcecfb80b43e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:27:12.533Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=20f21a21-24e5-4334-95e4-bcecfb80b43e ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:27:12.533Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=20f21a21-24e5-4334-95e4-bcecfb80b43e ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:27:14.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:27:15.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc0be3b2-b9c2-4954-b015-8e1654973ec9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:27:15.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc0be3b2-b9c2-4954-b015-8e1654973ec9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5dd598d5
2021-06-04T02:27:15.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc0be3b2-b9c2-4954-b015-8e1654973ec9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:27:15.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc0be3b2-b9c2-4954-b015-8e1654973ec9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:27:15.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:27:15.401Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:27:18.126Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=dc0be3b2-b9c2-4954-b015-8e1654973ec9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:27:18.127Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=dc0be3b2-b9c2-4954-b015-8e1654973ec9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:27:18.128Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=dc0be3b2-b9c2-4954-b015-8e1654973ec9 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:27:18.128Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=dc0be3b2-b9c2-4954-b015-8e1654973ec9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:27:18.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:27:21.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:27:24.264Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:27:24.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9a3ede6-8ab7-4976-a9f8-c3f19a34a82b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:27:24.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9a3ede6-8ab7-4976-a9f8-c3f19a34a82b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ac68a90
2021-06-04T02:27:24.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9a3ede6-8ab7-4976-a9f8-c3f19a34a82b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:27:24.874Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9a3ede6-8ab7-4976-a9f8-c3f19a34a82b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:27:26.281Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:27:26.379Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b9a3ede6-8ab7-4976-a9f8-c3f19a34a82b ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:27:26.379Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=b9a3ede6-8ab7-4976-a9f8-c3f19a34a82b ErrorCategory=ERROR ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:27:26.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07e27654-eac9-4b19-b781-b18db3c63605 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:27:26.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07e27654-eac9-4b19-b781-b18db3c63605 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@11e929a4
2021-06-04T02:27:26.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07e27654-eac9-4b19-b781-b18db3c63605 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:27:26.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07e27654-eac9-4b19-b781-b18db3c63605 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:27:27.619Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=07e27654-eac9-4b19-b781-b18db3c63605 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:27:27.619Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=07e27654-eac9-4b19-b781-b18db3c63605 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:27:28.274Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c9b40ea-231b-457e-a925-964978c6ddd0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:27:28.274Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c9b40ea-231b-457e-a925-964978c6ddd0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a03c9f1
2021-06-04T02:27:28.274Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c9b40ea-231b-457e-a925-964978c6ddd0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:27:28.274Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c9b40ea-231b-457e-a925-964978c6ddd0 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:27:29.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d68319f7-07bd-47dd-a63d-772fed298ce8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:27:29.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d68319f7-07bd-47dd-a63d-772fed298ce8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@14cf582b
2021-06-04T02:27:29.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d68319f7-07bd-47dd-a63d-772fed298ce8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:27:29.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d68319f7-07bd-47dd-a63d-772fed298ce8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:27:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:27:29.881Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:27:31.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26028765-ce1d-4cd6-bcbd-66c675084cd9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:27:31.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26028765-ce1d-4cd6-bcbd-66c675084cd9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c4e6564
2021-06-04T02:27:31.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26028765-ce1d-4cd6-bcbd-66c675084cd9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:27:31.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26028765-ce1d-4cd6-bcbd-66c675084cd9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:27:31.674Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=157691b1-bf86-4cbe-beb7-8d6f5b0d0294 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:27:31.674Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=157691b1-bf86-4cbe-beb7-8d6f5b0d0294 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74b2cd40
2021-06-04T02:27:31.674Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=157691b1-bf86-4cbe-beb7-8d6f5b0d0294 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:27:31.674Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=157691b1-bf86-4cbe-beb7-8d6f5b0d0294 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:27:33.458Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fad4f418-848d-4b8f-b682-a20a803a6736 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:27:33.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fad4f418-848d-4b8f-b682-a20a803a6736 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20aace66
2021-06-04T02:27:33.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fad4f418-848d-4b8f-b682-a20a803a6736 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:27:33.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fad4f418-848d-4b8f-b682-a20a803a6736 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:27:36.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ae7ea31-a6e4-47e0-8dd6-11381d2e8c58 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:27:36.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ae7ea31-a6e4-47e0-8dd6-11381d2e8c58 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ecac458
2021-06-04T02:27:36.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ae7ea31-a6e4-47e0-8dd6-11381d2e8c58 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:27:36.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ae7ea31-a6e4-47e0-8dd6-11381d2e8c58 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:27:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:27:39.454Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:27:39.454Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:27:39.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bfeff26c-86a7-4f18-b435-071e468d3c22 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:27:39.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bfeff26c-86a7-4f18-b435-071e468d3c22 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@11f0eda0
2021-06-04T02:27:39.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bfeff26c-86a7-4f18-b435-071e468d3c22 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:27:39.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bfeff26c-86a7-4f18-b435-071e468d3c22 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:27:42.647Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe1e5edc-6fab-4605-8f03-cbd3c4f26160 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:27:42.647Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe1e5edc-6fab-4605-8f03-cbd3c4f26160 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@73cafa13
2021-06-04T02:27:42.647Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe1e5edc-6fab-4605-8f03-cbd3c4f26160 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:27:42.647Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe1e5edc-6fab-4605-8f03-cbd3c4f26160 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:27:44.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:27:44.874Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:27:45.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64d20d75-c0be-463e-842a-fe4ee31c8a76 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:27:45.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64d20d75-c0be-463e-842a-fe4ee31c8a76 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@565c3f2
2021-06-04T02:27:45.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64d20d75-c0be-463e-842a-fe4ee31c8a76 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:27:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64d20d75-c0be-463e-842a-fe4ee31c8a76 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:27:48.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9856c049-8ac8-4c27-9439-997b9c04bbb6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:27:48.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9856c049-8ac8-4c27-9439-997b9c04bbb6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d953f02
2021-06-04T02:27:48.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9856c049-8ac8-4c27-9439-997b9c04bbb6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:27:48.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9856c049-8ac8-4c27-9439-997b9c04bbb6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:27:51.659Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7db9c976-fe69-41f4-a366-82fdf58bc097 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:27:51.659Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7db9c976-fe69-41f4-a366-82fdf58bc097 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b9e5cfd
2021-06-04T02:27:51.659Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7db9c976-fe69-41f4-a366-82fdf58bc097 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:27:51.659Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7db9c976-fe69-41f4-a366-82fdf58bc097 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:27:54.413Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T02:27:54.430Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=371fe066-f468-498d-a81a-5b1cf22040e6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:27:54.430Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=371fe066-f468-498d-a81a-5b1cf22040e6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f2025ff
2021-06-04T02:27:54.430Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=371fe066-f468-498d-a81a-5b1cf22040e6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:27:54.430Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=371fe066-f468-498d-a81a-5b1cf22040e6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:27:57.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b907419b-db44-4733-9ae3-d7ad5e4691d1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:27:57.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b907419b-db44-4733-9ae3-d7ad5e4691d1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f119ba
2021-06-04T02:27:57.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b907419b-db44-4733-9ae3-d7ad5e4691d1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:27:57.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b907419b-db44-4733-9ae3-d7ad5e4691d1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:27:59.870Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:27:59.878Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:28:00.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb7ae015-23bc-43a1-bca3-08576733313b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:28:00.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb7ae015-23bc-43a1-bca3-08576733313b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30a85b09
2021-06-04T02:28:00.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb7ae015-23bc-43a1-bca3-08576733313b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:28:00.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb7ae015-23bc-43a1-bca3-08576733313b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:28:03.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1077b7bc-31f7-46dc-863c-c21df6b1b643 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:28:03.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1077b7bc-31f7-46dc-863c-c21df6b1b643 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49289055
2021-06-04T02:28:03.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1077b7bc-31f7-46dc-863c-c21df6b1b643 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:28:03.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1077b7bc-31f7-46dc-863c-c21df6b1b643 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:28:06.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0654fa53-cc10-49db-82d3-c76a8025a90a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:28:06.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0654fa53-cc10-49db-82d3-c76a8025a90a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@67895b52
2021-06-04T02:28:06.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0654fa53-cc10-49db-82d3-c76a8025a90a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:28:06.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0654fa53-cc10-49db-82d3-c76a8025a90a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:28:09.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdfd9ea3-98a7-418b-9423-c4e6fbd8fee1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:28:09.776Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdfd9ea3-98a7-418b-9423-c4e6fbd8fee1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b39a2d0
2021-06-04T02:28:09.776Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdfd9ea3-98a7-418b-9423-c4e6fbd8fee1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:28:09.776Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdfd9ea3-98a7-418b-9423-c4e6fbd8fee1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:28:11.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d782583a-9f94-4691-bba8-cf1f06a2fb1b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:28:11.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d782583a-9f94-4691-bba8-cf1f06a2fb1b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@193bdcad
2021-06-04T02:28:12.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d782583a-9f94-4691-bba8-cf1f06a2fb1b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:28:12.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d782583a-9f94-4691-bba8-cf1f06a2fb1b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:28:14.872Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:28:14.879Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:28:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58f7bf4e-76a4-4fab-8666-1404fb6ff6e5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:28:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58f7bf4e-76a4-4fab-8666-1404fb6ff6e5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@141c5de7
2021-06-04T02:28:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58f7bf4e-76a4-4fab-8666-1404fb6ff6e5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:28:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58f7bf4e-76a4-4fab-8666-1404fb6ff6e5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:28:18.849Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2fdc0570-620c-4262-ac3f-5f9321376423 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:28:18.849Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2fdc0570-620c-4262-ac3f-5f9321376423 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3962c7fd
2021-06-04T02:28:18.849Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2fdc0570-620c-4262-ac3f-5f9321376423 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:28:18.849Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2fdc0570-620c-4262-ac3f-5f9321376423 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:28:21.270Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e139fe4-6308-4d75-a8e8-b4e1c1cffba7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:28:21.270Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e139fe4-6308-4d75-a8e8-b4e1c1cffba7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f6bcd23
2021-06-04T02:28:21.270Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e139fe4-6308-4d75-a8e8-b4e1c1cffba7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:28:21.270Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e139fe4-6308-4d75-a8e8-b4e1c1cffba7 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:28:24.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e91ebd76-a3d6-4022-9ae6-9a58720916ef PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:28:24.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e91ebd76-a3d6-4022-9ae6-9a58720916ef PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58f2a4d7
2021-06-04T02:28:24.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e91ebd76-a3d6-4022-9ae6-9a58720916ef PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:28:24.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e91ebd76-a3d6-4022-9ae6-9a58720916ef PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:28:27.747Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbe15035-21c4-4028-9406-9c33105d1765 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:28:27.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbe15035-21c4-4028-9406-9c33105d1765 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ef7394b
2021-06-04T02:28:27.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbe15035-21c4-4028-9406-9c33105d1765 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:28:27.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbe15035-21c4-4028-9406-9c33105d1765 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:28:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:28:29.874Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:28:30.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b05fc560-002f-4b2b-ad5c-6a939476806d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:28:30.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b05fc560-002f-4b2b-ad5c-6a939476806d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1855e47
2021-06-04T02:28:30.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b05fc560-002f-4b2b-ad5c-6a939476806d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:28:30.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b05fc560-002f-4b2b-ad5c-6a939476806d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:28:33.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0174e56b-f577-4619-8f57-43258723f99a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:28:33.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0174e56b-f577-4619-8f57-43258723f99a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@40c69981
2021-06-04T02:28:33.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0174e56b-f577-4619-8f57-43258723f99a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:28:33.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0174e56b-f577-4619-8f57-43258723f99a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:28:36.770Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e3c4486-d7b0-4047-bc32-30dd8008732f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:28:36.770Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e3c4486-d7b0-4047-bc32-30dd8008732f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ddf4952
2021-06-04T02:28:36.770Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e3c4486-d7b0-4047-bc32-30dd8008732f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:28:36.770Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e3c4486-d7b0-4047-bc32-30dd8008732f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:28:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:28:39.453Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:28:39.453Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:28:39.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f82afbc-2283-4df5-ad91-d34226249c48 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:28:39.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f82afbc-2283-4df5-ad91-d34226249c48 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1af514c3
2021-06-04T02:28:39.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f82afbc-2283-4df5-ad91-d34226249c48 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:28:39.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f82afbc-2283-4df5-ad91-d34226249c48 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:28:42.189Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b9ed68d-e4a7-4439-b5f1-3ea4dccebb67 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:28:42.189Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b9ed68d-e4a7-4439-b5f1-3ea4dccebb67 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@312906bc
2021-06-04T02:28:42.189Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b9ed68d-e4a7-4439-b5f1-3ea4dccebb67 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:28:42.189Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b9ed68d-e4a7-4439-b5f1-3ea4dccebb67 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:28:44.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:28:44.874Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:28:45.415Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c91e2906-a6e2-4961-b627-dfd5a34e5630 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:28:45.415Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c91e2906-a6e2-4961-b627-dfd5a34e5630 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45d78b89
2021-06-04T02:28:45.415Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c91e2906-a6e2-4961-b627-dfd5a34e5630 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:28:45.415Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c91e2906-a6e2-4961-b627-dfd5a34e5630 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:28:48.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1cbd0d8-6d71-499b-a7bb-2139e220aade PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:28:48.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1cbd0d8-6d71-499b-a7bb-2139e220aade PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@32b5cfb8
2021-06-04T02:28:48.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1cbd0d8-6d71-499b-a7bb-2139e220aade PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:28:48.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1cbd0d8-6d71-499b-a7bb-2139e220aade PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:28:51.402Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afe66124-796c-4dcb-83e5-bf19f99663f0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:28:51.402Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afe66124-796c-4dcb-83e5-bf19f99663f0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@548621
2021-06-04T02:28:51.402Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afe66124-796c-4dcb-83e5-bf19f99663f0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:28:51.402Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afe66124-796c-4dcb-83e5-bf19f99663f0 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:28:54.811Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T02:28:56.659Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82c81ad9-114c-4ec4-8ae1-00939d5b5677 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:28:56.659Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82c81ad9-114c-4ec4-8ae1-00939d5b5677 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79b17c71
2021-06-04T02:28:56.659Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82c81ad9-114c-4ec4-8ae1-00939d5b5677 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:28:56.659Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82c81ad9-114c-4ec4-8ae1-00939d5b5677 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:28:57.862Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9eca8e62-2d97-470e-b1eb-91053922c54f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:28:57.862Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9eca8e62-2d97-470e-b1eb-91053922c54f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@c32b0d
2021-06-04T02:28:57.862Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9eca8e62-2d97-470e-b1eb-91053922c54f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:28:57.862Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9eca8e62-2d97-470e-b1eb-91053922c54f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:28:59.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:29:00.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f37b952-4410-4c7c-b2fe-898be4276917 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:29:00.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f37b952-4410-4c7c-b2fe-898be4276917 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c17eca2
2021-06-04T02:29:00.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f37b952-4410-4c7c-b2fe-898be4276917 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:29:00.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f37b952-4410-4c7c-b2fe-898be4276917 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:29:03.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10213ded-e472-483c-b1b8-5a4f609d175e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:29:03.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10213ded-e472-483c-b1b8-5a4f609d175e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38d6048f
2021-06-04T02:29:03.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10213ded-e472-483c-b1b8-5a4f609d175e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:29:03.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10213ded-e472-483c-b1b8-5a4f609d175e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:29:06.571Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=10213ded-e472-483c-b1b8-5a4f609d175e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:29:06.572Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=10213ded-e472-483c-b1b8-5a4f609d175e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:29:06.572Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=10213ded-e472-483c-b1b8-5a4f609d175e ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:29:06.572Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=10213ded-e472-483c-b1b8-5a4f609d175e ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:29:07.867Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T02:29:09.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1816c22a-e889-4291-b87a-c1f645512a28 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:29:09.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1816c22a-e889-4291-b87a-c1f645512a28 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4af6b510
2021-06-04T02:29:09.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1816c22a-e889-4291-b87a-c1f645512a28 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:29:09.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1816c22a-e889-4291-b87a-c1f645512a28 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:29:10.762Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=1816c22a-e889-4291-b87a-c1f645512a28 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:29:10.762Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=1816c22a-e889-4291-b87a-c1f645512a28 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:29:11.267Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbed9bad-a8f9-423e-8887-55b15b1c95ac PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:29:11.267Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbed9bad-a8f9-423e-8887-55b15b1c95ac PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@70a5e030
2021-06-04T02:29:11.267Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbed9bad-a8f9-423e-8887-55b15b1c95ac PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:29:11.267Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbed9bad-a8f9-423e-8887-55b15b1c95ac PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:29:11.402Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fbed9bad-a8f9-423e-8887-55b15b1c95ac ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:29:11.403Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fbed9bad-a8f9-423e-8887-55b15b1c95ac ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:29:12.307Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=790a8dc3-e4cb-4be6-8d62-00617037c803 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:29:12.307Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=790a8dc3-e4cb-4be6-8d62-00617037c803 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@785f60d7
2021-06-04T02:29:12.307Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=790a8dc3-e4cb-4be6-8d62-00617037c803 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:29:12.307Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=790a8dc3-e4cb-4be6-8d62-00617037c803 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:29:14.464Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:29:14.466Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:29:15.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d828119e-1125-401c-941f-8fa71f228c87 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:29:15.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d828119e-1125-401c-941f-8fa71f228c87 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@77e04f9
2021-06-04T02:29:15.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d828119e-1125-401c-941f-8fa71f228c87 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:29:15.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d828119e-1125-401c-941f-8fa71f228c87 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:29:20.378Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3218c4e-666d-45d7-9291-0ede3034bcc5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:29:20.378Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3218c4e-666d-45d7-9291-0ede3034bcc5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@77daa462
2021-06-04T02:29:20.378Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3218c4e-666d-45d7-9291-0ede3034bcc5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:29:20.378Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3218c4e-666d-45d7-9291-0ede3034bcc5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:29:21.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3794025d-9752-4cdb-8296-52d3173f91b1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:29:21.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3794025d-9752-4cdb-8296-52d3173f91b1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28216ec9
2021-06-04T02:29:21.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3794025d-9752-4cdb-8296-52d3173f91b1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:29:21.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3794025d-9752-4cdb-8296-52d3173f91b1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:29:25.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33361553-ff86-4151-9955-d65605aeb046 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:29:25.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33361553-ff86-4151-9955-d65605aeb046 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2bfbeac2
2021-06-04T02:29:25.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33361553-ff86-4151-9955-d65605aeb046 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:29:25.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33361553-ff86-4151-9955-d65605aeb046 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:29:27.960Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=257f10f0-c690-480e-8750-a225a8d04962 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:29:27.960Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=257f10f0-c690-480e-8750-a225a8d04962 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c556a88
2021-06-04T02:29:27.961Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=257f10f0-c690-480e-8750-a225a8d04962 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:29:27.961Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=257f10f0-c690-480e-8750-a225a8d04962 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:29:32.366Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b32da289-e231-497b-940b-28f7983bf98b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:29:32.366Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b32da289-e231-497b-940b-28f7983bf98b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e0e2cd4
2021-06-04T02:29:32.366Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b32da289-e231-497b-940b-28f7983bf98b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:29:32.366Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b32da289-e231-497b-940b-28f7983bf98b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:29:35.475Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6b52a80-3ef0-40db-91e1-37ee1c394288 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:29:35.475Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6b52a80-3ef0-40db-91e1-37ee1c394288 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d7a42fa
2021-06-04T02:29:35.475Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6b52a80-3ef0-40db-91e1-37ee1c394288 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:29:35.475Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6b52a80-3ef0-40db-91e1-37ee1c394288 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:29:38.479Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f6b52a80-3ef0-40db-91e1-37ee1c394288 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:29:38.479Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f6b52a80-3ef0-40db-91e1-37ee1c394288 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:29:38.479Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f6b52a80-3ef0-40db-91e1-37ee1c394288 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:29:38.479Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f6b52a80-3ef0-40db-91e1-37ee1c394288 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:29:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:29:39.453Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:29:39.453Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:29:40.759Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=803eab27-a4b3-4bb7-9dd8-3073d938eb9d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:29:40.759Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=803eab27-a4b3-4bb7-9dd8-3073d938eb9d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29a30e6d
2021-06-04T02:29:40.759Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=803eab27-a4b3-4bb7-9dd8-3073d938eb9d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:29:40.759Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=803eab27-a4b3-4bb7-9dd8-3073d938eb9d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:29:41.376Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=803eab27-a4b3-4bb7-9dd8-3073d938eb9d ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:29:41.376Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=803eab27-a4b3-4bb7-9dd8-3073d938eb9d ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:29:42.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89415834-3514-4f2b-81d2-280ac90239b6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:29:42.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89415834-3514-4f2b-81d2-280ac90239b6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@51b2df69
2021-06-04T02:29:42.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89415834-3514-4f2b-81d2-280ac90239b6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:29:42.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89415834-3514-4f2b-81d2-280ac90239b6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:29:42.947Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=73fac823-cd66-4115-81aa-fe110ff754e9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:29:42.947Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=73fac823-cd66-4115-81aa-fe110ff754e9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ed03a37
2021-06-04T02:29:42.947Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=73fac823-cd66-4115-81aa-fe110ff754e9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:29:42.947Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=73fac823-cd66-4115-81aa-fe110ff754e9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:29:45.903Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4477f65b-578a-4628-bb60-2b158a992644 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:29:45.903Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4477f65b-578a-4628-bb60-2b158a992644 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6fb197e6
2021-06-04T02:29:45.903Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4477f65b-578a-4628-bb60-2b158a992644 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:29:45.903Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4477f65b-578a-4628-bb60-2b158a992644 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:29:48.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=170edc0b-ad0f-46c4-b6ac-59e084f792b0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:29:48.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=170edc0b-ad0f-46c4-b6ac-59e084f792b0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1894a003
2021-06-04T02:29:48.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=170edc0b-ad0f-46c4-b6ac-59e084f792b0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:29:48.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=170edc0b-ad0f-46c4-b6ac-59e084f792b0 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:29:51.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2654e69-6bdc-40bc-897f-ca294ad4a6aa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:29:51.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2654e69-6bdc-40bc-897f-ca294ad4a6aa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f9a6def
2021-06-04T02:29:51.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2654e69-6bdc-40bc-897f-ca294ad4a6aa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:29:51.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2654e69-6bdc-40bc-897f-ca294ad4a6aa PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:29:54.295Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:29:54.297Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:29:55.380Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f76748c1-0fea-4973-b52a-9cca37f7f440 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:29:55.380Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f76748c1-0fea-4973-b52a-9cca37f7f440 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@c4f5a9
2021-06-04T02:29:55.380Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f76748c1-0fea-4973-b52a-9cca37f7f440 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:29:55.380Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f76748c1-0fea-4973-b52a-9cca37f7f440 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:29:57.876Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1da8b9ad-157c-4965-a593-38f76a407860 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:29:57.876Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1da8b9ad-157c-4965-a593-38f76a407860 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@63294cf0
2021-06-04T02:29:57.876Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1da8b9ad-157c-4965-a593-38f76a407860 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:29:57.876Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1da8b9ad-157c-4965-a593-38f76a407860 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:30:00.966Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4d23219-8c37-4370-97ee-7637dfc72195 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:30:00.966Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4d23219-8c37-4370-97ee-7637dfc72195 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e806c2e
2021-06-04T02:30:00.966Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4d23219-8c37-4370-97ee-7637dfc72195 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:30:00.966Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4d23219-8c37-4370-97ee-7637dfc72195 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:30:04.195Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22facb09-39c2-4dfd-92a3-bf5c84f49803 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:30:04.195Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22facb09-39c2-4dfd-92a3-bf5c84f49803 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@52798704
2021-06-04T02:30:04.195Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22facb09-39c2-4dfd-92a3-bf5c84f49803 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:30:04.195Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22facb09-39c2-4dfd-92a3-bf5c84f49803 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:30:06.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:30:06.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:30:07.198Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=22facb09-39c2-4dfd-92a3-bf5c84f49803 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:30:07.199Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=22facb09-39c2-4dfd-92a3-bf5c84f49803 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:30:07.199Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=22facb09-39c2-4dfd-92a3-bf5c84f49803 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:30:07.199Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=22facb09-39c2-4dfd-92a3-bf5c84f49803 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:30:09.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:30:10.590Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2ab6bf1-72f1-4750-9cb5-30dc288461ad PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:30:10.590Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2ab6bf1-72f1-4750-9cb5-30dc288461ad PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@75b7595f
2021-06-04T02:30:10.590Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2ab6bf1-72f1-4750-9cb5-30dc288461ad PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:30:10.590Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2ab6bf1-72f1-4750-9cb5-30dc288461ad PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:30:11.305Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:30:11.565Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c2ab6bf1-72f1-4750-9cb5-30dc288461ad ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:30:11.565Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=c2ab6bf1-72f1-4750-9cb5-30dc288461ad ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:30:12.178Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=230cfafa-2f9e-43e7-906b-e32896119d2b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:30:12.178Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=230cfafa-2f9e-43e7-906b-e32896119d2b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@16c237d
2021-06-04T02:30:12.178Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=230cfafa-2f9e-43e7-906b-e32896119d2b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:30:12.178Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=230cfafa-2f9e-43e7-906b-e32896119d2b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:30:12.725Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=230cfafa-2f9e-43e7-906b-e32896119d2b ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:30:12.725Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=230cfafa-2f9e-43e7-906b-e32896119d2b ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:30:13.224Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d1238de-7ca7-4870-bb46-ee84ed8e2603 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:30:13.224Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d1238de-7ca7-4870-bb46-ee84ed8e2603 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1fb3d5f3
2021-06-04T02:30:13.224Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d1238de-7ca7-4870-bb46-ee84ed8e2603 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:30:13.224Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d1238de-7ca7-4870-bb46-ee84ed8e2603 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:30:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d53930cf-0acc-49f4-8caf-426a2b57378c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:30:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d53930cf-0acc-49f4-8caf-426a2b57378c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50810afb
2021-06-04T02:30:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d53930cf-0acc-49f4-8caf-426a2b57378c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:30:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d53930cf-0acc-49f4-8caf-426a2b57378c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:30:18.680Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eff8a815-125f-4ebb-901a-72e02b4626b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:30:18.680Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eff8a815-125f-4ebb-901a-72e02b4626b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a259353
2021-06-04T02:30:18.680Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eff8a815-125f-4ebb-901a-72e02b4626b9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:30:18.680Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eff8a815-125f-4ebb-901a-72e02b4626b9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:30:21.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54860ec7-c654-49f5-9f2b-81a8ef572e70 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:30:21.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54860ec7-c654-49f5-9f2b-81a8ef572e70 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ab22ea1
2021-06-04T02:30:21.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54860ec7-c654-49f5-9f2b-81a8ef572e70 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:30:21.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54860ec7-c654-49f5-9f2b-81a8ef572e70 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:30:27.278Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ce3ab8b-89c9-4304-9524-3819d245f99d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:30:27.279Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ce3ab8b-89c9-4304-9524-3819d245f99d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b2f6249
2021-06-04T02:30:27.279Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ce3ab8b-89c9-4304-9524-3819d245f99d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:30:27.279Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ce3ab8b-89c9-4304-9524-3819d245f99d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:30:30.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44cadd74-5f52-443e-bcd5-fa7194a1ae47 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:30:30.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44cadd74-5f52-443e-bcd5-fa7194a1ae47 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@33a16b05
2021-06-04T02:30:30.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44cadd74-5f52-443e-bcd5-fa7194a1ae47 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:30:30.977Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44cadd74-5f52-443e-bcd5-fa7194a1ae47 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:30:32.689Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e56c8603-ac6e-4169-9db1-157bc8758069 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:30:32.689Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e56c8603-ac6e-4169-9db1-157bc8758069 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1538d929
2021-06-04T02:30:32.690Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e56c8603-ac6e-4169-9db1-157bc8758069 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:30:32.690Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e56c8603-ac6e-4169-9db1-157bc8758069 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:30:35.694Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e56c8603-ac6e-4169-9db1-157bc8758069 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:30:35.694Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e56c8603-ac6e-4169-9db1-157bc8758069 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:30:35.695Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e56c8603-ac6e-4169-9db1-157bc8758069 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:30:35.695Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e56c8603-ac6e-4169-9db1-157bc8758069 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:30:36.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:30:36.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:30:39.780Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:30:40.458Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e9b2b30-d00f-4823-a813-1c1fcd41ff4f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:30:40.458Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e9b2b30-d00f-4823-a813-1c1fcd41ff4f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e843a09
2021-06-04T02:30:40.458Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e9b2b30-d00f-4823-a813-1c1fcd41ff4f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:30:40.458Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e9b2b30-d00f-4823-a813-1c1fcd41ff4f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:30:42.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:30:42.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:30:43.509Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=4e9b2b30-d00f-4823-a813-1c1fcd41ff4f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:30:43.509Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=4e9b2b30-d00f-4823-a813-1c1fcd41ff4f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:30:45.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:30:48.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:30:51.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:30:54.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:30:57.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:31:00.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:31:03.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:31:03.557Z [cluster1-timeouter-0] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.138.69:9042] Operation timed out
at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:31:03.558Z [cluster1-timeouter-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.ConnectionException: [cassandra.onap/10.242.138.69:9042] Pool was closed during initialization
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:173)
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:158)
at com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1080)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.google.common.util.concurrent.CollectionFuture.handleAllCompleted(CollectionFuture.java:69)
at com.google.common.util.concurrent.AggregateFuture.processCompleted(AggregateFuture.java:282)
at com.google.common.util.concurrent.AggregateFuture.decrementCountAndMaybeComplete(AggregateFuture.java:264)
at com.google.common.util.concurrent.AggregateFuture.access$200(AggregateFuture.java:42)
at com.google.common.util.concurrent.AggregateFuture$1.run(AggregateFuture.java:147)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179)
at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179)
at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:100)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771)
at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:31:03.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76e39d68-4500-4fa2-a566-09e3e28a9410 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:31:03.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76e39d68-4500-4fa2-a566-09e3e28a9410 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@46689529
2021-06-04T02:31:03.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76e39d68-4500-4fa2-a566-09e3e28a9410 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:31:03.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76e39d68-4500-4fa2-a566-09e3e28a9410 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:31:06.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:31:06.613Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=76e39d68-4500-4fa2-a566-09e3e28a9410 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:31:06.613Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=76e39d68-4500-4fa2-a566-09e3e28a9410 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:31:06.613Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=76e39d68-4500-4fa2-a566-09e3e28a9410 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:31:06.613Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=76e39d68-4500-4fa2-a566-09e3e28a9410 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:31:07.376Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c9a12f9-b99c-40ca-8acf-aec360d748bd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:31:07.376Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c9a12f9-b99c-40ca-8acf-aec360d748bd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a51c98e
2021-06-04T02:31:07.376Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c9a12f9-b99c-40ca-8acf-aec360d748bd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:31:07.376Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c9a12f9-b99c-40ca-8acf-aec360d748bd PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:31:09.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:31:10.423Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=4c9a12f9-b99c-40ca-8acf-aec360d748bd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:31:10.423Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=4c9a12f9-b99c-40ca-8acf-aec360d748bd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:31:10.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc71988e-41e6-41fe-bf3d-7e1c57f064b2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:31:10.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc71988e-41e6-41fe-bf3d-7e1c57f064b2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f098fc3
2021-06-04T02:31:10.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc71988e-41e6-41fe-bf3d-7e1c57f064b2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:31:10.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc71988e-41e6-41fe-bf3d-7e1c57f064b2 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:31:11.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ca340d7-41a7-4df9-b8fd-d27972b10cf3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:31:11.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ca340d7-41a7-4df9-b8fd-d27972b10cf3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79228ef9
2021-06-04T02:31:11.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ca340d7-41a7-4df9-b8fd-d27972b10cf3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:31:11.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ca340d7-41a7-4df9-b8fd-d27972b10cf3 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:31:11.377Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:31:11.601Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15caabf5-27af-4192-9fd5-536d179bb4a2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:31:11.601Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15caabf5-27af-4192-9fd5-536d179bb4a2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4025c1ad
2021-06-04T02:31:11.601Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15caabf5-27af-4192-9fd5-536d179bb4a2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:31:11.601Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15caabf5-27af-4192-9fd5-536d179bb4a2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:31:11.694Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=15caabf5-27af-4192-9fd5-536d179bb4a2 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:31:11.694Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=15caabf5-27af-4192-9fd5-536d179bb4a2 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:31:11.836Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://message-router.onap:3904: The target server failed to respond
2021-06-04T02:31:11.836Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://message-router.onap:3904: The target server failed to respond
2021-06-04T02:31:11.836Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:31:11.836Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:31:11.932Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:31:11.932Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:31:11.964Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:31:11.964Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:31:12.052Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:31:12.052Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:31:12.052Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:31:12.052Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:31:12.276Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7a60e83-8404-4c20-97c1-686fc12c0181 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:31:12.276Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7a60e83-8404-4c20-97c1-686fc12c0181 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@63f139fd
2021-06-04T02:31:12.276Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7a60e83-8404-4c20-97c1-686fc12c0181 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:31:12.276Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7a60e83-8404-4c20-97c1-686fc12c0181 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:31:12.308Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:31:12.313Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:31:12.327Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:31:12.328Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:31:12.340Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:31:12.341Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:31:12.367Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:31:12.368Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:31:12.372Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e7a60e83-8404-4c20-97c1-686fc12c0181 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:31:12.373Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e7a60e83-8404-4c20-97c1-686fc12c0181 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:31:12.377Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:31:12.378Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:31:12.386Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:31:12.386Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:31:12.397Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:31:12.398Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:31:12.407Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:31:12.407Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:31:12.422Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:31:12.423Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:31:12.430Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:31:12.431Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:31:12.438Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:31:12.439Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:31:12.450Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:31:12.451Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:31:12.461Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:31:12.463Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:31:12.491Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:31:12.492Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:31:12.510Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:31:12.511Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:31:12.518Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:31:12.700Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 503 Service Unavailable
2021-06-04T02:31:12.701Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 503
2021-06-04T02:31:12.701Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=503, variables=[]]
2021-06-04T02:31:12.701Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:31:12.702Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T02:31:12.703Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:31:12.703Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:31:12.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01bcab88-a2be-4440-842f-5d6485f0082c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:31:12.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01bcab88-a2be-4440-842f-5d6485f0082c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@179512d7
2021-06-04T02:31:12.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01bcab88-a2be-4440-842f-5d6485f0082c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:31:12.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01bcab88-a2be-4440-842f-5d6485f0082c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:31:12.886Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 503 Service Unavailable
2021-06-04T02:31:12.886Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 503
2021-06-04T02:31:12.886Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=503, variables=[]]
2021-06-04T02:31:13.154Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=01bcab88-a2be-4440-842f-5d6485f0082c ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:31:13.154Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=01bcab88-a2be-4440-842f-5d6485f0082c ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:31:13.863Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc1b33b3-2368-4e9b-94a7-2913a8be841e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:31:13.864Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc1b33b3-2368-4e9b-94a7-2913a8be841e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7aad039a
2021-06-04T02:31:13.864Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc1b33b3-2368-4e9b-94a7-2913a8be841e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:31:13.864Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc1b33b3-2368-4e9b-94a7-2913a8be841e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:31:14.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ad8e4a1-fb51-438a-abb0-bd6e3942f1ef PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:31:14.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ad8e4a1-fb51-438a-abb0-bd6e3942f1ef PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@146b8dcb
2021-06-04T02:31:14.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ad8e4a1-fb51-438a-abb0-bd6e3942f1ef PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:31:14.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ad8e4a1-fb51-438a-abb0-bd6e3942f1ef PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:31:14.867Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:31:14.876Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:31:14.876Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T02:31:16.248Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e855722-2912-473b-bea5-c215dc0257db PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:31:16.248Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e855722-2912-473b-bea5-c215dc0257db PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ebf706a
2021-06-04T02:31:16.248Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e855722-2912-473b-bea5-c215dc0257db PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:31:16.248Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e855722-2912-473b-bea5-c215dc0257db PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:31:16.651Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9e855722-2912-473b-bea5-c215dc0257db ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:31:16.651Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9e855722-2912-473b-bea5-c215dc0257db ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:31:17.248Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08d4be9c-9067-45a0-85ea-8b34a76ed8af PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:31:17.248Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08d4be9c-9067-45a0-85ea-8b34a76ed8af PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4103d6c0
2021-06-04T02:31:17.248Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08d4be9c-9067-45a0-85ea-8b34a76ed8af PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:31:17.249Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08d4be9c-9067-45a0-85ea-8b34a76ed8af PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:31:18.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f7e4edb-7506-4c4b-8a3c-300291343034 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:31:18.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f7e4edb-7506-4c4b-8a3c-300291343034 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53a0aca9
2021-06-04T02:31:18.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f7e4edb-7506-4c4b-8a3c-300291343034 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:31:18.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f7e4edb-7506-4c4b-8a3c-300291343034 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:31:19.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e175ae04-519c-45b7-ae0a-fa6039f26b62 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:31:19.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e175ae04-519c-45b7-ae0a-fa6039f26b62 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b6d66c3
2021-06-04T02:31:19.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e175ae04-519c-45b7-ae0a-fa6039f26b62 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:31:19.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e175ae04-519c-45b7-ae0a-fa6039f26b62 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:31:20.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37a11f8d-1f02-4715-93ea-5b842f52650e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:31:20.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37a11f8d-1f02-4715-93ea-5b842f52650e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ed479e4
2021-06-04T02:31:20.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37a11f8d-1f02-4715-93ea-5b842f52650e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:31:20.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37a11f8d-1f02-4715-93ea-5b842f52650e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:31:21.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e63a4b3-f849-4263-9ba0-4666a1a5bc43 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:31:21.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e63a4b3-f849-4263-9ba0-4666a1a5bc43 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6786171a
2021-06-04T02:31:21.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e63a4b3-f849-4263-9ba0-4666a1a5bc43 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:31:21.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e63a4b3-f849-4263-9ba0-4666a1a5bc43 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:31:22.861Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edab62b1-0c69-4dee-8658-c60631231f5d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:31:22.861Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edab62b1-0c69-4dee-8658-c60631231f5d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5aa04957
2021-06-04T02:31:22.861Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edab62b1-0c69-4dee-8658-c60631231f5d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:31:22.861Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edab62b1-0c69-4dee-8658-c60631231f5d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:31:24.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc369b82-75db-43c0-814e-9c92c4633aa3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:31:24.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc369b82-75db-43c0-814e-9c92c4633aa3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6be6ec62
2021-06-04T02:31:24.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc369b82-75db-43c0-814e-9c92c4633aa3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:31:24.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc369b82-75db-43c0-814e-9c92c4633aa3 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:31:27.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a66240d5-b8d2-440f-8987-7b2d30a6e2fd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:31:27.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a66240d5-b8d2-440f-8987-7b2d30a6e2fd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15b7fefc
2021-06-04T02:31:27.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a66240d5-b8d2-440f-8987-7b2d30a6e2fd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:31:27.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a66240d5-b8d2-440f-8987-7b2d30a6e2fd PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:31:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:31:29.883Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:31:30.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75777937-9da2-4c04-a9d2-94f5020bc524 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:31:30.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75777937-9da2-4c04-a9d2-94f5020bc524 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@425e1597
2021-06-04T02:31:30.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75777937-9da2-4c04-a9d2-94f5020bc524 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:31:30.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75777937-9da2-4c04-a9d2-94f5020bc524 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:31:33.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df93c663-005a-4314-89a8-74a0bd96feef PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:31:33.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df93c663-005a-4314-89a8-74a0bd96feef PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a6c067a
2021-06-04T02:31:33.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df93c663-005a-4314-89a8-74a0bd96feef PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:31:33.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df93c663-005a-4314-89a8-74a0bd96feef PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:31:36.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=781bd2c3-8e11-44e5-82d5-502c0bf90b59 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:31:36.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=781bd2c3-8e11-44e5-82d5-502c0bf90b59 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@46b56ca9
2021-06-04T02:31:36.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=781bd2c3-8e11-44e5-82d5-502c0bf90b59 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:31:36.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=781bd2c3-8e11-44e5-82d5-502c0bf90b59 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:31:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:31:39.453Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:31:39.453Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:31:39.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0db312f-82cf-450a-9ca9-7e81a9c932e9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:31:39.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0db312f-82cf-450a-9ca9-7e81a9c932e9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6cdf2a9d
2021-06-04T02:31:39.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0db312f-82cf-450a-9ca9-7e81a9c932e9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:31:39.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0db312f-82cf-450a-9ca9-7e81a9c932e9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:31:42.753Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f914fc1e-a227-49a5-b61d-d62723ec7e1d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:31:42.753Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f914fc1e-a227-49a5-b61d-d62723ec7e1d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e9f683c
2021-06-04T02:31:42.753Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f914fc1e-a227-49a5-b61d-d62723ec7e1d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:31:42.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f914fc1e-a227-49a5-b61d-d62723ec7e1d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:31:44.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:31:44.876Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:31:45.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=441ede15-0958-47b1-844f-d6adb35ab147 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:31:45.647Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=441ede15-0958-47b1-844f-d6adb35ab147 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@243aea43
2021-06-04T02:31:45.647Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=441ede15-0958-47b1-844f-d6adb35ab147 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:31:45.647Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=441ede15-0958-47b1-844f-d6adb35ab147 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:31:48.773Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c31818ba-7aba-4c1f-b3b8-51ba42915510 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:31:48.773Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c31818ba-7aba-4c1f-b3b8-51ba42915510 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49870a49
2021-06-04T02:31:48.773Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c31818ba-7aba-4c1f-b3b8-51ba42915510 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:31:48.773Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c31818ba-7aba-4c1f-b3b8-51ba42915510 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:31:51.651Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=627e45a8-e061-4dc1-99dd-5c7d3fd17047 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:31:51.651Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=627e45a8-e061-4dc1-99dd-5c7d3fd17047 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c195a26
2021-06-04T02:31:51.651Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=627e45a8-e061-4dc1-99dd-5c7d3fd17047 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:31:51.651Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=627e45a8-e061-4dc1-99dd-5c7d3fd17047 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:31:54.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61a7ea6e-ee52-4e61-aa83-5edc6dcaae75 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:31:54.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61a7ea6e-ee52-4e61-aa83-5edc6dcaae75 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79621711
2021-06-04T02:31:54.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61a7ea6e-ee52-4e61-aa83-5edc6dcaae75 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:31:54.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61a7ea6e-ee52-4e61-aa83-5edc6dcaae75 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:31:55.059Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T02:31:57.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c221da32-6b1f-448a-8b9f-d1f68e18a055 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:31:57.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c221da32-6b1f-448a-8b9f-d1f68e18a055 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a79828c
2021-06-04T02:31:57.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c221da32-6b1f-448a-8b9f-d1f68e18a055 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:31:57.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c221da32-6b1f-448a-8b9f-d1f68e18a055 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:31:59.869Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:31:59.874Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:32:00.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c563b8f0-c09e-4d93-bc37-245e3c3eb6e8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:32:00.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c563b8f0-c09e-4d93-bc37-245e3c3eb6e8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b5d14c8
2021-06-04T02:32:00.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c563b8f0-c09e-4d93-bc37-245e3c3eb6e8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:32:00.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c563b8f0-c09e-4d93-bc37-245e3c3eb6e8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:32:03.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a3ff19e-4ebe-4f50-9e8a-cfea53900f58 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:32:03.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a3ff19e-4ebe-4f50-9e8a-cfea53900f58 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d83a9ef
2021-06-04T02:32:03.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a3ff19e-4ebe-4f50-9e8a-cfea53900f58 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:32:03.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a3ff19e-4ebe-4f50-9e8a-cfea53900f58 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:32:06.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7711e0ba-2fc7-4ea5-baf5-4fb6c47fa835 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:32:06.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7711e0ba-2fc7-4ea5-baf5-4fb6c47fa835 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@430f1d1
2021-06-04T02:32:06.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7711e0ba-2fc7-4ea5-baf5-4fb6c47fa835 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:32:06.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7711e0ba-2fc7-4ea5-baf5-4fb6c47fa835 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:32:09.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b246e3f-d222-4523-a00d-b0e1e3f8c467 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:32:09.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b246e3f-d222-4523-a00d-b0e1e3f8c467 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@429b6e39
2021-06-04T02:32:09.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b246e3f-d222-4523-a00d-b0e1e3f8c467 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:32:09.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b246e3f-d222-4523-a00d-b0e1e3f8c467 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:32:12.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=049e120b-2054-49c8-b278-129c12a8336f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:32:12.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=049e120b-2054-49c8-b278-129c12a8336f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5173c9f6
2021-06-04T02:32:12.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=049e120b-2054-49c8-b278-129c12a8336f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:32:12.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=049e120b-2054-49c8-b278-129c12a8336f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:32:14.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:32:14.881Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:32:15.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36af52d5-b325-45cc-9a0d-b54adea7c906 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:32:15.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36af52d5-b325-45cc-9a0d-b54adea7c906 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@214fdee6
2021-06-04T02:32:15.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36af52d5-b325-45cc-9a0d-b54adea7c906 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:32:15.872Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36af52d5-b325-45cc-9a0d-b54adea7c906 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:32:18.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b316305-55eb-4b3d-9103-e86338ab8c8a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:32:18.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b316305-55eb-4b3d-9103-e86338ab8c8a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22f20d67
2021-06-04T02:32:18.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b316305-55eb-4b3d-9103-e86338ab8c8a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:32:18.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b316305-55eb-4b3d-9103-e86338ab8c8a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:32:21.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84d95545-1873-4e57-b2b9-fd4e101f60f5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:32:21.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84d95545-1873-4e57-b2b9-fd4e101f60f5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3b8155a6
2021-06-04T02:32:21.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84d95545-1873-4e57-b2b9-fd4e101f60f5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:32:21.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84d95545-1873-4e57-b2b9-fd4e101f60f5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:32:24.349Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71bbb067-2648-435e-91ee-8ebd2d276d6b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:32:24.349Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71bbb067-2648-435e-91ee-8ebd2d276d6b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74721759
2021-06-04T02:32:24.349Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71bbb067-2648-435e-91ee-8ebd2d276d6b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:32:24.349Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71bbb067-2648-435e-91ee-8ebd2d276d6b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:32:27.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d756008-a8a2-4121-9289-58bc182ca6ce PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:32:27.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d756008-a8a2-4121-9289-58bc182ca6ce PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b155fdf
2021-06-04T02:32:27.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d756008-a8a2-4121-9289-58bc182ca6ce PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:32:27.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d756008-a8a2-4121-9289-58bc182ca6ce PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:32:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:32:31.132Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd5ffd2d-615c-4311-afb5-221bf063d1f4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:32:31.132Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd5ffd2d-615c-4311-afb5-221bf063d1f4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@19bef6ef
2021-06-04T02:32:31.132Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd5ffd2d-615c-4311-afb5-221bf063d1f4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:32:31.132Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd5ffd2d-615c-4311-afb5-221bf063d1f4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:32:33.322Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=98f8c286-fee6-4bc3-86b3-85eab29a0301 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:32:33.322Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=98f8c286-fee6-4bc3-86b3-85eab29a0301 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28a3bc1b
2021-06-04T02:32:33.322Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=98f8c286-fee6-4bc3-86b3-85eab29a0301 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:32:33.322Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=98f8c286-fee6-4bc3-86b3-85eab29a0301 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:32:35.076Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:32:35.077Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:32:35.089Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:32:36.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc80dd1a-e8db-42c6-87f7-cb9cc9b24b5c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:32:36.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc80dd1a-e8db-42c6-87f7-cb9cc9b24b5c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c0fae89
2021-06-04T02:32:36.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc80dd1a-e8db-42c6-87f7-cb9cc9b24b5c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:32:36.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc80dd1a-e8db-42c6-87f7-cb9cc9b24b5c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:32:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:32:39.454Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:32:39.454Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:32:39.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23de589a-487e-47d2-9799-3df2ee14fb6a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:32:39.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23de589a-487e-47d2-9799-3df2ee14fb6a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4d65eb70
2021-06-04T02:32:39.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23de589a-487e-47d2-9799-3df2ee14fb6a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:32:39.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23de589a-487e-47d2-9799-3df2ee14fb6a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:32:42.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=704b461f-b86b-4b0c-ac54-8ef59adc1df8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:32:42.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=704b461f-b86b-4b0c-ac54-8ef59adc1df8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@238275bd
2021-06-04T02:32:42.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=704b461f-b86b-4b0c-ac54-8ef59adc1df8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:32:42.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=704b461f-b86b-4b0c-ac54-8ef59adc1df8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:32:44.869Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:32:45.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4e9df61-d14b-4493-82f4-f315997cc617 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:32:45.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4e9df61-d14b-4493-82f4-f315997cc617 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@16f456b2
2021-06-04T02:32:45.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4e9df61-d14b-4493-82f4-f315997cc617 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:32:45.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4e9df61-d14b-4493-82f4-f315997cc617 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:32:47.476Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:32:48.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cca125e-e25e-4400-821a-28a1d5e7f28e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:32:48.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cca125e-e25e-4400-821a-28a1d5e7f28e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27bec903
2021-06-04T02:32:48.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cca125e-e25e-4400-821a-28a1d5e7f28e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:32:48.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cca125e-e25e-4400-821a-28a1d5e7f28e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:32:51.798Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd7463c4-9f32-49d1-81ff-66a443e57728 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:32:51.798Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd7463c4-9f32-49d1-81ff-66a443e57728 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@456298ef
2021-06-04T02:32:51.798Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd7463c4-9f32-49d1-81ff-66a443e57728 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:32:51.798Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd7463c4-9f32-49d1-81ff-66a443e57728 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:32:54.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a31a18ee-4ddf-45f7-baba-d2ebc0dfeb9a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:32:54.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a31a18ee-4ddf-45f7-baba-d2ebc0dfeb9a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@757d3263
2021-06-04T02:32:54.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a31a18ee-4ddf-45f7-baba-d2ebc0dfeb9a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:32:54.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a31a18ee-4ddf-45f7-baba-d2ebc0dfeb9a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:32:57.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7a0cdfa-b15c-4d5d-9dfb-10ccb31ab36a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:32:57.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7a0cdfa-b15c-4d5d-9dfb-10ccb31ab36a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4188abb8
2021-06-04T02:32:57.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7a0cdfa-b15c-4d5d-9dfb-10ccb31ab36a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:32:57.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7a0cdfa-b15c-4d5d-9dfb-10ccb31ab36a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:32:58.583Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T02:32:59.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:33:00.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ecd9cb07-d1a0-44b0-a2bf-5354c02ee2eb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:33:00.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ecd9cb07-d1a0-44b0-a2bf-5354c02ee2eb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@10af845b
2021-06-04T02:33:00.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ecd9cb07-d1a0-44b0-a2bf-5354c02ee2eb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:33:00.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ecd9cb07-d1a0-44b0-a2bf-5354c02ee2eb PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:33:01.307Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:33:03.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14408c15-edaf-4dae-8b53-2c585be96e32 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:33:03.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14408c15-edaf-4dae-8b53-2c585be96e32 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41dbd341
2021-06-04T02:33:03.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14408c15-edaf-4dae-8b53-2c585be96e32 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:33:03.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14408c15-edaf-4dae-8b53-2c585be96e32 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:33:06.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce9dcb8c-8a33-4820-872f-6ab552cfa764 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:33:06.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce9dcb8c-8a33-4820-872f-6ab552cfa764 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d291f33
2021-06-04T02:33:06.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce9dcb8c-8a33-4820-872f-6ab552cfa764 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:33:06.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce9dcb8c-8a33-4820-872f-6ab552cfa764 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:33:09.686Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa141889-00ac-441e-b704-3d9468e750d0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:33:09.686Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa141889-00ac-441e-b704-3d9468e750d0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@59f8aa45
2021-06-04T02:33:09.686Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa141889-00ac-441e-b704-3d9468e750d0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:33:09.686Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa141889-00ac-441e-b704-3d9468e750d0 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:33:12.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0869aff4-aed4-4a0c-bdfa-44045f79ab55 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:33:12.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0869aff4-aed4-4a0c-bdfa-44045f79ab55 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3599707d
2021-06-04T02:33:12.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0869aff4-aed4-4a0c-bdfa-44045f79ab55 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:33:12.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0869aff4-aed4-4a0c-bdfa-44045f79ab55 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:33:14.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:33:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6ab1ac9-3643-4eb5-bd01-5f472238f580 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:33:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6ab1ac9-3643-4eb5-bd01-5f472238f580 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a47fc54
2021-06-04T02:33:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6ab1ac9-3643-4eb5-bd01-5f472238f580 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:33:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6ab1ac9-3643-4eb5-bd01-5f472238f580 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:33:16.228Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:33:18.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77e07419-03cb-4987-96a4-7aea717de8eb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:33:18.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77e07419-03cb-4987-96a4-7aea717de8eb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f82aea8
2021-06-04T02:33:18.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77e07419-03cb-4987-96a4-7aea717de8eb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:33:18.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77e07419-03cb-4987-96a4-7aea717de8eb PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:33:21.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7926fbb5-df6d-42b7-a97e-640a93236f67 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:33:21.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7926fbb5-df6d-42b7-a97e-640a93236f67 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23b4819f
2021-06-04T02:33:21.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7926fbb5-df6d-42b7-a97e-640a93236f67 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:33:21.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7926fbb5-df6d-42b7-a97e-640a93236f67 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:33:26.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f1c0225-da72-4096-a1d6-8f0efe8e9a84 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:33:26.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f1c0225-da72-4096-a1d6-8f0efe8e9a84 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5dd0170c
2021-06-04T02:33:26.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f1c0225-da72-4096-a1d6-8f0efe8e9a84 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:33:26.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f1c0225-da72-4096-a1d6-8f0efe8e9a84 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:33:27.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38f1877d-cb6f-4a63-b4ed-74f71d14a0ad PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:33:27.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38f1877d-cb6f-4a63-b4ed-74f71d14a0ad PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4860f5be
2021-06-04T02:33:27.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38f1877d-cb6f-4a63-b4ed-74f71d14a0ad PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:33:27.473Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38f1877d-cb6f-4a63-b4ed-74f71d14a0ad PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:33:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:33:30.287Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77ac1368-5397-4fa9-8b84-e93b63409bf8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:33:30.288Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77ac1368-5397-4fa9-8b84-e93b63409bf8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@62bdf5f4
2021-06-04T02:33:30.288Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77ac1368-5397-4fa9-8b84-e93b63409bf8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:33:30.288Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77ac1368-5397-4fa9-8b84-e93b63409bf8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:33:31.316Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:33:33.563Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0772e055-30f6-4516-906c-1ebd47662575 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:33:33.563Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0772e055-30f6-4516-906c-1ebd47662575 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65022845
2021-06-04T02:33:33.563Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0772e055-30f6-4516-906c-1ebd47662575 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:33:33.563Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0772e055-30f6-4516-906c-1ebd47662575 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:33:36.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c08e4fb2-0136-4b99-8086-e0be61acfb55 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:33:36.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c08e4fb2-0136-4b99-8086-e0be61acfb55 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38372b9e
2021-06-04T02:33:36.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c08e4fb2-0136-4b99-8086-e0be61acfb55 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:33:36.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c08e4fb2-0136-4b99-8086-e0be61acfb55 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:33:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:33:39.453Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:33:39.453Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:33:39.680Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c242fb5-f81b-462b-b07b-cdf5dae514d4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:33:39.680Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c242fb5-f81b-462b-b07b-cdf5dae514d4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7735f423
2021-06-04T02:33:39.680Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c242fb5-f81b-462b-b07b-cdf5dae514d4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:33:39.680Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c242fb5-f81b-462b-b07b-cdf5dae514d4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:33:42.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9b220c1-69ec-4ac6-97ae-5eb9b47f53fa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:33:42.256Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9b220c1-69ec-4ac6-97ae-5eb9b47f53fa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a2abd64
2021-06-04T02:33:42.256Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9b220c1-69ec-4ac6-97ae-5eb9b47f53fa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:33:42.256Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9b220c1-69ec-4ac6-97ae-5eb9b47f53fa PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:33:44.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:33:45.720Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=243ff0bd-c392-446e-9f32-d5b8e62860d3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:33:45.720Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=243ff0bd-c392-446e-9f32-d5b8e62860d3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e9ef264
2021-06-04T02:33:45.720Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=243ff0bd-c392-446e-9f32-d5b8e62860d3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:33:45.720Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=243ff0bd-c392-446e-9f32-d5b8e62860d3 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:33:51.770Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d61ddb48-03c7-4aee-8d13-7980f76f331f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:33:51.770Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d61ddb48-03c7-4aee-8d13-7980f76f331f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ff453f2
2021-06-04T02:33:51.770Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d61ddb48-03c7-4aee-8d13-7980f76f331f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:33:51.770Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d61ddb48-03c7-4aee-8d13-7980f76f331f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:33:52.047Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:33:52.047Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:33:52.867Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T02:33:54.776Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d61ddb48-03c7-4aee-8d13-7980f76f331f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:33:54.777Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d61ddb48-03c7-4aee-8d13-7980f76f331f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:33:54.777Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=d61ddb48-03c7-4aee-8d13-7980f76f331f ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:33:54.777Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=d61ddb48-03c7-4aee-8d13-7980f76f331f ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:34:00.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:34:00.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:34:01.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5596703-dca6-4136-926c-9ed8099233a3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:34:01.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5596703-dca6-4136-926c-9ed8099233a3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57b83ac3
2021-06-04T02:34:01.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5596703-dca6-4136-926c-9ed8099233a3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:34:01.778Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5596703-dca6-4136-926c-9ed8099233a3 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:34:01.972Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f5596703-dca6-4136-926c-9ed8099233a3 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:34:01.972Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f5596703-dca6-4136-926c-9ed8099233a3 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:34:02.459Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:34:03.152Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4700af11-10d0-41ea-bb3f-8aa8f7e74b8b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:34:03.152Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4700af11-10d0-41ea-bb3f-8aa8f7e74b8b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@122bc71
2021-06-04T02:34:03.153Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4700af11-10d0-41ea-bb3f-8aa8f7e74b8b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:34:03.153Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4700af11-10d0-41ea-bb3f-8aa8f7e74b8b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:34:03.520Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=4700af11-10d0-41ea-bb3f-8aa8f7e74b8b ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:34:03.520Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=4700af11-10d0-41ea-bb3f-8aa8f7e74b8b ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:34:04.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78e81cc8-949b-413f-862c-e8ec36beaeea PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:34:04.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78e81cc8-949b-413f-862c-e8ec36beaeea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c641464
2021-06-04T02:34:04.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78e81cc8-949b-413f-862c-e8ec36beaeea PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:34:04.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78e81cc8-949b-413f-862c-e8ec36beaeea PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:34:04.277Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=78e81cc8-949b-413f-862c-e8ec36beaeea ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:34:04.277Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=78e81cc8-949b-413f-862c-e8ec36beaeea ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:34:05.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4901038-6c77-4130-887d-eb80053f849b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:34:05.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4901038-6c77-4130-887d-eb80053f849b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a9c5d09
2021-06-04T02:34:05.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4901038-6c77-4130-887d-eb80053f849b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:34:05.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4901038-6c77-4130-887d-eb80053f849b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:34:07.130Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3b228de-1654-4e6d-8140-aff5678d9a46 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:34:07.130Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3b228de-1654-4e6d-8140-aff5678d9a46 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71677e93
2021-06-04T02:34:07.130Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3b228de-1654-4e6d-8140-aff5678d9a46 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:34:07.130Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3b228de-1654-4e6d-8140-aff5678d9a46 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:34:08.590Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3990798-2f9c-4255-a09b-216186256d09 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:34:08.590Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3990798-2f9c-4255-a09b-216186256d09 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65b285fa
2021-06-04T02:34:08.590Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3990798-2f9c-4255-a09b-216186256d09 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:34:08.590Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3990798-2f9c-4255-a09b-216186256d09 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:34:09.609Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fdddbd9-f404-4a54-981d-46fed9a5b72a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:34:09.609Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fdddbd9-f404-4a54-981d-46fed9a5b72a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69797a1c
2021-06-04T02:34:09.609Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fdddbd9-f404-4a54-981d-46fed9a5b72a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:34:09.609Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fdddbd9-f404-4a54-981d-46fed9a5b72a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:34:12.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6252d12-92cc-40ae-b00b-00b87215f377 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:34:12.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6252d12-92cc-40ae-b00b-00b87215f377 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3155162f
2021-06-04T02:34:12.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6252d12-92cc-40ae-b00b-00b87215f377 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:34:12.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6252d12-92cc-40ae-b00b-00b87215f377 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:34:13.664Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T02:34:13.751Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:34:13.753Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:34:13.959Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:34:13.960Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:34:14.269Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:34:14.270Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:34:15.393Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:34:15.394Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:34:15.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e39602d1-c57a-4879-9b95-336d7d993a93 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:34:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e39602d1-c57a-4879-9b95-336d7d993a93 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b8c6570
2021-06-04T02:34:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e39602d1-c57a-4879-9b95-336d7d993a93 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:34:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e39602d1-c57a-4879-9b95-336d7d993a93 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:34:18.719Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6efb055d-8973-461b-8730-7ce80b20560a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:34:18.719Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6efb055d-8973-461b-8730-7ce80b20560a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ae0a2ae
2021-06-04T02:34:18.719Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6efb055d-8973-461b-8730-7ce80b20560a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:34:18.719Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6efb055d-8973-461b-8730-7ce80b20560a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:34:21.442Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8cbf96c8-fdeb-4aba-b6d5-71bd9f037dfa PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:34:21.442Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8cbf96c8-fdeb-4aba-b6d5-71bd9f037dfa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28eb8074
2021-06-04T02:34:21.442Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8cbf96c8-fdeb-4aba-b6d5-71bd9f037dfa PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:34:21.442Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8cbf96c8-fdeb-4aba-b6d5-71bd9f037dfa PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:34:24.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e08a8bc7-eb7c-4033-8104-8fd1e9d4a49e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:34:24.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e08a8bc7-eb7c-4033-8104-8fd1e9d4a49e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@31960f28
2021-06-04T02:34:24.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e08a8bc7-eb7c-4033-8104-8fd1e9d4a49e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:34:24.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e08a8bc7-eb7c-4033-8104-8fd1e9d4a49e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:34:27.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b40b9172-1d5e-4790-9fd3-9c80c3d78331 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:34:27.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b40b9172-1d5e-4790-9fd3-9c80c3d78331 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29295b8f
2021-06-04T02:34:27.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b40b9172-1d5e-4790-9fd3-9c80c3d78331 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:34:27.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b40b9172-1d5e-4790-9fd3-9c80c3d78331 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:34:29.037Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:34:29.039Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:34:30.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=757f9f33-a50d-4c63-862e-a191eedba0d8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:34:30.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=757f9f33-a50d-4c63-862e-a191eedba0d8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@265369d6
2021-06-04T02:34:30.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=757f9f33-a50d-4c63-862e-a191eedba0d8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:34:30.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=757f9f33-a50d-4c63-862e-a191eedba0d8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:34:31.820Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:34:31.821Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:34:31.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:34:31.871Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T02:34:33.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f30817af-6b73-41b8-8128-0570fd98dfc2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:34:33.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f30817af-6b73-41b8-8128-0570fd98dfc2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@52cfa548
2021-06-04T02:34:33.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f30817af-6b73-41b8-8128-0570fd98dfc2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:34:33.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f30817af-6b73-41b8-8128-0570fd98dfc2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:34:34.782Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f30817af-6b73-41b8-8128-0570fd98dfc2 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:34:34.782Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f30817af-6b73-41b8-8128-0570fd98dfc2 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:34:36.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fad2a049-6ae6-4ad7-bab8-5ba7a1cbbff6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:34:36.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fad2a049-6ae6-4ad7-bab8-5ba7a1cbbff6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53210f76
2021-06-04T02:34:36.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fad2a049-6ae6-4ad7-bab8-5ba7a1cbbff6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:34:36.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fad2a049-6ae6-4ad7-bab8-5ba7a1cbbff6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:34:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:34:39.453Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:34:39.453Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:34:39.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d67a71a-5822-4334-9a84-b8ce28e74333 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:34:39.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d67a71a-5822-4334-9a84-b8ce28e74333 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3037d3be
2021-06-04T02:34:39.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d67a71a-5822-4334-9a84-b8ce28e74333 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:34:39.479Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d67a71a-5822-4334-9a84-b8ce28e74333 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:34:42.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36c2d11e-f3eb-4d3c-a0e9-5b35d3fa578e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:34:42.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36c2d11e-f3eb-4d3c-a0e9-5b35d3fa578e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d9701b7
2021-06-04T02:34:42.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36c2d11e-f3eb-4d3c-a0e9-5b35d3fa578e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:34:42.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36c2d11e-f3eb-4d3c-a0e9-5b35d3fa578e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:34:44.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:34:45.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1f78fec-809c-49a3-96f0-51c9ea3858c5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:34:45.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1f78fec-809c-49a3-96f0-51c9ea3858c5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@225d00a8
2021-06-04T02:34:45.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1f78fec-809c-49a3-96f0-51c9ea3858c5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:34:45.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1f78fec-809c-49a3-96f0-51c9ea3858c5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:34:48.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53a646e4-f8b7-4225-90c4-9cbc9b0d0269 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:34:48.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53a646e4-f8b7-4225-90c4-9cbc9b0d0269 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@795ce12a
2021-06-04T02:34:48.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53a646e4-f8b7-4225-90c4-9cbc9b0d0269 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:34:48.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53a646e4-f8b7-4225-90c4-9cbc9b0d0269 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:34:51.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93ed7575-cc91-43c7-b69d-463e50548c49 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:34:51.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93ed7575-cc91-43c7-b69d-463e50548c49 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@77f8679c
2021-06-04T02:34:51.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93ed7575-cc91-43c7-b69d-463e50548c49 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:34:51.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93ed7575-cc91-43c7-b69d-463e50548c49 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:34:51.280Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://message-router.onap:3904: The target server failed to respond
2021-06-04T02:34:51.280Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:34:51.732Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:34:51.732Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:34:51.733Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:34:51.733Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:34:51.812Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:34:51.812Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:34:51.812Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:34:51.812Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:34:51.843Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:34:51.843Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T02:34:51.843Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:34:51.844Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T02:34:51.844Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T02:34:52.867Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T02:34:54.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59534b94-5cbd-4d20-ae49-4bdccd727f37 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:34:54.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59534b94-5cbd-4d20-ae49-4bdccd727f37 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42d74a6d
2021-06-04T02:34:54.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59534b94-5cbd-4d20-ae49-4bdccd727f37 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:34:54.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59534b94-5cbd-4d20-ae49-4bdccd727f37 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:34:57.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:34:57.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:34:57.521Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=59534b94-5cbd-4d20-ae49-4bdccd727f37 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:34:57.521Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=59534b94-5cbd-4d20-ae49-4bdccd727f37 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:34:57.521Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=59534b94-5cbd-4d20-ae49-4bdccd727f37 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:34:57.521Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=59534b94-5cbd-4d20-ae49-4bdccd727f37 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:34:58.479Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:34:58.480Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:34:58.715Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:34:59.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:35:00.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:35:01.198Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c98b4af-9be8-443f-a574-2c2b4a8d9c15 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:35:01.198Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c98b4af-9be8-443f-a574-2c2b4a8d9c15 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@8454adf
2021-06-04T02:35:01.198Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c98b4af-9be8-443f-a574-2c2b4a8d9c15 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:35:01.198Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c98b4af-9be8-443f-a574-2c2b4a8d9c15 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:35:01.411Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3c98b4af-9be8-443f-a574-2c2b4a8d9c15 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:35:01.411Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=3c98b4af-9be8-443f-a574-2c2b4a8d9c15 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:35:01.557Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c57d446-4296-4f53-bdd4-97b860f9776f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:35:01.557Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c57d446-4296-4f53-bdd4-97b860f9776f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22fefe86
2021-06-04T02:35:01.557Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c57d446-4296-4f53-bdd4-97b860f9776f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:35:01.557Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c57d446-4296-4f53-bdd4-97b860f9776f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:35:02.275Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:35:03.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2fc3c63-4a54-4882-b08b-98478be81a5d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:35:03.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2fc3c63-4a54-4882-b08b-98478be81a5d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a025c96
2021-06-04T02:35:03.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2fc3c63-4a54-4882-b08b-98478be81a5d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:35:03.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2fc3c63-4a54-4882-b08b-98478be81a5d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:35:04.226Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e2fc3c63-4a54-4882-b08b-98478be81a5d ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:35:04.226Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e2fc3c63-4a54-4882-b08b-98478be81a5d ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:35:06.107Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:35:06.109Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:35:06.487Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea78ba79-4f68-48bc-b196-e9759d248322 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:35:06.487Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea78ba79-4f68-48bc-b196-e9759d248322 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7833f6bb
2021-06-04T02:35:06.487Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea78ba79-4f68-48bc-b196-e9759d248322 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:35:06.487Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea78ba79-4f68-48bc-b196-e9759d248322 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:35:06.551Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:35:06.551Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T02:35:09.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34d0b32b-f5b6-4daa-ae45-3bd24eaf9ef5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:35:09.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34d0b32b-f5b6-4daa-ae45-3bd24eaf9ef5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b24c23e
2021-06-04T02:35:09.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34d0b32b-f5b6-4daa-ae45-3bd24eaf9ef5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:35:09.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34d0b32b-f5b6-4daa-ae45-3bd24eaf9ef5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:35:09.820Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=34d0b32b-f5b6-4daa-ae45-3bd24eaf9ef5 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:35:09.820Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=34d0b32b-f5b6-4daa-ae45-3bd24eaf9ef5 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:35:12.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d59a803-728d-4fc8-8161-6ec96bbcf127 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:35:12.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d59a803-728d-4fc8-8161-6ec96bbcf127 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4efb1512
2021-06-04T02:35:12.285Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d59a803-728d-4fc8-8161-6ec96bbcf127 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:35:12.285Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d59a803-728d-4fc8-8161-6ec96bbcf127 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:35:14.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:35:15.435Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:35:15.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08f77427-590b-4d53-94ea-b9f68fc3962f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:35:15.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08f77427-590b-4d53-94ea-b9f68fc3962f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65516b7
2021-06-04T02:35:15.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08f77427-590b-4d53-94ea-b9f68fc3962f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:35:15.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08f77427-590b-4d53-94ea-b9f68fc3962f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:35:18.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5a76566-6452-48cf-a8ff-1d0fa9a47873 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:35:18.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5a76566-6452-48cf-a8ff-1d0fa9a47873 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6134bee8
2021-06-04T02:35:18.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5a76566-6452-48cf-a8ff-1d0fa9a47873 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:35:18.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5a76566-6452-48cf-a8ff-1d0fa9a47873 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:35:22.380Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9922468b-32c5-41d7-a300-f26c31391c65 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:35:22.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9922468b-32c5-41d7-a300-f26c31391c65 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5cbca5c2
2021-06-04T02:35:22.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9922468b-32c5-41d7-a300-f26c31391c65 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:35:22.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9922468b-32c5-41d7-a300-f26c31391c65 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:35:24.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac539131-3772-4d69-ab91-4f0eaece5f1e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:35:24.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac539131-3772-4d69-ab91-4f0eaece5f1e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a7978c2
2021-06-04T02:35:24.481Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac539131-3772-4d69-ab91-4f0eaece5f1e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:35:24.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac539131-3772-4d69-ab91-4f0eaece5f1e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:35:27.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05f80ca9-2700-4000-a8e3-3fbe2a7c1bbe PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:35:27.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05f80ca9-2700-4000-a8e3-3fbe2a7c1bbe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@64372f94
2021-06-04T02:35:27.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05f80ca9-2700-4000-a8e3-3fbe2a7c1bbe PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:35:27.478Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05f80ca9-2700-4000-a8e3-3fbe2a7c1bbe PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:35:29.870Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:35:30.485Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=05f80ca9-2700-4000-a8e3-3fbe2a7c1bbe ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:35:30.486Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=05f80ca9-2700-4000-a8e3-3fbe2a7c1bbe ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:35:30.486Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=05f80ca9-2700-4000-a8e3-3fbe2a7c1bbe ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:35:30.486Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=05f80ca9-2700-4000-a8e3-3fbe2a7c1bbe ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:35:33.100Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83415541-3d4b-4460-8dfb-e1db6f3a028f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:35:33.100Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83415541-3d4b-4460-8dfb-e1db6f3a028f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20b01e04
2021-06-04T02:35:33.100Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83415541-3d4b-4460-8dfb-e1db6f3a028f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:35:33.100Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83415541-3d4b-4460-8dfb-e1db6f3a028f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:35:33.351Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=83415541-3d4b-4460-8dfb-e1db6f3a028f ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:35:33.352Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=83415541-3d4b-4460-8dfb-e1db6f3a028f ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:35:33.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44b6929f-412c-4cb0-8401-96e8357d5228 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:35:33.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44b6929f-412c-4cb0-8401-96e8357d5228 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1825f9fc
2021-06-04T02:35:33.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44b6929f-412c-4cb0-8401-96e8357d5228 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:35:33.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44b6929f-412c-4cb0-8401-96e8357d5228 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:35:36.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d64b15d-e0ce-4c9f-9c94-7e48949fc0d1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:35:36.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d64b15d-e0ce-4c9f-9c94-7e48949fc0d1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45b32ee3
2021-06-04T02:35:36.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d64b15d-e0ce-4c9f-9c94-7e48949fc0d1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:35:36.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d64b15d-e0ce-4c9f-9c94-7e48949fc0d1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:35:37.867Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T02:35:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:35:39.453Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T02:35:39.454Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:35:39.454Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:35:39.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78993040-f37e-4bcd-be24-eab7036d3449 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:35:39.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78993040-f37e-4bcd-be24-eab7036d3449 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6553586f
2021-06-04T02:35:39.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78993040-f37e-4bcd-be24-eab7036d3449 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:35:39.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78993040-f37e-4bcd-be24-eab7036d3449 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:35:40.816Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=78993040-f37e-4bcd-be24-eab7036d3449 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:35:40.816Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=78993040-f37e-4bcd-be24-eab7036d3449 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:35:43.657Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43e86481-4fbb-4d07-a3d8-3e569bd83077 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:35:43.657Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43e86481-4fbb-4d07-a3d8-3e569bd83077 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@256321b5
2021-06-04T02:35:43.657Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43e86481-4fbb-4d07-a3d8-3e569bd83077 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:35:43.657Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43e86481-4fbb-4d07-a3d8-3e569bd83077 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:35:45.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e8b80e2-f996-42cf-b055-ad6a7a466af9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:35:45.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e8b80e2-f996-42cf-b055-ad6a7a466af9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@123ec6fc
2021-06-04T02:35:45.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e8b80e2-f996-42cf-b055-ad6a7a466af9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:35:45.372Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e8b80e2-f996-42cf-b055-ad6a7a466af9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:35:48.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3cbd715-2255-4941-8e56-a5f59e40fa26 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:35:48.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3cbd715-2255-4941-8e56-a5f59e40fa26 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e26366e
2021-06-04T02:35:48.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3cbd715-2255-4941-8e56-a5f59e40fa26 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:35:48.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3cbd715-2255-4941-8e56-a5f59e40fa26 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:35:48.855Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 503 Service Unavailable
2021-06-04T02:35:48.856Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 503
2021-06-04T02:35:48.856Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=503, variables=[]]
2021-06-04T02:35:49.279Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:35:49.282Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:35:49.347Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:35:49.349Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:35:50.675Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:35:50.676Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:35:51.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d7eb80a-f94f-485b-aff7-9ef0d1db9690 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:35:51.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d7eb80a-f94f-485b-aff7-9ef0d1db9690 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@31c99fe5
2021-06-04T02:35:51.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d7eb80a-f94f-485b-aff7-9ef0d1db9690 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:35:51.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d7eb80a-f94f-485b-aff7-9ef0d1db9690 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:35:54.702Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da3a80f5-58c0-42e6-8b37-e038679cfd50 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:35:54.702Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da3a80f5-58c0-42e6-8b37-e038679cfd50 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d1b6ee0
2021-06-04T02:35:54.702Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da3a80f5-58c0-42e6-8b37-e038679cfd50 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:35:54.702Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da3a80f5-58c0-42e6-8b37-e038679cfd50 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:35:57.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2054a522-b129-4eb6-899b-6cefb18b41f6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:35:57.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2054a522-b129-4eb6-899b-6cefb18b41f6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69f64099
2021-06-04T02:35:57.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2054a522-b129-4eb6-899b-6cefb18b41f6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:35:57.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2054a522-b129-4eb6-899b-6cefb18b41f6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:36:00.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a93da6b-92eb-4f76-9262-3941785e7618 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:36:00.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a93da6b-92eb-4f76-9262-3941785e7618 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@169c8e8f
2021-06-04T02:36:00.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a93da6b-92eb-4f76-9262-3941785e7618 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:36:00.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a93da6b-92eb-4f76-9262-3941785e7618 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:36:03.028Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:36:03.030Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:36:03.247Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:36:03.247Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T02:36:03.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ace44983-8c67-467e-b771-3c51ab7bc2dd PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:36:03.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ace44983-8c67-467e-b771-3c51ab7bc2dd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b570d0e
2021-06-04T02:36:03.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ace44983-8c67-467e-b771-3c51ab7bc2dd PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:36:03.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ace44983-8c67-467e-b771-3c51ab7bc2dd PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:36:06.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fcfc0f34-3d71-4a8e-b029-f2920e48b4b5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:36:06.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fcfc0f34-3d71-4a8e-b029-f2920e48b4b5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ded12ea
2021-06-04T02:36:06.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fcfc0f34-3d71-4a8e-b029-f2920e48b4b5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:36:06.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fcfc0f34-3d71-4a8e-b029-f2920e48b4b5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:36:06.874Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fcfc0f34-3d71-4a8e-b029-f2920e48b4b5 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:36:06.874Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fcfc0f34-3d71-4a8e-b029-f2920e48b4b5 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:36:09.939Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=358d72e4-3c03-455c-8b66-90888a7b9fe0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:36:09.939Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=358d72e4-3c03-455c-8b66-90888a7b9fe0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@66446f46
2021-06-04T02:36:09.939Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=358d72e4-3c03-455c-8b66-90888a7b9fe0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:36:09.939Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=358d72e4-3c03-455c-8b66-90888a7b9fe0 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:36:12.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d049e173-2b68-4877-8df8-2cd9ce482145 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:36:12.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d049e173-2b68-4877-8df8-2cd9ce482145 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@145e7df7
2021-06-04T02:36:12.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d049e173-2b68-4877-8df8-2cd9ce482145 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:36:12.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d049e173-2b68-4877-8df8-2cd9ce482145 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:36:14.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:36:16.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c46f6d4b-5453-4046-a738-edbf1046a998 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:36:16.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c46f6d4b-5453-4046-a738-edbf1046a998 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47322d0f
2021-06-04T02:36:16.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c46f6d4b-5453-4046-a738-edbf1046a998 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:36:16.076Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c46f6d4b-5453-4046-a738-edbf1046a998 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:36:18.676Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93a5f08c-37be-4912-906b-d6e311c4f48a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:36:18.676Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93a5f08c-37be-4912-906b-d6e311c4f48a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@121d0d41
2021-06-04T02:36:18.676Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93a5f08c-37be-4912-906b-d6e311c4f48a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:36:18.676Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93a5f08c-37be-4912-906b-d6e311c4f48a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:36:21.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4eb563e1-e991-48f5-8419-84b37a0934ee PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:36:21.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4eb563e1-e991-48f5-8419-84b37a0934ee PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57667e1b
2021-06-04T02:36:21.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4eb563e1-e991-48f5-8419-84b37a0934ee PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:36:21.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4eb563e1-e991-48f5-8419-84b37a0934ee PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:36:22.867Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T02:36:25.740Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:36:25.740Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:36:25.851Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:36:25.851Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:36:25.891Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:36:25.891Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:36:25.938Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T02:36:25.941Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:36:26.127Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:36:26.127Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:36:26.268Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:36:26.268Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:36:26.318Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:36:26.318Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:36:26.410Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T02:36:26.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a1f2c90-9d56-449b-8c1b-4c8494321814 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:36:26.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a1f2c90-9d56-449b-8c1b-4c8494321814 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30b010c5
2021-06-04T02:36:26.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a1f2c90-9d56-449b-8c1b-4c8494321814 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:36:26.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a1f2c90-9d56-449b-8c1b-4c8494321814 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:36:28.275Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3a1f2c90-9d56-449b-8c1b-4c8494321814 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:36:28.276Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3a1f2c90-9d56-449b-8c1b-4c8494321814 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:36:29.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0fcee3c-2363-436f-9d2b-cab1eaffc595 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:36:29.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0fcee3c-2363-436f-9d2b-cab1eaffc595 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@66bc0989
2021-06-04T02:36:29.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0fcee3c-2363-436f-9d2b-cab1eaffc595 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:36:29.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0fcee3c-2363-436f-9d2b-cab1eaffc595 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:36:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:36:30.603Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a17c0e3e-bf05-45a3-8c1c-c0ac668d8424 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:36:30.603Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a17c0e3e-bf05-45a3-8c1c-c0ac668d8424 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1cb1671a
2021-06-04T02:36:30.603Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a17c0e3e-bf05-45a3-8c1c-c0ac668d8424 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:36:30.604Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a17c0e3e-bf05-45a3-8c1c-c0ac668d8424 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:36:33.609Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a17c0e3e-bf05-45a3-8c1c-c0ac668d8424 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:36:33.609Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a17c0e3e-bf05-45a3-8c1c-c0ac668d8424 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:36:33.610Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a17c0e3e-bf05-45a3-8c1c-c0ac668d8424 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:36:33.610Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a17c0e3e-bf05-45a3-8c1c-c0ac668d8424 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:36:36.126Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:36:36.126Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:36:36.171Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:36:36.171Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:36:36.263Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:36:36.263Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:36:36.264Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T02:36:36.266Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:36:37.654Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9edae718-c331-4af7-94db-09615ad4de91 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:36:37.654Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9edae718-c331-4af7-94db-09615ad4de91 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@78c34431
2021-06-04T02:36:37.654Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9edae718-c331-4af7-94db-09615ad4de91 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:36:37.654Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9edae718-c331-4af7-94db-09615ad4de91 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:36:38.213Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9edae718-c331-4af7-94db-09615ad4de91 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:36:38.213Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9edae718-c331-4af7-94db-09615ad4de91 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:36:38.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b44c5e48-f2c9-46dd-9b11-7f601166349c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:36:38.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b44c5e48-f2c9-46dd-9b11-7f601166349c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e33fd04
2021-06-04T02:36:38.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b44c5e48-f2c9-46dd-9b11-7f601166349c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:36:38.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b44c5e48-f2c9-46dd-9b11-7f601166349c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:36:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:36:39.454Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:36:39.454Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:36:41.986Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=b44c5e48-f2c9-46dd-9b11-7f601166349c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:36:41.986Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=b44c5e48-f2c9-46dd-9b11-7f601166349c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:36:41.986Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b44c5e48-f2c9-46dd-9b11-7f601166349c ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:36:41.986Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b44c5e48-f2c9-46dd-9b11-7f601166349c ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:36:43.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54a5fcc6-500c-4a13-9dce-16db3e60ecd5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:36:43.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54a5fcc6-500c-4a13-9dce-16db3e60ecd5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@59adca6f
2021-06-04T02:36:43.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54a5fcc6-500c-4a13-9dce-16db3e60ecd5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:36:43.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54a5fcc6-500c-4a13-9dce-16db3e60ecd5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:36:43.851Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=54a5fcc6-500c-4a13-9dce-16db3e60ecd5 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:36:43.851Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=54a5fcc6-500c-4a13-9dce-16db3e60ecd5 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:36:44.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cc9505b-20c6-42e6-8c06-2671876943d1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:36:44.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cc9505b-20c6-42e6-8c06-2671876943d1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@59a4e6f3
2021-06-04T02:36:44.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cc9505b-20c6-42e6-8c06-2671876943d1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:36:44.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cc9505b-20c6-42e6-8c06-2671876943d1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:36:47.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e91a76ba-223d-4f18-87aa-d3ea2a172ce4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:36:47.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e91a76ba-223d-4f18-87aa-d3ea2a172ce4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@8aeeb1e
2021-06-04T02:36:47.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e91a76ba-223d-4f18-87aa-d3ea2a172ce4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:36:47.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e91a76ba-223d-4f18-87aa-d3ea2a172ce4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:36:48.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e940aee-e048-41b9-bea8-282f3a708991 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:36:48.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e940aee-e048-41b9-bea8-282f3a708991 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f67b6d6
2021-06-04T02:36:48.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e940aee-e048-41b9-bea8-282f3a708991 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:36:48.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e940aee-e048-41b9-bea8-282f3a708991 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:36:51.182Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:36:51.182Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:36:51.207Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:36:51.207Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:36:51.230Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:36:51.230Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:36:51.251Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T02:36:51.252Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500
2021-06-04T02:36:51.252Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]]
2021-06-04T02:36:51.383Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:36:51.385Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:36:52.171Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4aef4af-cf91-4d77-8f4c-a2ffde2e7741 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:36:52.171Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4aef4af-cf91-4d77-8f4c-a2ffde2e7741 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b63264a
2021-06-04T02:36:52.171Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4aef4af-cf91-4d77-8f4c-a2ffde2e7741 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:36:52.171Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4aef4af-cf91-4d77-8f4c-a2ffde2e7741 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:36:57.618Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce29061f-c873-4c75-8b1e-2ec3893522a4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:36:57.618Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce29061f-c873-4c75-8b1e-2ec3893522a4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@158ed6ab
2021-06-04T02:36:57.618Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce29061f-c873-4c75-8b1e-2ec3893522a4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:36:57.618Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce29061f-c873-4c75-8b1e-2ec3893522a4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:36:59.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66ccfb0d-e326-4bf3-aa42-7e53e774f1c8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:36:59.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66ccfb0d-e326-4bf3-aa42-7e53e774f1c8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6a87291f
2021-06-04T02:36:59.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66ccfb0d-e326-4bf3-aa42-7e53e774f1c8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:36:59.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66ccfb0d-e326-4bf3-aa42-7e53e774f1c8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:37:01.251Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f6233ed-943b-4db7-82a3-e46c8adbdd45 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:37:01.251Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f6233ed-943b-4db7-82a3-e46c8adbdd45 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68d4f39f
2021-06-04T02:37:01.251Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f6233ed-943b-4db7-82a3-e46c8adbdd45 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:37:01.251Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f6233ed-943b-4db7-82a3-e46c8adbdd45 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:37:05.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acf14c21-6c5c-4d4d-b32f-1edce5c5fb39 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:37:05.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acf14c21-6c5c-4d4d-b32f-1edce5c5fb39 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a77c9b9
2021-06-04T02:37:05.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acf14c21-6c5c-4d4d-b32f-1edce5c5fb39 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:37:05.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acf14c21-6c5c-4d4d-b32f-1edce5c5fb39 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:37:07.370Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57811f6d-8973-4b14-a7aa-58b0d7122163 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:37:07.371Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57811f6d-8973-4b14-a7aa-58b0d7122163 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79af7fd2
2021-06-04T02:37:07.371Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57811f6d-8973-4b14-a7aa-58b0d7122163 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:37:07.371Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57811f6d-8973-4b14-a7aa-58b0d7122163 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:37:09.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2ed7ca3-a2af-41b5-ac70-f49a862178e1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:37:09.520Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2ed7ca3-a2af-41b5-ac70-f49a862178e1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a337e29
2021-06-04T02:37:09.520Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2ed7ca3-a2af-41b5-ac70-f49a862178e1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:37:09.520Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2ed7ca3-a2af-41b5-ac70-f49a862178e1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:37:12.690Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf09dc26-4036-4bef-8cd9-890dc1002433 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:37:12.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf09dc26-4036-4bef-8cd9-890dc1002433 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@653428fb
2021-06-04T02:37:12.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf09dc26-4036-4bef-8cd9-890dc1002433 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:37:12.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf09dc26-4036-4bef-8cd9-890dc1002433 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:37:16.504Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c25daa48-404c-4024-9655-e9b3a68febe5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:37:16.504Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c25daa48-404c-4024-9655-e9b3a68febe5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41aa0fe5
2021-06-04T02:37:16.505Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c25daa48-404c-4024-9655-e9b3a68febe5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:37:16.505Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c25daa48-404c-4024-9655-e9b3a68febe5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:37:18.672Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df926cda-6e69-4286-80c5-ebe3dc8911dc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:37:18.673Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df926cda-6e69-4286-80c5-ebe3dc8911dc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4379b9ed
2021-06-04T02:37:18.673Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df926cda-6e69-4286-80c5-ebe3dc8911dc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:37:18.673Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df926cda-6e69-4286-80c5-ebe3dc8911dc PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:37:21.499Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d02fe4b4-9fec-4a59-88d8-3d964a3dfc4c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:37:21.499Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d02fe4b4-9fec-4a59-88d8-3d964a3dfc4c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@728a559d
2021-06-04T02:37:21.499Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d02fe4b4-9fec-4a59-88d8-3d964a3dfc4c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:37:21.500Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d02fe4b4-9fec-4a59-88d8-3d964a3dfc4c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:37:23.412Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0dvx4gzma60151cit7fgpv24s52
2021-06-04T02:37:23.412Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0o9dksnec088410rawdcgn9h1056
2021-06-04T02:37:23.412Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01qh6ameuez7et1gzqspearovmf47
2021-06-04T02:37:23.412Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01hsbzsjhvo4w7fgxw678xtuo554
2021-06-04T02:37:23.412Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0qlumk3m1aead8l2fpjlauoxl55
2021-06-04T02:37:23.412Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0o52sspd4i69d13u30knicvyvp51
2021-06-04T02:37:23.412Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01ndqalz3fr1pl1ub2bqpdlewvo50
2021-06-04T02:37:23.412Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0vzjrkjfxsejg8ldcfw4n7e749
2021-06-04T02:37:23.412Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node016muo6ikdom3s1bc1mprjd5pe448
2021-06-04T02:37:23.412Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0xdr8ps0xl1j17hapxbdfm29g53
2021-06-04T02:37:23.412Z [Scheduler-7967307-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01k5n1ru2f04as1pds5jr1ntrll57
2021-06-04T02:37:28.149Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fde6a0c1-0964-462c-8424-80c80e39476d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:37:28.149Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fde6a0c1-0964-462c-8424-80c80e39476d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@36bdc8c7
2021-06-04T02:37:28.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fde6a0c1-0964-462c-8424-80c80e39476d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:37:28.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fde6a0c1-0964-462c-8424-80c80e39476d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:37:29.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4024dcb8-0c56-4455-85ac-617f30aac093 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:37:29.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4024dcb8-0c56-4455-85ac-617f30aac093 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27792cd2
2021-06-04T02:37:29.471Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4024dcb8-0c56-4455-85ac-617f30aac093 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:37:29.472Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4024dcb8-0c56-4455-85ac-617f30aac093 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:37:30.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f651913-ebbd-4e29-b1cf-b8c360f1cfe6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:37:30.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f651913-ebbd-4e29-b1cf-b8c360f1cfe6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29c15f01
2021-06-04T02:37:30.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f651913-ebbd-4e29-b1cf-b8c360f1cfe6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:37:30.585Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f651913-ebbd-4e29-b1cf-b8c360f1cfe6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:37:36.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:37:36.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:37:39.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:37:39.362Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a33fa67e-0f79-47f2-b676-2ea047c8a6c6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:37:39.362Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a33fa67e-0f79-47f2-b676-2ea047c8a6c6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@947d119
2021-06-04T02:37:39.362Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a33fa67e-0f79-47f2-b676-2ea047c8a6c6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:37:39.362Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a33fa67e-0f79-47f2-b676-2ea047c8a6c6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:37:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:37:39.452Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts.
2021-06-04T02:37:39.453Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:37:39.453Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:37:41.587Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:37:41.931Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:37:41.931Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:37:41.938Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:37:41.939Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:37:42.130Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:37:42.133Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:37:42.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e9a181a-79ad-46f0-bc4e-e661e5daf2ea PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:37:42.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e9a181a-79ad-46f0-bc4e-e661e5daf2ea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@51e4db06
2021-06-04T02:37:42.384Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e9a181a-79ad-46f0-bc4e-e661e5daf2ea PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:37:42.384Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e9a181a-79ad-46f0-bc4e-e661e5daf2ea PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:37:42.503Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:37:42.505Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:37:42.655Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 503 Service Unavailable
2021-06-04T02:37:42.656Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 503
2021-06-04T02:37:42.656Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=503, variables=[]]
2021-06-04T02:37:42.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=351a7ee6-cbc5-4c8e-a200-bad1dab9da02 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:37:42.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=351a7ee6-cbc5-4c8e-a200-bad1dab9da02 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f957254
2021-06-04T02:37:42.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=351a7ee6-cbc5-4c8e-a200-bad1dab9da02 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:37:42.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=351a7ee6-cbc5-4c8e-a200-bad1dab9da02 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:37:42.984Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:37:42.985Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:37:43.013Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:37:43.014Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:37:43.083Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:37:43.084Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:37:43.099Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:37:43.099Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:37:43.105Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:37:43.106Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:37:43.120Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:37:43.437Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c09ff05-aa09-41a2-9a85-cca5f9cedf29 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:37:43.437Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c09ff05-aa09-41a2-9a85-cca5f9cedf29 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c0f1bf0
2021-06-04T02:37:43.438Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c09ff05-aa09-41a2-9a85-cca5f9cedf29 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:37:43.438Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c09ff05-aa09-41a2-9a85-cca5f9cedf29 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:37:44.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:37:44.891Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:37:44.891Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T02:37:45.475Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22d40d4f-cd78-4d8d-b213-59e82b454201 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:37:45.475Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22d40d4f-cd78-4d8d-b213-59e82b454201 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2bf7de71
2021-06-04T02:37:45.475Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22d40d4f-cd78-4d8d-b213-59e82b454201 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:37:45.475Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22d40d4f-cd78-4d8d-b213-59e82b454201 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:37:48.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b718f93-f891-4506-a1d5-cd849b637c22 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:37:48.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b718f93-f891-4506-a1d5-cd849b637c22 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5cbc1ce2
2021-06-04T02:37:48.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b718f93-f891-4506-a1d5-cd849b637c22 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:37:48.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b718f93-f891-4506-a1d5-cd849b637c22 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:37:49.253Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=4b718f93-f891-4506-a1d5-cd849b637c22 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:37:49.253Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=4b718f93-f891-4506-a1d5-cd849b637c22 ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:37:51.752Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88870769-3484-4fcc-a2a4-e92a13372a9a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:37:51.752Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88870769-3484-4fcc-a2a4-e92a13372a9a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@482fd2f3
2021-06-04T02:37:51.752Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88870769-3484-4fcc-a2a4-e92a13372a9a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:37:51.752Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88870769-3484-4fcc-a2a4-e92a13372a9a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:37:55.167Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e425485-fd53-4e6e-9f44-4d34560b5c57 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:37:55.167Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e425485-fd53-4e6e-9f44-4d34560b5c57 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c1b909d
2021-06-04T02:37:55.168Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e425485-fd53-4e6e-9f44-4d34560b5c57 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:37:55.168Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e425485-fd53-4e6e-9f44-4d34560b5c57 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:37:58.348Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1998ddc2-7c2a-4635-b165-258b9e7147e7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:37:58.348Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1998ddc2-7c2a-4635-b165-258b9e7147e7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@390ad739
2021-06-04T02:37:58.348Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1998ddc2-7c2a-4635-b165-258b9e7147e7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:37:58.348Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1998ddc2-7c2a-4635-b165-258b9e7147e7 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:37:59.872Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:37:59.881Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:38:00.649Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5a74531-d11a-4623-8d79-224f3a833700 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:38:00.649Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5a74531-d11a-4623-8d79-224f3a833700 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@56d97f6
2021-06-04T02:38:00.649Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5a74531-d11a-4623-8d79-224f3a833700 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:38:00.649Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5a74531-d11a-4623-8d79-224f3a833700 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:38:03.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=468431d0-310a-4bb9-b87d-7eb8b6028dd6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:38:03.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=468431d0-310a-4bb9-b87d-7eb8b6028dd6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@33e375e2
2021-06-04T02:38:03.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=468431d0-310a-4bb9-b87d-7eb8b6028dd6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:38:03.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=468431d0-310a-4bb9-b87d-7eb8b6028dd6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:38:06.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4da513c8-678c-4f9c-a071-e818690347c9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:38:06.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4da513c8-678c-4f9c-a071-e818690347c9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@430c847b
2021-06-04T02:38:06.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4da513c8-678c-4f9c-a071-e818690347c9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:38:06.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4da513c8-678c-4f9c-a071-e818690347c9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:38:09.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a46e5273-6d05-4eff-b169-f5b38057f7b5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:38:09.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a46e5273-6d05-4eff-b169-f5b38057f7b5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c50303c
2021-06-04T02:38:09.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a46e5273-6d05-4eff-b169-f5b38057f7b5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:38:09.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a46e5273-6d05-4eff-b169-f5b38057f7b5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:38:12.660Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50a7ffd2-85e6-4299-b166-2722438bc376 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:38:12.660Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50a7ffd2-85e6-4299-b166-2722438bc376 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@456bc067
2021-06-04T02:38:12.660Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50a7ffd2-85e6-4299-b166-2722438bc376 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:38:12.660Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50a7ffd2-85e6-4299-b166-2722438bc376 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:38:14.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:38:14.879Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:38:15.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7cecaa32-5099-43b8-9898-71bdaedf8d03 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:38:15.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7cecaa32-5099-43b8-9898-71bdaedf8d03 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d8ff14d
2021-06-04T02:38:15.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7cecaa32-5099-43b8-9898-71bdaedf8d03 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:38:15.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7cecaa32-5099-43b8-9898-71bdaedf8d03 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:38:18.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac9ce995-12f4-4232-966a-f4bade40593f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:38:18.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac9ce995-12f4-4232-966a-f4bade40593f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a078fdb
2021-06-04T02:38:18.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac9ce995-12f4-4232-966a-f4bade40593f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:38:18.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac9ce995-12f4-4232-966a-f4bade40593f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:38:21.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b92bcef-b720-433c-a93a-94c30e438e9b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:38:21.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b92bcef-b720-433c-a93a-94c30e438e9b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@677b9777
2021-06-04T02:38:21.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b92bcef-b720-433c-a93a-94c30e438e9b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:38:21.475Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b92bcef-b720-433c-a93a-94c30e438e9b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:38:24.435Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70da4dc7-6c86-4187-adb0-138476132953 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:38:24.435Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70da4dc7-6c86-4187-adb0-138476132953 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7c880b07
2021-06-04T02:38:24.435Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70da4dc7-6c86-4187-adb0-138476132953 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:38:24.435Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70da4dc7-6c86-4187-adb0-138476132953 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:38:27.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8066388-5ec4-47d5-bba1-e066067d4734 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:38:27.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8066388-5ec4-47d5-bba1-e066067d4734 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e9f8842
2021-06-04T02:38:27.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8066388-5ec4-47d5-bba1-e066067d4734 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:38:27.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8066388-5ec4-47d5-bba1-e066067d4734 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:38:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:38:29.899Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:38:30.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5ba2da4-71fb-4d5d-890c-b2eb3b618301 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:38:30.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5ba2da4-71fb-4d5d-890c-b2eb3b618301 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1810bb1d
2021-06-04T02:38:30.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5ba2da4-71fb-4d5d-890c-b2eb3b618301 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:38:30.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5ba2da4-71fb-4d5d-890c-b2eb3b618301 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:38:33.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd3ea687-ddb4-43b1-a32b-7547707a5444 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:38:33.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd3ea687-ddb4-43b1-a32b-7547707a5444 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@236b5747
2021-06-04T02:38:33.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd3ea687-ddb4-43b1-a32b-7547707a5444 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:38:33.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd3ea687-ddb4-43b1-a32b-7547707a5444 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:38:36.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6df4a96a-7b7b-4ae6-b8d5-16dd9567dfc7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:38:36.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6df4a96a-7b7b-4ae6-b8d5-16dd9567dfc7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f07a01e
2021-06-04T02:38:36.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6df4a96a-7b7b-4ae6-b8d5-16dd9567dfc7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:38:36.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6df4a96a-7b7b-4ae6-b8d5-16dd9567dfc7 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:38:39.454Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:38:39.456Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:38:39.456Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:38:39.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c2bab01-9d03-4659-9f96-16f9dcf49ea1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:38:39.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c2bab01-9d03-4659-9f96-16f9dcf49ea1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@dc8e624
2021-06-04T02:38:39.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c2bab01-9d03-4659-9f96-16f9dcf49ea1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:38:39.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c2bab01-9d03-4659-9f96-16f9dcf49ea1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:38:42.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d7c6bbf-d6b3-4623-b538-6aeb4ef82236 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:38:42.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d7c6bbf-d6b3-4623-b538-6aeb4ef82236 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@109d7cd3
2021-06-04T02:38:42.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d7c6bbf-d6b3-4623-b538-6aeb4ef82236 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:38:42.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d7c6bbf-d6b3-4623-b538-6aeb4ef82236 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:38:44.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:38:44.919Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:38:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bcd6b99-816a-4abe-b616-cd7229bb85b7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:38:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bcd6b99-816a-4abe-b616-cd7229bb85b7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69b5d0e8
2021-06-04T02:38:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bcd6b99-816a-4abe-b616-cd7229bb85b7 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:38:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bcd6b99-816a-4abe-b616-cd7229bb85b7 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:38:48.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92163260-ced4-458f-a9b6-4f00fee3fb75 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:38:48.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92163260-ced4-458f-a9b6-4f00fee3fb75 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b908a90
2021-06-04T02:38:48.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92163260-ced4-458f-a9b6-4f00fee3fb75 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:38:48.671Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92163260-ced4-458f-a9b6-4f00fee3fb75 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:38:51.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e6111dc-ae15-49e8-b546-198bc1491907 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:38:51.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e6111dc-ae15-49e8-b546-198bc1491907 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@123bc00
2021-06-04T02:38:51.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e6111dc-ae15-49e8-b546-198bc1491907 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:38:51.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e6111dc-ae15-49e8-b546-198bc1491907 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:38:54.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f110bce-2cf5-429f-8ddb-13f320bec675 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:38:54.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f110bce-2cf5-429f-8ddb-13f320bec675 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a232313
2021-06-04T02:38:54.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f110bce-2cf5-429f-8ddb-13f320bec675 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:38:54.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f110bce-2cf5-429f-8ddb-13f320bec675 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:38:55.511Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T02:38:57.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80c638ae-4807-4a38-971b-c86cbd92f662 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:38:57.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80c638ae-4807-4a38-971b-c86cbd92f662 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3dd68e2f
2021-06-04T02:38:57.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80c638ae-4807-4a38-971b-c86cbd92f662 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:38:57.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80c638ae-4807-4a38-971b-c86cbd92f662 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:38:59.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:39:00.200Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:39:00.393Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f59d4ad-1355-4378-b988-8ebcc0f0c344 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:39:00.393Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f59d4ad-1355-4378-b988-8ebcc0f0c344 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@72dd570f
2021-06-04T02:39:00.393Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f59d4ad-1355-4378-b988-8ebcc0f0c344 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:39:00.393Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f59d4ad-1355-4378-b988-8ebcc0f0c344 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:39:03.335Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62582412-bddb-451e-aed0-924548b2e989 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:39:03.335Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62582412-bddb-451e-aed0-924548b2e989 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e0226e8
2021-06-04T02:39:03.335Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62582412-bddb-451e-aed0-924548b2e989 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:39:03.335Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62582412-bddb-451e-aed0-924548b2e989 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:39:06.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fa0893e-1ca4-43db-a3ab-c44d9726f0ae PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:39:06.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fa0893e-1ca4-43db-a3ab-c44d9726f0ae PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d5aab80
2021-06-04T02:39:06.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fa0893e-1ca4-43db-a3ab-c44d9726f0ae PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:39:06.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fa0893e-1ca4-43db-a3ab-c44d9726f0ae PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:39:09.694Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3b762bf-7d09-419e-9461-e4fb549f762f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:39:09.694Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3b762bf-7d09-419e-9461-e4fb549f762f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f4fbf2
2021-06-04T02:39:09.694Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3b762bf-7d09-419e-9461-e4fb549f762f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:39:09.694Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3b762bf-7d09-419e-9461-e4fb549f762f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:39:12.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:39:12.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:39:12.700Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=b3b762bf-7d09-419e-9461-e4fb549f762f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:39:12.702Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=b3b762bf-7d09-419e-9461-e4fb549f762f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:39:12.702Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b3b762bf-7d09-419e-9461-e4fb549f762f ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:39:12.702Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b3b762bf-7d09-419e-9461-e4fb549f762f ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:39:14.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b77ed7d7-6ae2-49ae-b9c0-b5ae77f0dc28 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:39:14.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b77ed7d7-6ae2-49ae-b9c0-b5ae77f0dc28 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c09b14c
2021-06-04T02:39:14.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b77ed7d7-6ae2-49ae-b9c0-b5ae77f0dc28 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:39:14.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b77ed7d7-6ae2-49ae-b9c0-b5ae77f0dc28 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:39:14.715Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:39:14.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:39:15.176Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b77ed7d7-6ae2-49ae-b9c0-b5ae77f0dc28 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:39:15.176Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=b77ed7d7-6ae2-49ae-b9c0-b5ae77f0dc28 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:39:15.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3be3bef4-fde9-4a48-b9e2-1bfa2d18a95e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:39:15.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3be3bef4-fde9-4a48-b9e2-1bfa2d18a95e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3b9d4000
2021-06-04T02:39:15.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3be3bef4-fde9-4a48-b9e2-1bfa2d18a95e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:39:15.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3be3bef4-fde9-4a48-b9e2-1bfa2d18a95e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:39:16.318Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3be3bef4-fde9-4a48-b9e2-1bfa2d18a95e ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:39:16.319Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3be3bef4-fde9-4a48-b9e2-1bfa2d18a95e ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:39:18.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84bf43d7-f904-44b0-bab2-9290744fa275 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:39:18.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84bf43d7-f904-44b0-bab2-9290744fa275 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@181507ea
2021-06-04T02:39:18.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84bf43d7-f904-44b0-bab2-9290744fa275 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:39:18.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84bf43d7-f904-44b0-bab2-9290744fa275 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:39:21.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bda5409b-ea8f-46f2-8b5b-d17b59c4f377 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:39:21.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bda5409b-ea8f-46f2-8b5b-d17b59c4f377 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49474675
2021-06-04T02:39:21.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bda5409b-ea8f-46f2-8b5b-d17b59c4f377 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:39:21.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bda5409b-ea8f-46f2-8b5b-d17b59c4f377 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:39:22.047Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:39:22.049Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:39:22.153Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:39:24.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c5dee25-a3f1-4ebe-9f4b-564eaa956e58 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:39:24.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c5dee25-a3f1-4ebe-9f4b-564eaa956e58 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35726ff7
2021-06-04T02:39:24.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c5dee25-a3f1-4ebe-9f4b-564eaa956e58 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:39:24.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c5dee25-a3f1-4ebe-9f4b-564eaa956e58 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:39:27.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8d295f5-725c-41de-97c4-c69d9653abe1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:39:27.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8d295f5-725c-41de-97c4-c69d9653abe1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@643ea419
2021-06-04T02:39:27.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8d295f5-725c-41de-97c4-c69d9653abe1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:39:27.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8d295f5-725c-41de-97c4-c69d9653abe1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:39:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:39:30.840Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:39:30.857Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=681d9e47-844d-4f02-b026-6528dea0f7af PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:39:30.857Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=681d9e47-844d-4f02-b026-6528dea0f7af PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5424d523
2021-06-04T02:39:30.857Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=681d9e47-844d-4f02-b026-6528dea0f7af PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:39:30.857Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=681d9e47-844d-4f02-b026-6528dea0f7af PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:39:33.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a8a38ef-1456-4666-ace0-aa753bc6b2eb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:39:33.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a8a38ef-1456-4666-ace0-aa753bc6b2eb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2723453c
2021-06-04T02:39:33.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a8a38ef-1456-4666-ace0-aa753bc6b2eb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:39:33.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a8a38ef-1456-4666-ace0-aa753bc6b2eb PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:39:36.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68448cf6-d6b0-4bd5-bab3-8badc78604c9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:39:36.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68448cf6-d6b0-4bd5-bab3-8badc78604c9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1089bf8
2021-06-04T02:39:36.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68448cf6-d6b0-4bd5-bab3-8badc78604c9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:39:36.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68448cf6-d6b0-4bd5-bab3-8badc78604c9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:39:39.452Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:39:39.453Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:39:39.453Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:39:39.647Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61db8687-cc6c-4608-9972-68d750251ec3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:39:39.647Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61db8687-cc6c-4608-9972-68d750251ec3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1087e9ac
2021-06-04T02:39:39.647Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61db8687-cc6c-4608-9972-68d750251ec3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:39:39.647Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61db8687-cc6c-4608-9972-68d750251ec3 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:39:44.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:39:45.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:39:45.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:39:48.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:39:48.301Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:39:48.360Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7dd84ed9-fe02-476c-9e4a-4c9c7e8f773f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:39:48.360Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7dd84ed9-fe02-476c-9e4a-4c9c7e8f773f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6278bb52
2021-06-04T02:39:48.360Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7dd84ed9-fe02-476c-9e4a-4c9c7e8f773f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:39:48.360Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7dd84ed9-fe02-476c-9e4a-4c9c7e8f773f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:39:50.502Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a018d2b5-a9c1-44bb-b77e-616af0126f30 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:39:50.502Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a018d2b5-a9c1-44bb-b77e-616af0126f30 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f4f0884
2021-06-04T02:39:50.502Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a018d2b5-a9c1-44bb-b77e-616af0126f30 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:39:50.502Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a018d2b5-a9c1-44bb-b77e-616af0126f30 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:39:50.589Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:39:51.018Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a018d2b5-a9c1-44bb-b77e-616af0126f30 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:39:51.019Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=a018d2b5-a9c1-44bb-b77e-616af0126f30 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:39:51.359Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bc6c550-e0be-4691-8f32-e222bbae3967 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:39:51.359Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bc6c550-e0be-4691-8f32-e222bbae3967 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1add9fce
2021-06-04T02:39:51.360Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bc6c550-e0be-4691-8f32-e222bbae3967 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:39:51.360Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bc6c550-e0be-4691-8f32-e222bbae3967 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:39:51.560Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=5bc6c550-e0be-4691-8f32-e222bbae3967 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:39:51.560Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=5bc6c550-e0be-4691-8f32-e222bbae3967 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:39:51.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02408463-2f10-4c59-9863-29ad30e21a86 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:39:51.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02408463-2f10-4c59-9863-29ad30e21a86 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35b8cfb0
2021-06-04T02:39:51.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02408463-2f10-4c59-9863-29ad30e21a86 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:39:51.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02408463-2f10-4c59-9863-29ad30e21a86 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:39:54.498Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6be6a16f-ae23-40f3-85e5-63a3c829fa3e PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:39:54.498Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6be6a16f-ae23-40f3-85e5-63a3c829fa3e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@123d407e
2021-06-04T02:39:54.498Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6be6a16f-ae23-40f3-85e5-63a3c829fa3e PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:39:54.498Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6be6a16f-ae23-40f3-85e5-63a3c829fa3e PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:39:59.275Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee366b40-21ac-4e23-9d29-fb7cd2d9837d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:39:59.275Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee366b40-21ac-4e23-9d29-fb7cd2d9837d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35916195
2021-06-04T02:39:59.275Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee366b40-21ac-4e23-9d29-fb7cd2d9837d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:39:59.275Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee366b40-21ac-4e23-9d29-fb7cd2d9837d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:39:59.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:40:02.279Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ee366b40-21ac-4e23-9d29-fb7cd2d9837d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:40:02.279Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ee366b40-21ac-4e23-9d29-fb7cd2d9837d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:40:02.279Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ee366b40-21ac-4e23-9d29-fb7cd2d9837d ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:40:02.279Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ee366b40-21ac-4e23-9d29-fb7cd2d9837d ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:40:02.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52e75661-9895-43bc-a9d8-aafe911c8316 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:40:02.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52e75661-9895-43bc-a9d8-aafe911c8316 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43c4bb06
2021-06-04T02:40:02.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52e75661-9895-43bc-a9d8-aafe911c8316 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:40:02.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52e75661-9895-43bc-a9d8-aafe911c8316 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:40:06.026Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=52e75661-9895-43bc-a9d8-aafe911c8316 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:40:06.026Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=52e75661-9895-43bc-a9d8-aafe911c8316 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:40:07.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aabbd859-009e-4d73-9dd9-080504c6fb17 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:40:07.375Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aabbd859-009e-4d73-9dd9-080504c6fb17 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4834a151
2021-06-04T02:40:07.375Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aabbd859-009e-4d73-9dd9-080504c6fb17 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:40:07.375Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aabbd859-009e-4d73-9dd9-080504c6fb17 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:40:07.867Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information.
2021-06-04T02:40:09.119Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=aabbd859-009e-4d73-9dd9-080504c6fb17 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:40:09.119Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=aabbd859-009e-4d73-9dd9-080504c6fb17 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:40:09.715Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0562716-2282-4ada-8ec7-9e3aef016759 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:40:09.715Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0562716-2282-4ada-8ec7-9e3aef016759 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@106d6554
2021-06-04T02:40:09.715Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0562716-2282-4ada-8ec7-9e3aef016759 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:40:09.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0562716-2282-4ada-8ec7-9e3aef016759 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:40:10.018Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e0562716-2282-4ada-8ec7-9e3aef016759 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:40:10.018Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e0562716-2282-4ada-8ec7-9e3aef016759 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:40:10.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59965cec-e475-4536-b211-aa7ff041c329 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:40:10.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59965cec-e475-4536-b211-aa7ff041c329 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3172f8f9
2021-06-04T02:40:10.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59965cec-e475-4536-b211-aa7ff041c329 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:40:10.474Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59965cec-e475-4536-b211-aa7ff041c329 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:40:21.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:40:21.262Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:40:22.539Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:40:22.545Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:40:23.091Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eba3acd7-d3a4-4491-8246-e090c241227a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:40:23.091Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eba3acd7-d3a4-4491-8246-e090c241227a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c21f9af
2021-06-04T02:40:23.091Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eba3acd7-d3a4-4491-8246-e090c241227a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:40:23.091Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eba3acd7-d3a4-4491-8246-e090c241227a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:40:23.764Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:40:26.392Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:40:26.395Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:40:27.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b58c3515-b193-4bbd-8b20-773066f62d7a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:40:27.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b58c3515-b193-4bbd-8b20-773066f62d7a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@159fa194
2021-06-04T02:40:27.855Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b58c3515-b193-4bbd-8b20-773066f62d7a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:40:27.855Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b58c3515-b193-4bbd-8b20-773066f62d7a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:40:28.960Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b58c3515-b193-4bbd-8b20-773066f62d7a ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:40:28.960Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=b58c3515-b193-4bbd-8b20-773066f62d7a ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:40:29.520Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85229fd0-f445-4d5a-b613-e10e633a81d2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:40:29.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85229fd0-f445-4d5a-b613-e10e633a81d2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ea331b6
2021-06-04T02:40:29.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85229fd0-f445-4d5a-b613-e10e633a81d2 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:40:29.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85229fd0-f445-4d5a-b613-e10e633a81d2 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:40:30.373Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=85229fd0-f445-4d5a-b613-e10e633a81d2 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:40:30.373Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=85229fd0-f445-4d5a-b613-e10e633a81d2 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:40:31.753Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13e4dad4-c127-43fb-831a-a363762d5819 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:40:31.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13e4dad4-c127-43fb-831a-a363762d5819 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4830a9ab
2021-06-04T02:40:31.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13e4dad4-c127-43fb-831a-a363762d5819 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:40:31.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13e4dad4-c127-43fb-831a-a363762d5819 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:40:35.392Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6882f74-9c6c-485e-a595-c7c2e21c0057 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:40:35.393Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6882f74-9c6c-485e-a595-c7c2e21c0057 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b0fdd83
2021-06-04T02:40:35.393Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6882f74-9c6c-485e-a595-c7c2e21c0057 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:40:35.393Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6882f74-9c6c-485e-a595-c7c2e21c0057 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:40:36.780Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=160cdf63-11c0-44b3-a919-1307add22fcb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:40:36.780Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=160cdf63-11c0-44b3-a919-1307add22fcb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@73f44c77
2021-06-04T02:40:36.780Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=160cdf63-11c0-44b3-a919-1307add22fcb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:40:36.780Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=160cdf63-11c0-44b3-a919-1307add22fcb PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:40:40.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5030f07-1e81-47f0-87e6-3d0dff19413c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:40:40.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5030f07-1e81-47f0-87e6-3d0dff19413c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42ded3e
2021-06-04T02:40:40.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5030f07-1e81-47f0-87e6-3d0dff19413c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:40:40.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5030f07-1e81-47f0-87e6-3d0dff19413c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:40:41.268Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b0671a0-73d2-437c-9e27-5345b627464c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:40:41.268Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b0671a0-73d2-437c-9e27-5345b627464c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@491d71e1
2021-06-04T02:40:41.269Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b0671a0-73d2-437c-9e27-5345b627464c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:40:41.269Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b0671a0-73d2-437c-9e27-5345b627464c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:40:41.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75f1f4c1-6b49-44a0-a73f-ebf3ce0d6c11 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:40:41.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75f1f4c1-6b49-44a0-a73f-ebf3ce0d6c11 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c9b4e84
2021-06-04T02:40:41.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75f1f4c1-6b49-44a0-a73f-ebf3ce0d6c11 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:40:41.878Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75f1f4c1-6b49-44a0-a73f-ebf3ce0d6c11 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:40:43.364Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e751b36-65ac-41f0-b752-15fbf8bda407 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:40:43.364Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e751b36-65ac-41f0-b752-15fbf8bda407 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ddd3894
2021-06-04T02:40:43.364Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e751b36-65ac-41f0-b752-15fbf8bda407 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:40:43.364Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e751b36-65ac-41f0-b752-15fbf8bda407 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:40:45.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9db2334a-47a9-4a9c-b1f6-0635702d1da6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:40:45.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9db2334a-47a9-4a9c-b1f6-0635702d1da6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@16726e0c
2021-06-04T02:40:45.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9db2334a-47a9-4a9c-b1f6-0635702d1da6 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:40:45.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9db2334a-47a9-4a9c-b1f6-0635702d1da6 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:40:48.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:40:48.262Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:40:48.322Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=9db2334a-47a9-4a9c-b1f6-0635702d1da6 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:40:48.323Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=9db2334a-47a9-4a9c-b1f6-0635702d1da6 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:40:48.323Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9db2334a-47a9-4a9c-b1f6-0635702d1da6 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:40:48.324Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9db2334a-47a9-4a9c-b1f6-0635702d1da6 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:40:50.859Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3eb89313-bca7-4278-91a4-f52e20859dd8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:40:50.859Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3eb89313-bca7-4278-91a4-f52e20859dd8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34c2975a
2021-06-04T02:40:50.860Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3eb89313-bca7-4278-91a4-f52e20859dd8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:40:50.860Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3eb89313-bca7-4278-91a4-f52e20859dd8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:40:51.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:40:53.906Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3eb89313-bca7-4278-91a4-f52e20859dd8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:40:53.906Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3eb89313-bca7-4278-91a4-f52e20859dd8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:40:53.907Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3eb89313-bca7-4278-91a4-f52e20859dd8 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:40:53.907Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=3eb89313-bca7-4278-91a4-f52e20859dd8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:40:54.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:40:57.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:40:57.808Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8cb95595-3aec-4777-8788-6c43ae90b65d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:40:57.809Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8cb95595-3aec-4777-8788-6c43ae90b65d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@56d6996f
2021-06-04T02:40:57.809Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8cb95595-3aec-4777-8788-6c43ae90b65d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:40:57.809Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8cb95595-3aec-4777-8788-6c43ae90b65d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:40:58.217Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8cb95595-3aec-4777-8788-6c43ae90b65d ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:40:58.218Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=8cb95595-3aec-4777-8788-6c43ae90b65d ErrorCategory=ERROR ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:40:59.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d91b143c-459e-479c-bf9e-c31d99ea0701 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:40:59.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d91b143c-459e-479c-bf9e-c31d99ea0701 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7309aad0
2021-06-04T02:40:59.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d91b143c-459e-479c-bf9e-c31d99ea0701 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:40:59.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d91b143c-459e-479c-bf9e-c31d99ea0701 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:40:59.375Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:40:59.975Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca531069-ee64-497a-a391-d7baef48a78a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:40:59.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca531069-ee64-497a-a391-d7baef48a78a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6949aed9
2021-06-04T02:40:59.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca531069-ee64-497a-a391-d7baef48a78a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:40:59.976Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca531069-ee64-497a-a391-d7baef48a78a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:41:01.073Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ca531069-ee64-497a-a391-d7baef48a78a ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:41:01.073Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ca531069-ee64-497a-a391-d7baef48a78a ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:41:01.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a1db7bd-a9ec-4cd9-bcf7-589a56fbefc4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:41:01.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a1db7bd-a9ec-4cd9-bcf7-589a56fbefc4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@bb64f7e
2021-06-04T02:41:01.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a1db7bd-a9ec-4cd9-bcf7-589a56fbefc4 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:41:01.577Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a1db7bd-a9ec-4cd9-bcf7-589a56fbefc4 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:41:02.369Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0940bdc-f302-4f8f-a58d-43a835ddc7c0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:41:02.370Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0940bdc-f302-4f8f-a58d-43a835ddc7c0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54454598
2021-06-04T02:41:02.370Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0940bdc-f302-4f8f-a58d-43a835ddc7c0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:41:02.370Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0940bdc-f302-4f8f-a58d-43a835ddc7c0 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:41:03.654Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c025002d-ce28-41be-838e-7cb8969190eb PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:41:03.654Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c025002d-ce28-41be-838e-7cb8969190eb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6aa42aea
2021-06-04T02:41:03.654Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c025002d-ce28-41be-838e-7cb8969190eb PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:41:03.654Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c025002d-ce28-41be-838e-7cb8969190eb PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:41:12.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:41:12.261Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:41:14.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26d7bf71-c12c-44ed-b0e9-26fb78099834 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:41:14.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26d7bf71-c12c-44ed-b0e9-26fb78099834 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e3f7e01
2021-06-04T02:41:14.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26d7bf71-c12c-44ed-b0e9-26fb78099834 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:41:14.775Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26d7bf71-c12c-44ed-b0e9-26fb78099834 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:41:14.802Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://message-router.onap:3904: The target server failed to respond
2021-06-04T02:41:14.802Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:41:15.112Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:41:15.112Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:41:15.123Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:41:15.123Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:41:15.140Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T02:41:15.142Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:41:15.172Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:41:15.172Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:41:15.179Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:41:15.179Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:41:15.182Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:41:15.182Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:41:16.089Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:41:16.358Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes
2021-06-04T02:41:16.359Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:41:18.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b399528-45de-46e2-afe2-6a01eecf29f3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:41:18.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b399528-45de-46e2-afe2-6a01eecf29f3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@774b1507
2021-06-04T02:41:18.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b399528-45de-46e2-afe2-6a01eecf29f3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:41:18.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b399528-45de-46e2-afe2-6a01eecf29f3 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:41:20.866Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81178990-1b35-4fc6-bf0d-c15e5bb139e9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:41:20.866Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81178990-1b35-4fc6-bf0d-c15e5bb139e9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9dcf7f3
2021-06-04T02:41:20.866Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81178990-1b35-4fc6-bf0d-c15e5bb139e9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:41:20.866Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81178990-1b35-4fc6-bf0d-c15e5bb139e9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:41:23.869Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=81178990-1b35-4fc6-bf0d-c15e5bb139e9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:41:23.870Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=81178990-1b35-4fc6-bf0d-c15e5bb139e9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:41:23.870Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=81178990-1b35-4fc6-bf0d-c15e5bb139e9 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:41:23.870Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=81178990-1b35-4fc6-bf0d-c15e5bb139e9 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:41:43.956Z [cluster1-timeouter-0] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.138.69:9042] Operation timed out
at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:41:43.957Z [cluster1-timeouter-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.138.69:9042
com.datastax.driver.core.exceptions.ConnectionException: [cassandra.onap/10.242.138.69:9042] Pool was closed during initialization
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:173)
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:158)
at com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1080)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746)
at com.google.common.util.concurrent.CollectionFuture.handleAllCompleted(CollectionFuture.java:69)
at com.google.common.util.concurrent.AggregateFuture.processCompleted(AggregateFuture.java:282)
at com.google.common.util.concurrent.AggregateFuture.decrementCountAndMaybeComplete(AggregateFuture.java:264)
at com.google.common.util.concurrent.AggregateFuture.access$200(AggregateFuture.java:42)
at com.google.common.util.concurrent.AggregateFuture$1.run(AggregateFuture.java:147)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179)
at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203)
at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179)
at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:100)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771)
at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
2021-06-04T02:41:43.957Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ac0bb3b-a3c6-43b6-a680-9724785fc890 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:41:43.957Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ac0bb3b-a3c6-43b6-a680-9724785fc890 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42646f58
2021-06-04T02:41:43.957Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ac0bb3b-a3c6-43b6-a680-9724785fc890 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:41:43.957Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ac0bb3b-a3c6-43b6-a680-9724785fc890 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:41:46.997Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=9ac0bb3b-a3c6-43b6-a680-9724785fc890 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:41:46.997Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=9ac0bb3b-a3c6-43b6-a680-9724785fc890 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:41:47.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2236a2a-70a0-4af1-87d3-6bbd4ed42520 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:41:47.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2236a2a-70a0-4af1-87d3-6bbd4ed42520 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58521eba
2021-06-04T02:41:47.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2236a2a-70a0-4af1-87d3-6bbd4ed42520 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:41:47.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2236a2a-70a0-4af1-87d3-6bbd4ed42520 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:41:48.815Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:41:48.815Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information.
2021-06-04T02:41:49.815Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:41:50.661Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d2236a2a-70a0-4af1-87d3-6bbd4ed42520 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
2021-06-04T02:41:50.661Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d2236a2a-70a0-4af1-87d3-6bbd4ed42520 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response:
org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:124)
at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:66)
at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:78)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51)
at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:47)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:232)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:145)
at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:405)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/java.net.SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:118)
... 13 common frames omitted
2021-06-04T02:41:50.816Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:41:50.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f981e4e5-7d60-43ae-a104-d3a0e2493a96 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:41:50.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f981e4e5-7d60-43ae-a104-d3a0e2493a96 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57a0ae10
2021-06-04T02:41:50.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f981e4e5-7d60-43ae-a104-d3a0e2493a96 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:41:50.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f981e4e5-7d60-43ae-a104-d3a0e2493a96 PartnerName=SDC.BE The cassandra down nodes number is 1
2021-06-04T02:41:51.711Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset
2021-06-04T02:41:51.711Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904
2021-06-04T02:41:51.816Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException
2021-06-04T02:41:51.981Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:41:51.982Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:41:52.513Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:41:52.514Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:41:52.595Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:41:52.597Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:41:52.608Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:41:52.609Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:41:52.644Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:41:52.645Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:41:52.658Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f981e4e5-7d60-43ae-a104-d3a0e2493a96 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:41:52.658Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=f981e4e5-7d60-43ae-a104-d3a0e2493a96 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information.
2021-06-04T02:41:52.847Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.246.203 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-5ddb77679c-fjvdd TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB.
2021-06-04T02:41:52.892Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:41:52.894Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:41:52.912Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:41:52.913Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:41:52.941Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:41:52.946Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:41:52.979Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:41:52.981Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:41:53.008Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:41:53.011Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:41:53.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd9f2824-b474-4064-91a7-16af3acfbdc8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:41:53.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd9f2824-b474-4064-91a7-16af3acfbdc8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ea3fcec
2021-06-04T02:41:53.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd9f2824-b474-4064-91a7-16af3acfbdc8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:41:53.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd9f2824-b474-4064-91a7-16af3acfbdc8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:41:53.025Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:41:53.026Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:41:53.070Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:41:53.103Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T02:41:53.103Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:41:53.104Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:41:53.104Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:41:54.147Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d348d3e-59ae-4bd5-abbf-5b0448139252 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:41:54.147Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d348d3e-59ae-4bd5-abbf-5b0448139252 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50fb807d
2021-06-04T02:41:54.147Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d348d3e-59ae-4bd5-abbf-5b0448139252 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:41:54.147Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d348d3e-59ae-4bd5-abbf-5b0448139252 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:41:54.758Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=2d348d3e-59ae-4bd5-abbf-5b0448139252 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:41:54.758Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=2d348d3e-59ae-4bd5-abbf-5b0448139252 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:41:55.353Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a984067-647c-446d-8de3-cc4ff6eee3d3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:41:55.353Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a984067-647c-446d-8de3-cc4ff6eee3d3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@279745c
2021-06-04T02:41:55.353Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a984067-647c-446d-8de3-cc4ff6eee3d3 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:41:55.353Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a984067-647c-446d-8de3-cc4ff6eee3d3 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:41:56.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25ed888e-17ba-43b7-b684-abfde6dda7b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:41:56.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25ed888e-17ba-43b7-b684-abfde6dda7b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30fdd555
2021-06-04T02:41:56.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25ed888e-17ba-43b7-b684-abfde6dda7b9 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:41:56.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25ed888e-17ba-43b7-b684-abfde6dda7b9 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:41:58.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=551bea51-018c-4cbc-a93c-af4610dcd27c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:41:58.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=551bea51-018c-4cbc-a93c-af4610dcd27c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@31b80b3a
2021-06-04T02:41:58.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=551bea51-018c-4cbc-a93c-af4610dcd27c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:41:58.050Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=551bea51-018c-4cbc-a93c-af4610dcd27c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:41:59.252Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d00317a-15e2-4cc0-879e-d9aad048d7ee PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:41:59.252Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d00317a-15e2-4cc0-879e-d9aad048d7ee PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3dcc9d18
2021-06-04T02:41:59.252Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d00317a-15e2-4cc0-879e-d9aad048d7ee PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:41:59.252Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d00317a-15e2-4cc0-879e-d9aad048d7ee PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:41:59.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:41:59.874Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:41:59.874Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster.
2021-06-04T02:42:01.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f2792e7-b7ae-4032-9206-cdd2e4dd2d0c PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:42:01.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f2792e7-b7ae-4032-9206-cdd2e4dd2d0c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74dec569
2021-06-04T02:42:01.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f2792e7-b7ae-4032-9206-cdd2e4dd2d0c PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:42:01.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f2792e7-b7ae-4032-9206-cdd2e4dd2d0c PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:42:01.774Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=5f2792e7-b7ae-4032-9206-cdd2e4dd2d0c ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:42:01.774Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=5f2792e7-b7ae-4032-9206-cdd2e4dd2d0c ErrorCategory=INFO ServiceName=BE Component DE state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster.
2021-06-04T02:42:02.660Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a146285d-6212-4073-82a9-ed81f23c3610 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:42:02.660Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a146285d-6212-4073-82a9-ed81f23c3610 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a57e1da
2021-06-04T02:42:02.660Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a146285d-6212-4073-82a9-ed81f23c3610 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:42:02.660Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a146285d-6212-4073-82a9-ed81f23c3610 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:42:04.249Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f3171a2-0f4b-414f-9d92-02af90d0315f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:42:04.249Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f3171a2-0f4b-414f-9d92-02af90d0315f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b47ce71
2021-06-04T02:42:04.249Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f3171a2-0f4b-414f-9d92-02af90d0315f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:42:04.249Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f3171a2-0f4b-414f-9d92-02af90d0315f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:42:05.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50f573d4-6107-4962-bbb7-9511267883be PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:42:05.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50f573d4-6107-4962-bbb7-9511267883be PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2babc5c
2021-06-04T02:42:05.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50f573d4-6107-4962-bbb7-9511267883be PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:42:05.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50f573d4-6107-4962-bbb7-9511267883be PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:42:06.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=070fbd0b-578d-4870-9b01-56fa2540edd0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:42:06.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=070fbd0b-578d-4870-9b01-56fa2540edd0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@cdd4ef
2021-06-04T02:42:06.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=070fbd0b-578d-4870-9b01-56fa2540edd0 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:42:06.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=070fbd0b-578d-4870-9b01-56fa2540edd0 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:42:08.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0cb8fb09-1237-40a8-a8bf-6ec89803d932 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:42:08.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0cb8fb09-1237-40a8-a8bf-6ec89803d932 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1581bc1d
2021-06-04T02:42:08.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0cb8fb09-1237-40a8-a8bf-6ec89803d932 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:42:08.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0cb8fb09-1237-40a8-a8bf-6ec89803d932 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:42:08.253Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T02:42:08.253Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:42:08.254Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:42:08.254Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:42:09.249Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da3df92f-736f-4eb9-8c0e-188429d4154d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:42:09.249Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da3df92f-736f-4eb9-8c0e-188429d4154d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@70d0cc9a
2021-06-04T02:42:09.249Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da3df92f-736f-4eb9-8c0e-188429d4154d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:42:09.249Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da3df92f-736f-4eb9-8c0e-188429d4154d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:42:10.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8cddf337-bfa9-43f7-9439-7f3b5b349ce5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:42:10.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8cddf337-bfa9-43f7-9439-7f3b5b349ce5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27dfc680
2021-06-04T02:42:10.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8cddf337-bfa9-43f7-9439-7f3b5b349ce5 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:42:10.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8cddf337-bfa9-43f7-9439-7f3b5b349ce5 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:42:11.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd4ff651-267b-42c0-adc0-ed87636ca7c8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:42:11.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd4ff651-267b-42c0-adc0-ed87636ca7c8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49db0438
2021-06-04T02:42:11.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd4ff651-267b-42c0-adc0-ed87636ca7c8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:42:11.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd4ff651-267b-42c0-adc0-ed87636ca7c8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:42:12.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6787f7c1-5366-41b2-9c28-f8106a4a9337 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:42:12.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6787f7c1-5366-41b2-9c28-f8106a4a9337 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@51a2384a
2021-06-04T02:42:12.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6787f7c1-5366-41b2-9c28-f8106a4a9337 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:42:12.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6787f7c1-5366-41b2-9c28-f8106a4a9337 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:42:13.649Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=305416a6-a770-4355-b80e-3d774c940990 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:42:13.649Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=305416a6-a770-4355-b80e-3d774c940990 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27e09af8
2021-06-04T02:42:13.649Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=305416a6-a770-4355-b80e-3d774c940990 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:42:13.649Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=305416a6-a770-4355-b80e-3d774c940990 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:42:14.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:42:14.875Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:42:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d856e0c3-57d0-43dc-b669-93b975c07d86 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:42:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d856e0c3-57d0-43dc-b669-93b975c07d86 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ed2a342
2021-06-04T02:42:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d856e0c3-57d0-43dc-b669-93b975c07d86 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:42:15.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d856e0c3-57d0-43dc-b669-93b975c07d86 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:42:18.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8582dbfc-aa42-4f6c-9b76-bb97db93158b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:42:18.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8582dbfc-aa42-4f6c-9b76-bb97db93158b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6fb99264
2021-06-04T02:42:18.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8582dbfc-aa42-4f6c-9b76-bb97db93158b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:42:18.647Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8582dbfc-aa42-4f6c-9b76-bb97db93158b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:42:21.656Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1e58202-e744-4a4b-a354-0b5b3fd6c75d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:42:21.656Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1e58202-e744-4a4b-a354-0b5b3fd6c75d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f9987b1
2021-06-04T02:42:21.656Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1e58202-e744-4a4b-a354-0b5b3fd6c75d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:42:21.656Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1e58202-e744-4a4b-a354-0b5b3fd6c75d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:42:23.212Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T02:42:24.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a9a77be-262c-424f-8d47-8fb62463273f PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:42:24.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a9a77be-262c-424f-8d47-8fb62463273f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@c0dffe0
2021-06-04T02:42:24.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a9a77be-262c-424f-8d47-8fb62463273f PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:42:24.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a9a77be-262c-424f-8d47-8fb62463273f PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:42:27.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94f20712-9485-469d-8a7d-6d6e8149d36a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:42:27.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94f20712-9485-469d-8a7d-6d6e8149d36a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@672e8590
2021-06-04T02:42:27.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94f20712-9485-469d-8a7d-6d6e8149d36a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:42:27.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94f20712-9485-469d-8a7d-6d6e8149d36a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:42:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:42:29.875Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:42:30.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e5cbdbd-55d6-498c-9818-a897b1ba8348 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:42:30.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e5cbdbd-55d6-498c-9818-a897b1ba8348 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@442701a3
2021-06-04T02:42:30.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e5cbdbd-55d6-498c-9818-a897b1ba8348 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:42:30.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e5cbdbd-55d6-498c-9818-a897b1ba8348 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:42:33.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaa25966-0cd1-4b48-81ec-5fe0ed6bc48a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:42:33.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaa25966-0cd1-4b48-81ec-5fe0ed6bc48a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27e0b299
2021-06-04T02:42:33.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaa25966-0cd1-4b48-81ec-5fe0ed6bc48a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:42:33.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaa25966-0cd1-4b48-81ec-5fe0ed6bc48a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:42:36.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de9a8fa6-f28d-4ead-8e45-beb1f0f53523 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:42:36.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de9a8fa6-f28d-4ead-8e45-beb1f0f53523 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4471ab7a
2021-06-04T02:42:36.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de9a8fa6-f28d-4ead-8e45-beb1f0f53523 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:42:36.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de9a8fa6-f28d-4ead-8e45-beb1f0f53523 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:42:39.453Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:42:39.455Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:42:39.455Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:42:39.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c02334a8-8b62-4006-ad71-01e9c2f22ecc PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:42:39.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c02334a8-8b62-4006-ad71-01e9c2f22ecc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57e0b461
2021-06-04T02:42:39.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c02334a8-8b62-4006-ad71-01e9c2f22ecc PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:42:39.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c02334a8-8b62-4006-ad71-01e9c2f22ecc PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:42:42.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f998ec79-6d6e-4637-9863-8a0b65cee41a PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:42:42.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f998ec79-6d6e-4637-9863-8a0b65cee41a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b368d27
2021-06-04T02:42:42.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f998ec79-6d6e-4637-9863-8a0b65cee41a PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:42:42.078Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f998ec79-6d6e-4637-9863-8a0b65cee41a PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:42:44.872Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:42:44.879Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:42:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc066f46-74eb-4db4-8ba0-eb50890db96d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:42:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc066f46-74eb-4db4-8ba0-eb50890db96d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9e096a2
2021-06-04T02:42:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc066f46-74eb-4db4-8ba0-eb50890db96d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:42:45.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc066f46-74eb-4db4-8ba0-eb50890db96d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:42:48.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96c71b84-e445-40c2-9444-1f8b3e27fb72 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:42:48.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96c71b84-e445-40c2-9444-1f8b3e27fb72 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4083c69f
2021-06-04T02:42:48.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96c71b84-e445-40c2-9444-1f8b3e27fb72 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:42:48.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96c71b84-e445-40c2-9444-1f8b3e27fb72 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:42:51.350Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0f41a77-ef52-4f1d-ad97-a07d245f679b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:42:51.350Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0f41a77-ef52-4f1d-ad97-a07d245f679b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@12923152
2021-06-04T02:42:51.350Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0f41a77-ef52-4f1d-ad97-a07d245f679b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:42:51.350Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0f41a77-ef52-4f1d-ad97-a07d245f679b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:42:54.418Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK
2021-06-04T02:42:54.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d2a8a6e-0628-4290-bc49-4e9195ea4c46 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:42:54.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d2a8a6e-0628-4290-bc49-4e9195ea4c46 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@dd2d992
2021-06-04T02:42:54.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d2a8a6e-0628-4290-bc49-4e9195ea4c46 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:42:54.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d2a8a6e-0628-4290-bc49-4e9195ea4c46 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:42:57.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a423830-179b-462a-8217-8b5d36807ec1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:42:57.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a423830-179b-462a-8217-8b5d36807ec1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@8a0b0c
2021-06-04T02:42:57.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a423830-179b-462a-8217-8b5d36807ec1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:42:57.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a423830-179b-462a-8217-8b5d36807ec1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:42:59.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:42:59.874Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:43:00.764Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d94f7d25-e565-46d3-a974-2a076be61606 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:43:00.764Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d94f7d25-e565-46d3-a974-2a076be61606 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e6382bc
2021-06-04T02:43:00.765Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d94f7d25-e565-46d3-a974-2a076be61606 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:43:00.765Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d94f7d25-e565-46d3-a974-2a076be61606 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:43:03.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d06954dc-1484-40be-8a2f-75af4f4c42d1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:43:03.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d06954dc-1484-40be-8a2f-75af4f4c42d1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5df83083
2021-06-04T02:43:03.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d06954dc-1484-40be-8a2f-75af4f4c42d1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:43:03.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d06954dc-1484-40be-8a2f-75af4f4c42d1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:43:06.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c53e0e4f-1b70-411a-a8c1-7bf7ea350f13 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:43:06.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c53e0e4f-1b70-411a-a8c1-7bf7ea350f13 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@467d7ce7
2021-06-04T02:43:06.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c53e0e4f-1b70-411a-a8c1-7bf7ea350f13 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:43:06.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c53e0e4f-1b70-411a-a8c1-7bf7ea350f13 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:43:09.673Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cf0c64a-3bca-4983-9055-8fda8774af62 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:43:09.673Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cf0c64a-3bca-4983-9055-8fda8774af62 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@16ffcd4f
2021-06-04T02:43:09.673Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cf0c64a-3bca-4983-9055-8fda8774af62 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:43:09.673Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cf0c64a-3bca-4983-9055-8fda8774af62 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:43:12.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bce9a90-089d-433f-8680-e87f353f4225 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:43:12.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bce9a90-089d-433f-8680-e87f353f4225 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54cbdb4e
2021-06-04T02:43:12.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bce9a90-089d-433f-8680-e87f353f4225 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:43:12.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bce9a90-089d-433f-8680-e87f353f4225 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:43:14.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:43:14.879Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:43:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eaa620d5-8d9b-4fa5-904f-3d8e3eeff23b PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:43:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eaa620d5-8d9b-4fa5-904f-3d8e3eeff23b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@48ab857c
2021-06-04T02:43:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eaa620d5-8d9b-4fa5-904f-3d8e3eeff23b PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:43:15.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eaa620d5-8d9b-4fa5-904f-3d8e3eeff23b PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:43:18.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5619629-d2f3-4042-a668-8f5d0c23a255 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:43:18.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5619629-d2f3-4042-a668-8f5d0c23a255 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@659c52ca
2021-06-04T02:43:18.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5619629-d2f3-4042-a668-8f5d0c23a255 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:43:18.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5619629-d2f3-4042-a668-8f5d0c23a255 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:43:21.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a88545a5-09d9-4170-84b5-4cfde2bb1c36 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:43:21.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a88545a5-09d9-4170-84b5-4cfde2bb1c36 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@de16e83
2021-06-04T02:43:21.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a88545a5-09d9-4170-84b5-4cfde2bb1c36 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:43:21.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a88545a5-09d9-4170-84b5-4cfde2bb1c36 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:43:24.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f5a567e-f2ec-4b58-ad83-5b8550fda1e1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:43:24.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f5a567e-f2ec-4b58-ad83-5b8550fda1e1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7fad5da
2021-06-04T02:43:24.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f5a567e-f2ec-4b58-ad83-5b8550fda1e1 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:43:24.317Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f5a567e-f2ec-4b58-ad83-5b8550fda1e1 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:43:27.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a5679a8-0a9b-4676-950d-b96e1c3e3ea8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:43:27.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a5679a8-0a9b-4676-950d-b96e1c3e3ea8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@136e303c
2021-06-04T02:43:27.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a5679a8-0a9b-4676-950d-b96e1c3e3ea8 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:43:27.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a5679a8-0a9b-4676-950d-b96e1c3e3ea8 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:43:29.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ...
2021-06-04T02:43:29.874Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK
2021-06-04T02:43:30.851Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47a68023-a739-481c-9f50-b7a7ca898015 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:43:30.851Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47a68023-a739-481c-9f50-b7a7ca898015 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@14633a99
2021-06-04T02:43:30.851Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47a68023-a739-481c-9f50-b7a7ca898015 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:43:30.851Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47a68023-a739-481c-9f50-b7a7ca898015 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:43:33.420Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7839d5da-4199-49b2-8d74-175ab01a2c2d PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:43:33.420Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7839d5da-4199-49b2-8d74-175ab01a2c2d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@12f0dbe0
2021-06-04T02:43:33.420Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7839d5da-4199-49b2-8d74-175ab01a2c2d PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:43:33.420Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7839d5da-4199-49b2-8d74-175ab01a2c2d PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:43:36.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09a391b7-f4da-4b35-a982-f293126143ba PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:43:36.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09a391b7-f4da-4b35-a982-f293126143ba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43758861
2021-06-04T02:43:36.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09a391b7-f4da-4b35-a982-f293126143ba PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:43:36.648Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09a391b7-f4da-4b35-a982-f293126143ba PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:43:39.453Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000
2021-06-04T02:43:39.455Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel.
2021-06-04T02:43:39.455Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ...
2021-06-04T02:43:39.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f99cbce2-4770-48a5-9a03-a705e47e4231 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:43:39.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f99cbce2-4770-48a5-9a03-a705e47e4231 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@21f8afe3
2021-06-04T02:43:39.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f99cbce2-4770-48a5-9a03-a705e47e4231 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:43:39.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f99cbce2-4770-48a5-9a03-a705e47e4231 PartnerName=SDC.BE The cassandra down nodes number is 0
2021-06-04T02:43:42.252Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8eebbfe4-9277-4eca-aad6-92c486632248 PartnerName=SDC.BE creating cluster for Cassandra for monitoring.
2021-06-04T02:43:42.252Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8eebbfe4-9277-4eca-aad6-92c486632248 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c42feb7
2021-06-04T02:43:42.252Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8eebbfe4-9277-4eca-aad6-92c486632248 PartnerName=SDC.BE The number of cassandra nodes is:3
2021-06-04T02:43:42.252Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8eebbfe4-9277-4eca-aad6-92c486632248 PartnerName=SDC.BE The cassandra down nodes number is 0