2021-10-15 00:44:05.117 [info] <0.33.0> Application lager started on node 'rabbit@10.242.238.8' 2021-10-15 00:44:05.522 [info] <0.33.0> Application os_mon started on node 'rabbit@10.242.238.8' 2021-10-15 00:44:05.522 [info] <0.33.0> Application crypto started on node 'rabbit@10.242.238.8' 2021-10-15 00:44:05.522 [info] <0.33.0> Application cowlib started on node 'rabbit@10.242.238.8' 2021-10-15 00:44:05.522 [info] <0.33.0> Application xmerl started on node 'rabbit@10.242.238.8' 2021-10-15 00:44:05.670 [info] <0.33.0> Application mnesia started on node 'rabbit@10.242.238.8' 2021-10-15 00:44:05.671 [info] <0.33.0> Application recon started on node 'rabbit@10.242.238.8' 2021-10-15 00:44:05.671 [info] <0.33.0> Application jsx started on node 'rabbit@10.242.238.8' 2021-10-15 00:44:05.671 [info] <0.33.0> Application asn1 started on node 'rabbit@10.242.238.8' 2021-10-15 00:44:05.671 [info] <0.33.0> Application public_key started on node 'rabbit@10.242.238.8' 2021-10-15 00:44:05.777 [info] <0.33.0> Application ssl started on node 'rabbit@10.242.238.8' 2021-10-15 00:44:05.794 [info] <0.33.0> Application ranch started on node 'rabbit@10.242.238.8' 2021-10-15 00:44:05.794 [info] <0.33.0> Application ranch_proxy_protocol started on node 'rabbit@10.242.238.8' 2021-10-15 00:44:05.795 [info] <0.33.0> Application rabbit_common started on node 'rabbit@10.242.238.8' 2021-10-15 00:44:05.805 [info] <0.33.0> Application amqp_client started on node 'rabbit@10.242.238.8' 2021-10-15 00:44:05.808 [info] <0.33.0> Application cowboy started on node 'rabbit@10.242.238.8' 2021-10-15 00:44:05.901 [info] <0.33.0> Application inets started on node 'rabbit@10.242.238.8' 2021-10-15 00:44:05.920 [info] <0.193.0> Starting RabbitMQ 3.7.4 on Erlang 20.1.7 Copyright (C) 2007-2018 Pivotal Software, Inc. Licensed under the MPL. See http://www.rabbitmq.com/ ## ## ## ## RabbitMQ 3.7.4. Copyright (C) 2007-2018 Pivotal Software, Inc. ########## Licensed under the MPL. See http://www.rabbitmq.com/ ###### ## ########## Logs: Starting broker... 2021-10-15 00:44:05.946 [info] <0.193.0> node : rabbit@10.242.238.8 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.conf cookie hash : fzkFV2J/Z5UOLdODv2NmbA== log(s) : database dir : /var/lib/rabbitmq/mnesia/rabbit@10.242.238.8 2021-10-15 00:44:08.793 [info] <0.201.0> Memory high watermark set to 6415 MiB (6727421132 bytes) of 16039 MiB (16818552832 bytes) total 2021-10-15 00:44:08.802 [info] <0.203.0> Enabling free disk space monitoring 2021-10-15 00:44:08.802 [info] <0.203.0> Disk free limit set to 50MB 2021-10-15 00:44:08.810 [info] <0.205.0> Limiting to approx 1048476 file handles (943626 sockets) 2021-10-15 00:44:08.810 [info] <0.206.0> FHC read buffering: OFF 2021-10-15 00:44:08.810 [info] <0.206.0> FHC write buffering: ON 2021-10-15 00:44:08.812 [info] <0.193.0> Node database directory at /var/lib/rabbitmq/mnesia/rabbit@10.242.238.8 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2021-10-15 00:44:08.812 [info] <0.193.0> Configured peer discovery backend: rabbit_peer_discovery_k8s 2021-10-15 00:44:08.812 [info] <0.193.0> Will try to lock with peer discovery backend rabbit_peer_discovery_k8s 2021-10-15 00:44:08.812 [info] <0.193.0> Peer discovery backend does not support locking, falling back to randomized delay 2021-10-15 00:44:08.813 [info] <0.193.0> Peer discovery backend rabbit_peer_discovery_k8s does not support registration, skipping randomized startup delay. 2021-10-15 00:44:08.879 [info] <0.193.0> Failed to get nodes from k8s - 403 2021-10-15 00:44:08.879 [error] <0.192.0> CRASH REPORT Process <0.192.0> with 0 neighbours exited with reason: no case clause matching {error,"403"} in rabbit_mnesia:init_from_config/0 line 164 in application_master:init/4 line 134 2021-10-15 00:44:08.880 [info] <0.33.0> Application rabbit exited with reason: no case clause matching {error,"403"} in rabbit_mnesia:init_from_config/0 line 164 {"Kernel pid terminated",application_controller,"{application_start_failure,rabbit,{bad_return,{{rabbit,start,[normal,[]]},{'EXIT',{{case_clause,{error,\"403\"}},[{rabbit_mnesia,init_from_config,0,[{file,\"src/rabbit_mnesia.erl\"},{line,164}]},{rabbit_mnesia,init_with_lock,3,[{file,\"src/rabbit_mnesia.erl\"},{line,144}]},{rabbit_mnesia,init,0,[{file,\"src/rabbit_mnesia.erl\"},{line,111}]},{rabbit_boot_steps,'-run_step/2-lc$^1/1-1-',1,[{file,\"src/rabbit_boot_steps.erl\"},{line,49}]},{rabbit_boot_steps,run_step,2,[{file,\"src/rabbit_boot_steps.erl\"},{line,49}]},{rabbit_boot_steps,'-run_boot_steps/1-lc$^0/1-0-',1,[{file,\"src/rabbit_boot_steps.erl\"},{line,26}]},{rabbit_boot_steps,run_boot_steps,1,[{file,\"src/rabbit_boot_steps.erl\"},{line,26}]},{rabbit,start,2,[{file,\"src/rabbit.erl\"},{line,793}]}]}}}}}"} Kernel pid terminated (application_controller) ({application_start_failure,rabbit,{bad_return,{{rabbit,start,[normal,[]]},{'EXIT',{{case_clause,{error,"403"}},[{rabbit_mnesia,init_from_config,0,[{file Crash dump is being written to: /var/log/rabbitmq/erl_crash.dump...done