By type
Using /etc/ansible/ansible.cfg as config file 127.0.0.1 | SUCCESS => { "ansible_facts": { "discovered_interpreter_python": "/usr/libexec/platform-python" }, "changed": false, "elapsed": 0, "match_groupdict": {}, "match_groups": [], "path": null, "port": 5432, "search_regex": null, "state": "started" } Using /etc/ansible/ansible.cfg as config file 127.0.0.1 | FAILED! => { "ansible_facts": { "discovered_interpreter_python": "/usr/libexec/platform-python" }, "changed": false, "msg": "argument port is of type
and we were unable to convert to int: cannot be converted to an int" } Using /etc/ansible/ansible.cfg as config file 127.0.0.1 | FAILED! => { "ansible_facts": { "discovered_interpreter_python": "/usr/libexec/platform-python" }, "changed": false, "msg": "argument port is of type and we were unable to convert to int: cannot be converted to an int" } Using /etc/ansible/ansible.cfg as config file 127.0.0.1 | SUCCESS => { "ansible_facts": { "discovered_interpreter_python": "/usr/libexec/platform-python" }, "changed": false, "db": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER" } Default organization added. Demo Credential, Inventory, and Job Template added. (changed: True) 2022-04-27 17:12:03,909 DEBUG awx.main.dispatch publish awx.main.tasks.apply_cluster_membership_policies(6fc343ef-ed51-458b-9bec-85dae76d52b5, queue=awx_private_queue) Successfully registered instance onap-awx-0 (changed: True) 2022-04-27 17:13:21,169 DEBUG awx.main.dispatch publish awx.main.tasks.apply_cluster_membership_policies(bd2fdc34-a6f5-4419-853e-ae653535bea0, queue=awx_private_queue) 2022-04-27 17:13:22,123 DEBUG awx.main.dispatch publish awx.main.tasks.apply_cluster_membership_policies(16a1243a-a272-4937-96ab-9c883a33eafc, queue=awx_private_queue) Creating instance group tower (changed: True) /usr/bin/launch_awx_task.sh: line 27: unset: `#!/bin/sh': not a valid identifier 2022-04-27 17:13:22,931 INFO RPC interface 'supervisor' initialized 2022-04-27 17:13:22,931 CRIT Server 'unix_http_server' running without any HTTP authentication checking 2022-04-27 17:13:22,931 INFO supervisord started with pid 150 2022-04-27 17:13:23,935 INFO spawned: 'awx-config-watcher' with pid 153 2022-04-27 17:13:23,940 INFO spawned: 'dispatcher' with pid 154 2022-04-27 17:13:23,944 INFO spawned: 'callback-receiver' with pid 155 2022-04-27 17:13:23,948 INFO spawned: 'channels-worker' with pid 156 READY 2022-04-27 17:13:25,066 INFO success: awx-config-watcher entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-04-27 17:13:25,066 INFO success: dispatcher entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-04-27 17:13:25,066 INFO success: callback-receiver entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-04-27 17:13:25,066 INFO success: channels-worker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-04-27 17:13:27,000 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:175 2022-04-27 17:13:27,000 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:175 2022-04-27 17:13:27,006 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:176 2022-04-27 17:13:27,006 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:176 2022-04-27 17:13:27,011 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:177 2022-04-27 17:13:27,011 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:177 2022-04-27 17:13:27,016 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:178 2022-04-27 17:13:27,016 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:178 2022-04-27 17:13:27,089 - INFO - runworker - Using single-threaded worker. 2022-04-27 17:13:27,089 - INFO - runworker - Running worker against channel layer default (asgi_amqp.core.AMQPChannelLayer) 2022-04-27 17:13:27,090 - INFO - worker - Listening on channels websocket.connect, websocket.disconnect, websocket.receive 2022-04-27 17:13:27,161 WARNING awx.main.dispatch scaling up worker pid:180 2022-04-27 17:13:27,173 WARNING awx.main.dispatch scaling up worker pid:181 2022-04-27 17:13:27,185 WARNING awx.main.dispatch scaling up worker pid:182 2022-04-27 17:13:27,195 WARNING awx.main.dispatch scaling up worker pid:183 2022-04-27 17:13:27,201 DEBUG awx.main.tasks Syncing Schedules 2022-04-27 17:13:28,005 ERROR celery.beat Removing corrupted schedule file '/var/lib/awx/beat.db': error(11, 'Resource temporarily unavailable') Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/celery/beat.py", line 485, in setup_schedule self._store = self._open_schedule() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/celery/beat.py", line 475, in _open_schedule return self.persistence.open(self.schedule_filename, writeback=True) File "/usr/lib64/python3.6/shelve.py", line 243, in open return DbfilenameShelf(filename, flag, protocol, writeback) File "/usr/lib64/python3.6/shelve.py", line 227, in __init__ Shelf.__init__(self, dbm.open(filename, flag), protocol, writeback) File "/usr/lib64/python3.6/dbm/__init__.py", line 94, in open return mod.open(file, flag, mode) _gdbm.error: [Errno 11] Resource temporarily unavailable 2022-04-27 17:13:29,171 DEBUG awx.main.tasks Waited 0.0013535022735595703 seconds to obtain lock name: cluster_policy_lock 2022-04-27 17:13:29,181 DEBUG awx.main.tasks Total non-isolated instances:1 available for policy: 1 2022-04-27 17:13:29,181 DEBUG awx.main.tasks Policy percentage, adding Instances [1] to Group tower 2022-04-27 17:13:29,181 DEBUG awx.main.tasks Adding instances [1] to group tower 2022-04-27 17:13:29,315 DEBUG awx.main.tasks Cluster policy computation finished in 0.14413094520568848 seconds 2022-04-27 17:13:29,316 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:13:29,569 DEBUG awx.main.dispatch listening on ['awx_private_queue [direct]', 'onap-awx-0 [direct]', 'tower_broadcast_all_onap-awx-0 [fanout]'] 2022-04-27 17:13:49,892 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(50539836-6865-47cf-b675-8ed935615da6, queue=awx_private_queue) [2022-04-27 17:13:49,892: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(50539836-6865-47cf-b675-8ed935615da6, queue=awx_private_queue) 2022-04-27 17:13:49,914 DEBUG awx.main.dispatch delivered 50539836-6865-47cf-b675-8ed935615da6 to worker[180] qsize 0 2022-04-27 17:13:49,921 DEBUG awx.main.dispatch task 50539836-6865-47cf-b675-8ed935615da6 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:13:49,924 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:13:49,949 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:13:49,987 DEBUG awx.main.dispatch task 50539836-6865-47cf-b675-8ed935615da6 is finished 2022-04-27 17:13:59,526 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(3d716bdb-8276-41a1-bb2f-96a5b21a37ee, queue=awx_private_queue) [2022-04-27 17:13:59,526: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(3d716bdb-8276-41a1-bb2f-96a5b21a37ee, queue=awx_private_queue) 2022-04-27 17:13:59,542 DEBUG awx.main.dispatch delivered 3d716bdb-8276-41a1-bb2f-96a5b21a37ee to worker[181] qsize 0 2022-04-27 17:13:59,546 DEBUG awx.main.dispatch task 3d716bdb-8276-41a1-bb2f-96a5b21a37ee starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:13:59,563 DEBUG awx.main.tasks Starting periodic scheduler RESULT 2 OKREADY 2022-04-27 17:14:02,496 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:13:59.571242+00:00 2022-04-27 17:14:03,892 DEBUG awx.main.dispatch task 3d716bdb-8276-41a1-bb2f-96a5b21a37ee is finished 2022-04-27 17:14:09,876 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(075c0f61-56bc-4877-8fe6-ed13a3a798b5, queue=awx_private_queue) [2022-04-27 17:14:09,876: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(075c0f61-56bc-4877-8fe6-ed13a3a798b5, queue=awx_private_queue) 2022-04-27 17:14:09,894 DEBUG awx.main.dispatch delivered 075c0f61-56bc-4877-8fe6-ed13a3a798b5 to worker[181] qsize 0 2022-04-27 17:14:09,897 DEBUG awx.main.dispatch task 075c0f61-56bc-4877-8fe6-ed13a3a798b5 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:14:09,898 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:14:09,915 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:14:09,961 DEBUG awx.main.dispatch task 075c0f61-56bc-4877-8fe6-ed13a3a798b5 is finished 2022-04-27 17:14:29,526 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(572beb1c-05d7-405f-9863-934f9a7e458e, queue=onap-awx-0) [2022-04-27 17:14:29,526: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(572beb1c-05d7-405f-9863-934f9a7e458e, queue=onap-awx-0) 2022-04-27 17:14:29,743 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(b4b1b737-6e12-4d12-a2c3-555f321ec862, queue=onap-awx-0) [2022-04-27 17:14:29,743: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(b4b1b737-6e12-4d12-a2c3-555f321ec862, queue=onap-awx-0) 2022-04-27 17:14:29,760 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d1e5b242-ca73-4ddb-a500-6f4e4992e201, queue=awx_private_queue) [2022-04-27 17:14:29,760: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d1e5b242-ca73-4ddb-a500-6f4e4992e201, queue=awx_private_queue) 2022-04-27 17:14:29,760 DEBUG awx.main.dispatch delivered 572beb1c-05d7-405f-9863-934f9a7e458e to worker[182] qsize 0 2022-04-27 17:14:29,764 DEBUG awx.main.dispatch delivered b4b1b737-6e12-4d12-a2c3-555f321ec862 to worker[183] qsize 0 2022-04-27 17:14:29,765 DEBUG awx.main.dispatch task 572beb1c-05d7-405f-9863-934f9a7e458e starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:14:29,771 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:14:29,766 DEBUG awx.main.dispatch task b4b1b737-6e12-4d12-a2c3-555f321ec862 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:14:29,778 DEBUG awx.main.dispatch delivered d1e5b242-ca73-4ddb-a500-6f4e4992e201 to worker[181] qsize 0 2022-04-27 17:14:29,780 DEBUG awx.main.dispatch task d1e5b242-ca73-4ddb-a500-6f4e4992e201 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:14:29,789 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:14:29,792 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:13:59.563881+00:00 2022-04-27 17:14:29,790 DEBUG awx.main.dispatch task b4b1b737-6e12-4d12-a2c3-555f321ec862 is finished 2022-04-27 17:14:29,875 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d0e92835-0cd4-4b3f-9c03-3480a88032a0, queue=awx_private_queue) [2022-04-27 17:14:29,875: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d0e92835-0cd4-4b3f-9c03-3480a88032a0, queue=awx_private_queue) 2022-04-27 17:14:29,899 DEBUG awx.main.dispatch delivered d0e92835-0cd4-4b3f-9c03-3480a88032a0 to worker[180] qsize 0 2022-04-27 17:14:29,902 DEBUG awx.main.dispatch task d0e92835-0cd4-4b3f-9c03-3480a88032a0 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:14:29,905 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:14:29,919 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:14:29,948 DEBUG awx.main.dispatch task d0e92835-0cd4-4b3f-9c03-3480a88032a0 is finished 2022-04-27 17:14:30,420 DEBUG awx.main.dispatch task 572beb1c-05d7-405f-9863-934f9a7e458e is finished 2022-04-27 17:14:30,877 DEBUG awx.main.dispatch task d1e5b242-ca73-4ddb-a500-6f4e4992e201 is finished 2022-04-27 17:14:49,874 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(4643ff25-d30e-4160-a49e-838933b225e7, queue=awx_private_queue) [2022-04-27 17:14:49,874: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(4643ff25-d30e-4160-a49e-838933b225e7, queue=awx_private_queue) 2022-04-27 17:14:49,889 DEBUG awx.main.dispatch delivered 4643ff25-d30e-4160-a49e-838933b225e7 to worker[182] qsize 0 2022-04-27 17:14:49,893 DEBUG awx.main.dispatch task 4643ff25-d30e-4160-a49e-838933b225e7 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:14:49,894 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:14:49,913 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:14:49,959 DEBUG awx.main.dispatch task 4643ff25-d30e-4160-a49e-838933b225e7 is finished 2022-04-27 17:14:59,759 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(079c3fe3-467d-4c5c-8fd3-5d89496cc134, queue=awx_private_queue) [2022-04-27 17:14:59,759: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(079c3fe3-467d-4c5c-8fd3-5d89496cc134, queue=awx_private_queue) 2022-04-27 17:14:59,782 DEBUG awx.main.dispatch delivered 079c3fe3-467d-4c5c-8fd3-5d89496cc134 to worker[181] qsize 0 2022-04-27 17:14:59,785 DEBUG awx.main.dispatch task 079c3fe3-467d-4c5c-8fd3-5d89496cc134 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:14:59,802 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:14:59,805 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:14:29.789910+00:00 2022-04-27 17:15:00,669 DEBUG awx.main.dispatch task 079c3fe3-467d-4c5c-8fd3-5d89496cc134 is finished RESULT 2 OKREADY 2022-04-27 17:15:09,875 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a2e47231-d41b-452a-8c6f-4039850d77bb, queue=awx_private_queue) [2022-04-27 17:15:09,875: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a2e47231-d41b-452a-8c6f-4039850d77bb, queue=awx_private_queue) 2022-04-27 17:15:17,487 DEBUG awx.main.dispatch delivered a2e47231-d41b-452a-8c6f-4039850d77bb to worker[182] qsize 0 2022-04-27 17:15:17,489 DEBUG awx.main.dispatch task a2e47231-d41b-452a-8c6f-4039850d77bb starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:15:17,491 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:15:17,510 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:15:17,542 DEBUG awx.main.dispatch task a2e47231-d41b-452a-8c6f-4039850d77bb is finished 2022-04-27 17:15:29,534 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(ad382556-0a17-4240-8523-3f53b06fc54c, queue=onap-awx-0) [2022-04-27 17:15:29,534: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(ad382556-0a17-4240-8523-3f53b06fc54c, queue=onap-awx-0) 2022-04-27 17:15:29,570 DEBUG awx.main.dispatch delivered ad382556-0a17-4240-8523-3f53b06fc54c to worker[183] qsize 0 2022-04-27 17:15:29,576 DEBUG awx.main.dispatch task ad382556-0a17-4240-8523-3f53b06fc54c starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:15:29,577 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:15:29,744 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(13949a2a-9510-4209-b781-23a937980d39, queue=onap-awx-0) [2022-04-27 17:15:29,744: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(13949a2a-9510-4209-b781-23a937980d39, queue=onap-awx-0) 2022-04-27 17:15:29,764 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(4d486610-b015-4b69-ac86-04f810a3c632, queue=awx_private_queue) [2022-04-27 17:15:29,764: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(4d486610-b015-4b69-ac86-04f810a3c632, queue=awx_private_queue) 2022-04-27 17:15:29,876 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(51234605-1c6e-462c-8b4c-b73d9787a730, queue=awx_private_queue) [2022-04-27 17:15:29,876: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(51234605-1c6e-462c-8b4c-b73d9787a730, queue=awx_private_queue) 2022-04-27 17:15:29,762 DEBUG awx.main.dispatch delivered 13949a2a-9510-4209-b781-23a937980d39 to worker[182] qsize 0 2022-04-27 17:15:29,933 DEBUG awx.main.dispatch delivered 4d486610-b015-4b69-ac86-04f810a3c632 to worker[181] qsize 0 2022-04-27 17:15:29,933 DEBUG awx.main.dispatch task 13949a2a-9510-4209-b781-23a937980d39 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:15:29,935 DEBUG awx.main.dispatch task 4d486610-b015-4b69-ac86-04f810a3c632 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:15:29,936 DEBUG awx.main.dispatch delivered 51234605-1c6e-462c-8b4c-b73d9787a730 to worker[180] qsize 0 2022-04-27 17:15:29,940 DEBUG awx.main.dispatch task 51234605-1c6e-462c-8b4c-b73d9787a730 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:15:29,944 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:15:29,944 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:15:29,946 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:14:59.802739+00:00 2022-04-27 17:15:29,949 DEBUG awx.main.dispatch task 13949a2a-9510-4209-b781-23a937980d39 is finished 2022-04-27 17:15:29,959 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:15:29,987 DEBUG awx.main.dispatch task 51234605-1c6e-462c-8b4c-b73d9787a730 is finished 2022-04-27 17:15:33,021 DEBUG awx.main.dispatch task ad382556-0a17-4240-8523-3f53b06fc54c is finished 2022-04-27 17:15:34,347 DEBUG awx.main.dispatch task 4d486610-b015-4b69-ac86-04f810a3c632 is finished 2022-04-27 17:15:49,889 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(4c4a60e2-36b6-4b2d-ac84-0224d00419ca, queue=awx_private_queue) [2022-04-27 17:15:49,889: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(4c4a60e2-36b6-4b2d-ac84-0224d00419ca, queue=awx_private_queue) 2022-04-27 17:15:59,765 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(06b74aa0-d8b6-44b2-9a6c-8c94bb6c0485, queue=awx_private_queue) [2022-04-27 17:15:59,765: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(06b74aa0-d8b6-44b2-9a6c-8c94bb6c0485, queue=awx_private_queue) RESULT 2 OKREADY 2022-04-27 17:16:09,888 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(72ae3673-07fc-47d1-b74e-33ff87bf3dfd, queue=awx_private_queue) [2022-04-27 17:16:09,888: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(72ae3673-07fc-47d1-b74e-33ff87bf3dfd, queue=awx_private_queue) 2022-04-27 17:16:17,766 DEBUG awx.main.dispatch delivered 4c4a60e2-36b6-4b2d-ac84-0224d00419ca to worker[183] qsize 0 2022-04-27 17:16:17,770 DEBUG awx.main.dispatch delivered 06b74aa0-d8b6-44b2-9a6c-8c94bb6c0485 to worker[181] qsize 0 2022-04-27 17:16:17,771 DEBUG awx.main.dispatch task 4c4a60e2-36b6-4b2d-ac84-0224d00419ca starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:16:17,772 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:16:17,773 DEBUG awx.main.dispatch task 06b74aa0-d8b6-44b2-9a6c-8c94bb6c0485 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:16:17,774 DEBUG awx.main.dispatch delivered 72ae3673-07fc-47d1-b74e-33ff87bf3dfd to worker[182] qsize 0 2022-04-27 17:16:17,777 DEBUG awx.main.dispatch task 72ae3673-07fc-47d1-b74e-33ff87bf3dfd starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:16:17,779 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:16:17,783 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:16:17,787 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:15:29.944451+00:00 2022-04-27 17:16:17,793 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:16:17,804 DEBUG awx.main.scheduler Not running scheduler, another task holds lock 2022-04-27 17:16:17,804 DEBUG awx.main.dispatch task 72ae3673-07fc-47d1-b74e-33ff87bf3dfd is finished 2022-04-27 17:16:17,840 DEBUG awx.main.dispatch task 4c4a60e2-36b6-4b2d-ac84-0224d00419ca is finished 2022-04-27 17:16:18,631 DEBUG awx.main.dispatch task 06b74aa0-d8b6-44b2-9a6c-8c94bb6c0485 is finished 2022-04-27 17:16:29,540 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(3e76c55e-3601-4c83-8002-9d391e1d40d3, queue=onap-awx-0) [2022-04-27 17:16:29,540: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(3e76c55e-3601-4c83-8002-9d391e1d40d3, queue=onap-awx-0) 2022-04-27 17:16:29,579 DEBUG awx.main.dispatch delivered 3e76c55e-3601-4c83-8002-9d391e1d40d3 to worker[181] qsize 0 2022-04-27 17:16:29,581 DEBUG awx.main.dispatch task 3e76c55e-3601-4c83-8002-9d391e1d40d3 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:16:29,583 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:16:29,664 DEBUG awx.main.dispatch task 3e76c55e-3601-4c83-8002-9d391e1d40d3 is finished 2022-04-27 17:16:29,744 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(9c40d0e6-e5cc-4abc-820f-d1b901dfbdf7, queue=onap-awx-0) [2022-04-27 17:16:29,744: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(9c40d0e6-e5cc-4abc-820f-d1b901dfbdf7, queue=onap-awx-0) 2022-04-27 17:16:29,761 DEBUG awx.main.dispatch delivered 9c40d0e6-e5cc-4abc-820f-d1b901dfbdf7 to worker[183] qsize 0 2022-04-27 17:16:29,765 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(aea702a0-b398-43ed-96fd-e09c878a463f, queue=awx_private_queue) 2022-04-27 17:16:29,764 DEBUG awx.main.dispatch task 9c40d0e6-e5cc-4abc-820f-d1b901dfbdf7 starting awx.main.tasks.awx_k8s_reaper(*[]) [2022-04-27 17:16:29,765: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(aea702a0-b398-43ed-96fd-e09c878a463f, queue=awx_private_queue) 2022-04-27 17:16:29,779 DEBUG awx.main.dispatch task 9c40d0e6-e5cc-4abc-820f-d1b901dfbdf7 is finished 2022-04-27 17:16:29,888 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7c4d9ea7-b016-46b0-ae74-f3a1957a6305, queue=awx_private_queue) [2022-04-27 17:16:29,888: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7c4d9ea7-b016-46b0-ae74-f3a1957a6305, queue=awx_private_queue) 2022-04-27 17:16:34,872 DEBUG awx.main.dispatch delivered aea702a0-b398-43ed-96fd-e09c878a463f to worker[180] qsize 0 2022-04-27 17:16:35,056 DEBUG awx.main.dispatch delivered 7c4d9ea7-b016-46b0-ae74-f3a1957a6305 to worker[182] qsize 0 2022-04-27 17:16:35,058 DEBUG awx.main.dispatch task 7c4d9ea7-b016-46b0-ae74-f3a1957a6305 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:16:35,061 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:16:35,058 DEBUG awx.main.dispatch task aea702a0-b398-43ed-96fd-e09c878a463f starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:16:35,072 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:16:35,077 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:16:35,079 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:16:17.784082+00:00 2022-04-27 17:16:35,107 DEBUG awx.main.dispatch task 7c4d9ea7-b016-46b0-ae74-f3a1957a6305 is finished 2022-04-27 17:16:35,374 DEBUG awx.main.dispatch task aea702a0-b398-43ed-96fd-e09c878a463f is finished 2022-04-27 17:16:55,566 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(35486140-486a-4312-bf5f-61b144485a1b, queue=awx_private_queue) [2022-04-27 17:16:55,566: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(35486140-486a-4312-bf5f-61b144485a1b, queue=awx_private_queue) 2022-04-27 17:16:55,587 DEBUG awx.main.dispatch delivered 35486140-486a-4312-bf5f-61b144485a1b to worker[182] qsize 0 RESULT 2 OKREADY 2022-04-27 17:16:55,591 DEBUG awx.main.dispatch task 35486140-486a-4312-bf5f-61b144485a1b starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:16:55,593 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:16:55,611 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:16:55,640 DEBUG awx.main.dispatch task 35486140-486a-4312-bf5f-61b144485a1b is finished 2022-04-27 17:16:59,766 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(91cc50fd-831d-4563-8a02-f441108afd37, queue=awx_private_queue) [2022-04-27 17:16:59,766: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(91cc50fd-831d-4563-8a02-f441108afd37, queue=awx_private_queue) 2022-04-27 17:17:15,572 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(88877655-72bf-4ba1-bbce-c1d6de7b58c1, queue=awx_private_queue) [2022-04-27 17:17:15,572: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(88877655-72bf-4ba1-bbce-c1d6de7b58c1, queue=awx_private_queue) 2022-04-27 17:17:29,541 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(840f6622-db3f-4d39-9ae4-4ff107cb07cc, queue=onap-awx-0) [2022-04-27 17:17:29,541: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(840f6622-db3f-4d39-9ae4-4ff107cb07cc, queue=onap-awx-0) 2022-04-27 17:17:29,572 DEBUG awx.main.dispatch delivered 840f6622-db3f-4d39-9ae4-4ff107cb07cc to worker[181] qsize 0 2022-04-27 17:17:29,574 DEBUG awx.main.dispatch task 840f6622-db3f-4d39-9ae4-4ff107cb07cc starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:17:29,576 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:17:29,744 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(7690a672-cba1-42e0-830b-e10bf1dd5b4f, queue=onap-awx-0) [2022-04-27 17:17:29,744: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(7690a672-cba1-42e0-830b-e10bf1dd5b4f, queue=onap-awx-0) 2022-04-27 17:17:29,763 DEBUG awx.main.dispatch delivered 7690a672-cba1-42e0-830b-e10bf1dd5b4f to worker[183] qsize 0 2022-04-27 17:17:29,767 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(332f02f2-a0a4-4631-ba52-b026231ec374, queue=awx_private_queue) [2022-04-27 17:17:29,767: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(332f02f2-a0a4-4631-ba52-b026231ec374, queue=awx_private_queue) 2022-04-27 17:17:29,766 DEBUG awx.main.dispatch task 7690a672-cba1-42e0-830b-e10bf1dd5b4f starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:17:29,780 DEBUG awx.main.dispatch task 7690a672-cba1-42e0-830b-e10bf1dd5b4f is finished 2022-04-27 17:17:29,966 DEBUG awx.main.dispatch task 840f6622-db3f-4d39-9ae4-4ff107cb07cc is finished 2022-04-27 17:17:33,044 DEBUG awx.main.dispatch delivered 91cc50fd-831d-4563-8a02-f441108afd37 to worker[182] qsize 0 2022-04-27 17:17:33,049 DEBUG awx.main.dispatch delivered 88877655-72bf-4ba1-bbce-c1d6de7b58c1 to worker[180] qsize 0 2022-04-27 17:17:33,049 DEBUG awx.main.dispatch task 91cc50fd-831d-4563-8a02-f441108afd37 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:17:33,052 DEBUG awx.main.dispatch delivered 332f02f2-a0a4-4631-ba52-b026231ec374 to worker[183] qsize 0 2022-04-27 17:17:33,052 DEBUG awx.main.dispatch task 88877655-72bf-4ba1-bbce-c1d6de7b58c1 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:17:33,054 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:17:33,054 DEBUG awx.main.dispatch task 332f02f2-a0a4-4631-ba52-b026231ec374 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:17:33,061 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:17:33,064 DEBUG awx.main.tasks Not running periodic scheduler, another task holds lock 2022-04-27 17:17:33,064 DEBUG awx.main.dispatch task 332f02f2-a0a4-4631-ba52-b026231ec374 is finished 2022-04-27 17:17:33,065 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:16:35.073227+00:00 2022-04-27 17:17:33,070 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:17:33,101 DEBUG awx.main.dispatch task 88877655-72bf-4ba1-bbce-c1d6de7b58c1 is finished 2022-04-27 17:17:34,168 DEBUG awx.main.dispatch task 91cc50fd-831d-4563-8a02-f441108afd37 is finished 2022-04-27 17:17:35,573 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(464bc6d9-ea27-4bf6-b421-c1fcf3ab1a52, queue=awx_private_queue) [2022-04-27 17:17:35,573: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(464bc6d9-ea27-4bf6-b421-c1fcf3ab1a52, queue=awx_private_queue) 2022-04-27 17:17:45,403 DEBUG awx.main.dispatch delivered 464bc6d9-ea27-4bf6-b421-c1fcf3ab1a52 to worker[181] qsize 0 2022-04-27 17:17:45,610 DEBUG awx.main.dispatch task 464bc6d9-ea27-4bf6-b421-c1fcf3ab1a52 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:17:45,614 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:17:45,630 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:17:45,657 DEBUG awx.main.dispatch task 464bc6d9-ea27-4bf6-b421-c1fcf3ab1a52 is finished 2022-04-27 17:17:55,582 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6a459586-04a3-4ea3-a626-b6e378a00bc0, queue=awx_private_queue) [2022-04-27 17:17:55,582: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6a459586-04a3-4ea3-a626-b6e378a00bc0, queue=awx_private_queue) 2022-04-27 17:17:55,600 DEBUG awx.main.dispatch delivered 6a459586-04a3-4ea3-a626-b6e378a00bc0 to worker[182] qsize 0 2022-04-27 17:17:55,603 DEBUG awx.main.dispatch task 6a459586-04a3-4ea3-a626-b6e378a00bc0 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:17:55,605 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:17:55,623 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:17:55,656 DEBUG awx.main.dispatch task 6a459586-04a3-4ea3-a626-b6e378a00bc0 is finished 2022-04-27 17:17:59,766 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(f56702bf-4ae4-496b-af0d-105ada6c7264, queue=awx_private_queue) [2022-04-27 17:17:59,766: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(f56702bf-4ae4-496b-af0d-105ada6c7264, queue=awx_private_queue) 2022-04-27 17:17:59,784 DEBUG awx.main.dispatch delivered f56702bf-4ae4-496b-af0d-105ada6c7264 to worker[181] qsize 0 2022-04-27 17:17:59,787 DEBUG awx.main.dispatch task f56702bf-4ae4-496b-af0d-105ada6c7264 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:17:59,799 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:17:59,802 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:17:33.061211+00:00 2022-04-27 17:18:00,541 DEBUG awx.main.dispatch task f56702bf-4ae4-496b-af0d-105ada6c7264 is finished RESULT 2 OKREADY 2022-04-27 17:18:15,588 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(350fcd41-6313-4153-8468-47b05e44a607, queue=awx_private_queue) [2022-04-27 17:18:15,588: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(350fcd41-6313-4153-8468-47b05e44a607, queue=awx_private_queue) 2022-04-27 17:18:15,607 DEBUG awx.main.dispatch delivered 350fcd41-6313-4153-8468-47b05e44a607 to worker[181] qsize 0 2022-04-27 17:18:15,609 DEBUG awx.main.dispatch task 350fcd41-6313-4153-8468-47b05e44a607 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:18:15,611 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:18:15,631 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:18:15,665 DEBUG awx.main.dispatch task 350fcd41-6313-4153-8468-47b05e44a607 is finished 2022-04-27 17:18:29,546 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(33e2845f-8e86-4a53-9639-7069d966b518, queue=onap-awx-0) [2022-04-27 17:18:29,546: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(33e2845f-8e86-4a53-9639-7069d966b518, queue=onap-awx-0) 2022-04-27 17:18:29,580 DEBUG awx.main.dispatch delivered 33e2845f-8e86-4a53-9639-7069d966b518 to worker[181] qsize 0 2022-04-27 17:18:29,582 DEBUG awx.main.dispatch task 33e2845f-8e86-4a53-9639-7069d966b518 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:18:29,585 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:18:29,744 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(82235ba8-d4c0-48ad-a677-abff5fc9046e, queue=onap-awx-0) [2022-04-27 17:18:29,744: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(82235ba8-d4c0-48ad-a677-abff5fc9046e, queue=onap-awx-0) 2022-04-27 17:18:29,764 DEBUG awx.main.dispatch delivered 82235ba8-d4c0-48ad-a677-abff5fc9046e to worker[182] qsize 0 2022-04-27 17:18:29,765 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(cd6883e2-86d5-4311-a9fa-db54b7eee551, queue=awx_private_queue) [2022-04-27 17:18:29,765: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(cd6883e2-86d5-4311-a9fa-db54b7eee551, queue=awx_private_queue) 2022-04-27 17:18:29,767 DEBUG awx.main.dispatch task 82235ba8-d4c0-48ad-a677-abff5fc9046e starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:18:29,781 DEBUG awx.main.dispatch task 82235ba8-d4c0-48ad-a677-abff5fc9046e is finished 2022-04-27 17:18:29,798 DEBUG awx.main.dispatch delivered cd6883e2-86d5-4311-a9fa-db54b7eee551 to worker[182] qsize 0 2022-04-27 17:18:29,801 DEBUG awx.main.dispatch task cd6883e2-86d5-4311-a9fa-db54b7eee551 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:18:29,810 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:18:29,813 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:17:59.800049+00:00 2022-04-27 17:18:29,856 DEBUG awx.main.dispatch task 33e2845f-8e86-4a53-9639-7069d966b518 is finished 2022-04-27 17:18:30,595 DEBUG awx.main.dispatch task cd6883e2-86d5-4311-a9fa-db54b7eee551 is finished 2022-04-27 17:18:35,588 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0030bc62-7f87-464c-bb8f-3f7b62314f76, queue=awx_private_queue) [2022-04-27 17:18:35,588: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0030bc62-7f87-464c-bb8f-3f7b62314f76, queue=awx_private_queue) 2022-04-27 17:18:35,605 DEBUG awx.main.dispatch delivered 0030bc62-7f87-464c-bb8f-3f7b62314f76 to worker[180] qsize 0 2022-04-27 17:18:35,608 DEBUG awx.main.dispatch task 0030bc62-7f87-464c-bb8f-3f7b62314f76 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:18:35,613 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:18:35,631 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:18:35,663 DEBUG awx.main.dispatch task 0030bc62-7f87-464c-bb8f-3f7b62314f76 is finished 2022-04-27 17:18:55,597 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(8243c712-d112-4778-a6a7-ebed078c4a27, queue=awx_private_queue) [2022-04-27 17:18:55,597: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(8243c712-d112-4778-a6a7-ebed078c4a27, queue=awx_private_queue) 2022-04-27 17:18:55,632 DEBUG awx.main.dispatch delivered 8243c712-d112-4778-a6a7-ebed078c4a27 to worker[183] qsize 0 2022-04-27 17:18:55,815 DEBUG awx.main.dispatch task 8243c712-d112-4778-a6a7-ebed078c4a27 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:18:55,818 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:18:55,836 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:18:55,865 DEBUG awx.main.dispatch task 8243c712-d112-4778-a6a7-ebed078c4a27 is finished 2022-04-27 17:18:59,766 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(647fc0f6-92e0-43f8-82ee-ddcb2a719328, queue=awx_private_queue) [2022-04-27 17:18:59,766: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(647fc0f6-92e0-43f8-82ee-ddcb2a719328, queue=awx_private_queue) 2022-04-27 17:19:00,082 DEBUG awx.main.dispatch delivered 647fc0f6-92e0-43f8-82ee-ddcb2a719328 to worker[182] qsize 0 2022-04-27 17:19:00,086 DEBUG awx.main.dispatch task 647fc0f6-92e0-43f8-82ee-ddcb2a719328 starting awx.main.tasks.awx_periodic_scheduler(*[]) RESULT 2 OKREADY 2022-04-27 17:19:00,100 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:19:00,103 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:18:29.810990+00:00 2022-04-27 17:19:00,120 DEBUG awx.main.dispatch task 647fc0f6-92e0-43f8-82ee-ddcb2a719328 is finished 2022-04-27 17:19:15,602 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b969540b-e4e9-403d-827b-e5a46fcd66c5, queue=awx_private_queue) [2022-04-27 17:19:15,602: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b969540b-e4e9-403d-827b-e5a46fcd66c5, queue=awx_private_queue) 2022-04-27 17:19:15,622 DEBUG awx.main.dispatch delivered b969540b-e4e9-403d-827b-e5a46fcd66c5 to worker[183] qsize 0 2022-04-27 17:19:15,625 DEBUG awx.main.dispatch task b969540b-e4e9-403d-827b-e5a46fcd66c5 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:19:15,628 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:19:15,654 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:19:15,685 DEBUG awx.main.dispatch task b969540b-e4e9-403d-827b-e5a46fcd66c5 is finished 2022-04-27 17:19:29,549 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(855af754-468c-4fe5-931e-a0040111b267, queue=onap-awx-0) [2022-04-27 17:19:29,549: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(855af754-468c-4fe5-931e-a0040111b267, queue=onap-awx-0) 2022-04-27 17:19:29,577 DEBUG awx.main.dispatch delivered 855af754-468c-4fe5-931e-a0040111b267 to worker[181] qsize 0 2022-04-27 17:19:29,579 DEBUG awx.main.dispatch task 855af754-468c-4fe5-931e-a0040111b267 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:19:29,580 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:19:29,744 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(4e89a3f6-3ead-4ee1-a5b5-b52f31f6bf7e, queue=onap-awx-0) [2022-04-27 17:19:29,744: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(4e89a3f6-3ead-4ee1-a5b5-b52f31f6bf7e, queue=onap-awx-0) 2022-04-27 17:19:29,760 DEBUG awx.main.dispatch delivered 4e89a3f6-3ead-4ee1-a5b5-b52f31f6bf7e to worker[182] qsize 0 2022-04-27 17:19:29,762 DEBUG awx.main.dispatch task 4e89a3f6-3ead-4ee1-a5b5-b52f31f6bf7e starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:19:29,765 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(28e0b22c-8ca5-4b94-bbd1-6363870d4826, queue=awx_private_queue) [2022-04-27 17:19:29,765: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(28e0b22c-8ca5-4b94-bbd1-6363870d4826, queue=awx_private_queue) 2022-04-27 17:19:29,775 DEBUG awx.main.dispatch task 4e89a3f6-3ead-4ee1-a5b5-b52f31f6bf7e is finished 2022-04-27 17:19:29,778 DEBUG awx.main.dispatch delivered 28e0b22c-8ca5-4b94-bbd1-6363870d4826 to worker[183] qsize 0 2022-04-27 17:19:29,780 DEBUG awx.main.dispatch task 28e0b22c-8ca5-4b94-bbd1-6363870d4826 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:19:29,790 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:19:29,792 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:19:00.100511+00:00 2022-04-27 17:19:29,903 DEBUG awx.main.dispatch task 855af754-468c-4fe5-931e-a0040111b267 is finished 2022-04-27 17:19:30,236 DEBUG awx.main.dispatch task 28e0b22c-8ca5-4b94-bbd1-6363870d4826 is finished 2022-04-27 17:19:35,602 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(deb91f7b-9012-48f4-a798-e5f898b4954d, queue=awx_private_queue) [2022-04-27 17:19:35,602: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(deb91f7b-9012-48f4-a798-e5f898b4954d, queue=awx_private_queue) 2022-04-27 17:19:56,868 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ad072d6b-c7d2-431b-9a8b-15248aa9637d, queue=awx_private_queue) [2022-04-27 17:19:56,868: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ad072d6b-c7d2-431b-9a8b-15248aa9637d, queue=awx_private_queue) RESULT 2 2022-04-27 17:19:59,767 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(11bf19ef-fc3f-4ef4-9d9d-cfe52b1caa82, queue=awx_private_queue) [2022-04-27 17:19:59,767: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(11bf19ef-fc3f-4ef4-9d9d-cfe52b1caa82, queue=awx_private_queue) OKREADY 2022-04-27 17:20:16,876 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b981aa9d-d178-493a-bd99-675f717ab3a6, queue=awx_private_queue) [2022-04-27 17:20:16,876: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b981aa9d-d178-493a-bd99-675f717ab3a6, queue=awx_private_queue) 2022-04-27 17:20:28,245 DEBUG awx.main.dispatch delivered deb91f7b-9012-48f4-a798-e5f898b4954d to worker[181] qsize 0 2022-04-27 17:20:28,436 DEBUG awx.main.dispatch delivered ad072d6b-c7d2-431b-9a8b-15248aa9637d to worker[180] qsize 0 2022-04-27 17:20:28,437 DEBUG awx.main.dispatch delivered 11bf19ef-fc3f-4ef4-9d9d-cfe52b1caa82 to worker[182] qsize 0 2022-04-27 17:20:28,436 DEBUG awx.main.dispatch task deb91f7b-9012-48f4-a798-e5f898b4954d starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:20:28,439 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:20:28,439 DEBUG awx.main.dispatch delivered b981aa9d-d178-493a-bd99-675f717ab3a6 to worker[183] qsize 0 2022-04-27 17:20:28,439 DEBUG awx.main.dispatch task 11bf19ef-fc3f-4ef4-9d9d-cfe52b1caa82 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:20:28,438 DEBUG awx.main.dispatch task ad072d6b-c7d2-431b-9a8b-15248aa9637d starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:20:28,441 DEBUG awx.main.dispatch task b981aa9d-d178-493a-bd99-675f717ab3a6 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:20:28,444 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:20:28,444 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:20:28,450 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:20:28,453 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:19:29.790289+00:00 2022-04-27 17:20:28,458 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:20:28,460 DEBUG awx.main.scheduler Not running scheduler, another task holds lock 2022-04-27 17:20:28,460 DEBUG awx.main.dispatch task ad072d6b-c7d2-431b-9a8b-15248aa9637d is finished 2022-04-27 17:20:28,463 DEBUG awx.main.scheduler Not running scheduler, another task holds lock 2022-04-27 17:20:28,463 DEBUG awx.main.dispatch task b981aa9d-d178-493a-bd99-675f717ab3a6 is finished 2022-04-27 17:20:28,497 DEBUG awx.main.dispatch task deb91f7b-9012-48f4-a798-e5f898b4954d is finished 2022-04-27 17:20:28,842 DEBUG awx.main.dispatch task 11bf19ef-fc3f-4ef4-9d9d-cfe52b1caa82 is finished 2022-04-27 17:20:29,550 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(ffc61b8d-5ad8-4c02-bfa6-d8e03050a34f, queue=onap-awx-0) [2022-04-27 17:20:29,550: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(ffc61b8d-5ad8-4c02-bfa6-d8e03050a34f, queue=onap-awx-0) 2022-04-27 17:20:29,599 DEBUG awx.main.dispatch delivered ffc61b8d-5ad8-4c02-bfa6-d8e03050a34f to worker[181] qsize 0 2022-04-27 17:20:29,601 DEBUG awx.main.dispatch task ffc61b8d-5ad8-4c02-bfa6-d8e03050a34f starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:20:29,604 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:20:29,631 DEBUG awx.main.dispatch task ffc61b8d-5ad8-4c02-bfa6-d8e03050a34f is finished 2022-04-27 17:20:29,744 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(5dfb7c42-b984-4c02-80a6-e1ed4967e294, queue=onap-awx-0) [2022-04-27 17:20:29,744: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(5dfb7c42-b984-4c02-80a6-e1ed4967e294, queue=onap-awx-0) 2022-04-27 17:20:29,761 DEBUG awx.main.dispatch delivered 5dfb7c42-b984-4c02-80a6-e1ed4967e294 to worker[183] qsize 0 2022-04-27 17:20:29,764 DEBUG awx.main.dispatch task 5dfb7c42-b984-4c02-80a6-e1ed4967e294 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:20:29,766 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(ea2a03bb-6d67-4170-aa17-c1cb4e151268, queue=awx_private_queue) [2022-04-27 17:20:29,766: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(ea2a03bb-6d67-4170-aa17-c1cb4e151268, queue=awx_private_queue) 2022-04-27 17:20:29,779 DEBUG awx.main.dispatch task 5dfb7c42-b984-4c02-80a6-e1ed4967e294 is finished 2022-04-27 17:20:36,875 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5ec63081-60ba-4e3a-8653-52a7ed33871d, queue=awx_private_queue) [2022-04-27 17:20:36,875: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5ec63081-60ba-4e3a-8653-52a7ed33871d, queue=awx_private_queue) 2022-04-27 17:20:54,932 DEBUG awx.main.dispatch delivered ea2a03bb-6d67-4170-aa17-c1cb4e151268 to worker[183] qsize 0 2022-04-27 17:20:54,934 DEBUG awx.main.dispatch delivered 5ec63081-60ba-4e3a-8653-52a7ed33871d to worker[180] qsize 0 2022-04-27 17:20:54,934 DEBUG awx.main.dispatch task ea2a03bb-6d67-4170-aa17-c1cb4e151268 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:20:54,937 DEBUG awx.main.dispatch task 5ec63081-60ba-4e3a-8653-52a7ed33871d starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:20:54,939 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:20:54,948 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:20:54,952 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:20:28.450956+00:00 2022-04-27 17:20:54,957 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:20:54,989 DEBUG awx.main.dispatch task 5ec63081-60ba-4e3a-8653-52a7ed33871d is finished 2022-04-27 17:20:55,319 DEBUG awx.main.dispatch task ea2a03bb-6d67-4170-aa17-c1cb4e151268 is finished 2022-04-27 17:20:56,886 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d376b9a0-c552-4057-b582-88fc16ec590b, queue=awx_private_queue) [2022-04-27 17:20:56,886: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d376b9a0-c552-4057-b582-88fc16ec590b, queue=awx_private_queue) 2022-04-27 17:20:56,906 DEBUG awx.main.dispatch delivered d376b9a0-c552-4057-b582-88fc16ec590b to worker[181] qsize 0 2022-04-27 17:20:56,910 DEBUG awx.main.dispatch task d376b9a0-c552-4057-b582-88fc16ec590b starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:20:56,913 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:20:56,928 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:20:56,962 DEBUG awx.main.dispatch task d376b9a0-c552-4057-b582-88fc16ec590b is finished 2022-04-27 17:20:59,766 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(73a15b09-9313-4414-ae2c-59a911671b12, queue=awx_private_queue) [2022-04-27 17:20:59,766: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(73a15b09-9313-4414-ae2c-59a911671b12, queue=awx_private_queue) RESULT 2 OKREADY 2022-04-27 17:21:05,031 DEBUG awx.main.dispatch delivered 73a15b09-9313-4414-ae2c-59a911671b12 to worker[182] qsize 0 2022-04-27 17:21:05,035 DEBUG awx.main.dispatch task 73a15b09-9313-4414-ae2c-59a911671b12 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:21:05,048 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:21:05,051 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:20:54.948976+00:00 2022-04-27 17:21:05,478 DEBUG awx.main.dispatch task 73a15b09-9313-4414-ae2c-59a911671b12 is finished 2022-04-27 17:21:16,890 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(128e716d-e06d-4590-8536-5a90d77a43ca, queue=awx_private_queue) [2022-04-27 17:21:16,890: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(128e716d-e06d-4590-8536-5a90d77a43ca, queue=awx_private_queue) 2022-04-27 17:21:29,553 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(66f8ad00-727b-46bd-bd55-26c65068fbc1, queue=onap-awx-0) [2022-04-27 17:21:29,553: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(66f8ad00-727b-46bd-bd55-26c65068fbc1, queue=onap-awx-0) 2022-04-27 17:21:29,744 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(19e6d66e-7584-46c7-af02-f22ba67e03d9, queue=onap-awx-0) [2022-04-27 17:21:29,744: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(19e6d66e-7584-46c7-af02-f22ba67e03d9, queue=onap-awx-0) 2022-04-27 17:21:29,755 DEBUG awx.main.dispatch delivered 66f8ad00-727b-46bd-bd55-26c65068fbc1 to worker[180] qsize 0 2022-04-27 17:21:29,758 DEBUG awx.main.dispatch delivered 19e6d66e-7584-46c7-af02-f22ba67e03d9 to worker[182] qsize 0 2022-04-27 17:21:29,758 DEBUG awx.main.dispatch task 66f8ad00-727b-46bd-bd55-26c65068fbc1 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:21:29,763 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:21:29,761 DEBUG awx.main.dispatch task 19e6d66e-7584-46c7-af02-f22ba67e03d9 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:21:29,766 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(2646cc82-9009-45cb-a507-32197bede3f8, queue=awx_private_queue) [2022-04-27 17:21:29,766: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(2646cc82-9009-45cb-a507-32197bede3f8, queue=awx_private_queue) 2022-04-27 17:21:29,776 DEBUG awx.main.dispatch task 19e6d66e-7584-46c7-af02-f22ba67e03d9 is finished 2022-04-27 17:21:36,009 DEBUG awx.main.dispatch delivered 128e716d-e06d-4590-8536-5a90d77a43ca to worker[181] qsize 0 2022-04-27 17:21:36,012 DEBUG awx.main.dispatch delivered 2646cc82-9009-45cb-a507-32197bede3f8 to worker[182] qsize 0 2022-04-27 17:21:36,012 DEBUG awx.main.dispatch task 128e716d-e06d-4590-8536-5a90d77a43ca starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:21:36,014 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:21:36,014 DEBUG awx.main.dispatch task 2646cc82-9009-45cb-a507-32197bede3f8 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:21:36,028 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:21:36,032 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:21:05.048727+00:00 2022-04-27 17:21:36,035 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:21:36,071 DEBUG awx.main.dispatch task 128e716d-e06d-4590-8536-5a90d77a43ca is finished 2022-04-27 17:21:36,098 DEBUG awx.main.dispatch task 66f8ad00-727b-46bd-bd55-26c65068fbc1 is finished 2022-04-27 17:21:36,800 DEBUG awx.main.dispatch task 2646cc82-9009-45cb-a507-32197bede3f8 is finished 2022-04-27 17:21:36,890 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3a3510dc-c0a0-4731-bc7d-5ae938786dd7, queue=awx_private_queue) [2022-04-27 17:21:36,890: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3a3510dc-c0a0-4731-bc7d-5ae938786dd7, queue=awx_private_queue) 2022-04-27 17:21:49,976 DEBUG awx.main.dispatch delivered 3a3510dc-c0a0-4731-bc7d-5ae938786dd7 to worker[181] qsize 0 2022-04-27 17:21:49,979 DEBUG awx.main.dispatch task 3a3510dc-c0a0-4731-bc7d-5ae938786dd7 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:21:49,981 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:21:50,008 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:21:50,029 WARNING kombu.mixins Connection to broker lost, trying to re-establish connection... Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/mixins.py", line 175, in run for _ in self.consume(limit=None, **kwargs): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/mixins.py", line 197, in consume conn.drain_events(timeout=safety_interval) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 315, in drain_events return self.transport.drain_events(self.connection, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 103, in drain_events return connection.drain_events(**kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 500, in drain_events while not self.blocking_read(timeout): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 505, in blocking_read frame = self.transport.read_frame() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 256, in read_frame frame_header = read(7, True) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 440, in _read s = recv(n - len(rbuf)) ConnectionResetError: [Errno 104] Connection reset by peer 2022-04-27 17:21:50,030 WARNING kombu.mixins Connection to broker lost, trying to re-establish connection... Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/mixins.py", line 175, in run for _ in self.consume(limit=None, **kwargs): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/mixins.py", line 197, in consume conn.drain_events(timeout=safety_interval) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 315, in drain_events return self.transport.drain_events(self.connection, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 103, in drain_events return connection.drain_events(**kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 500, in drain_events while not self.blocking_read(timeout): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 505, in blocking_read frame = self.transport.read_frame() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 256, in read_frame frame_header = read(7, True) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 440, in _read s = recv(n - len(rbuf)) ConnectionResetError: [Errno 104] Connection reset by peer 2022-04-27 17:21:50,039 DEBUG awx.main.dispatch task 3a3510dc-c0a0-4731-bc7d-5ae938786dd7 is finished 2022-04-27 17:21:50,048 WARNING kombu.mixins Broker connection error, trying again in 2.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-04-27 17:21:50,048 WARNING kombu.mixins Broker connection error, trying again in 2.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-04-27 17:21:52,058 WARNING kombu.mixins Broker connection error, trying again in 4.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-04-27 17:21:52,063 WARNING kombu.mixins Broker connection error, trying again in 4.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-04-27 17:21:56,072 WARNING kombu.mixins Broker connection error, trying again in 6.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-04-27 17:21:56,080 WARNING kombu.mixins Broker connection error, trying again in 6.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-04-27 17:21:56,900 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b72d095e-4862-4851-98ed-db8a8871a309, queue=awx_private_queue) [2022-04-27 17:21:56,900: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b72d095e-4862-4851-98ed-db8a8871a309, queue=awx_private_queue) RESULT 2 OKREADY 2022-04-27 17:22:02,093 WARNING kombu.mixins Broker connection error, trying again in 8.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-04-27 17:22:02,100 WARNING kombu.mixins Broker connection error, trying again in 8.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-04-27 17:22:10,111 WARNING kombu.mixins Broker connection error, trying again in 10.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-04-27 17:22:10,122 WARNING kombu.mixins Broker connection error, trying again in 10.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-04-27 17:22:20,135 WARNING kombu.mixins Broker connection error, trying again in 12.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/asgi_amqp/core.py", line 127, in receive self.tdata.connection.drain_events(timeout=1) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 315, in drain_events return self.transport.drain_events(self.connection, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 103, in drain_events return connection.drain_events(**kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 500, in drain_events while not self.blocking_read(timeout): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 505, in blocking_read frame = self.transport.read_frame() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 256, in read_frame frame_header = read(7, True) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 440, in _read s = recv(n - len(rbuf)) ConnectionResetError: [Errno 104] Connection reset by peer During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 431, in _reraise_as_library_errors yield File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 422, in ensure_connection callback, timeout=timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/bin/awx-manage", line 11, in load_entry_point('awx==9.0.1.0', 'console_scripts', 'awx-manage')() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/__init__.py", line 158, in manage execute_from_command_line(sys.argv) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/core/management/__init__.py", line 381, in execute_from_command_line utility.execute() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/core/management/__init__.py", line 375, in execute self.fetch_command(subcommand).run_from_argv(self.argv) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/core/management/base.py", line 323, in run_from_argv self.execute(*args, **cmd_options) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/core/management/base.py", line 364, in execute output = self.handle(*args, **options) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/channels/management/commands/runworker.py", line 83, in handle worker.run() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/channels/worker.py", line 87, in run channel, content = self.channel_layer.receive_many(channels, block=True) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/asgiref/base_layer.py", line 43, in receive_many return self.receive(channels, block) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/asgi_amqp/core.py", line 131, in receive self.recover() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/asgi_amqp/core.py", line 76, in recover self.tdata.connection.ensure_connection(max_retries=5) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 422, in ensure_connection callback, timeout=timeout) File "/usr/lib64/python3.6/contextlib.py", line 99, in __exit__ self.gen.throw(type, value, traceback) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 436, in _reraise_as_library_errors sys.exc_info()[2]) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/vine/five.py", line 194, in reraise raise value.with_traceback(tb) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 431, in _reraise_as_library_errors yield File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 422, in ensure_connection callback, timeout=timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) kombu.exceptions.OperationalError: [Errno 111] Connection refused 2022-04-27 17:22:20,144 WARNING kombu.mixins Broker connection error, trying again in 12.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-04-27 17:22:20,565 INFO exited: channels-worker (exit status 1; not expected) 2022-04-27 17:22:21,572 INFO spawned: 'channels-worker' with pid 192 2022-04-27 17:22:22,575 INFO success: channels-worker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-04-27 17:22:24,649 - INFO - runworker - Using single-threaded worker. 2022-04-27 17:22:24,649 - INFO - runworker - Running worker against channel layer default (asgi_amqp.core.AMQPChannelLayer) 2022-04-27 17:22:24,650 - INFO - worker - Listening on channels websocket.connect, websocket.disconnect, websocket.receive 2022-04-27 17:22:32,163 WARNING kombu.mixins Broker connection error, trying again in 14.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-04-27 17:22:32,168 WARNING kombu.mixins Broker connection error, trying again in 14.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-04-27 17:22:46,188 WARNING kombu.mixins Broker connection error, trying again in 16.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-04-27 17:22:46,202 WARNING kombu.mixins Broker connection error, trying again in 16.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused RESULT 2 OKREADY 2022-04-27 17:23:02,218 WARNING kombu.mixins Broker connection error, trying again in 18.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-04-27 17:23:02,230 WARNING kombu.mixins Broker connection error, trying again in 18.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-04-27 17:23:20,251 WARNING kombu.mixins Broker connection error, trying again in 20.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-04-27 17:23:20,261 WARNING kombu.mixins Broker connection error, trying again in 20.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-04-27 17:23:40,281 WARNING kombu.mixins Broker connection error, trying again in 22.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-04-27 17:23:40,294 WARNING kombu.mixins Broker connection error, trying again in 22.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused RESULT 2 OKREADY 2022-04-27 17:24:02,316 WARNING kombu.mixins Broker connection error, trying again in 24.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-04-27 17:24:02,335 WARNING kombu.mixins Broker connection error, trying again in 24.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-04-27 17:24:26,353 WARNING kombu.mixins Broker connection error, trying again in 26.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-04-27 17:24:26,374 WARNING kombu.mixins Broker connection error, trying again in 26.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-04-27 17:24:52,390 WARNING kombu.mixins Broker connection error, trying again in 28.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-04-27 17:24:52,415 WARNING kombu.mixins Broker connection error, trying again in 28.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-04-27 17:24:59,618 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(5c935a61-f584-472c-85d5-cb2e66d76fff, queue=awx_private_queue) [2022-04-27 17:24:59,618: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(5c935a61-f584-472c-85d5-cb2e66d76fff, queue=awx_private_queue) 2022-04-27 17:24:59,860 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(7ca97b13-d6be-471c-94de-a9b3d9e79da1, queue=onap-awx-0) [2022-04-27 17:24:59,860: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(7ca97b13-d6be-471c-94de-a9b3d9e79da1, queue=onap-awx-0) 2022-04-27 17:25:00,127 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(04a4af6c-50f1-4ffe-9d58-a29e9942bd0a, queue=onap-awx-0) [2022-04-27 17:25:00,127: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(04a4af6c-50f1-4ffe-9d58-a29e9942bd0a, queue=onap-awx-0) RESULT 2 OKREADY 2022-04-27 17:25:00,149 DEBUG awx.main.dispatch publish awx.main.tasks.awx_isolated_heartbeat(76adace8-f7f8-4ec7-b44f-32a5334313ae, queue=onap-awx-0) [2022-04-27 17:25:00,149: DEBUG/Process-1] publish awx.main.tasks.awx_isolated_heartbeat(76adace8-f7f8-4ec7-b44f-32a5334313ae, queue=onap-awx-0) 2022-04-27 17:25:00,168 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(800a44e0-c541-4316-acc2-6c404a565d2a, queue=awx_private_queue) [2022-04-27 17:25:00,168: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(800a44e0-c541-4316-acc2-6c404a565d2a, queue=awx_private_queue) 2022-04-27 17:25:20,312 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(034ecc22-5409-4073-8eb6-26561025be33, queue=awx_private_queue) [2022-04-27 17:25:20,312: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(034ecc22-5409-4073-8eb6-26561025be33, queue=awx_private_queue) 2022-04-27 17:25:20,440 DEBUG awx.main.dispatch listening on ['awx_private_queue [direct]', 'onap-awx-0 [direct]', 'tower_broadcast_all_onap-awx-0 [fanout]'] 2022-04-27 17:25:29,617 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(f8d54b09-4a30-4fd1-b37a-3a860a6c6b0e, queue=awx_private_queue) [2022-04-27 17:25:29,617: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(f8d54b09-4a30-4fd1-b37a-3a860a6c6b0e, queue=awx_private_queue) 2022-04-27 17:25:29,639 DEBUG awx.main.dispatch delivered f8d54b09-4a30-4fd1-b37a-3a860a6c6b0e to worker[181] qsize 0 2022-04-27 17:25:29,645 DEBUG awx.main.dispatch task f8d54b09-4a30-4fd1-b37a-3a860a6c6b0e starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:25:29,657 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:25:29,660 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:21:36.029654+00:00 2022-04-27 17:25:29,844 DEBUG awx.main.dispatch task f8d54b09-4a30-4fd1-b37a-3a860a6c6b0e is finished 2022-04-27 17:25:40,312 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(2008c566-61a9-4df7-842f-80b84c24a363, queue=awx_private_queue) [2022-04-27 17:25:40,312: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(2008c566-61a9-4df7-842f-80b84c24a363, queue=awx_private_queue) 2022-04-27 17:25:40,331 DEBUG awx.main.dispatch delivered 2008c566-61a9-4df7-842f-80b84c24a363 to worker[180] qsize 0 2022-04-27 17:25:40,336 DEBUG awx.main.dispatch task 2008c566-61a9-4df7-842f-80b84c24a363 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:25:40,339 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:25:40,360 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:25:40,393 DEBUG awx.main.dispatch task 2008c566-61a9-4df7-842f-80b84c24a363 is finished 2022-04-27 17:25:59,617 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(aa3aea3e-7fac-4fcc-8452-c04a7922b845, queue=awx_private_queue) [2022-04-27 17:25:59,617: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(aa3aea3e-7fac-4fcc-8452-c04a7922b845, queue=awx_private_queue) 2022-04-27 17:25:59,650 DEBUG awx.main.dispatch delivered aa3aea3e-7fac-4fcc-8452-c04a7922b845 to worker[180] qsize 0 2022-04-27 17:25:59,653 DEBUG awx.main.dispatch task aa3aea3e-7fac-4fcc-8452-c04a7922b845 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:25:59,663 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:25:59,666 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:25:29.657696+00:00 2022-04-27 17:25:59,861 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(3ae30060-ba3e-43af-907a-6da79dd0b004, queue=onap-awx-0) [2022-04-27 17:25:59,861: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(3ae30060-ba3e-43af-907a-6da79dd0b004, queue=onap-awx-0) 2022-04-27 17:26:00,082 DEBUG awx.main.dispatch delivered 3ae30060-ba3e-43af-907a-6da79dd0b004 to worker[182] qsize 0 2022-04-27 17:26:00,085 DEBUG awx.main.dispatch task 3ae30060-ba3e-43af-907a-6da79dd0b004 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:26:00,090 DEBUG awx.main.tasks Cluster node heartbeat task. RESULT 2 OKREADY 2022-04-27 17:26:00,128 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(9d77add5-87bb-4935-b956-dc66cedc27f0, queue=onap-awx-0) [2022-04-27 17:26:00,128: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(9d77add5-87bb-4935-b956-dc66cedc27f0, queue=onap-awx-0) 2022-04-27 17:26:00,147 DEBUG awx.main.dispatch delivered 9d77add5-87bb-4935-b956-dc66cedc27f0 to worker[181] qsize 0 2022-04-27 17:26:00,150 DEBUG awx.main.dispatch task 9d77add5-87bb-4935-b956-dc66cedc27f0 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:26:00,166 DEBUG awx.main.dispatch task 9d77add5-87bb-4935-b956-dc66cedc27f0 is finished 2022-04-27 17:26:00,207 DEBUG awx.main.dispatch task aa3aea3e-7fac-4fcc-8452-c04a7922b845 is finished 2022-04-27 17:26:00,312 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(51e1de4a-7b30-4dc8-8e7c-831e0e342d94, queue=awx_private_queue) [2022-04-27 17:26:00,312: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(51e1de4a-7b30-4dc8-8e7c-831e0e342d94, queue=awx_private_queue) 2022-04-27 17:26:00,507 WARNING awx.main.tasks Rejoining the cluster as instance onap-awx-0. 2022-04-27 17:26:00,508 DEBUG awx.main.dispatch task 3ae30060-ba3e-43af-907a-6da79dd0b004 is finished 2022-04-27 17:26:00,515 DEBUG awx.main.dispatch delivered 51e1de4a-7b30-4dc8-8e7c-831e0e342d94 to worker[182] qsize 0 2022-04-27 17:26:00,518 DEBUG awx.main.dispatch task 51e1de4a-7b30-4dc8-8e7c-831e0e342d94 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:26:00,520 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:26:00,538 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:26:00,569 DEBUG awx.main.dispatch task 51e1de4a-7b30-4dc8-8e7c-831e0e342d94 is finished 2022-04-27 17:26:20,313 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0e42751b-2c92-4422-9eb9-1c5107c9c652, queue=awx_private_queue) [2022-04-27 17:26:20,313: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0e42751b-2c92-4422-9eb9-1c5107c9c652, queue=awx_private_queue) 2022-04-27 17:26:20,328 DEBUG awx.main.dispatch delivered 0e42751b-2c92-4422-9eb9-1c5107c9c652 to worker[183] qsize 0 2022-04-27 17:26:20,332 DEBUG awx.main.dispatch task 0e42751b-2c92-4422-9eb9-1c5107c9c652 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:26:20,335 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:26:20,356 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:26:20,395 DEBUG awx.main.dispatch task 0e42751b-2c92-4422-9eb9-1c5107c9c652 is finished 2022-04-27 17:26:29,616 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(77ee3b94-e2a3-4f47-8ba6-d01caffcc71c, queue=awx_private_queue) [2022-04-27 17:26:29,616: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(77ee3b94-e2a3-4f47-8ba6-d01caffcc71c, queue=awx_private_queue) 2022-04-27 17:26:29,633 DEBUG awx.main.dispatch delivered 77ee3b94-e2a3-4f47-8ba6-d01caffcc71c to worker[181] qsize 0 2022-04-27 17:26:29,637 DEBUG awx.main.dispatch task 77ee3b94-e2a3-4f47-8ba6-d01caffcc71c starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:26:29,648 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:26:29,651 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:25:59.663716+00:00 2022-04-27 17:26:30,146 DEBUG awx.main.dispatch task 77ee3b94-e2a3-4f47-8ba6-d01caffcc71c is finished 2022-04-27 17:26:40,314 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(2113731d-dbca-453e-b69a-633a410d9e8d, queue=awx_private_queue) [2022-04-27 17:26:40,314: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(2113731d-dbca-453e-b69a-633a410d9e8d, queue=awx_private_queue) 2022-04-27 17:26:40,335 DEBUG awx.main.dispatch delivered 2113731d-dbca-453e-b69a-633a410d9e8d to worker[182] qsize 0 2022-04-27 17:26:40,338 DEBUG awx.main.dispatch task 2113731d-dbca-453e-b69a-633a410d9e8d starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:26:40,341 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:26:40,360 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:26:40,391 DEBUG awx.main.dispatch task 2113731d-dbca-453e-b69a-633a410d9e8d is finished 2022-04-27 17:26:59,617 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(72a16c01-bc01-4d15-996d-ba3021e9814a, queue=awx_private_queue) [2022-04-27 17:26:59,617: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(72a16c01-bc01-4d15-996d-ba3021e9814a, queue=awx_private_queue) 2022-04-27 17:26:59,670 DEBUG awx.main.dispatch delivered 72a16c01-bc01-4d15-996d-ba3021e9814a to worker[180] qsize 0 2022-04-27 17:26:59,861 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(a72a8ad5-57df-44f3-bfa6-318a1029e1d7, queue=onap-awx-0) [2022-04-27 17:26:59,861: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(a72a8ad5-57df-44f3-bfa6-318a1029e1d7, queue=onap-awx-0) 2022-04-27 17:26:59,673 DEBUG awx.main.dispatch task 72a16c01-bc01-4d15-996d-ba3021e9814a starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:26:59,873 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:26:59,876 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:26:29.648875+00:00 2022-04-27 17:26:59,890 DEBUG awx.main.dispatch delivered a72a8ad5-57df-44f3-bfa6-318a1029e1d7 to worker[183] qsize 0 2022-04-27 17:26:59,893 DEBUG awx.main.dispatch task a72a8ad5-57df-44f3-bfa6-318a1029e1d7 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:26:59,895 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:27:00,127 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(80f4e138-48a2-4f93-ac45-155bc73b3be0, queue=onap-awx-0) [2022-04-27 17:27:00,127: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(80f4e138-48a2-4f93-ac45-155bc73b3be0, queue=onap-awx-0) 2022-04-27 17:27:00,314 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(49e178f3-06de-4825-ad3d-863d7cf8a8ba, queue=awx_private_queue) [2022-04-27 17:27:00,314: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(49e178f3-06de-4825-ad3d-863d7cf8a8ba, queue=awx_private_queue) RESULT 2 OKREADY 2022-04-27 17:27:00,595 DEBUG awx.main.dispatch task a72a8ad5-57df-44f3-bfa6-318a1029e1d7 is finished 2022-04-27 17:27:00,678 DEBUG awx.main.dispatch delivered 49e178f3-06de-4825-ad3d-863d7cf8a8ba to worker[181] qsize 0 2022-04-27 17:27:00,682 DEBUG awx.main.dispatch task 49e178f3-06de-4825-ad3d-863d7cf8a8ba starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:27:00,683 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:27:00,699 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:27:00,728 DEBUG awx.main.dispatch delivered 80f4e138-48a2-4f93-ac45-155bc73b3be0 to worker[183] qsize 0 2022-04-27 17:27:00,732 DEBUG awx.main.dispatch task 80f4e138-48a2-4f93-ac45-155bc73b3be0 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:27:00,733 DEBUG awx.main.dispatch task 49e178f3-06de-4825-ad3d-863d7cf8a8ba is finished 2022-04-27 17:27:00,746 DEBUG awx.main.dispatch task 80f4e138-48a2-4f93-ac45-155bc73b3be0 is finished 2022-04-27 17:27:00,766 DEBUG awx.main.dispatch task 72a16c01-bc01-4d15-996d-ba3021e9814a is finished 2022-04-27 17:27:20,321 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(64adc913-2872-427e-a8e3-11e829c1cd02, queue=awx_private_queue) [2022-04-27 17:27:20,321: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(64adc913-2872-427e-a8e3-11e829c1cd02, queue=awx_private_queue) 2022-04-27 17:27:20,337 DEBUG awx.main.dispatch delivered 64adc913-2872-427e-a8e3-11e829c1cd02 to worker[183] qsize 0 2022-04-27 17:27:20,340 DEBUG awx.main.dispatch task 64adc913-2872-427e-a8e3-11e829c1cd02 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:27:20,341 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:27:20,359 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:27:20,396 DEBUG awx.main.dispatch task 64adc913-2872-427e-a8e3-11e829c1cd02 is finished 2022-04-27 17:27:29,616 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(c89320cb-5d77-45da-a5c7-a80edd20c9cd, queue=awx_private_queue) [2022-04-27 17:27:29,616: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(c89320cb-5d77-45da-a5c7-a80edd20c9cd, queue=awx_private_queue) 2022-04-27 17:27:29,636 DEBUG awx.main.dispatch delivered c89320cb-5d77-45da-a5c7-a80edd20c9cd to worker[182] qsize 0 2022-04-27 17:27:29,640 DEBUG awx.main.dispatch task c89320cb-5d77-45da-a5c7-a80edd20c9cd starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:27:29,651 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:27:29,654 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:26:59.873897+00:00 2022-04-27 17:27:29,681 DEBUG awx.main.dispatch task c89320cb-5d77-45da-a5c7-a80edd20c9cd is finished 2022-04-27 17:27:40,321 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5e0bb7f4-0937-4c29-a112-327cba6662dc, queue=awx_private_queue) [2022-04-27 17:27:40,321: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5e0bb7f4-0937-4c29-a112-327cba6662dc, queue=awx_private_queue) 2022-04-27 17:27:40,340 DEBUG awx.main.dispatch delivered 5e0bb7f4-0937-4c29-a112-327cba6662dc to worker[181] qsize 0 2022-04-27 17:27:40,344 DEBUG awx.main.dispatch task 5e0bb7f4-0937-4c29-a112-327cba6662dc starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:27:40,346 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:27:40,368 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:27:40,401 DEBUG awx.main.dispatch task 5e0bb7f4-0937-4c29-a112-327cba6662dc is finished 2022-04-27 17:27:59,626 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(200001b9-7351-4bff-937d-4a4641f81db5, queue=awx_private_queue) [2022-04-27 17:27:59,626: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(200001b9-7351-4bff-937d-4a4641f81db5, queue=awx_private_queue) 2022-04-27 17:27:59,673 DEBUG awx.main.dispatch delivered 200001b9-7351-4bff-937d-4a4641f81db5 to worker[180] qsize 0 2022-04-27 17:27:59,676 DEBUG awx.main.dispatch task 200001b9-7351-4bff-937d-4a4641f81db5 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:27:59,846 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:27:59,848 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:27:29.651549+00:00 2022-04-27 17:27:59,860 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(5fdc792d-6de1-48be-99d7-b604acb6dbba, queue=onap-awx-0) [2022-04-27 17:27:59,860: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(5fdc792d-6de1-48be-99d7-b604acb6dbba, queue=onap-awx-0) 2022-04-27 17:27:59,880 DEBUG awx.main.dispatch task 200001b9-7351-4bff-937d-4a4641f81db5 is finished 2022-04-27 17:27:59,890 DEBUG awx.main.dispatch delivered 5fdc792d-6de1-48be-99d7-b604acb6dbba to worker[182] qsize 0 2022-04-27 17:27:59,893 DEBUG awx.main.dispatch task 5fdc792d-6de1-48be-99d7-b604acb6dbba starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:27:59,895 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:27:59,921 DEBUG awx.main.dispatch task 5fdc792d-6de1-48be-99d7-b604acb6dbba is finished 2022-04-27 17:28:00,127 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(9ab9d59b-bb59-4eb4-8000-a34d37e2c214, queue=onap-awx-0) [2022-04-27 17:28:00,127: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(9ab9d59b-bb59-4eb4-8000-a34d37e2c214, queue=onap-awx-0) 2022-04-27 17:28:00,322 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5b081a3f-55a6-47da-b353-c19ce7df0d89, queue=awx_private_queue) [2022-04-27 17:28:00,322: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5b081a3f-55a6-47da-b353-c19ce7df0d89, queue=awx_private_queue) RESULT 2 OKREADY 2022-04-27 17:28:00,341 DEBUG awx.main.dispatch delivered 5b081a3f-55a6-47da-b353-c19ce7df0d89 to worker[180] qsize 0 2022-04-27 17:28:00,343 DEBUG awx.main.dispatch task 5b081a3f-55a6-47da-b353-c19ce7df0d89 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:28:00,345 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:28:00,365 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:28:00,366 DEBUG awx.main.dispatch delivered 9ab9d59b-bb59-4eb4-8000-a34d37e2c214 to worker[182] qsize 0 2022-04-27 17:28:00,369 DEBUG awx.main.dispatch task 9ab9d59b-bb59-4eb4-8000-a34d37e2c214 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:28:00,382 DEBUG awx.main.dispatch task 9ab9d59b-bb59-4eb4-8000-a34d37e2c214 is finished 2022-04-27 17:28:00,395 DEBUG awx.main.dispatch task 5b081a3f-55a6-47da-b353-c19ce7df0d89 is finished 2022-04-27 17:28:20,831 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(058c4121-416b-4ac4-ab3c-6518701e04c3, queue=awx_private_queue) [2022-04-27 17:28:20,831: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(058c4121-416b-4ac4-ab3c-6518701e04c3, queue=awx_private_queue) 2022-04-27 17:28:20,851 DEBUG awx.main.dispatch delivered 058c4121-416b-4ac4-ab3c-6518701e04c3 to worker[181] qsize 0 2022-04-27 17:28:20,853 DEBUG awx.main.dispatch task 058c4121-416b-4ac4-ab3c-6518701e04c3 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:28:20,855 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:28:20,872 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:28:20,907 DEBUG awx.main.dispatch task 058c4121-416b-4ac4-ab3c-6518701e04c3 is finished 2022-04-27 17:28:29,626 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(35d2b731-2bcb-4a0a-847c-fd579748d157, queue=awx_private_queue) [2022-04-27 17:28:29,626: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(35d2b731-2bcb-4a0a-847c-fd579748d157, queue=awx_private_queue) 2022-04-27 17:28:29,659 DEBUG awx.main.dispatch delivered 35d2b731-2bcb-4a0a-847c-fd579748d157 to worker[183] qsize 0 2022-04-27 17:28:29,663 DEBUG awx.main.dispatch task 35d2b731-2bcb-4a0a-847c-fd579748d157 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:28:29,674 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:28:29,677 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:27:59.846691+00:00 2022-04-27 17:28:30,039 DEBUG awx.main.dispatch task 35d2b731-2bcb-4a0a-847c-fd579748d157 is finished 2022-04-27 17:28:40,834 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d585cfb0-0a18-4ab8-9c0b-8d776bf0ee34, queue=awx_private_queue) [2022-04-27 17:28:40,834: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d585cfb0-0a18-4ab8-9c0b-8d776bf0ee34, queue=awx_private_queue) 2022-04-27 17:28:40,864 DEBUG awx.main.dispatch delivered d585cfb0-0a18-4ab8-9c0b-8d776bf0ee34 to worker[180] qsize 0 2022-04-27 17:28:40,867 DEBUG awx.main.dispatch task d585cfb0-0a18-4ab8-9c0b-8d776bf0ee34 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:28:40,868 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:28:40,889 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:28:40,921 DEBUG awx.main.dispatch task d585cfb0-0a18-4ab8-9c0b-8d776bf0ee34 is finished 2022-04-27 17:28:59,635 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(59edb667-45f6-4a2a-8e10-4419544b22c6, queue=awx_private_queue) [2022-04-27 17:28:59,635: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(59edb667-45f6-4a2a-8e10-4419544b22c6, queue=awx_private_queue) 2022-04-27 17:28:59,681 DEBUG awx.main.dispatch delivered 59edb667-45f6-4a2a-8e10-4419544b22c6 to worker[182] qsize 0 2022-04-27 17:28:59,861 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(679626f6-9df7-4e82-8767-2b8ba7d1573d, queue=onap-awx-0) [2022-04-27 17:28:59,861: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(679626f6-9df7-4e82-8767-2b8ba7d1573d, queue=onap-awx-0) 2022-04-27 17:28:59,683 DEBUG awx.main.dispatch task 59edb667-45f6-4a2a-8e10-4419544b22c6 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:28:59,870 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:28:59,872 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:28:29.674439+00:00 2022-04-27 17:28:59,887 DEBUG awx.main.dispatch delivered 679626f6-9df7-4e82-8767-2b8ba7d1573d to worker[181] qsize 0 2022-04-27 17:28:59,889 DEBUG awx.main.dispatch task 679626f6-9df7-4e82-8767-2b8ba7d1573d starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:28:59,891 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:29:00,116 DEBUG awx.main.dispatch task 679626f6-9df7-4e82-8767-2b8ba7d1573d is finished 2022-04-27 17:29:00,127 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(ee3c5972-3fb6-4087-973e-fbaeb951556a, queue=onap-awx-0) [2022-04-27 17:29:00,127: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(ee3c5972-3fb6-4087-973e-fbaeb951556a, queue=onap-awx-0) RESULT 2 OKREADY 2022-04-27 17:29:00,320 DEBUG awx.main.dispatch task 59edb667-45f6-4a2a-8e10-4419544b22c6 is finished 2022-04-27 17:29:00,358 DEBUG awx.main.dispatch delivered ee3c5972-3fb6-4087-973e-fbaeb951556a to worker[183] qsize 0 2022-04-27 17:29:00,361 DEBUG awx.main.dispatch task ee3c5972-3fb6-4087-973e-fbaeb951556a starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:29:00,374 DEBUG awx.main.dispatch task ee3c5972-3fb6-4087-973e-fbaeb951556a is finished 2022-04-27 17:29:00,833 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(4cbc01aa-fa47-4a9c-b795-18b43d7b0cbd, queue=awx_private_queue) [2022-04-27 17:29:00,833: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(4cbc01aa-fa47-4a9c-b795-18b43d7b0cbd, queue=awx_private_queue) 2022-04-27 17:29:00,851 DEBUG awx.main.dispatch delivered 4cbc01aa-fa47-4a9c-b795-18b43d7b0cbd to worker[183] qsize 0 2022-04-27 17:29:00,855 DEBUG awx.main.dispatch task 4cbc01aa-fa47-4a9c-b795-18b43d7b0cbd starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:29:00,857 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:29:00,872 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:29:00,902 DEBUG awx.main.dispatch task 4cbc01aa-fa47-4a9c-b795-18b43d7b0cbd is finished 2022-04-27 17:29:20,834 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5527f1fe-5328-4c6e-84a5-66bd9ae072d0, queue=awx_private_queue) [2022-04-27 17:29:20,834: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5527f1fe-5328-4c6e-84a5-66bd9ae072d0, queue=awx_private_queue) 2022-04-27 17:29:20,849 DEBUG awx.main.dispatch delivered 5527f1fe-5328-4c6e-84a5-66bd9ae072d0 to worker[180] qsize 0 2022-04-27 17:29:20,852 DEBUG awx.main.dispatch task 5527f1fe-5328-4c6e-84a5-66bd9ae072d0 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:29:20,854 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:29:20,871 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:29:20,900 DEBUG awx.main.dispatch task 5527f1fe-5328-4c6e-84a5-66bd9ae072d0 is finished 2022-04-27 17:29:29,635 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(c4dd35a8-0b60-4a2c-90e8-bf1f882423ce, queue=awx_private_queue) [2022-04-27 17:29:29,635: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(c4dd35a8-0b60-4a2c-90e8-bf1f882423ce, queue=awx_private_queue) 2022-04-27 17:29:29,653 DEBUG awx.main.dispatch delivered c4dd35a8-0b60-4a2c-90e8-bf1f882423ce to worker[182] qsize 0 2022-04-27 17:29:29,656 DEBUG awx.main.dispatch task c4dd35a8-0b60-4a2c-90e8-bf1f882423ce starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:29:29,667 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:29:29,670 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:28:59.870547+00:00 2022-04-27 17:29:29,823 DEBUG awx.main.dispatch task c4dd35a8-0b60-4a2c-90e8-bf1f882423ce is finished 2022-04-27 17:29:40,835 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6d37f4fe-a79e-42e0-a10f-db8cf899523d, queue=awx_private_queue) [2022-04-27 17:29:40,835: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6d37f4fe-a79e-42e0-a10f-db8cf899523d, queue=awx_private_queue) 2022-04-27 17:29:40,857 DEBUG awx.main.dispatch delivered 6d37f4fe-a79e-42e0-a10f-db8cf899523d to worker[180] qsize 0 2022-04-27 17:29:40,861 DEBUG awx.main.dispatch task 6d37f4fe-a79e-42e0-a10f-db8cf899523d starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:29:40,862 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:29:40,879 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:29:40,909 DEBUG awx.main.dispatch task 6d37f4fe-a79e-42e0-a10f-db8cf899523d is finished 2022-04-27 17:29:59,641 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(5372b90d-b7cc-48e6-8f2b-08005d7e13a1, queue=awx_private_queue) [2022-04-27 17:29:59,641: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(5372b90d-b7cc-48e6-8f2b-08005d7e13a1, queue=awx_private_queue) 2022-04-27 17:29:59,674 DEBUG awx.main.dispatch delivered 5372b90d-b7cc-48e6-8f2b-08005d7e13a1 to worker[181] qsize 0 2022-04-27 17:29:59,677 DEBUG awx.main.dispatch task 5372b90d-b7cc-48e6-8f2b-08005d7e13a1 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:29:59,687 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:29:59,690 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:29:29.667447+00:00 2022-04-27 17:29:59,861 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(881c0c16-ab8d-4e1f-bbd0-981bb52da50c, queue=onap-awx-0) [2022-04-27 17:29:59,861: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(881c0c16-ab8d-4e1f-bbd0-981bb52da50c, queue=onap-awx-0) 2022-04-27 17:29:59,891 DEBUG awx.main.dispatch delivered 881c0c16-ab8d-4e1f-bbd0-981bb52da50c to worker[183] qsize 0 2022-04-27 17:29:59,893 DEBUG awx.main.dispatch task 881c0c16-ab8d-4e1f-bbd0-981bb52da50c starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:30:00,068 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:30:00,127 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(609e2a38-5e83-4638-aeb5-fe780c0eae0f, queue=onap-awx-0) [2022-04-27 17:30:00,127: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(609e2a38-5e83-4638-aeb5-fe780c0eae0f, queue=onap-awx-0) RESULT 2 OKREADY 2022-04-27 17:30:00,335 DEBUG awx.main.dispatch task 5372b90d-b7cc-48e6-8f2b-08005d7e13a1 is finished 2022-04-27 17:30:00,464 DEBUG awx.main.dispatch task 881c0c16-ab8d-4e1f-bbd0-981bb52da50c is finished 2022-04-27 17:30:00,655 DEBUG awx.main.dispatch delivered 609e2a38-5e83-4638-aeb5-fe780c0eae0f to worker[181] qsize 0 2022-04-27 17:30:00,658 DEBUG awx.main.dispatch task 609e2a38-5e83-4638-aeb5-fe780c0eae0f starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:30:00,671 DEBUG awx.main.dispatch task 609e2a38-5e83-4638-aeb5-fe780c0eae0f is finished 2022-04-27 17:30:00,835 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(dcb2a702-1e2b-479b-b50e-2db7c9d9863b, queue=awx_private_queue) [2022-04-27 17:30:00,835: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(dcb2a702-1e2b-479b-b50e-2db7c9d9863b, queue=awx_private_queue) 2022-04-27 17:30:00,853 DEBUG awx.main.dispatch delivered dcb2a702-1e2b-479b-b50e-2db7c9d9863b to worker[182] qsize 0 2022-04-27 17:30:00,857 DEBUG awx.main.dispatch task dcb2a702-1e2b-479b-b50e-2db7c9d9863b starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:30:00,860 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:30:00,875 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:30:00,903 DEBUG awx.main.dispatch task dcb2a702-1e2b-479b-b50e-2db7c9d9863b is finished 2022-04-27 17:30:20,843 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5fe63954-cbb1-4d0b-a600-ed127a0a19c5, queue=awx_private_queue) [2022-04-27 17:30:20,843: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5fe63954-cbb1-4d0b-a600-ed127a0a19c5, queue=awx_private_queue) 2022-04-27 17:30:20,866 DEBUG awx.main.dispatch delivered 5fe63954-cbb1-4d0b-a600-ed127a0a19c5 to worker[183] qsize 0 2022-04-27 17:30:20,869 DEBUG awx.main.dispatch task 5fe63954-cbb1-4d0b-a600-ed127a0a19c5 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:30:20,871 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:30:20,889 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:30:20,920 DEBUG awx.main.dispatch task 5fe63954-cbb1-4d0b-a600-ed127a0a19c5 is finished 2022-04-27 17:30:29,642 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(cac58c8d-f926-414e-a1f0-f490b1c10d6c, queue=awx_private_queue) [2022-04-27 17:30:29,642: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(cac58c8d-f926-414e-a1f0-f490b1c10d6c, queue=awx_private_queue) 2022-04-27 17:30:29,660 DEBUG awx.main.dispatch delivered cac58c8d-f926-414e-a1f0-f490b1c10d6c to worker[181] qsize 0 2022-04-27 17:30:29,664 DEBUG awx.main.dispatch task cac58c8d-f926-414e-a1f0-f490b1c10d6c starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:30:29,676 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:30:29,679 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:29:59.687320+00:00 2022-04-27 17:30:30,116 DEBUG awx.main.dispatch task cac58c8d-f926-414e-a1f0-f490b1c10d6c is finished 2022-04-27 17:30:40,845 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a390e31f-e75f-4856-baea-666deb45c7e6, queue=awx_private_queue) [2022-04-27 17:30:40,845: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a390e31f-e75f-4856-baea-666deb45c7e6, queue=awx_private_queue) 2022-04-27 17:30:40,865 DEBUG awx.main.dispatch delivered a390e31f-e75f-4856-baea-666deb45c7e6 to worker[181] qsize 0 2022-04-27 17:30:40,869 DEBUG awx.main.dispatch task a390e31f-e75f-4856-baea-666deb45c7e6 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:30:40,871 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:30:40,893 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:30:40,924 DEBUG awx.main.dispatch task a390e31f-e75f-4856-baea-666deb45c7e6 is finished 2022-04-27 17:30:59,650 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(76545351-b9a0-4063-b605-875455271dd1, queue=awx_private_queue) [2022-04-27 17:30:59,650: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(76545351-b9a0-4063-b605-875455271dd1, queue=awx_private_queue) 2022-04-27 17:30:59,670 DEBUG awx.main.dispatch delivered 76545351-b9a0-4063-b605-875455271dd1 to worker[181] qsize 0 2022-04-27 17:30:59,673 DEBUG awx.main.dispatch task 76545351-b9a0-4063-b605-875455271dd1 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:30:59,684 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:30:59,687 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:30:29.676875+00:00 2022-04-27 17:30:59,861 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(1a65c395-7381-4f49-ab24-965b5d517529, queue=onap-awx-0) [2022-04-27 17:30:59,861: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(1a65c395-7381-4f49-ab24-965b5d517529, queue=onap-awx-0) 2022-04-27 17:30:59,909 DEBUG awx.main.dispatch delivered 1a65c395-7381-4f49-ab24-965b5d517529 to worker[180] qsize 0 2022-04-27 17:30:59,961 DEBUG awx.main.dispatch task 76545351-b9a0-4063-b605-875455271dd1 is finished 2022-04-27 17:30:59,912 DEBUG awx.main.dispatch task 1a65c395-7381-4f49-ab24-965b5d517529 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:31:00,092 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:31:00,128 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(9e0359d6-4904-4a7f-8925-4f19206258b1, queue=onap-awx-0) [2022-04-27 17:31:00,128: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(9e0359d6-4904-4a7f-8925-4f19206258b1, queue=onap-awx-0) RESULT 2 OKREADY 2022-04-27 17:31:00,337 DEBUG awx.main.dispatch task 1a65c395-7381-4f49-ab24-965b5d517529 is finished 2022-04-27 17:31:00,727 DEBUG awx.main.dispatch delivered 9e0359d6-4904-4a7f-8925-4f19206258b1 to worker[180] qsize 0 2022-04-27 17:31:00,730 DEBUG awx.main.dispatch task 9e0359d6-4904-4a7f-8925-4f19206258b1 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:31:00,745 DEBUG awx.main.dispatch task 9e0359d6-4904-4a7f-8925-4f19206258b1 is finished 2022-04-27 17:31:00,845 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e5fdb72d-979d-423c-836a-d355e1f81987, queue=awx_private_queue) [2022-04-27 17:31:00,845: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e5fdb72d-979d-423c-836a-d355e1f81987, queue=awx_private_queue) 2022-04-27 17:31:00,862 DEBUG awx.main.dispatch delivered e5fdb72d-979d-423c-836a-d355e1f81987 to worker[181] qsize 0 2022-04-27 17:31:00,864 DEBUG awx.main.dispatch task e5fdb72d-979d-423c-836a-d355e1f81987 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:31:00,867 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:31:00,883 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:31:00,911 DEBUG awx.main.dispatch task e5fdb72d-979d-423c-836a-d355e1f81987 is finished 2022-04-27 17:31:21,197 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b91cf8ae-48c6-48e3-91ec-e7490e508f20, queue=awx_private_queue) [2022-04-27 17:31:21,197: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b91cf8ae-48c6-48e3-91ec-e7490e508f20, queue=awx_private_queue) 2022-04-27 17:31:21,216 DEBUG awx.main.dispatch delivered b91cf8ae-48c6-48e3-91ec-e7490e508f20 to worker[182] qsize 0 2022-04-27 17:31:21,218 DEBUG awx.main.dispatch task b91cf8ae-48c6-48e3-91ec-e7490e508f20 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:31:21,221 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:31:21,239 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:31:21,273 DEBUG awx.main.dispatch task b91cf8ae-48c6-48e3-91ec-e7490e508f20 is finished 2022-04-27 17:31:29,651 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(817bd5e5-88ba-4a36-88e2-f1fb4e93c6a5, queue=awx_private_queue) [2022-04-27 17:31:29,651: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(817bd5e5-88ba-4a36-88e2-f1fb4e93c6a5, queue=awx_private_queue) 2022-04-27 17:31:29,670 DEBUG awx.main.dispatch delivered 817bd5e5-88ba-4a36-88e2-f1fb4e93c6a5 to worker[183] qsize 0 2022-04-27 17:31:29,674 DEBUG awx.main.dispatch task 817bd5e5-88ba-4a36-88e2-f1fb4e93c6a5 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:31:29,684 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:31:29,687 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:30:59.685012+00:00 2022-04-27 17:31:30,143 DEBUG awx.main.dispatch task 817bd5e5-88ba-4a36-88e2-f1fb4e93c6a5 is finished 2022-04-27 17:31:41,199 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(248db601-684f-4680-9a61-dd198d30b06d, queue=awx_private_queue) [2022-04-27 17:31:41,199: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(248db601-684f-4680-9a61-dd198d30b06d, queue=awx_private_queue) 2022-04-27 17:31:41,222 DEBUG awx.main.dispatch delivered 248db601-684f-4680-9a61-dd198d30b06d to worker[183] qsize 0 2022-04-27 17:31:41,225 DEBUG awx.main.dispatch task 248db601-684f-4680-9a61-dd198d30b06d starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:31:41,228 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:31:41,246 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:31:41,278 DEBUG awx.main.dispatch task 248db601-684f-4680-9a61-dd198d30b06d is finished 2022-04-27 17:31:59,660 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(653706e2-6e89-45d7-bc24-f5b1ce529a0c, queue=awx_private_queue) [2022-04-27 17:31:59,660: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(653706e2-6e89-45d7-bc24-f5b1ce529a0c, queue=awx_private_queue) 2022-04-27 17:31:59,676 DEBUG awx.main.dispatch delivered 653706e2-6e89-45d7-bc24-f5b1ce529a0c to worker[180] qsize 0 2022-04-27 17:31:59,679 DEBUG awx.main.dispatch task 653706e2-6e89-45d7-bc24-f5b1ce529a0c starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:31:59,691 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:31:59,694 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:31:29.685066+00:00 2022-04-27 17:31:59,861 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(826c3b93-2109-4e91-b8c5-8537c0b22332, queue=onap-awx-0) [2022-04-27 17:31:59,861: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(826c3b93-2109-4e91-b8c5-8537c0b22332, queue=onap-awx-0) 2022-04-27 17:31:59,908 DEBUG awx.main.dispatch delivered 826c3b93-2109-4e91-b8c5-8537c0b22332 to worker[181] qsize 0 2022-04-27 17:31:59,911 DEBUG awx.main.dispatch task 826c3b93-2109-4e91-b8c5-8537c0b22332 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:31:59,913 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:32:00,128 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(5df4445f-a6c6-4a66-873c-00c599a79c5f, queue=onap-awx-0) [2022-04-27 17:32:00,128: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(5df4445f-a6c6-4a66-873c-00c599a79c5f, queue=onap-awx-0) 2022-04-27 17:32:00,139 DEBUG awx.main.dispatch task 826c3b93-2109-4e91-b8c5-8537c0b22332 is finished RESULT 2 OKREADY 2022-04-27 17:32:00,135 DEBUG awx.main.dispatch task 653706e2-6e89-45d7-bc24-f5b1ce529a0c is finished 2022-04-27 17:32:00,546 DEBUG awx.main.dispatch delivered 5df4445f-a6c6-4a66-873c-00c599a79c5f to worker[181] qsize 0 2022-04-27 17:32:00,550 DEBUG awx.main.dispatch task 5df4445f-a6c6-4a66-873c-00c599a79c5f starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:32:00,564 DEBUG awx.main.dispatch task 5df4445f-a6c6-4a66-873c-00c599a79c5f is finished 2022-04-27 17:32:01,199 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ac724a30-5716-4e67-a0e5-9995583e95ec, queue=awx_private_queue) [2022-04-27 17:32:01,199: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ac724a30-5716-4e67-a0e5-9995583e95ec, queue=awx_private_queue) 2022-04-27 17:32:01,216 DEBUG awx.main.dispatch delivered ac724a30-5716-4e67-a0e5-9995583e95ec to worker[182] qsize 0 2022-04-27 17:32:01,219 DEBUG awx.main.dispatch task ac724a30-5716-4e67-a0e5-9995583e95ec starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:32:01,221 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:32:01,236 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:32:01,267 DEBUG awx.main.dispatch task ac724a30-5716-4e67-a0e5-9995583e95ec is finished 2022-04-27 17:32:21,199 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6a183d38-2761-45d5-901f-fb2061b4b72f, queue=awx_private_queue) [2022-04-27 17:32:21,199: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6a183d38-2761-45d5-901f-fb2061b4b72f, queue=awx_private_queue) 2022-04-27 17:32:21,221 DEBUG awx.main.dispatch delivered 6a183d38-2761-45d5-901f-fb2061b4b72f to worker[183] qsize 0 2022-04-27 17:32:21,224 DEBUG awx.main.dispatch task 6a183d38-2761-45d5-901f-fb2061b4b72f starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:32:21,226 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:32:21,245 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:32:21,274 DEBUG awx.main.dispatch task 6a183d38-2761-45d5-901f-fb2061b4b72f is finished 2022-04-27 17:32:29,660 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(b1add11a-d8f5-4401-bf5b-761e5b14f564, queue=awx_private_queue) [2022-04-27 17:32:29,660: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(b1add11a-d8f5-4401-bf5b-761e5b14f564, queue=awx_private_queue) 2022-04-27 17:32:33,283 DEBUG awx.main.dispatch delivered b1add11a-d8f5-4401-bf5b-761e5b14f564 to worker[182] qsize 0 2022-04-27 17:32:33,287 DEBUG awx.main.dispatch task b1add11a-d8f5-4401-bf5b-761e5b14f564 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:32:33,301 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:32:33,304 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:31:59.691758+00:00 2022-04-27 17:32:33,546 DEBUG awx.main.dispatch task b1add11a-d8f5-4401-bf5b-761e5b14f564 is finished 2022-04-27 17:32:41,202 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f2f32d10-0376-43ea-8c9c-33f8e41e90ec, queue=awx_private_queue) [2022-04-27 17:32:41,202: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f2f32d10-0376-43ea-8c9c-33f8e41e90ec, queue=awx_private_queue) 2022-04-27 17:32:41,219 DEBUG awx.main.dispatch delivered f2f32d10-0376-43ea-8c9c-33f8e41e90ec to worker[183] qsize 0 2022-04-27 17:32:41,222 DEBUG awx.main.dispatch task f2f32d10-0376-43ea-8c9c-33f8e41e90ec starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:32:41,225 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:32:41,245 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:32:41,277 DEBUG awx.main.dispatch task f2f32d10-0376-43ea-8c9c-33f8e41e90ec is finished 2022-04-27 17:32:59,669 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(e1c1cff6-62ca-4e7b-b9fe-9ecb471b03ba, queue=awx_private_queue) [2022-04-27 17:32:59,669: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(e1c1cff6-62ca-4e7b-b9fe-9ecb471b03ba, queue=awx_private_queue) 2022-04-27 17:32:59,689 DEBUG awx.main.dispatch delivered e1c1cff6-62ca-4e7b-b9fe-9ecb471b03ba to worker[183] qsize 0 2022-04-27 17:32:59,693 DEBUG awx.main.dispatch task e1c1cff6-62ca-4e7b-b9fe-9ecb471b03ba starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:32:59,704 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:32:59,706 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:32:33.302075+00:00 2022-04-27 17:32:59,861 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(86e5a02a-a37f-4d6a-9970-4c56f03fa01f, queue=onap-awx-0) [2022-04-27 17:32:59,861: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(86e5a02a-a37f-4d6a-9970-4c56f03fa01f, queue=onap-awx-0) 2022-04-27 17:32:59,904 DEBUG awx.main.dispatch delivered 86e5a02a-a37f-4d6a-9970-4c56f03fa01f to worker[181] qsize 0 2022-04-27 17:32:59,906 DEBUG awx.main.dispatch task 86e5a02a-a37f-4d6a-9970-4c56f03fa01f starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:33:00,094 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:33:00,127 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(93c69e4b-0a89-4fe1-9a6a-82f721e016d8, queue=onap-awx-0) [2022-04-27 17:33:00,127: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(93c69e4b-0a89-4fe1-9a6a-82f721e016d8, queue=onap-awx-0) RESULT 2 OKREADY 2022-04-27 17:33:00,173 DEBUG awx.main.dispatch task e1c1cff6-62ca-4e7b-b9fe-9ecb471b03ba is finished 2022-04-27 17:33:00,304 DEBUG awx.main.dispatch task 86e5a02a-a37f-4d6a-9970-4c56f03fa01f is finished 2022-04-27 17:33:00,691 DEBUG awx.main.dispatch delivered 93c69e4b-0a89-4fe1-9a6a-82f721e016d8 to worker[181] qsize 0 2022-04-27 17:33:00,694 DEBUG awx.main.dispatch task 93c69e4b-0a89-4fe1-9a6a-82f721e016d8 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:33:00,708 DEBUG awx.main.dispatch task 93c69e4b-0a89-4fe1-9a6a-82f721e016d8 is finished 2022-04-27 17:33:01,202 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(796b8feb-0e34-4536-8f89-4fb92257c74f, queue=awx_private_queue) [2022-04-27 17:33:01,202: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(796b8feb-0e34-4536-8f89-4fb92257c74f, queue=awx_private_queue) 2022-04-27 17:33:01,228 DEBUG awx.main.dispatch delivered 796b8feb-0e34-4536-8f89-4fb92257c74f to worker[180] qsize 0 2022-04-27 17:33:01,231 DEBUG awx.main.dispatch task 796b8feb-0e34-4536-8f89-4fb92257c74f starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:33:01,233 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:33:01,251 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:33:01,284 DEBUG awx.main.dispatch task 796b8feb-0e34-4536-8f89-4fb92257c74f is finished 2022-04-27 17:33:21,203 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3717af06-b036-4941-bcfd-0ab6af3a0830, queue=awx_private_queue) [2022-04-27 17:33:21,203: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3717af06-b036-4941-bcfd-0ab6af3a0830, queue=awx_private_queue) 2022-04-27 17:33:21,224 DEBUG awx.main.dispatch delivered 3717af06-b036-4941-bcfd-0ab6af3a0830 to worker[180] qsize 0 2022-04-27 17:33:21,226 DEBUG awx.main.dispatch task 3717af06-b036-4941-bcfd-0ab6af3a0830 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:33:21,228 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:33:21,250 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:33:21,281 DEBUG awx.main.dispatch task 3717af06-b036-4941-bcfd-0ab6af3a0830 is finished 2022-04-27 17:33:29,669 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(272d7813-5aba-43cc-9e50-761bf15be8fc, queue=awx_private_queue) [2022-04-27 17:33:29,669: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(272d7813-5aba-43cc-9e50-761bf15be8fc, queue=awx_private_queue) 2022-04-27 17:33:29,688 DEBUG awx.main.dispatch delivered 272d7813-5aba-43cc-9e50-761bf15be8fc to worker[180] qsize 0 2022-04-27 17:33:29,691 DEBUG awx.main.dispatch task 272d7813-5aba-43cc-9e50-761bf15be8fc starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:33:29,703 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:33:29,706 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:32:59.704185+00:00 2022-04-27 17:33:29,887 DEBUG awx.main.dispatch task 272d7813-5aba-43cc-9e50-761bf15be8fc is finished 2022-04-27 17:33:41,206 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(9ebec550-9cda-4edd-ad35-9b9f7101482d, queue=awx_private_queue) [2022-04-27 17:33:41,206: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(9ebec550-9cda-4edd-ad35-9b9f7101482d, queue=awx_private_queue) 2022-04-27 17:33:41,230 DEBUG awx.main.dispatch delivered 9ebec550-9cda-4edd-ad35-9b9f7101482d to worker[183] qsize 0 2022-04-27 17:33:41,234 DEBUG awx.main.dispatch task 9ebec550-9cda-4edd-ad35-9b9f7101482d starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:33:41,238 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:33:41,258 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:33:41,292 DEBUG awx.main.dispatch task 9ebec550-9cda-4edd-ad35-9b9f7101482d is finished 2022-04-27 17:33:59,678 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(7d903ef2-f692-46ff-aab0-aca83137773a, queue=awx_private_queue) [2022-04-27 17:33:59,678: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(7d903ef2-f692-46ff-aab0-aca83137773a, queue=awx_private_queue) 2022-04-27 17:33:59,696 DEBUG awx.main.dispatch delivered 7d903ef2-f692-46ff-aab0-aca83137773a to worker[180] qsize 0 2022-04-27 17:33:59,700 DEBUG awx.main.dispatch task 7d903ef2-f692-46ff-aab0-aca83137773a starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:33:59,713 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:33:59,716 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:33:29.703739+00:00 2022-04-27 17:33:59,861 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(5f3b52e8-6d96-4c39-8a23-fddbe500f1d6, queue=onap-awx-0) [2022-04-27 17:33:59,861: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(5f3b52e8-6d96-4c39-8a23-fddbe500f1d6, queue=onap-awx-0) 2022-04-27 17:33:59,885 DEBUG awx.main.dispatch delivered 5f3b52e8-6d96-4c39-8a23-fddbe500f1d6 to worker[181] qsize 0 2022-04-27 17:33:59,890 DEBUG awx.main.dispatch task 5f3b52e8-6d96-4c39-8a23-fddbe500f1d6 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:33:59,893 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:34:00,128 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(b125a4cd-5578-4d65-a3b7-d235043d0a08, queue=onap-awx-0) [2022-04-27 17:34:00,128: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(b125a4cd-5578-4d65-a3b7-d235043d0a08, queue=onap-awx-0) 2022-04-27 17:34:00,181 DEBUG awx.main.dispatch delivered b125a4cd-5578-4d65-a3b7-d235043d0a08 to worker[183] qsize 0 RESULT 2 OKREADY 2022-04-27 17:34:00,188 DEBUG awx.main.dispatch task b125a4cd-5578-4d65-a3b7-d235043d0a08 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:34:00,192 DEBUG awx.main.dispatch task 7d903ef2-f692-46ff-aab0-aca83137773a is finished 2022-04-27 17:34:00,201 DEBUG awx.main.dispatch task b125a4cd-5578-4d65-a3b7-d235043d0a08 is finished 2022-04-27 17:34:00,022 DEBUG awx.main.dispatch task 5f3b52e8-6d96-4c39-8a23-fddbe500f1d6 is finished 2022-04-27 17:34:01,206 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b001eeeb-2273-4d53-8382-a6ddb5818404, queue=awx_private_queue) [2022-04-27 17:34:01,206: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b001eeeb-2273-4d53-8382-a6ddb5818404, queue=awx_private_queue) 2022-04-27 17:34:01,236 DEBUG awx.main.dispatch delivered b001eeeb-2273-4d53-8382-a6ddb5818404 to worker[183] qsize 0 2022-04-27 17:34:01,239 DEBUG awx.main.dispatch task b001eeeb-2273-4d53-8382-a6ddb5818404 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:34:01,241 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:34:01,261 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:34:01,289 DEBUG awx.main.dispatch task b001eeeb-2273-4d53-8382-a6ddb5818404 is finished 2022-04-27 17:34:21,371 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(67b016fd-505d-4e97-a89a-9f61c13ed1c6, queue=awx_private_queue) [2022-04-27 17:34:21,371: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(67b016fd-505d-4e97-a89a-9f61c13ed1c6, queue=awx_private_queue) 2022-04-27 17:34:21,395 DEBUG awx.main.dispatch delivered 67b016fd-505d-4e97-a89a-9f61c13ed1c6 to worker[180] qsize 0 2022-04-27 17:34:21,398 DEBUG awx.main.dispatch task 67b016fd-505d-4e97-a89a-9f61c13ed1c6 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:34:21,401 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:34:21,422 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:34:21,454 DEBUG awx.main.dispatch task 67b016fd-505d-4e97-a89a-9f61c13ed1c6 is finished 2022-04-27 17:34:29,678 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(290942db-990f-41af-afdd-e896d0c7c972, queue=awx_private_queue) [2022-04-27 17:34:29,678: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(290942db-990f-41af-afdd-e896d0c7c972, queue=awx_private_queue) 2022-04-27 17:34:29,697 DEBUG awx.main.dispatch delivered 290942db-990f-41af-afdd-e896d0c7c972 to worker[182] qsize 0 2022-04-27 17:34:29,700 DEBUG awx.main.dispatch task 290942db-990f-41af-afdd-e896d0c7c972 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:34:29,711 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:34:29,715 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:33:59.713783+00:00 2022-04-27 17:34:29,736 DEBUG awx.main.dispatch task 290942db-990f-41af-afdd-e896d0c7c972 is finished 2022-04-27 17:34:41,373 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(832bb8ee-12e4-4506-97cd-575e80750bf5, queue=awx_private_queue) [2022-04-27 17:34:41,373: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(832bb8ee-12e4-4506-97cd-575e80750bf5, queue=awx_private_queue) 2022-04-27 17:34:41,392 DEBUG awx.main.dispatch delivered 832bb8ee-12e4-4506-97cd-575e80750bf5 to worker[181] qsize 0 2022-04-27 17:34:41,395 DEBUG awx.main.dispatch task 832bb8ee-12e4-4506-97cd-575e80750bf5 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:34:41,396 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:34:41,415 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:34:41,444 DEBUG awx.main.dispatch task 832bb8ee-12e4-4506-97cd-575e80750bf5 is finished 2022-04-27 17:34:59,687 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(f304b48d-dd91-4b42-a4c5-ad87a226254b, queue=awx_private_queue) [2022-04-27 17:34:59,687: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(f304b48d-dd91-4b42-a4c5-ad87a226254b, queue=awx_private_queue) 2022-04-27 17:34:59,708 DEBUG awx.main.dispatch delivered f304b48d-dd91-4b42-a4c5-ad87a226254b to worker[181] qsize 0 2022-04-27 17:34:59,713 DEBUG awx.main.dispatch task f304b48d-dd91-4b42-a4c5-ad87a226254b starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:34:59,724 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:34:59,728 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:34:29.712110+00:00 2022-04-27 17:34:59,861 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(df742726-dae7-4b35-b827-74ef13f33b28, queue=onap-awx-0) [2022-04-27 17:34:59,861: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(df742726-dae7-4b35-b827-74ef13f33b28, queue=onap-awx-0) 2022-04-27 17:34:59,888 DEBUG awx.main.dispatch delivered df742726-dae7-4b35-b827-74ef13f33b28 to worker[183] qsize 0 2022-04-27 17:34:59,891 DEBUG awx.main.dispatch task df742726-dae7-4b35-b827-74ef13f33b28 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:34:59,894 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:35:00,046 DEBUG awx.main.dispatch task df742726-dae7-4b35-b827-74ef13f33b28 is finished 2022-04-27 17:35:00,128 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(d6a08da8-b50e-4dca-92e6-7e2b8684dc02, queue=onap-awx-0) [2022-04-27 17:35:00,128: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(d6a08da8-b50e-4dca-92e6-7e2b8684dc02, queue=onap-awx-0) RESULT 2 OKREADY 2022-04-27 17:35:00,143 DEBUG awx.main.dispatch delivered d6a08da8-b50e-4dca-92e6-7e2b8684dc02 to worker[182] qsize 0 2022-04-27 17:35:00,145 DEBUG awx.main.dispatch task d6a08da8-b50e-4dca-92e6-7e2b8684dc02 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:35:00,149 DEBUG awx.main.dispatch publish awx.main.tasks.awx_isolated_heartbeat(563a0db8-ae4b-4661-85af-eec510d74008, queue=onap-awx-0) [2022-04-27 17:35:00,149: DEBUG/Process-1] publish awx.main.tasks.awx_isolated_heartbeat(563a0db8-ae4b-4661-85af-eec510d74008, queue=onap-awx-0) 2022-04-27 17:35:00,159 DEBUG awx.main.dispatch task d6a08da8-b50e-4dca-92e6-7e2b8684dc02 is finished 2022-04-27 17:35:00,169 DEBUG awx.main.dispatch delivered 563a0db8-ae4b-4661-85af-eec510d74008 to worker[183] qsize 0 2022-04-27 17:35:00,171 DEBUG awx.main.dispatch task 563a0db8-ae4b-4661-85af-eec510d74008 starting awx.main.tasks.awx_isolated_heartbeat(*[]) 2022-04-27 17:35:00,173 DEBUG awx.main.tasks Controlling node checking for any isolated management tasks. 2022-04-27 17:35:00,192 DEBUG awx.main.dispatch task 563a0db8-ae4b-4661-85af-eec510d74008 is finished 2022-04-27 17:35:00,044 DEBUG awx.main.dispatch task f304b48d-dd91-4b42-a4c5-ad87a226254b is finished 2022-04-27 17:35:01,373 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(1698490f-ec5a-484c-b91f-d37d983f0051, queue=awx_private_queue) [2022-04-27 17:35:01,373: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(1698490f-ec5a-484c-b91f-d37d983f0051, queue=awx_private_queue) 2022-04-27 17:35:01,398 DEBUG awx.main.dispatch delivered 1698490f-ec5a-484c-b91f-d37d983f0051 to worker[182] qsize 0 2022-04-27 17:35:01,401 DEBUG awx.main.dispatch task 1698490f-ec5a-484c-b91f-d37d983f0051 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:35:01,403 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:35:01,422 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:35:01,452 DEBUG awx.main.dispatch task 1698490f-ec5a-484c-b91f-d37d983f0051 is finished 2022-04-27 17:35:21,374 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c34f70b5-2821-4f3a-8291-8d004798b01d, queue=awx_private_queue) [2022-04-27 17:35:21,374: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c34f70b5-2821-4f3a-8291-8d004798b01d, queue=awx_private_queue) 2022-04-27 17:35:21,394 DEBUG awx.main.dispatch delivered c34f70b5-2821-4f3a-8291-8d004798b01d to worker[183] qsize 0 2022-04-27 17:35:21,396 DEBUG awx.main.dispatch task c34f70b5-2821-4f3a-8291-8d004798b01d starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:35:21,398 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:35:21,416 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:35:21,452 DEBUG awx.main.dispatch task c34f70b5-2821-4f3a-8291-8d004798b01d is finished 2022-04-27 17:35:29,687 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(b331c760-f401-44d8-b942-36025c8f2d81, queue=awx_private_queue) [2022-04-27 17:35:29,687: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(b331c760-f401-44d8-b942-36025c8f2d81, queue=awx_private_queue) 2022-04-27 17:35:29,704 DEBUG awx.main.dispatch delivered b331c760-f401-44d8-b942-36025c8f2d81 to worker[182] qsize 0 2022-04-27 17:35:29,707 DEBUG awx.main.dispatch task b331c760-f401-44d8-b942-36025c8f2d81 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:35:29,721 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:35:29,724 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:34:59.725090+00:00 2022-04-27 17:35:30,291 DEBUG awx.main.dispatch task b331c760-f401-44d8-b942-36025c8f2d81 is finished 2022-04-27 17:35:41,376 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3fa9cfb6-9acf-4409-853c-dded12c01ba4, queue=awx_private_queue) [2022-04-27 17:35:41,376: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3fa9cfb6-9acf-4409-853c-dded12c01ba4, queue=awx_private_queue) 2022-04-27 17:35:41,395 DEBUG awx.main.dispatch delivered 3fa9cfb6-9acf-4409-853c-dded12c01ba4 to worker[180] qsize 0 2022-04-27 17:35:41,398 DEBUG awx.main.dispatch task 3fa9cfb6-9acf-4409-853c-dded12c01ba4 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:35:41,400 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:35:41,419 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:35:41,449 DEBUG awx.main.dispatch task 3fa9cfb6-9acf-4409-853c-dded12c01ba4 is finished 2022-04-27 17:35:59,686 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(da40f719-43ef-4a2e-a606-93fa09eb121b, queue=awx_private_queue) [2022-04-27 17:35:59,686: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(da40f719-43ef-4a2e-a606-93fa09eb121b, queue=awx_private_queue) 2022-04-27 17:35:59,712 DEBUG awx.main.dispatch delivered da40f719-43ef-4a2e-a606-93fa09eb121b to worker[181] qsize 0 2022-04-27 17:35:59,716 DEBUG awx.main.dispatch task da40f719-43ef-4a2e-a606-93fa09eb121b starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:35:59,728 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:35:59,731 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:35:29.721572+00:00 2022-04-27 17:35:59,861 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(c88b6789-05b8-4c68-bbe7-ee063a97b036, queue=onap-awx-0) [2022-04-27 17:35:59,861: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(c88b6789-05b8-4c68-bbe7-ee063a97b036, queue=onap-awx-0) 2022-04-27 17:35:59,889 DEBUG awx.main.dispatch delivered c88b6789-05b8-4c68-bbe7-ee063a97b036 to worker[182] qsize 0 2022-04-27 17:35:59,891 DEBUG awx.main.dispatch task c88b6789-05b8-4c68-bbe7-ee063a97b036 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:35:59,893 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:36:00,128 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(8e019c83-a220-40a6-9e8a-54a04c7038b2, queue=onap-awx-0) [2022-04-27 17:36:00,128: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(8e019c83-a220-40a6-9e8a-54a04c7038b2, queue=onap-awx-0) 2022-04-27 17:36:00,138 DEBUG awx.main.dispatch task c88b6789-05b8-4c68-bbe7-ee063a97b036 is finished RESULT 2 OKREADY 2022-04-27 17:36:00,157 DEBUG awx.main.dispatch delivered 8e019c83-a220-40a6-9e8a-54a04c7038b2 to worker[180] qsize 0 2022-04-27 17:36:00,160 DEBUG awx.main.dispatch task 8e019c83-a220-40a6-9e8a-54a04c7038b2 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:36:00,173 DEBUG awx.main.dispatch task 8e019c83-a220-40a6-9e8a-54a04c7038b2 is finished 2022-04-27 17:36:00,134 DEBUG awx.main.dispatch task da40f719-43ef-4a2e-a606-93fa09eb121b is finished 2022-04-27 17:36:01,376 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(56ab5944-e833-4e7b-9e91-adcba55ae5b7, queue=awx_private_queue) [2022-04-27 17:36:01,376: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(56ab5944-e833-4e7b-9e91-adcba55ae5b7, queue=awx_private_queue) 2022-04-27 17:36:01,392 DEBUG awx.main.dispatch delivered 56ab5944-e833-4e7b-9e91-adcba55ae5b7 to worker[182] qsize 0 2022-04-27 17:36:01,394 DEBUG awx.main.dispatch task 56ab5944-e833-4e7b-9e91-adcba55ae5b7 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:36:01,396 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:36:01,414 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:36:01,441 DEBUG awx.main.dispatch task 56ab5944-e833-4e7b-9e91-adcba55ae5b7 is finished 2022-04-27 17:36:21,385 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d24d3072-03d4-4229-9116-775bf7b68d15, queue=awx_private_queue) [2022-04-27 17:36:21,385: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d24d3072-03d4-4229-9116-775bf7b68d15, queue=awx_private_queue) 2022-04-27 17:36:21,405 DEBUG awx.main.dispatch delivered d24d3072-03d4-4229-9116-775bf7b68d15 to worker[180] qsize 0 2022-04-27 17:36:21,409 DEBUG awx.main.dispatch task d24d3072-03d4-4229-9116-775bf7b68d15 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:36:21,411 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:36:21,433 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:36:21,460 DEBUG awx.main.dispatch task d24d3072-03d4-4229-9116-775bf7b68d15 is finished 2022-04-27 17:36:29,687 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(b491e50a-02fc-4fa3-9aca-fc1af57b5016, queue=awx_private_queue) [2022-04-27 17:36:29,687: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(b491e50a-02fc-4fa3-9aca-fc1af57b5016, queue=awx_private_queue) 2022-04-27 17:36:29,716 DEBUG awx.main.dispatch delivered b491e50a-02fc-4fa3-9aca-fc1af57b5016 to worker[183] qsize 0 2022-04-27 17:36:29,721 DEBUG awx.main.dispatch task b491e50a-02fc-4fa3-9aca-fc1af57b5016 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:36:29,736 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:36:29,740 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:35:59.728596+00:00 2022-04-27 17:36:30,213 DEBUG awx.main.dispatch task b491e50a-02fc-4fa3-9aca-fc1af57b5016 is finished 2022-04-27 17:36:41,385 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(1cce7d36-ad15-4b1a-b25a-8096ba421b3a, queue=awx_private_queue) [2022-04-27 17:36:41,385: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(1cce7d36-ad15-4b1a-b25a-8096ba421b3a, queue=awx_private_queue) 2022-04-27 17:36:41,404 DEBUG awx.main.dispatch delivered 1cce7d36-ad15-4b1a-b25a-8096ba421b3a to worker[183] qsize 0 2022-04-27 17:36:41,408 DEBUG awx.main.dispatch task 1cce7d36-ad15-4b1a-b25a-8096ba421b3a starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:36:41,410 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:36:41,430 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:36:41,461 DEBUG awx.main.dispatch task 1cce7d36-ad15-4b1a-b25a-8096ba421b3a is finished 2022-04-27 17:36:59,696 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(807d6ea5-a09a-4f30-9b56-3dc02edbc1a0, queue=awx_private_queue) [2022-04-27 17:36:59,696: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(807d6ea5-a09a-4f30-9b56-3dc02edbc1a0, queue=awx_private_queue) 2022-04-27 17:36:59,718 DEBUG awx.main.dispatch delivered 807d6ea5-a09a-4f30-9b56-3dc02edbc1a0 to worker[182] qsize 0 2022-04-27 17:36:59,721 DEBUG awx.main.dispatch task 807d6ea5-a09a-4f30-9b56-3dc02edbc1a0 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:36:59,735 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:36:59,738 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:36:29.737137+00:00 2022-04-27 17:36:59,861 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(2c142b50-60ec-4bec-bbc6-246c09511746, queue=onap-awx-0) [2022-04-27 17:36:59,861: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(2c142b50-60ec-4bec-bbc6-246c09511746, queue=onap-awx-0) 2022-04-27 17:36:59,892 DEBUG awx.main.dispatch delivered 2c142b50-60ec-4bec-bbc6-246c09511746 to worker[181] qsize 0 2022-04-27 17:36:59,895 DEBUG awx.main.dispatch task 2c142b50-60ec-4bec-bbc6-246c09511746 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:36:59,898 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:37:00,128 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(04791dbe-434b-40db-95f4-23ecab4575af, queue=onap-awx-0) [2022-04-27 17:37:00,128: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(04791dbe-434b-40db-95f4-23ecab4575af, queue=onap-awx-0) RESULT 2 OKREADY 2022-04-27 17:37:00,390 DEBUG awx.main.dispatch task 807d6ea5-a09a-4f30-9b56-3dc02edbc1a0 is finished 2022-04-27 17:37:00,247 DEBUG awx.main.dispatch task 2c142b50-60ec-4bec-bbc6-246c09511746 is finished 2022-04-27 17:37:00,480 DEBUG awx.main.dispatch delivered 04791dbe-434b-40db-95f4-23ecab4575af to worker[181] qsize 0 2022-04-27 17:37:00,483 DEBUG awx.main.dispatch task 04791dbe-434b-40db-95f4-23ecab4575af starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:37:00,499 DEBUG awx.main.dispatch task 04791dbe-434b-40db-95f4-23ecab4575af is finished 2022-04-27 17:37:01,386 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b42eaad9-08c8-4a98-9562-e7cd62d8b905, queue=awx_private_queue) [2022-04-27 17:37:01,386: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b42eaad9-08c8-4a98-9562-e7cd62d8b905, queue=awx_private_queue) 2022-04-27 17:37:01,404 DEBUG awx.main.dispatch delivered b42eaad9-08c8-4a98-9562-e7cd62d8b905 to worker[183] qsize 0 2022-04-27 17:37:01,407 DEBUG awx.main.dispatch task b42eaad9-08c8-4a98-9562-e7cd62d8b905 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:37:01,409 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:37:01,426 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:37:01,460 DEBUG awx.main.dispatch task b42eaad9-08c8-4a98-9562-e7cd62d8b905 is finished 2022-04-27 17:37:21,704 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6502a53a-2e67-48cc-a8d1-be5087d800e8, queue=awx_private_queue) [2022-04-27 17:37:21,704: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6502a53a-2e67-48cc-a8d1-be5087d800e8, queue=awx_private_queue) 2022-04-27 17:37:21,725 DEBUG awx.main.dispatch delivered 6502a53a-2e67-48cc-a8d1-be5087d800e8 to worker[181] qsize 0 2022-04-27 17:37:21,728 DEBUG awx.main.dispatch task 6502a53a-2e67-48cc-a8d1-be5087d800e8 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:37:21,730 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:37:21,746 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:37:21,771 DEBUG awx.main.dispatch task 6502a53a-2e67-48cc-a8d1-be5087d800e8 is finished 2022-04-27 17:37:29,697 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(e48506a3-5ab7-4437-a85d-d88d9c63dcd0, queue=awx_private_queue) [2022-04-27 17:37:29,697: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(e48506a3-5ab7-4437-a85d-d88d9c63dcd0, queue=awx_private_queue) 2022-04-27 17:37:29,716 DEBUG awx.main.dispatch delivered e48506a3-5ab7-4437-a85d-d88d9c63dcd0 to worker[181] qsize 0 2022-04-27 17:37:29,719 DEBUG awx.main.dispatch task e48506a3-5ab7-4437-a85d-d88d9c63dcd0 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:37:29,731 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:37:29,733 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:36:59.735978+00:00 2022-04-27 17:37:29,909 DEBUG awx.main.dispatch task e48506a3-5ab7-4437-a85d-d88d9c63dcd0 is finished 2022-04-27 17:37:41,706 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(308eed76-c6c3-47c9-b62d-62387b16c5fe, queue=awx_private_queue) [2022-04-27 17:37:41,706: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(308eed76-c6c3-47c9-b62d-62387b16c5fe, queue=awx_private_queue) 2022-04-27 17:37:41,726 DEBUG awx.main.dispatch delivered 308eed76-c6c3-47c9-b62d-62387b16c5fe to worker[181] qsize 0 2022-04-27 17:37:41,729 DEBUG awx.main.dispatch task 308eed76-c6c3-47c9-b62d-62387b16c5fe starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:37:41,731 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:37:41,753 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:37:41,781 DEBUG awx.main.dispatch task 308eed76-c6c3-47c9-b62d-62387b16c5fe is finished 2022-04-27 17:37:59,707 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(a6054c85-805e-42df-86d0-9c14d64401f8, queue=awx_private_queue) [2022-04-27 17:37:59,707: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(a6054c85-805e-42df-86d0-9c14d64401f8, queue=awx_private_queue) 2022-04-27 17:37:59,731 DEBUG awx.main.dispatch delivered a6054c85-805e-42df-86d0-9c14d64401f8 to worker[181] qsize 0 2022-04-27 17:37:59,736 DEBUG awx.main.dispatch task a6054c85-805e-42df-86d0-9c14d64401f8 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:37:59,750 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:37:59,754 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:37:29.731213+00:00 2022-04-27 17:37:59,861 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(f76a6f66-1fde-4a6e-8f12-cd31e0fc270b, queue=onap-awx-0) [2022-04-27 17:37:59,861: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(f76a6f66-1fde-4a6e-8f12-cd31e0fc270b, queue=onap-awx-0) 2022-04-27 17:37:59,894 DEBUG awx.main.dispatch delivered f76a6f66-1fde-4a6e-8f12-cd31e0fc270b to worker[182] qsize 0 2022-04-27 17:37:59,897 DEBUG awx.main.dispatch task f76a6f66-1fde-4a6e-8f12-cd31e0fc270b starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:37:59,900 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:37:59,978 DEBUG awx.main.dispatch task f76a6f66-1fde-4a6e-8f12-cd31e0fc270b is finished 2022-04-27 17:37:59,982 DEBUG awx.main.dispatch task a6054c85-805e-42df-86d0-9c14d64401f8 is finished 2022-04-27 17:38:00,128 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(20c2885a-0584-4ee8-8009-26e1855d2be1, queue=onap-awx-0) [2022-04-27 17:38:00,128: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(20c2885a-0584-4ee8-8009-26e1855d2be1, queue=onap-awx-0) 2022-04-27 17:38:00,602 DEBUG awx.main.dispatch delivered 20c2885a-0584-4ee8-8009-26e1855d2be1 to worker[182] qsize 0 RESULT 2 OKREADY 2022-04-27 17:38:00,609 DEBUG awx.main.dispatch task 20c2885a-0584-4ee8-8009-26e1855d2be1 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:38:00,622 DEBUG awx.main.dispatch task 20c2885a-0584-4ee8-8009-26e1855d2be1 is finished 2022-04-27 17:38:01,705 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7c941cc0-9b2a-4cb4-b48f-b41dfdc21a94, queue=awx_private_queue) [2022-04-27 17:38:01,705: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7c941cc0-9b2a-4cb4-b48f-b41dfdc21a94, queue=awx_private_queue) 2022-04-27 17:38:01,886 DEBUG awx.main.dispatch delivered 7c941cc0-9b2a-4cb4-b48f-b41dfdc21a94 to worker[183] qsize 0 2022-04-27 17:38:01,889 DEBUG awx.main.dispatch task 7c941cc0-9b2a-4cb4-b48f-b41dfdc21a94 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:38:01,894 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:38:01,918 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:38:01,945 DEBUG awx.main.dispatch task 7c941cc0-9b2a-4cb4-b48f-b41dfdc21a94 is finished 2022-04-27 17:38:21,709 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ef818503-3fb8-4134-b2fb-992900d06b82, queue=awx_private_queue) [2022-04-27 17:38:21,709: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ef818503-3fb8-4134-b2fb-992900d06b82, queue=awx_private_queue) 2022-04-27 17:38:21,728 DEBUG awx.main.dispatch delivered ef818503-3fb8-4134-b2fb-992900d06b82 to worker[180] qsize 0 2022-04-27 17:38:21,733 DEBUG awx.main.dispatch task ef818503-3fb8-4134-b2fb-992900d06b82 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:38:21,737 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:38:21,761 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:38:21,792 DEBUG awx.main.dispatch task ef818503-3fb8-4134-b2fb-992900d06b82 is finished 2022-04-27 17:38:29,706 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(2123b7b2-4dbd-4c88-b6cf-41ba1609e786, queue=awx_private_queue) [2022-04-27 17:38:29,706: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(2123b7b2-4dbd-4c88-b6cf-41ba1609e786, queue=awx_private_queue) 2022-04-27 17:38:29,727 DEBUG awx.main.dispatch delivered 2123b7b2-4dbd-4c88-b6cf-41ba1609e786 to worker[180] qsize 0 2022-04-27 17:38:29,731 DEBUG awx.main.dispatch task 2123b7b2-4dbd-4c88-b6cf-41ba1609e786 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:38:29,750 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:38:29,754 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:37:59.750885+00:00 2022-04-27 17:38:29,953 DEBUG awx.main.dispatch task 2123b7b2-4dbd-4c88-b6cf-41ba1609e786 is finished 2022-04-27 17:38:41,706 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6bb9de9f-1cd3-4684-8ddc-4ec66caaf7ef, queue=awx_private_queue) [2022-04-27 17:38:41,706: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6bb9de9f-1cd3-4684-8ddc-4ec66caaf7ef, queue=awx_private_queue) 2022-04-27 17:38:41,725 DEBUG awx.main.dispatch delivered 6bb9de9f-1cd3-4684-8ddc-4ec66caaf7ef to worker[182] qsize 0 2022-04-27 17:38:41,727 DEBUG awx.main.dispatch task 6bb9de9f-1cd3-4684-8ddc-4ec66caaf7ef starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:38:41,728 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:38:41,749 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:38:41,776 DEBUG awx.main.dispatch task 6bb9de9f-1cd3-4684-8ddc-4ec66caaf7ef is finished 2022-04-27 17:38:59,715 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(138da29b-3bfd-41ba-8e4e-fdaeb5fa7c16, queue=awx_private_queue) [2022-04-27 17:38:59,715: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(138da29b-3bfd-41ba-8e4e-fdaeb5fa7c16, queue=awx_private_queue) 2022-04-27 17:38:59,735 DEBUG awx.main.dispatch delivered 138da29b-3bfd-41ba-8e4e-fdaeb5fa7c16 to worker[180] qsize 0 2022-04-27 17:38:59,740 DEBUG awx.main.dispatch task 138da29b-3bfd-41ba-8e4e-fdaeb5fa7c16 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:38:59,751 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:38:59,753 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:38:29.750983+00:00 2022-04-27 17:38:59,861 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(7b72ad6b-9061-4d29-bad1-f4346dd41562, queue=onap-awx-0) [2022-04-27 17:38:59,861: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(7b72ad6b-9061-4d29-bad1-f4346dd41562, queue=onap-awx-0) 2022-04-27 17:38:59,892 DEBUG awx.main.dispatch delivered 7b72ad6b-9061-4d29-bad1-f4346dd41562 to worker[183] qsize 0 2022-04-27 17:38:59,895 DEBUG awx.main.dispatch task 7b72ad6b-9061-4d29-bad1-f4346dd41562 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:38:59,898 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:39:00,128 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(ae2537c3-c507-45b6-84e7-b5910738d303, queue=onap-awx-0) [2022-04-27 17:39:00,128: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(ae2537c3-c507-45b6-84e7-b5910738d303, queue=onap-awx-0) 2022-04-27 17:39:00,227 DEBUG awx.main.dispatch task 7b72ad6b-9061-4d29-bad1-f4346dd41562 is finished RESULT 2 OKREADY 2022-04-27 17:39:00,358 DEBUG awx.main.dispatch delivered ae2537c3-c507-45b6-84e7-b5910738d303 to worker[181] qsize 0 2022-04-27 17:39:00,362 DEBUG awx.main.dispatch task ae2537c3-c507-45b6-84e7-b5910738d303 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:39:00,381 DEBUG awx.main.dispatch task ae2537c3-c507-45b6-84e7-b5910738d303 is finished 2022-04-27 17:39:00,591 DEBUG awx.main.dispatch task 138da29b-3bfd-41ba-8e4e-fdaeb5fa7c16 is finished 2022-04-27 17:39:01,706 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(abbc26c3-c1d6-4ad7-8560-5224173000d6, queue=awx_private_queue) [2022-04-27 17:39:01,706: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(abbc26c3-c1d6-4ad7-8560-5224173000d6, queue=awx_private_queue) 2022-04-27 17:39:01,923 DEBUG awx.main.dispatch delivered abbc26c3-c1d6-4ad7-8560-5224173000d6 to worker[181] qsize 0 2022-04-27 17:39:01,926 DEBUG awx.main.dispatch task abbc26c3-c1d6-4ad7-8560-5224173000d6 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:39:01,929 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:39:01,948 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:39:01,976 DEBUG awx.main.dispatch task abbc26c3-c1d6-4ad7-8560-5224173000d6 is finished 2022-04-27 17:39:21,706 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(04b2bd6b-25ed-4f28-beb8-3efcb2e48e7b, queue=awx_private_queue) [2022-04-27 17:39:21,706: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(04b2bd6b-25ed-4f28-beb8-3efcb2e48e7b, queue=awx_private_queue) 2022-04-27 17:39:21,724 DEBUG awx.main.dispatch delivered 04b2bd6b-25ed-4f28-beb8-3efcb2e48e7b to worker[181] qsize 0 2022-04-27 17:39:21,726 DEBUG awx.main.dispatch task 04b2bd6b-25ed-4f28-beb8-3efcb2e48e7b starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:39:21,728 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:39:21,747 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:39:21,780 DEBUG awx.main.dispatch task 04b2bd6b-25ed-4f28-beb8-3efcb2e48e7b is finished 2022-04-27 17:39:29,714 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d86f37be-f5ce-447e-80a4-b2dd52d27dc3, queue=awx_private_queue) [2022-04-27 17:39:29,714: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d86f37be-f5ce-447e-80a4-b2dd52d27dc3, queue=awx_private_queue) 2022-04-27 17:39:29,738 DEBUG awx.main.dispatch delivered d86f37be-f5ce-447e-80a4-b2dd52d27dc3 to worker[181] qsize 0 2022-04-27 17:39:29,742 DEBUG awx.main.dispatch task d86f37be-f5ce-447e-80a4-b2dd52d27dc3 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:39:29,757 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:39:29,759 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:38:59.751265+00:00 2022-04-27 17:39:30,586 DEBUG awx.main.dispatch task d86f37be-f5ce-447e-80a4-b2dd52d27dc3 is finished 2022-04-27 17:39:41,709 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c483cb21-de1d-4d39-aba4-81c571685e97, queue=awx_private_queue) [2022-04-27 17:39:41,709: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c483cb21-de1d-4d39-aba4-81c571685e97, queue=awx_private_queue) 2022-04-27 17:39:48,847 DEBUG awx.main.dispatch delivered c483cb21-de1d-4d39-aba4-81c571685e97 to worker[180] qsize 0 2022-04-27 17:39:48,850 DEBUG awx.main.dispatch task c483cb21-de1d-4d39-aba4-81c571685e97 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:39:48,853 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:39:48,872 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:39:48,902 DEBUG awx.main.dispatch task c483cb21-de1d-4d39-aba4-81c571685e97 is finished 2022-04-27 17:39:59,722 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(6d1233b1-7f77-41f9-b904-0fa9a61f488b, queue=awx_private_queue) [2022-04-27 17:39:59,722: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(6d1233b1-7f77-41f9-b904-0fa9a61f488b, queue=awx_private_queue) 2022-04-27 17:39:59,737 DEBUG awx.main.dispatch delivered 6d1233b1-7f77-41f9-b904-0fa9a61f488b to worker[180] qsize 0 2022-04-27 17:39:59,740 DEBUG awx.main.dispatch task 6d1233b1-7f77-41f9-b904-0fa9a61f488b starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:39:59,749 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:39:59,752 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:39:29.757452+00:00 2022-04-27 17:39:59,861 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(d9271085-2e86-416c-900c-12333c461bf1, queue=onap-awx-0) [2022-04-27 17:39:59,861: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(d9271085-2e86-416c-900c-12333c461bf1, queue=onap-awx-0) 2022-04-27 17:39:59,888 DEBUG awx.main.dispatch delivered d9271085-2e86-416c-900c-12333c461bf1 to worker[181] qsize 0 2022-04-27 17:39:59,890 DEBUG awx.main.dispatch task d9271085-2e86-416c-900c-12333c461bf1 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:39:59,891 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:40:00,128 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(f10434e1-9cb2-43bf-ad61-60baa299c2a6, queue=onap-awx-0) [2022-04-27 17:40:00,128: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(f10434e1-9cb2-43bf-ad61-60baa299c2a6, queue=onap-awx-0) 2022-04-27 17:40:00,575 DEBUG awx.main.dispatch task d9271085-2e86-416c-900c-12333c461bf1 is finished RESULT 2 OKREADY 2022-04-27 17:40:01,397 DEBUG awx.main.dispatch task 6d1233b1-7f77-41f9-b904-0fa9a61f488b is finished 2022-04-27 17:40:01,708 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e5a42d7c-39f2-4799-91ce-a2c1ebb37219, queue=awx_private_queue) [2022-04-27 17:40:01,708: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e5a42d7c-39f2-4799-91ce-a2c1ebb37219, queue=awx_private_queue) 2022-04-27 17:40:05,283 DEBUG awx.main.dispatch delivered e5a42d7c-39f2-4799-91ce-a2c1ebb37219 to worker[183] qsize 0 2022-04-27 17:40:05,287 DEBUG awx.main.dispatch task e5a42d7c-39f2-4799-91ce-a2c1ebb37219 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:40:05,289 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:40:05,306 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:40:05,333 DEBUG awx.main.dispatch task e5a42d7c-39f2-4799-91ce-a2c1ebb37219 is finished 2022-04-27 17:40:07,362 DEBUG awx.main.dispatch delivered f10434e1-9cb2-43bf-ad61-60baa299c2a6 to worker[181] qsize 0 2022-04-27 17:40:07,366 DEBUG awx.main.dispatch task f10434e1-9cb2-43bf-ad61-60baa299c2a6 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:40:07,380 DEBUG awx.main.dispatch task f10434e1-9cb2-43bf-ad61-60baa299c2a6 is finished 2022-04-27 17:40:26,802 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0607c589-792c-4d60-b79f-4e1d556993f5, queue=awx_private_queue) [2022-04-27 17:40:26,802: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0607c589-792c-4d60-b79f-4e1d556993f5, queue=awx_private_queue) 2022-04-27 17:40:26,829 DEBUG awx.main.dispatch delivered 0607c589-792c-4d60-b79f-4e1d556993f5 to worker[180] qsize 0 2022-04-27 17:40:26,831 DEBUG awx.main.dispatch task 0607c589-792c-4d60-b79f-4e1d556993f5 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:40:26,833 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:40:26,851 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:40:26,881 DEBUG awx.main.dispatch task 0607c589-792c-4d60-b79f-4e1d556993f5 is finished 2022-04-27 17:40:29,722 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(ea38917c-5b18-496d-bdb5-88a0b3187e61, queue=awx_private_queue) [2022-04-27 17:40:29,722: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(ea38917c-5b18-496d-bdb5-88a0b3187e61, queue=awx_private_queue) 2022-04-27 17:40:34,326 DEBUG awx.main.dispatch delivered ea38917c-5b18-496d-bdb5-88a0b3187e61 to worker[182] qsize 0 2022-04-27 17:40:34,329 DEBUG awx.main.dispatch task ea38917c-5b18-496d-bdb5-88a0b3187e61 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:40:34,341 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:40:34,345 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:39:59.749853+00:00 2022-04-27 17:40:35,032 DEBUG awx.main.dispatch task ea38917c-5b18-496d-bdb5-88a0b3187e61 is finished 2022-04-27 17:40:46,806 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3d831d5d-257b-461f-8d93-95814cc2b4b5, queue=awx_private_queue) [2022-04-27 17:40:46,806: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3d831d5d-257b-461f-8d93-95814cc2b4b5, queue=awx_private_queue) 2022-04-27 17:40:46,831 DEBUG awx.main.dispatch delivered 3d831d5d-257b-461f-8d93-95814cc2b4b5 to worker[183] qsize 0 2022-04-27 17:40:46,833 DEBUG awx.main.dispatch task 3d831d5d-257b-461f-8d93-95814cc2b4b5 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:40:46,835 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:40:46,856 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:40:46,891 DEBUG awx.main.dispatch task 3d831d5d-257b-461f-8d93-95814cc2b4b5 is finished 2022-04-27 17:40:59,726 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(fa238827-c0ac-4351-ba95-f6e60a092fb9, queue=awx_private_queue) [2022-04-27 17:40:59,726: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(fa238827-c0ac-4351-ba95-f6e60a092fb9, queue=awx_private_queue) 2022-04-27 17:40:59,749 DEBUG awx.main.dispatch delivered fa238827-c0ac-4351-ba95-f6e60a092fb9 to worker[183] qsize 0 2022-04-27 17:40:59,754 DEBUG awx.main.dispatch task fa238827-c0ac-4351-ba95-f6e60a092fb9 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:40:59,768 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:40:59,772 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:40:34.342108+00:00 2022-04-27 17:40:59,861 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(ad8d3b0d-06d7-4066-9594-5d779b89f84b, queue=onap-awx-0) [2022-04-27 17:40:59,861: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(ad8d3b0d-06d7-4066-9594-5d779b89f84b, queue=onap-awx-0) 2022-04-27 17:40:59,895 DEBUG awx.main.dispatch delivered ad8d3b0d-06d7-4066-9594-5d779b89f84b to worker[181] qsize 0 2022-04-27 17:40:59,897 DEBUG awx.main.dispatch task ad8d3b0d-06d7-4066-9594-5d779b89f84b starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:40:59,900 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:41:00,129 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(a5f124e8-eca7-41fc-9233-08b260e35360, queue=onap-awx-0) [2022-04-27 17:41:00,129: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(a5f124e8-eca7-41fc-9233-08b260e35360, queue=onap-awx-0) 2022-04-27 17:41:00,629 DEBUG awx.main.dispatch delivered a5f124e8-eca7-41fc-9233-08b260e35360 to worker[180] qsize 0 RESULT 2 OKREADY 2022-04-27 17:41:00,632 DEBUG awx.main.dispatch task a5f124e8-eca7-41fc-9233-08b260e35360 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:41:00,646 DEBUG awx.main.dispatch task a5f124e8-eca7-41fc-9233-08b260e35360 is finished 2022-04-27 17:41:03,652 DEBUG awx.main.dispatch task fa238827-c0ac-4351-ba95-f6e60a092fb9 is finished 2022-04-27 17:41:03,645 DEBUG awx.main.dispatch task ad8d3b0d-06d7-4066-9594-5d779b89f84b is finished 2022-04-27 17:41:06,805 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(716551f4-3255-4222-a638-8a67e320ff70, queue=awx_private_queue) [2022-04-27 17:41:06,805: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(716551f4-3255-4222-a638-8a67e320ff70, queue=awx_private_queue) 2022-04-27 17:41:06,824 DEBUG awx.main.dispatch delivered 716551f4-3255-4222-a638-8a67e320ff70 to worker[182] qsize 0 2022-04-27 17:41:06,826 DEBUG awx.main.dispatch task 716551f4-3255-4222-a638-8a67e320ff70 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:41:06,828 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:41:06,846 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:41:06,877 DEBUG awx.main.dispatch task 716551f4-3255-4222-a638-8a67e320ff70 is finished 2022-04-27 17:41:26,815 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(65430b6f-6aa7-45e0-98e6-c12cff3804d6, queue=awx_private_queue) [2022-04-27 17:41:26,815: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(65430b6f-6aa7-45e0-98e6-c12cff3804d6, queue=awx_private_queue) 2022-04-27 17:41:26,838 DEBUG awx.main.dispatch delivered 65430b6f-6aa7-45e0-98e6-c12cff3804d6 to worker[182] qsize 0 2022-04-27 17:41:26,842 DEBUG awx.main.dispatch task 65430b6f-6aa7-45e0-98e6-c12cff3804d6 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:41:26,844 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:41:26,863 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:41:26,896 DEBUG awx.main.dispatch task 65430b6f-6aa7-45e0-98e6-c12cff3804d6 is finished 2022-04-27 17:41:29,725 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d4f98c5a-9c91-4137-9639-f20c4e445a1b, queue=awx_private_queue) [2022-04-27 17:41:29,725: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d4f98c5a-9c91-4137-9639-f20c4e445a1b, queue=awx_private_queue) 2022-04-27 17:41:29,740 DEBUG awx.main.dispatch delivered d4f98c5a-9c91-4137-9639-f20c4e445a1b to worker[182] qsize 0 2022-04-27 17:41:29,743 DEBUG awx.main.dispatch task d4f98c5a-9c91-4137-9639-f20c4e445a1b starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:41:29,752 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:41:29,755 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:40:59.768560+00:00 2022-04-27 17:41:30,246 DEBUG awx.main.dispatch task d4f98c5a-9c91-4137-9639-f20c4e445a1b is finished 2022-04-27 17:41:46,813 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(bd0e8398-7dba-4656-9f91-e6ba91d0b151, queue=awx_private_queue) [2022-04-27 17:41:46,813: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(bd0e8398-7dba-4656-9f91-e6ba91d0b151, queue=awx_private_queue) 2022-04-27 17:41:46,829 DEBUG awx.main.dispatch delivered bd0e8398-7dba-4656-9f91-e6ba91d0b151 to worker[183] qsize 0 2022-04-27 17:41:46,832 DEBUG awx.main.dispatch task bd0e8398-7dba-4656-9f91-e6ba91d0b151 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:41:46,834 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:41:46,855 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:41:46,884 DEBUG awx.main.dispatch task bd0e8398-7dba-4656-9f91-e6ba91d0b151 is finished 2022-04-27 17:41:59,726 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(e0f2f5fa-f891-4650-98f1-fb16807534b7, queue=awx_private_queue) [2022-04-27 17:41:59,726: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(e0f2f5fa-f891-4650-98f1-fb16807534b7, queue=awx_private_queue) 2022-04-27 17:41:59,744 DEBUG awx.main.dispatch delivered e0f2f5fa-f891-4650-98f1-fb16807534b7 to worker[181] qsize 0 2022-04-27 17:41:59,747 DEBUG awx.main.dispatch task e0f2f5fa-f891-4650-98f1-fb16807534b7 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:41:59,759 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:41:59,762 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:41:29.752763+00:00 2022-04-27 17:41:59,861 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(b9651aba-aced-4d76-96c2-1674b4f124a7, queue=onap-awx-0) [2022-04-27 17:41:59,861: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(b9651aba-aced-4d76-96c2-1674b4f124a7, queue=onap-awx-0) 2022-04-27 17:41:59,889 DEBUG awx.main.dispatch delivered b9651aba-aced-4d76-96c2-1674b4f124a7 to worker[182] qsize 0 2022-04-27 17:41:59,893 DEBUG awx.main.dispatch task b9651aba-aced-4d76-96c2-1674b4f124a7 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:41:59,896 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:42:00,128 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(10399e44-48cf-474c-a4b0-1045c0dc4173, queue=onap-awx-0) [2022-04-27 17:42:00,128: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(10399e44-48cf-474c-a4b0-1045c0dc4173, queue=onap-awx-0) 2022-04-27 17:42:00,308 DEBUG awx.main.dispatch task b9651aba-aced-4d76-96c2-1674b4f124a7 is finished RESULT 2 OKREADY 2022-04-27 17:42:00,309 DEBUG awx.main.dispatch task e0f2f5fa-f891-4650-98f1-fb16807534b7 is finished 2022-04-27 17:42:00,432 DEBUG awx.main.dispatch delivered 10399e44-48cf-474c-a4b0-1045c0dc4173 to worker[182] qsize 0 2022-04-27 17:42:00,435 DEBUG awx.main.dispatch task 10399e44-48cf-474c-a4b0-1045c0dc4173 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:42:00,448 DEBUG awx.main.dispatch task 10399e44-48cf-474c-a4b0-1045c0dc4173 is finished 2022-04-27 17:42:06,813 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(2e7a1132-ebb1-45df-a62c-d1d596fce41c, queue=awx_private_queue) [2022-04-27 17:42:06,813: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(2e7a1132-ebb1-45df-a62c-d1d596fce41c, queue=awx_private_queue) 2022-04-27 17:42:07,040 DEBUG awx.main.dispatch delivered 2e7a1132-ebb1-45df-a62c-d1d596fce41c to worker[181] qsize 0 2022-04-27 17:42:07,043 DEBUG awx.main.dispatch task 2e7a1132-ebb1-45df-a62c-d1d596fce41c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:42:07,045 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:42:07,060 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:42:07,090 DEBUG awx.main.dispatch task 2e7a1132-ebb1-45df-a62c-d1d596fce41c is finished 2022-04-27 17:42:26,815 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(9afb6704-6801-4dd9-8651-abd60abcb1be, queue=awx_private_queue) [2022-04-27 17:42:26,815: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(9afb6704-6801-4dd9-8651-abd60abcb1be, queue=awx_private_queue) 2022-04-27 17:42:26,830 DEBUG awx.main.dispatch delivered 9afb6704-6801-4dd9-8651-abd60abcb1be to worker[181] qsize 0 2022-04-27 17:42:26,833 DEBUG awx.main.dispatch task 9afb6704-6801-4dd9-8651-abd60abcb1be starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:42:26,834 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:42:26,853 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:42:26,878 DEBUG awx.main.dispatch task 9afb6704-6801-4dd9-8651-abd60abcb1be is finished 2022-04-27 17:42:29,726 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(2afa83a2-af7f-4ca0-9a08-6e165269ef3c, queue=awx_private_queue) [2022-04-27 17:42:29,726: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(2afa83a2-af7f-4ca0-9a08-6e165269ef3c, queue=awx_private_queue) 2022-04-27 17:42:29,745 DEBUG awx.main.dispatch delivered 2afa83a2-af7f-4ca0-9a08-6e165269ef3c to worker[180] qsize 0 2022-04-27 17:42:29,747 DEBUG awx.main.dispatch task 2afa83a2-af7f-4ca0-9a08-6e165269ef3c starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:42:29,759 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:42:29,763 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:41:59.759724+00:00 2022-04-27 17:42:29,964 DEBUG awx.main.dispatch task 2afa83a2-af7f-4ca0-9a08-6e165269ef3c is finished 2022-04-27 17:42:46,823 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a2cc4aff-4484-41bf-a92d-f7f654f03d4a, queue=awx_private_queue) [2022-04-27 17:42:46,823: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a2cc4aff-4484-41bf-a92d-f7f654f03d4a, queue=awx_private_queue) 2022-04-27 17:42:46,840 DEBUG awx.main.dispatch delivered a2cc4aff-4484-41bf-a92d-f7f654f03d4a to worker[181] qsize 0 2022-04-27 17:42:46,844 DEBUG awx.main.dispatch task a2cc4aff-4484-41bf-a92d-f7f654f03d4a starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:42:46,849 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:42:46,869 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:42:46,898 DEBUG awx.main.dispatch task a2cc4aff-4484-41bf-a92d-f7f654f03d4a is finished 2022-04-27 17:42:59,726 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(0e9d5a62-26a7-4bdb-ad8d-7c0af51bbe46, queue=awx_private_queue) [2022-04-27 17:42:59,726: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(0e9d5a62-26a7-4bdb-ad8d-7c0af51bbe46, queue=awx_private_queue) 2022-04-27 17:42:59,748 DEBUG awx.main.dispatch delivered 0e9d5a62-26a7-4bdb-ad8d-7c0af51bbe46 to worker[180] qsize 0 2022-04-27 17:42:59,751 DEBUG awx.main.dispatch task 0e9d5a62-26a7-4bdb-ad8d-7c0af51bbe46 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:42:59,765 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:42:59,768 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:42:29.759924+00:00 2022-04-27 17:42:59,862 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(e22881c8-1582-4c5c-b0c1-3ecd6e9e0018, queue=onap-awx-0) [2022-04-27 17:42:59,862: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(e22881c8-1582-4c5c-b0c1-3ecd6e9e0018, queue=onap-awx-0) 2022-04-27 17:42:59,896 DEBUG awx.main.dispatch delivered e22881c8-1582-4c5c-b0c1-3ecd6e9e0018 to worker[181] qsize 0 2022-04-27 17:42:59,900 DEBUG awx.main.dispatch task e22881c8-1582-4c5c-b0c1-3ecd6e9e0018 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:42:59,901 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:42:59,932 DEBUG awx.main.dispatch task 0e9d5a62-26a7-4bdb-ad8d-7c0af51bbe46 is finished 2022-04-27 17:42:59,946 DEBUG awx.main.dispatch task e22881c8-1582-4c5c-b0c1-3ecd6e9e0018 is finished 2022-04-27 17:43:00,129 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(5dfe053b-1236-4128-b4db-fda206d77d7a, queue=onap-awx-0) [2022-04-27 17:43:00,129: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(5dfe053b-1236-4128-b4db-fda206d77d7a, queue=onap-awx-0) 2022-04-27 17:43:00,481 DEBUG awx.main.dispatch delivered 5dfe053b-1236-4128-b4db-fda206d77d7a to worker[183] qsize 0 RESULT 2 OKREADY 2022-04-27 17:43:00,484 DEBUG awx.main.dispatch task 5dfe053b-1236-4128-b4db-fda206d77d7a starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:43:00,500 DEBUG awx.main.dispatch task 5dfe053b-1236-4128-b4db-fda206d77d7a is finished 2022-04-27 17:43:06,823 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e1bd3773-617f-40eb-a97b-2414ea5603f2, queue=awx_private_queue) [2022-04-27 17:43:06,823: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e1bd3773-617f-40eb-a97b-2414ea5603f2, queue=awx_private_queue) 2022-04-27 17:43:07,055 DEBUG awx.main.dispatch delivered e1bd3773-617f-40eb-a97b-2414ea5603f2 to worker[180] qsize 0 2022-04-27 17:43:07,058 DEBUG awx.main.dispatch task e1bd3773-617f-40eb-a97b-2414ea5603f2 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:43:07,061 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:43:07,075 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:43:07,108 DEBUG awx.main.dispatch task e1bd3773-617f-40eb-a97b-2414ea5603f2 is finished 2022-04-27 17:43:27,139 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e7d8bcbb-cb1d-4c83-b253-ad06901b0b51, queue=awx_private_queue) [2022-04-27 17:43:27,139: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e7d8bcbb-cb1d-4c83-b253-ad06901b0b51, queue=awx_private_queue) 2022-04-27 17:43:27,175 DEBUG awx.main.dispatch delivered e7d8bcbb-cb1d-4c83-b253-ad06901b0b51 to worker[183] qsize 0 2022-04-27 17:43:27,179 DEBUG awx.main.dispatch task e7d8bcbb-cb1d-4c83-b253-ad06901b0b51 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:43:27,181 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:43:27,200 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:43:27,228 DEBUG awx.main.dispatch task e7d8bcbb-cb1d-4c83-b253-ad06901b0b51 is finished 2022-04-27 17:43:29,726 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(e74f68c9-3b2a-4f56-a32f-6143efa513c9, queue=awx_private_queue) [2022-04-27 17:43:29,726: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(e74f68c9-3b2a-4f56-a32f-6143efa513c9, queue=awx_private_queue) 2022-04-27 17:43:29,745 DEBUG awx.main.dispatch delivered e74f68c9-3b2a-4f56-a32f-6143efa513c9 to worker[180] qsize 0 2022-04-27 17:43:29,749 DEBUG awx.main.dispatch task e74f68c9-3b2a-4f56-a32f-6143efa513c9 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:43:29,760 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:43:29,763 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:42:59.765258+00:00 2022-04-27 17:43:30,339 DEBUG awx.main.dispatch task e74f68c9-3b2a-4f56-a32f-6143efa513c9 is finished 2022-04-27 17:43:47,145 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6606b8a6-ceb0-492a-bd31-2de4466e6c6a, queue=awx_private_queue) [2022-04-27 17:43:47,145: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6606b8a6-ceb0-492a-bd31-2de4466e6c6a, queue=awx_private_queue) 2022-04-27 17:43:47,165 DEBUG awx.main.dispatch delivered 6606b8a6-ceb0-492a-bd31-2de4466e6c6a to worker[182] qsize 0 2022-04-27 17:43:47,168 DEBUG awx.main.dispatch task 6606b8a6-ceb0-492a-bd31-2de4466e6c6a starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:43:47,170 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:43:47,188 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:43:47,220 DEBUG awx.main.dispatch task 6606b8a6-ceb0-492a-bd31-2de4466e6c6a is finished 2022-04-27 17:43:59,726 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(e958b941-92a0-4fc2-9ece-1e8a5a6cbcf4, queue=awx_private_queue) [2022-04-27 17:43:59,726: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(e958b941-92a0-4fc2-9ece-1e8a5a6cbcf4, queue=awx_private_queue) 2022-04-27 17:43:59,745 DEBUG awx.main.dispatch delivered e958b941-92a0-4fc2-9ece-1e8a5a6cbcf4 to worker[180] qsize 0 2022-04-27 17:43:59,748 DEBUG awx.main.dispatch task e958b941-92a0-4fc2-9ece-1e8a5a6cbcf4 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:43:59,759 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:43:59,763 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:43:29.760953+00:00 2022-04-27 17:43:59,862 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(6b2cdc0a-6639-47d3-8921-d1046846e162, queue=onap-awx-0) [2022-04-27 17:43:59,862: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(6b2cdc0a-6639-47d3-8921-d1046846e162, queue=onap-awx-0) 2022-04-27 17:43:59,894 DEBUG awx.main.dispatch delivered 6b2cdc0a-6639-47d3-8921-d1046846e162 to worker[183] qsize 0 2022-04-27 17:43:59,896 DEBUG awx.main.dispatch task 6b2cdc0a-6639-47d3-8921-d1046846e162 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:43:59,898 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:44:00,129 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(df225cfa-f9bf-49c8-b7f5-e074c6398950, queue=onap-awx-0) [2022-04-27 17:44:00,129: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(df225cfa-f9bf-49c8-b7f5-e074c6398950, queue=onap-awx-0) RESULT 2 OKREADY 2022-04-27 17:44:00,265 DEBUG awx.main.dispatch task 6b2cdc0a-6639-47d3-8921-d1046846e162 is finished 2022-04-27 17:44:00,281 DEBUG awx.main.dispatch task e958b941-92a0-4fc2-9ece-1e8a5a6cbcf4 is finished 2022-04-27 17:44:00,558 DEBUG awx.main.dispatch delivered df225cfa-f9bf-49c8-b7f5-e074c6398950 to worker[183] qsize 0 2022-04-27 17:44:00,562 DEBUG awx.main.dispatch task df225cfa-f9bf-49c8-b7f5-e074c6398950 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:44:00,580 DEBUG awx.main.dispatch task df225cfa-f9bf-49c8-b7f5-e074c6398950 is finished 2022-04-27 17:44:07,146 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(50164d2b-2f60-443e-8f3e-98688045f109, queue=awx_private_queue) [2022-04-27 17:44:07,146: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(50164d2b-2f60-443e-8f3e-98688045f109, queue=awx_private_queue) 2022-04-27 17:44:07,332 DEBUG awx.main.dispatch delivered 50164d2b-2f60-443e-8f3e-98688045f109 to worker[180] qsize 0 2022-04-27 17:44:07,334 DEBUG awx.main.dispatch task 50164d2b-2f60-443e-8f3e-98688045f109 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:44:07,337 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:44:07,352 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:44:07,382 DEBUG awx.main.dispatch task 50164d2b-2f60-443e-8f3e-98688045f109 is finished 2022-04-27 17:44:27,147 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c2767fd0-ed42-485f-8459-e61e039b9306, queue=awx_private_queue) [2022-04-27 17:44:27,147: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c2767fd0-ed42-485f-8459-e61e039b9306, queue=awx_private_queue) 2022-04-27 17:44:27,169 DEBUG awx.main.dispatch delivered c2767fd0-ed42-485f-8459-e61e039b9306 to worker[183] qsize 0 2022-04-27 17:44:27,172 DEBUG awx.main.dispatch task c2767fd0-ed42-485f-8459-e61e039b9306 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:44:27,175 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:44:27,193 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:44:27,225 DEBUG awx.main.dispatch task c2767fd0-ed42-485f-8459-e61e039b9306 is finished 2022-04-27 17:44:29,726 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(8b99d0f8-2f3c-46e8-ae46-d68edc04f39a, queue=awx_private_queue) [2022-04-27 17:44:29,726: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(8b99d0f8-2f3c-46e8-ae46-d68edc04f39a, queue=awx_private_queue) 2022-04-27 17:44:29,742 DEBUG awx.main.dispatch delivered 8b99d0f8-2f3c-46e8-ae46-d68edc04f39a to worker[183] qsize 0 2022-04-27 17:44:29,745 DEBUG awx.main.dispatch task 8b99d0f8-2f3c-46e8-ae46-d68edc04f39a starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:44:29,756 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:44:29,760 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:43:59.760439+00:00 2022-04-27 17:44:30,199 DEBUG awx.main.dispatch task 8b99d0f8-2f3c-46e8-ae46-d68edc04f39a is finished 2022-04-27 17:44:47,155 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(84db7687-61eb-4ea8-844a-1abd0af52eef, queue=awx_private_queue) [2022-04-27 17:44:47,155: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(84db7687-61eb-4ea8-844a-1abd0af52eef, queue=awx_private_queue) 2022-04-27 17:44:47,180 DEBUG awx.main.dispatch delivered 84db7687-61eb-4ea8-844a-1abd0af52eef to worker[180] qsize 0 2022-04-27 17:44:47,184 DEBUG awx.main.dispatch task 84db7687-61eb-4ea8-844a-1abd0af52eef starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:44:47,188 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:44:47,206 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:44:47,238 DEBUG awx.main.dispatch task 84db7687-61eb-4ea8-844a-1abd0af52eef is finished 2022-04-27 17:44:59,726 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(9aced198-eeb4-40da-9d85-2b26a06e4fce, queue=awx_private_queue) [2022-04-27 17:44:59,726: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(9aced198-eeb4-40da-9d85-2b26a06e4fce, queue=awx_private_queue) 2022-04-27 17:44:59,743 DEBUG awx.main.dispatch delivered 9aced198-eeb4-40da-9d85-2b26a06e4fce to worker[181] qsize 0 2022-04-27 17:44:59,746 DEBUG awx.main.dispatch task 9aced198-eeb4-40da-9d85-2b26a06e4fce starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:44:59,759 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:44:59,762 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:44:29.756629+00:00 2022-04-27 17:44:59,863 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(d6a14d94-03d3-4c45-8f75-a47a746ac539, queue=onap-awx-0) [2022-04-27 17:44:59,863: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(d6a14d94-03d3-4c45-8f75-a47a746ac539, queue=onap-awx-0) 2022-04-27 17:44:59,901 DEBUG awx.main.dispatch delivered d6a14d94-03d3-4c45-8f75-a47a746ac539 to worker[183] qsize 0 2022-04-27 17:44:59,903 DEBUG awx.main.dispatch task d6a14d94-03d3-4c45-8f75-a47a746ac539 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:44:59,905 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:45:00,129 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(36a3f79d-baa1-4722-a5af-9d473cd36ca5, queue=onap-awx-0) [2022-04-27 17:45:00,129: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(36a3f79d-baa1-4722-a5af-9d473cd36ca5, queue=onap-awx-0) 2022-04-27 17:45:00,152 DEBUG awx.main.dispatch publish awx.main.tasks.awx_isolated_heartbeat(4f6808c8-ce30-4770-9c8c-7b18b74ec8c5, queue=onap-awx-0) [2022-04-27 17:45:00,152: DEBUG/Process-1] publish awx.main.tasks.awx_isolated_heartbeat(4f6808c8-ce30-4770-9c8c-7b18b74ec8c5, queue=onap-awx-0) RESULT 2 OKREADY 2022-04-27 17:45:00,194 DEBUG awx.main.dispatch task d6a14d94-03d3-4c45-8f75-a47a746ac539 is finished 2022-04-27 17:45:00,301 DEBUG awx.main.dispatch delivered 36a3f79d-baa1-4722-a5af-9d473cd36ca5 to worker[183] qsize 0 2022-04-27 17:45:00,304 DEBUG awx.main.dispatch delivered 4f6808c8-ce30-4770-9c8c-7b18b74ec8c5 to worker[180] qsize 0 2022-04-27 17:45:00,304 DEBUG awx.main.dispatch task 36a3f79d-baa1-4722-a5af-9d473cd36ca5 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:45:00,306 DEBUG awx.main.dispatch task 4f6808c8-ce30-4770-9c8c-7b18b74ec8c5 starting awx.main.tasks.awx_isolated_heartbeat(*[]) 2022-04-27 17:45:00,308 DEBUG awx.main.tasks Controlling node checking for any isolated management tasks. 2022-04-27 17:45:00,318 DEBUG awx.main.dispatch task 36a3f79d-baa1-4722-a5af-9d473cd36ca5 is finished 2022-04-27 17:45:00,323 DEBUG awx.main.dispatch task 4f6808c8-ce30-4770-9c8c-7b18b74ec8c5 is finished 2022-04-27 17:45:00,327 DEBUG awx.main.dispatch task 9aced198-eeb4-40da-9d85-2b26a06e4fce is finished 2022-04-27 17:45:07,154 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e7dd1342-dcc7-402a-9de0-27bb39d3c8f7, queue=awx_private_queue) [2022-04-27 17:45:07,154: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e7dd1342-dcc7-402a-9de0-27bb39d3c8f7, queue=awx_private_queue) 2022-04-27 17:45:07,357 DEBUG awx.main.dispatch delivered e7dd1342-dcc7-402a-9de0-27bb39d3c8f7 to worker[182] qsize 0 2022-04-27 17:45:07,361 DEBUG awx.main.dispatch task e7dd1342-dcc7-402a-9de0-27bb39d3c8f7 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:45:07,363 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:45:07,380 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:45:07,411 DEBUG awx.main.dispatch task e7dd1342-dcc7-402a-9de0-27bb39d3c8f7 is finished 2022-04-27 17:45:27,165 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(85683d33-f001-4e70-bf33-974d5c1a78d9, queue=awx_private_queue) [2022-04-27 17:45:27,165: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(85683d33-f001-4e70-bf33-974d5c1a78d9, queue=awx_private_queue) 2022-04-27 17:45:27,187 DEBUG awx.main.dispatch delivered 85683d33-f001-4e70-bf33-974d5c1a78d9 to worker[181] qsize 0 2022-04-27 17:45:27,190 DEBUG awx.main.dispatch task 85683d33-f001-4e70-bf33-974d5c1a78d9 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:45:27,191 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:45:27,211 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:45:27,241 DEBUG awx.main.dispatch task 85683d33-f001-4e70-bf33-974d5c1a78d9 is finished 2022-04-27 17:45:29,726 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(84cc69e6-714f-4b15-b423-32cbcef376e0, queue=awx_private_queue) [2022-04-27 17:45:29,726: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(84cc69e6-714f-4b15-b423-32cbcef376e0, queue=awx_private_queue) 2022-04-27 17:45:29,745 DEBUG awx.main.dispatch delivered 84cc69e6-714f-4b15-b423-32cbcef376e0 to worker[183] qsize 0 2022-04-27 17:45:29,748 DEBUG awx.main.dispatch task 84cc69e6-714f-4b15-b423-32cbcef376e0 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:45:29,761 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:45:29,764 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:44:59.759709+00:00 2022-04-27 17:45:30,001 DEBUG awx.main.dispatch task 84cc69e6-714f-4b15-b423-32cbcef376e0 is finished 2022-04-27 17:45:47,170 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7594b2a5-22a7-4263-a6bf-e9ee89948c1e, queue=awx_private_queue) [2022-04-27 17:45:47,170: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7594b2a5-22a7-4263-a6bf-e9ee89948c1e, queue=awx_private_queue) 2022-04-27 17:45:47,194 DEBUG awx.main.dispatch delivered 7594b2a5-22a7-4263-a6bf-e9ee89948c1e to worker[182] qsize 0 2022-04-27 17:45:47,196 DEBUG awx.main.dispatch task 7594b2a5-22a7-4263-a6bf-e9ee89948c1e starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:45:47,198 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:45:47,218 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:45:47,244 DEBUG awx.main.dispatch task 7594b2a5-22a7-4263-a6bf-e9ee89948c1e is finished 2022-04-27 17:45:59,730 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(e6f03310-48f7-437a-9b48-c7f6658eb141, queue=awx_private_queue) [2022-04-27 17:45:59,730: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(e6f03310-48f7-437a-9b48-c7f6658eb141, queue=awx_private_queue) 2022-04-27 17:45:59,754 DEBUG awx.main.dispatch delivered e6f03310-48f7-437a-9b48-c7f6658eb141 to worker[183] qsize 0 2022-04-27 17:45:59,758 DEBUG awx.main.dispatch task e6f03310-48f7-437a-9b48-c7f6658eb141 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:45:59,774 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:45:59,777 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:45:29.761694+00:00 2022-04-27 17:45:59,862 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(d07ef7de-2e31-439b-84a7-9ee13d12f937, queue=onap-awx-0) [2022-04-27 17:45:59,862: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(d07ef7de-2e31-439b-84a7-9ee13d12f937, queue=onap-awx-0) 2022-04-27 17:45:59,892 DEBUG awx.main.dispatch delivered d07ef7de-2e31-439b-84a7-9ee13d12f937 to worker[181] qsize 0 2022-04-27 17:45:59,894 DEBUG awx.main.dispatch task d07ef7de-2e31-439b-84a7-9ee13d12f937 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:45:59,896 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:46:00,106 DEBUG awx.main.dispatch task e6f03310-48f7-437a-9b48-c7f6658eb141 is finished 2022-04-27 17:46:00,129 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(0081e304-d03a-4e46-ac1d-49055130bbb8, queue=onap-awx-0) [2022-04-27 17:46:00,129: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(0081e304-d03a-4e46-ac1d-49055130bbb8, queue=onap-awx-0) RESULT 2 OKREADY 2022-04-27 17:46:00,184 DEBUG awx.main.dispatch delivered 0081e304-d03a-4e46-ac1d-49055130bbb8 to worker[180] qsize 0 2022-04-27 17:46:00,187 DEBUG awx.main.dispatch task 0081e304-d03a-4e46-ac1d-49055130bbb8 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:46:00,193 DEBUG awx.main.dispatch task d07ef7de-2e31-439b-84a7-9ee13d12f937 is finished 2022-04-27 17:46:00,203 DEBUG awx.main.dispatch task 0081e304-d03a-4e46-ac1d-49055130bbb8 is finished 2022-04-27 17:46:07,170 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(842d5fa4-f278-4925-b90e-04727a4b92c4, queue=awx_private_queue) [2022-04-27 17:46:07,170: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(842d5fa4-f278-4925-b90e-04727a4b92c4, queue=awx_private_queue) 2022-04-27 17:46:07,397 DEBUG awx.main.dispatch delivered 842d5fa4-f278-4925-b90e-04727a4b92c4 to worker[182] qsize 0 2022-04-27 17:46:07,400 DEBUG awx.main.dispatch task 842d5fa4-f278-4925-b90e-04727a4b92c4 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:46:07,403 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:46:07,419 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:46:07,450 DEBUG awx.main.dispatch task 842d5fa4-f278-4925-b90e-04727a4b92c4 is finished 2022-04-27 17:46:27,426 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c07d69ae-a5ea-40dc-8802-27e25509facb, queue=awx_private_queue) [2022-04-27 17:46:27,426: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c07d69ae-a5ea-40dc-8802-27e25509facb, queue=awx_private_queue) 2022-04-27 17:46:27,447 DEBUG awx.main.dispatch delivered c07d69ae-a5ea-40dc-8802-27e25509facb to worker[182] qsize 0 2022-04-27 17:46:27,449 DEBUG awx.main.dispatch task c07d69ae-a5ea-40dc-8802-27e25509facb starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:46:27,452 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:46:27,471 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:46:27,500 DEBUG awx.main.dispatch task c07d69ae-a5ea-40dc-8802-27e25509facb is finished 2022-04-27 17:46:29,730 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(145c2497-b611-471c-8114-e338513854b4, queue=awx_private_queue) [2022-04-27 17:46:29,730: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(145c2497-b611-471c-8114-e338513854b4, queue=awx_private_queue) 2022-04-27 17:46:29,752 DEBUG awx.main.dispatch delivered 145c2497-b611-471c-8114-e338513854b4 to worker[182] qsize 0 2022-04-27 17:46:29,755 DEBUG awx.main.dispatch task 145c2497-b611-471c-8114-e338513854b4 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:46:29,766 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:46:29,768 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:45:59.775138+00:00 2022-04-27 17:46:30,234 DEBUG awx.main.dispatch task 145c2497-b611-471c-8114-e338513854b4 is finished 2022-04-27 17:46:47,433 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f68f6a1f-42af-4116-9751-fbe46dfa8c13, queue=awx_private_queue) [2022-04-27 17:46:47,433: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f68f6a1f-42af-4116-9751-fbe46dfa8c13, queue=awx_private_queue) 2022-04-27 17:46:47,455 DEBUG awx.main.dispatch delivered f68f6a1f-42af-4116-9751-fbe46dfa8c13 to worker[180] qsize 0 2022-04-27 17:46:47,458 DEBUG awx.main.dispatch task f68f6a1f-42af-4116-9751-fbe46dfa8c13 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:46:47,460 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:46:47,479 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:46:47,511 DEBUG awx.main.dispatch task f68f6a1f-42af-4116-9751-fbe46dfa8c13 is finished 2022-04-27 17:46:59,733 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(63b33c70-5a46-4f35-8d5d-d5ec8be4d156, queue=awx_private_queue) [2022-04-27 17:46:59,733: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(63b33c70-5a46-4f35-8d5d-d5ec8be4d156, queue=awx_private_queue) 2022-04-27 17:46:59,755 DEBUG awx.main.dispatch delivered 63b33c70-5a46-4f35-8d5d-d5ec8be4d156 to worker[181] qsize 0 2022-04-27 17:46:59,758 DEBUG awx.main.dispatch task 63b33c70-5a46-4f35-8d5d-d5ec8be4d156 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:46:59,770 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:46:59,773 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:46:29.766437+00:00 2022-04-27 17:46:59,862 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(69619956-80f3-4130-9507-ec129e75fae3, queue=onap-awx-0) [2022-04-27 17:46:59,862: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(69619956-80f3-4130-9507-ec129e75fae3, queue=onap-awx-0) 2022-04-27 17:46:59,893 DEBUG awx.main.dispatch delivered 69619956-80f3-4130-9507-ec129e75fae3 to worker[183] qsize 0 2022-04-27 17:46:59,896 DEBUG awx.main.dispatch task 69619956-80f3-4130-9507-ec129e75fae3 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:46:59,901 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:47:00,129 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(51221335-5b75-4ac3-bc06-9399cdecf12a, queue=onap-awx-0) [2022-04-27 17:47:00,129: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(51221335-5b75-4ac3-bc06-9399cdecf12a, queue=onap-awx-0) RESULT 2 OKREADY 2022-04-27 17:47:00,308 DEBUG awx.main.dispatch task 69619956-80f3-4130-9507-ec129e75fae3 is finished 2022-04-27 17:47:00,496 DEBUG awx.main.dispatch delivered 51221335-5b75-4ac3-bc06-9399cdecf12a to worker[183] qsize 0 2022-04-27 17:47:00,499 DEBUG awx.main.dispatch task 51221335-5b75-4ac3-bc06-9399cdecf12a starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:47:00,513 DEBUG awx.main.dispatch task 51221335-5b75-4ac3-bc06-9399cdecf12a is finished 2022-04-27 17:47:00,529 DEBUG awx.main.dispatch task 63b33c70-5a46-4f35-8d5d-d5ec8be4d156 is finished 2022-04-27 17:47:07,433 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(98a74611-24db-4177-85dd-5774fe2c53c7, queue=awx_private_queue) [2022-04-27 17:47:07,433: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(98a74611-24db-4177-85dd-5774fe2c53c7, queue=awx_private_queue) 2022-04-27 17:47:07,631 DEBUG awx.main.dispatch delivered 98a74611-24db-4177-85dd-5774fe2c53c7 to worker[181] qsize 0 2022-04-27 17:47:07,633 DEBUG awx.main.dispatch task 98a74611-24db-4177-85dd-5774fe2c53c7 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:47:07,635 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:47:07,653 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:47:07,685 DEBUG awx.main.dispatch task 98a74611-24db-4177-85dd-5774fe2c53c7 is finished 2022-04-27 17:47:27,433 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(20c07b2c-c5a2-464c-8b43-9a6bb088ed27, queue=awx_private_queue) [2022-04-27 17:47:27,433: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(20c07b2c-c5a2-464c-8b43-9a6bb088ed27, queue=awx_private_queue) 2022-04-27 17:47:27,457 DEBUG awx.main.dispatch delivered 20c07b2c-c5a2-464c-8b43-9a6bb088ed27 to worker[181] qsize 0 2022-04-27 17:47:27,460 DEBUG awx.main.dispatch task 20c07b2c-c5a2-464c-8b43-9a6bb088ed27 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:47:27,462 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:47:27,479 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:47:27,505 DEBUG awx.main.dispatch task 20c07b2c-c5a2-464c-8b43-9a6bb088ed27 is finished 2022-04-27 17:47:29,733 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(a9988cbd-d68d-490e-a5c8-54bc2678776d, queue=awx_private_queue) [2022-04-27 17:47:29,733: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(a9988cbd-d68d-490e-a5c8-54bc2678776d, queue=awx_private_queue) 2022-04-27 17:47:29,754 DEBUG awx.main.dispatch delivered a9988cbd-d68d-490e-a5c8-54bc2678776d to worker[182] qsize 0 2022-04-27 17:47:29,757 DEBUG awx.main.dispatch task a9988cbd-d68d-490e-a5c8-54bc2678776d starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:47:29,771 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:47:29,775 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:46:59.770646+00:00 2022-04-27 17:47:30,129 DEBUG awx.main.dispatch task a9988cbd-d68d-490e-a5c8-54bc2678776d is finished 2022-04-27 17:47:47,442 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(579a5ad3-8d86-4106-8617-4731a8130946, queue=awx_private_queue) [2022-04-27 17:47:47,442: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(579a5ad3-8d86-4106-8617-4731a8130946, queue=awx_private_queue) 2022-04-27 17:47:47,461 DEBUG awx.main.dispatch delivered 579a5ad3-8d86-4106-8617-4731a8130946 to worker[181] qsize 0 2022-04-27 17:47:47,464 DEBUG awx.main.dispatch task 579a5ad3-8d86-4106-8617-4731a8130946 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:47:47,465 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:47:47,483 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:47:47,511 DEBUG awx.main.dispatch task 579a5ad3-8d86-4106-8617-4731a8130946 is finished 2022-04-27 17:47:59,733 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(0d9065e0-ab2d-431c-958d-5373c2b0f754, queue=awx_private_queue) [2022-04-27 17:47:59,733: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(0d9065e0-ab2d-431c-958d-5373c2b0f754, queue=awx_private_queue) 2022-04-27 17:47:59,755 DEBUG awx.main.dispatch delivered 0d9065e0-ab2d-431c-958d-5373c2b0f754 to worker[180] qsize 0 2022-04-27 17:47:59,759 DEBUG awx.main.dispatch task 0d9065e0-ab2d-431c-958d-5373c2b0f754 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:47:59,771 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:47:59,776 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:47:29.772003+00:00 2022-04-27 17:47:59,862 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(9b7c38a2-af0e-41e8-9b35-ced555a0ae8d, queue=onap-awx-0) [2022-04-27 17:47:59,862: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(9b7c38a2-af0e-41e8-9b35-ced555a0ae8d, queue=onap-awx-0) 2022-04-27 17:47:59,898 DEBUG awx.main.dispatch delivered 9b7c38a2-af0e-41e8-9b35-ced555a0ae8d to worker[182] qsize 0 2022-04-27 17:47:59,900 DEBUG awx.main.dispatch task 9b7c38a2-af0e-41e8-9b35-ced555a0ae8d starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:47:59,902 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:48:00,129 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(09feccb1-ae08-4727-87c7-e96ef06d5fef, queue=onap-awx-0) [2022-04-27 17:48:00,129: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(09feccb1-ae08-4727-87c7-e96ef06d5fef, queue=onap-awx-0) 2022-04-27 17:48:00,151 DEBUG awx.main.dispatch task 9b7c38a2-af0e-41e8-9b35-ced555a0ae8d is finished RESULT 2 OKREADY 2022-04-27 17:48:00,184 DEBUG awx.main.dispatch task 0d9065e0-ab2d-431c-958d-5373c2b0f754 is finished 2022-04-27 17:48:01,105 DEBUG awx.main.dispatch delivered 09feccb1-ae08-4727-87c7-e96ef06d5fef to worker[180] qsize 0 2022-04-27 17:48:01,109 DEBUG awx.main.dispatch task 09feccb1-ae08-4727-87c7-e96ef06d5fef starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:48:01,123 DEBUG awx.main.dispatch task 09feccb1-ae08-4727-87c7-e96ef06d5fef is finished 2022-04-27 17:48:07,441 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(066fdc2c-514e-4534-acf1-55743e502c79, queue=awx_private_queue) [2022-04-27 17:48:07,441: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(066fdc2c-514e-4534-acf1-55743e502c79, queue=awx_private_queue) 2022-04-27 17:48:07,645 DEBUG awx.main.dispatch delivered 066fdc2c-514e-4534-acf1-55743e502c79 to worker[180] qsize 0 2022-04-27 17:48:07,648 DEBUG awx.main.dispatch task 066fdc2c-514e-4534-acf1-55743e502c79 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:48:07,650 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:48:07,667 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:48:07,701 DEBUG awx.main.dispatch task 066fdc2c-514e-4534-acf1-55743e502c79 is finished 2022-04-27 17:48:27,442 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(58655e2c-e3a6-449a-8bec-9a91432be110, queue=awx_private_queue) [2022-04-27 17:48:27,442: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(58655e2c-e3a6-449a-8bec-9a91432be110, queue=awx_private_queue) 2022-04-27 17:48:27,464 DEBUG awx.main.dispatch delivered 58655e2c-e3a6-449a-8bec-9a91432be110 to worker[180] qsize 0 2022-04-27 17:48:27,469 DEBUG awx.main.dispatch task 58655e2c-e3a6-449a-8bec-9a91432be110 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:48:27,471 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:48:27,491 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:48:27,519 DEBUG awx.main.dispatch task 58655e2c-e3a6-449a-8bec-9a91432be110 is finished 2022-04-27 17:48:29,733 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(ae893c8f-90a4-4667-beb1-367190176e0d, queue=awx_private_queue) [2022-04-27 17:48:29,733: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(ae893c8f-90a4-4667-beb1-367190176e0d, queue=awx_private_queue) 2022-04-27 17:48:29,752 DEBUG awx.main.dispatch delivered ae893c8f-90a4-4667-beb1-367190176e0d to worker[181] qsize 0 2022-04-27 17:48:29,755 DEBUG awx.main.dispatch task ae893c8f-90a4-4667-beb1-367190176e0d starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:48:29,768 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:48:29,770 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:47:59.772446+00:00 2022-04-27 17:48:29,789 DEBUG awx.main.dispatch task ae893c8f-90a4-4667-beb1-367190176e0d is finished 2022-04-27 17:48:47,450 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7472e2d8-95a1-454c-a1f5-23c6f06a76ae, queue=awx_private_queue) [2022-04-27 17:48:47,450: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7472e2d8-95a1-454c-a1f5-23c6f06a76ae, queue=awx_private_queue) 2022-04-27 17:48:47,489 DEBUG awx.main.dispatch delivered 7472e2d8-95a1-454c-a1f5-23c6f06a76ae to worker[182] qsize 0 2022-04-27 17:48:47,493 DEBUG awx.main.dispatch task 7472e2d8-95a1-454c-a1f5-23c6f06a76ae starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:48:47,497 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:48:47,515 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:48:47,546 DEBUG awx.main.dispatch task 7472e2d8-95a1-454c-a1f5-23c6f06a76ae is finished 2022-04-27 17:48:59,733 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(85297ef3-ac11-49cb-94e7-b58d04d4dd5d, queue=awx_private_queue) [2022-04-27 17:48:59,733: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(85297ef3-ac11-49cb-94e7-b58d04d4dd5d, queue=awx_private_queue) 2022-04-27 17:48:59,750 DEBUG awx.main.dispatch delivered 85297ef3-ac11-49cb-94e7-b58d04d4dd5d to worker[180] qsize 0 2022-04-27 17:48:59,754 DEBUG awx.main.dispatch task 85297ef3-ac11-49cb-94e7-b58d04d4dd5d starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:48:59,766 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:48:59,771 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:48:29.768145+00:00 2022-04-27 17:48:59,863 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(f4e1d21c-c5f4-4339-92de-840ba0abfba2, queue=onap-awx-0) [2022-04-27 17:48:59,863: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(f4e1d21c-c5f4-4339-92de-840ba0abfba2, queue=onap-awx-0) 2022-04-27 17:48:59,893 DEBUG awx.main.dispatch delivered f4e1d21c-c5f4-4339-92de-840ba0abfba2 to worker[182] qsize 0 2022-04-27 17:48:59,895 DEBUG awx.main.dispatch task f4e1d21c-c5f4-4339-92de-840ba0abfba2 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:48:59,896 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:49:00,130 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(18c17391-4bc1-4807-9398-a67a8dca7a79, queue=onap-awx-0) [2022-04-27 17:49:00,130: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(18c17391-4bc1-4807-9398-a67a8dca7a79, queue=onap-awx-0) RESULT 2 OKREADY 2022-04-27 17:49:00,254 DEBUG awx.main.dispatch delivered 18c17391-4bc1-4807-9398-a67a8dca7a79 to worker[183] qsize 0 2022-04-27 17:49:00,257 DEBUG awx.main.dispatch task 18c17391-4bc1-4807-9398-a67a8dca7a79 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:49:00,275 DEBUG awx.main.dispatch task 18c17391-4bc1-4807-9398-a67a8dca7a79 is finished 2022-04-27 17:49:00,543 DEBUG awx.main.dispatch task f4e1d21c-c5f4-4339-92de-840ba0abfba2 is finished 2022-04-27 17:49:00,685 DEBUG awx.main.dispatch task 85297ef3-ac11-49cb-94e7-b58d04d4dd5d is finished 2022-04-27 17:49:07,450 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(732bc2ef-6fc8-4960-9732-b0ef98883f06, queue=awx_private_queue) [2022-04-27 17:49:07,450: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(732bc2ef-6fc8-4960-9732-b0ef98883f06, queue=awx_private_queue) 2022-04-27 17:49:07,645 DEBUG awx.main.dispatch delivered 732bc2ef-6fc8-4960-9732-b0ef98883f06 to worker[181] qsize 0 2022-04-27 17:49:07,649 DEBUG awx.main.dispatch task 732bc2ef-6fc8-4960-9732-b0ef98883f06 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:49:07,651 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:49:07,668 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:49:07,694 DEBUG awx.main.dispatch task 732bc2ef-6fc8-4960-9732-b0ef98883f06 is finished 2022-04-27 17:49:27,481 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(60ecea43-f21a-47a9-b38d-a8e99b5b6020, queue=awx_private_queue) [2022-04-27 17:49:27,481: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(60ecea43-f21a-47a9-b38d-a8e99b5b6020, queue=awx_private_queue) 2022-04-27 17:49:27,503 DEBUG awx.main.dispatch delivered 60ecea43-f21a-47a9-b38d-a8e99b5b6020 to worker[182] qsize 0 2022-04-27 17:49:27,505 DEBUG awx.main.dispatch task 60ecea43-f21a-47a9-b38d-a8e99b5b6020 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:49:27,507 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:49:27,525 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:49:27,552 DEBUG awx.main.dispatch task 60ecea43-f21a-47a9-b38d-a8e99b5b6020 is finished 2022-04-27 17:49:29,733 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(73d636c2-94fd-4f2b-b51c-7404519b1ca5, queue=awx_private_queue) [2022-04-27 17:49:29,733: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(73d636c2-94fd-4f2b-b51c-7404519b1ca5, queue=awx_private_queue) 2022-04-27 17:49:29,751 DEBUG awx.main.dispatch delivered 73d636c2-94fd-4f2b-b51c-7404519b1ca5 to worker[180] qsize 0 2022-04-27 17:49:29,753 DEBUG awx.main.dispatch task 73d636c2-94fd-4f2b-b51c-7404519b1ca5 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:49:29,764 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:49:29,766 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:48:59.767272+00:00 2022-04-27 17:49:30,094 DEBUG awx.main.dispatch task 73d636c2-94fd-4f2b-b51c-7404519b1ca5 is finished 2022-04-27 17:49:47,482 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(919bb7eb-91f9-4969-a33c-6572cac42e5a, queue=awx_private_queue) [2022-04-27 17:49:47,482: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(919bb7eb-91f9-4969-a33c-6572cac42e5a, queue=awx_private_queue) 2022-04-27 17:49:47,505 DEBUG awx.main.dispatch delivered 919bb7eb-91f9-4969-a33c-6572cac42e5a to worker[180] qsize 0 2022-04-27 17:49:47,507 DEBUG awx.main.dispatch task 919bb7eb-91f9-4969-a33c-6572cac42e5a starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:49:47,509 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:49:47,528 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:49:47,557 DEBUG awx.main.dispatch task 919bb7eb-91f9-4969-a33c-6572cac42e5a is finished 2022-04-27 17:49:59,736 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(2813c6b0-35c9-4264-af3c-5dbe6cf3399c, queue=awx_private_queue) [2022-04-27 17:49:59,736: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(2813c6b0-35c9-4264-af3c-5dbe6cf3399c, queue=awx_private_queue) 2022-04-27 17:49:59,757 DEBUG awx.main.dispatch delivered 2813c6b0-35c9-4264-af3c-5dbe6cf3399c to worker[182] qsize 0 2022-04-27 17:49:59,760 DEBUG awx.main.dispatch task 2813c6b0-35c9-4264-af3c-5dbe6cf3399c starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:49:59,774 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:49:59,778 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:49:29.764515+00:00 2022-04-27 17:49:59,863 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(73b8c394-5e9b-4f76-a4e7-c2694baea115, queue=onap-awx-0) [2022-04-27 17:49:59,863: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(73b8c394-5e9b-4f76-a4e7-c2694baea115, queue=onap-awx-0) 2022-04-27 17:49:59,898 DEBUG awx.main.dispatch delivered 73b8c394-5e9b-4f76-a4e7-c2694baea115 to worker[183] qsize 0 2022-04-27 17:49:59,901 DEBUG awx.main.dispatch task 73b8c394-5e9b-4f76-a4e7-c2694baea115 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:49:59,902 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:50:00,129 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(22a2640c-cdc1-496d-a60e-2cacefa59b3d, queue=onap-awx-0) [2022-04-27 17:50:00,129: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(22a2640c-cdc1-496d-a60e-2cacefa59b3d, queue=onap-awx-0) RESULT 2 OKREADY 2022-04-27 17:50:00,283 DEBUG awx.main.dispatch task 73b8c394-5e9b-4f76-a4e7-c2694baea115 is finished 2022-04-27 17:50:00,429 DEBUG awx.main.dispatch task 2813c6b0-35c9-4264-af3c-5dbe6cf3399c is finished 2022-04-27 17:50:00,576 DEBUG awx.main.dispatch delivered 22a2640c-cdc1-496d-a60e-2cacefa59b3d to worker[183] qsize 0 2022-04-27 17:50:00,579 DEBUG awx.main.dispatch task 22a2640c-cdc1-496d-a60e-2cacefa59b3d starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:50:00,593 DEBUG awx.main.dispatch task 22a2640c-cdc1-496d-a60e-2cacefa59b3d is finished 2022-04-27 17:50:07,482 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6bf72bd2-ab8d-4aa6-b8ff-cdf5e906325f, queue=awx_private_queue) [2022-04-27 17:50:07,482: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6bf72bd2-ab8d-4aa6-b8ff-cdf5e906325f, queue=awx_private_queue) 2022-04-27 17:50:07,697 DEBUG awx.main.dispatch delivered 6bf72bd2-ab8d-4aa6-b8ff-cdf5e906325f to worker[183] qsize 0 2022-04-27 17:50:07,701 DEBUG awx.main.dispatch task 6bf72bd2-ab8d-4aa6-b8ff-cdf5e906325f starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:50:07,703 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:50:07,722 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:50:07,750 DEBUG awx.main.dispatch task 6bf72bd2-ab8d-4aa6-b8ff-cdf5e906325f is finished 2022-04-27 17:50:27,490 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(91fbc3da-36bb-4421-91b0-facfc4cebbb8, queue=awx_private_queue) [2022-04-27 17:50:27,490: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(91fbc3da-36bb-4421-91b0-facfc4cebbb8, queue=awx_private_queue) 2022-04-27 17:50:27,507 DEBUG awx.main.dispatch delivered 91fbc3da-36bb-4421-91b0-facfc4cebbb8 to worker[180] qsize 0 2022-04-27 17:50:27,510 DEBUG awx.main.dispatch task 91fbc3da-36bb-4421-91b0-facfc4cebbb8 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:50:27,512 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:50:27,532 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:50:27,563 DEBUG awx.main.dispatch task 91fbc3da-36bb-4421-91b0-facfc4cebbb8 is finished 2022-04-27 17:50:29,736 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(3e391710-d62a-4c75-be68-0af0b2e9c693, queue=awx_private_queue) [2022-04-27 17:50:29,736: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(3e391710-d62a-4c75-be68-0af0b2e9c693, queue=awx_private_queue) 2022-04-27 17:50:29,752 DEBUG awx.main.dispatch delivered 3e391710-d62a-4c75-be68-0af0b2e9c693 to worker[180] qsize 0 2022-04-27 17:50:29,756 DEBUG awx.main.dispatch task 3e391710-d62a-4c75-be68-0af0b2e9c693 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:50:29,769 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:50:29,773 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:49:59.774928+00:00 2022-04-27 17:50:30,309 DEBUG awx.main.dispatch task 3e391710-d62a-4c75-be68-0af0b2e9c693 is finished 2022-04-27 17:50:47,499 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(cf5a8e33-bbdc-468a-9988-d63dc28975f3, queue=awx_private_queue) [2022-04-27 17:50:47,499: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(cf5a8e33-bbdc-468a-9988-d63dc28975f3, queue=awx_private_queue) 2022-04-27 17:50:47,522 DEBUG awx.main.dispatch delivered cf5a8e33-bbdc-468a-9988-d63dc28975f3 to worker[180] qsize 0 2022-04-27 17:50:47,524 DEBUG awx.main.dispatch task cf5a8e33-bbdc-468a-9988-d63dc28975f3 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:50:47,526 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:50:47,546 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:50:47,579 DEBUG awx.main.dispatch task cf5a8e33-bbdc-468a-9988-d63dc28975f3 is finished 2022-04-27 17:50:59,738 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(e8632465-b302-4c4c-a510-449055efe90a, queue=awx_private_queue) [2022-04-27 17:50:59,738: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(e8632465-b302-4c4c-a510-449055efe90a, queue=awx_private_queue) 2022-04-27 17:50:59,756 DEBUG awx.main.dispatch delivered e8632465-b302-4c4c-a510-449055efe90a to worker[180] qsize 0 2022-04-27 17:50:59,759 DEBUG awx.main.dispatch task e8632465-b302-4c4c-a510-449055efe90a starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:50:59,771 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:50:59,775 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:50:29.770252+00:00 2022-04-27 17:50:59,862 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(21c8e86e-ff4b-4578-ae11-d3ebc414f8f5, queue=onap-awx-0) [2022-04-27 17:50:59,862: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(21c8e86e-ff4b-4578-ae11-d3ebc414f8f5, queue=onap-awx-0) 2022-04-27 17:50:59,890 DEBUG awx.main.dispatch delivered 21c8e86e-ff4b-4578-ae11-d3ebc414f8f5 to worker[182] qsize 0 2022-04-27 17:50:59,892 DEBUG awx.main.dispatch task 21c8e86e-ff4b-4578-ae11-d3ebc414f8f5 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:50:59,895 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:51:00,103 DEBUG awx.main.dispatch task 21c8e86e-ff4b-4578-ae11-d3ebc414f8f5 is finished 2022-04-27 17:51:00,106 DEBUG awx.main.dispatch task e8632465-b302-4c4c-a510-449055efe90a is finished RESULT 2 OKREADY 2022-04-27 17:51:00,129 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(ae366555-7145-4c93-9b7b-dbaf77fce823, queue=onap-awx-0) [2022-04-27 17:51:00,129: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(ae366555-7145-4c93-9b7b-dbaf77fce823, queue=onap-awx-0) 2022-04-27 17:51:00,336 DEBUG awx.main.dispatch delivered ae366555-7145-4c93-9b7b-dbaf77fce823 to worker[181] qsize 0 2022-04-27 17:51:00,339 DEBUG awx.main.dispatch task ae366555-7145-4c93-9b7b-dbaf77fce823 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:51:00,354 DEBUG awx.main.dispatch task ae366555-7145-4c93-9b7b-dbaf77fce823 is finished 2022-04-27 17:51:07,499 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(be50c144-36ee-4aae-a7d8-963f56414e68, queue=awx_private_queue) [2022-04-27 17:51:07,499: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(be50c144-36ee-4aae-a7d8-963f56414e68, queue=awx_private_queue) 2022-04-27 17:51:07,690 DEBUG awx.main.dispatch delivered be50c144-36ee-4aae-a7d8-963f56414e68 to worker[180] qsize 0 2022-04-27 17:51:07,692 DEBUG awx.main.dispatch task be50c144-36ee-4aae-a7d8-963f56414e68 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:51:07,694 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:51:07,711 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:51:07,741 DEBUG awx.main.dispatch task be50c144-36ee-4aae-a7d8-963f56414e68 is finished 2022-04-27 17:51:27,505 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e179a2fe-b424-420a-b0ab-020eed20ffc6, queue=awx_private_queue) [2022-04-27 17:51:27,505: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e179a2fe-b424-420a-b0ab-020eed20ffc6, queue=awx_private_queue) 2022-04-27 17:51:27,522 DEBUG awx.main.dispatch delivered e179a2fe-b424-420a-b0ab-020eed20ffc6 to worker[180] qsize 0 2022-04-27 17:51:27,526 DEBUG awx.main.dispatch task e179a2fe-b424-420a-b0ab-020eed20ffc6 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:51:27,529 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:51:27,550 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:51:27,578 DEBUG awx.main.dispatch task e179a2fe-b424-420a-b0ab-020eed20ffc6 is finished 2022-04-27 17:51:29,739 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d318ef72-9176-4014-917f-e411b49b0df8, queue=awx_private_queue) [2022-04-27 17:51:29,739: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d318ef72-9176-4014-917f-e411b49b0df8, queue=awx_private_queue) 2022-04-27 17:51:29,760 DEBUG awx.main.dispatch delivered d318ef72-9176-4014-917f-e411b49b0df8 to worker[180] qsize 0 2022-04-27 17:51:29,765 DEBUG awx.main.dispatch task d318ef72-9176-4014-917f-e411b49b0df8 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:51:29,776 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:51:29,779 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:50:59.772632+00:00 2022-04-27 17:51:29,798 DEBUG awx.main.dispatch task d318ef72-9176-4014-917f-e411b49b0df8 is finished 2022-04-27 17:51:47,513 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(bf931d94-115d-4371-96d8-dde3f60d41dd, queue=awx_private_queue) [2022-04-27 17:51:47,513: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(bf931d94-115d-4371-96d8-dde3f60d41dd, queue=awx_private_queue) 2022-04-27 17:51:47,537 DEBUG awx.main.dispatch delivered bf931d94-115d-4371-96d8-dde3f60d41dd to worker[182] qsize 0 2022-04-27 17:51:47,541 DEBUG awx.main.dispatch task bf931d94-115d-4371-96d8-dde3f60d41dd starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:51:47,543 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:51:47,567 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:51:47,599 DEBUG awx.main.dispatch task bf931d94-115d-4371-96d8-dde3f60d41dd is finished 2022-04-27 17:51:59,742 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(81f0442c-f963-4a1d-ba63-d4b751c12aa8, queue=awx_private_queue) [2022-04-27 17:51:59,742: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(81f0442c-f963-4a1d-ba63-d4b751c12aa8, queue=awx_private_queue) 2022-04-27 17:51:59,766 DEBUG awx.main.dispatch delivered 81f0442c-f963-4a1d-ba63-d4b751c12aa8 to worker[183] qsize 0 2022-04-27 17:51:59,769 DEBUG awx.main.dispatch task 81f0442c-f963-4a1d-ba63-d4b751c12aa8 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:51:59,783 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:51:59,786 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:51:29.777012+00:00 2022-04-27 17:51:59,825 DEBUG awx.main.dispatch task 81f0442c-f963-4a1d-ba63-d4b751c12aa8 is finished 2022-04-27 17:51:59,863 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(62394478-e6ca-4f7a-9414-224a86252f77, queue=onap-awx-0) [2022-04-27 17:51:59,863: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(62394478-e6ca-4f7a-9414-224a86252f77, queue=onap-awx-0) 2022-04-27 17:51:59,913 DEBUG awx.main.dispatch delivered 62394478-e6ca-4f7a-9414-224a86252f77 to worker[182] qsize 0 2022-04-27 17:51:59,915 DEBUG awx.main.dispatch task 62394478-e6ca-4f7a-9414-224a86252f77 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:51:59,917 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:52:00,130 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(bc79ec31-d359-4cb1-b64e-bea79c7503ae, queue=onap-awx-0) [2022-04-27 17:52:00,130: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(bc79ec31-d359-4cb1-b64e-bea79c7503ae, queue=onap-awx-0) 2022-04-27 17:52:00,153 DEBUG awx.main.dispatch task 62394478-e6ca-4f7a-9414-224a86252f77 is finished RESULT 2 OKREADY 2022-04-27 17:52:00,509 DEBUG awx.main.dispatch delivered bc79ec31-d359-4cb1-b64e-bea79c7503ae to worker[183] qsize 0 2022-04-27 17:52:00,512 DEBUG awx.main.dispatch task bc79ec31-d359-4cb1-b64e-bea79c7503ae starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:52:00,525 DEBUG awx.main.dispatch task bc79ec31-d359-4cb1-b64e-bea79c7503ae is finished 2022-04-27 17:52:07,513 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(47b49a14-5b6a-4587-8e92-7651c95cb02a, queue=awx_private_queue) [2022-04-27 17:52:07,513: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(47b49a14-5b6a-4587-8e92-7651c95cb02a, queue=awx_private_queue) 2022-04-27 17:52:07,709 DEBUG awx.main.dispatch delivered 47b49a14-5b6a-4587-8e92-7651c95cb02a to worker[180] qsize 0 2022-04-27 17:52:07,711 DEBUG awx.main.dispatch task 47b49a14-5b6a-4587-8e92-7651c95cb02a starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:52:07,713 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:52:07,731 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:52:07,761 DEBUG awx.main.dispatch task 47b49a14-5b6a-4587-8e92-7651c95cb02a is finished 2022-04-27 17:52:27,759 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b2fb605b-7273-45ce-88a8-f75c9b569e47, queue=awx_private_queue) [2022-04-27 17:52:27,759: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b2fb605b-7273-45ce-88a8-f75c9b569e47, queue=awx_private_queue) 2022-04-27 17:52:27,778 DEBUG awx.main.dispatch delivered b2fb605b-7273-45ce-88a8-f75c9b569e47 to worker[183] qsize 0 2022-04-27 17:52:27,781 DEBUG awx.main.dispatch task b2fb605b-7273-45ce-88a8-f75c9b569e47 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:52:27,783 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:52:27,810 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:52:27,844 DEBUG awx.main.dispatch task b2fb605b-7273-45ce-88a8-f75c9b569e47 is finished 2022-04-27 17:52:29,741 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(84f86df8-49ae-4f3f-a814-5973aee0f6c0, queue=awx_private_queue) [2022-04-27 17:52:29,741: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(84f86df8-49ae-4f3f-a814-5973aee0f6c0, queue=awx_private_queue) 2022-04-27 17:52:29,761 DEBUG awx.main.dispatch delivered 84f86df8-49ae-4f3f-a814-5973aee0f6c0 to worker[181] qsize 0 2022-04-27 17:52:29,764 DEBUG awx.main.dispatch task 84f86df8-49ae-4f3f-a814-5973aee0f6c0 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:52:29,775 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:52:29,778 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:51:59.783710+00:00 2022-04-27 17:52:29,877 DEBUG awx.main.dispatch task 84f86df8-49ae-4f3f-a814-5973aee0f6c0 is finished 2022-04-27 17:52:47,760 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(91392109-3616-445d-a99e-621a52ab0bcf, queue=awx_private_queue) [2022-04-27 17:52:47,760: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(91392109-3616-445d-a99e-621a52ab0bcf, queue=awx_private_queue) 2022-04-27 17:52:47,779 DEBUG awx.main.dispatch delivered 91392109-3616-445d-a99e-621a52ab0bcf to worker[182] qsize 0 2022-04-27 17:52:47,783 DEBUG awx.main.dispatch task 91392109-3616-445d-a99e-621a52ab0bcf starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:52:47,785 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:52:47,804 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:52:47,834 DEBUG awx.main.dispatch task 91392109-3616-445d-a99e-621a52ab0bcf is finished 2022-04-27 17:52:59,743 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(2a1ea0a1-2547-45f8-b2c3-cd3bbff5ec67, queue=awx_private_queue) [2022-04-27 17:52:59,743: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(2a1ea0a1-2547-45f8-b2c3-cd3bbff5ec67, queue=awx_private_queue) 2022-04-27 17:52:59,762 DEBUG awx.main.dispatch delivered 2a1ea0a1-2547-45f8-b2c3-cd3bbff5ec67 to worker[182] qsize 0 2022-04-27 17:52:59,765 DEBUG awx.main.dispatch task 2a1ea0a1-2547-45f8-b2c3-cd3bbff5ec67 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:52:59,780 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:52:59,784 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:52:29.775580+00:00 2022-04-27 17:52:59,863 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(b57eb67a-196b-4652-a6bb-4bf119c4ccc4, queue=onap-awx-0) [2022-04-27 17:52:59,863: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(b57eb67a-196b-4652-a6bb-4bf119c4ccc4, queue=onap-awx-0) 2022-04-27 17:52:59,895 DEBUG awx.main.dispatch delivered b57eb67a-196b-4652-a6bb-4bf119c4ccc4 to worker[181] qsize 0 2022-04-27 17:52:59,897 DEBUG awx.main.dispatch task b57eb67a-196b-4652-a6bb-4bf119c4ccc4 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:52:59,899 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:53:00,130 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(26aa51a4-dfe1-4fc8-a72e-454802cbe1c5, queue=onap-awx-0) [2022-04-27 17:53:00,130: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(26aa51a4-dfe1-4fc8-a72e-454802cbe1c5, queue=onap-awx-0) 2022-04-27 17:53:00,262 DEBUG awx.main.dispatch delivered 26aa51a4-dfe1-4fc8-a72e-454802cbe1c5 to worker[180] qsize 0 RESULT 2 OKREADY 2022-04-27 17:53:00,266 DEBUG awx.main.dispatch task 26aa51a4-dfe1-4fc8-a72e-454802cbe1c5 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:53:00,280 DEBUG awx.main.dispatch task 26aa51a4-dfe1-4fc8-a72e-454802cbe1c5 is finished 2022-04-27 17:53:00,289 DEBUG awx.main.dispatch task b57eb67a-196b-4652-a6bb-4bf119c4ccc4 is finished 2022-04-27 17:53:00,353 DEBUG awx.main.dispatch task 2a1ea0a1-2547-45f8-b2c3-cd3bbff5ec67 is finished 2022-04-27 17:53:07,759 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(8d614532-9560-41de-a6e6-f4dcd5ab6149, queue=awx_private_queue) [2022-04-27 17:53:07,759: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(8d614532-9560-41de-a6e6-f4dcd5ab6149, queue=awx_private_queue) 2022-04-27 17:53:07,947 DEBUG awx.main.dispatch delivered 8d614532-9560-41de-a6e6-f4dcd5ab6149 to worker[181] qsize 0 2022-04-27 17:53:07,951 DEBUG awx.main.dispatch task 8d614532-9560-41de-a6e6-f4dcd5ab6149 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:53:07,953 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:53:07,970 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:53:08,002 DEBUG awx.main.dispatch task 8d614532-9560-41de-a6e6-f4dcd5ab6149 is finished 2022-04-27 17:53:27,770 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(043f1a27-41bd-466d-a556-d547ee9dae7b, queue=awx_private_queue) [2022-04-27 17:53:27,770: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(043f1a27-41bd-466d-a556-d547ee9dae7b, queue=awx_private_queue) 2022-04-27 17:53:27,787 DEBUG awx.main.dispatch delivered 043f1a27-41bd-466d-a556-d547ee9dae7b to worker[181] qsize 0 2022-04-27 17:53:27,790 DEBUG awx.main.dispatch task 043f1a27-41bd-466d-a556-d547ee9dae7b starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:53:27,792 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:53:27,809 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:53:27,836 DEBUG awx.main.dispatch task 043f1a27-41bd-466d-a556-d547ee9dae7b is finished 2022-04-27 17:53:29,744 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(1fc0d9c0-7642-4842-b887-8dc38e7e4890, queue=awx_private_queue) [2022-04-27 17:53:29,744: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(1fc0d9c0-7642-4842-b887-8dc38e7e4890, queue=awx_private_queue) 2022-04-27 17:53:29,768 DEBUG awx.main.dispatch delivered 1fc0d9c0-7642-4842-b887-8dc38e7e4890 to worker[182] qsize 0 2022-04-27 17:53:29,772 DEBUG awx.main.dispatch task 1fc0d9c0-7642-4842-b887-8dc38e7e4890 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:53:29,783 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:53:29,787 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:52:59.780882+00:00 2022-04-27 17:53:29,884 DEBUG awx.main.dispatch task 1fc0d9c0-7642-4842-b887-8dc38e7e4890 is finished 2022-04-27 17:53:47,778 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(395644c7-f335-4cc4-86fc-d3db57cccf1c, queue=awx_private_queue) [2022-04-27 17:53:47,778: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(395644c7-f335-4cc4-86fc-d3db57cccf1c, queue=awx_private_queue) 2022-04-27 17:53:47,802 DEBUG awx.main.dispatch delivered 395644c7-f335-4cc4-86fc-d3db57cccf1c to worker[183] qsize 0 2022-04-27 17:53:47,806 DEBUG awx.main.dispatch task 395644c7-f335-4cc4-86fc-d3db57cccf1c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:53:47,810 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:53:47,830 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:53:47,857 DEBUG awx.main.dispatch task 395644c7-f335-4cc4-86fc-d3db57cccf1c is finished 2022-04-27 17:53:59,746 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d6269c22-16a2-46d6-bd6e-d48379d0943b, queue=awx_private_queue) [2022-04-27 17:53:59,746: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d6269c22-16a2-46d6-bd6e-d48379d0943b, queue=awx_private_queue) 2022-04-27 17:53:59,780 DEBUG awx.main.dispatch delivered d6269c22-16a2-46d6-bd6e-d48379d0943b to worker[181] qsize 0 2022-04-27 17:53:59,785 DEBUG awx.main.dispatch task d6269c22-16a2-46d6-bd6e-d48379d0943b starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:53:59,800 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:53:59,803 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:53:29.783646+00:00 2022-04-27 17:53:59,863 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(919f3275-9f01-40af-941f-c4dd0a92141b, queue=onap-awx-0) [2022-04-27 17:53:59,863: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(919f3275-9f01-40af-941f-c4dd0a92141b, queue=onap-awx-0) 2022-04-27 17:53:59,895 DEBUG awx.main.dispatch delivered 919f3275-9f01-40af-941f-c4dd0a92141b to worker[183] qsize 0 2022-04-27 17:53:59,897 DEBUG awx.main.dispatch task 919f3275-9f01-40af-941f-c4dd0a92141b starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:53:59,899 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:53:59,925 DEBUG awx.main.dispatch task d6269c22-16a2-46d6-bd6e-d48379d0943b is finished 2022-04-27 17:53:59,926 DEBUG awx.main.dispatch task 919f3275-9f01-40af-941f-c4dd0a92141b is finished 2022-04-27 17:54:00,130 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(e476582e-dac4-41a6-801b-3ccc5de7ceee, queue=onap-awx-0) [2022-04-27 17:54:00,130: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(e476582e-dac4-41a6-801b-3ccc5de7ceee, queue=onap-awx-0) 2022-04-27 17:54:00,447 DEBUG awx.main.dispatch delivered e476582e-dac4-41a6-801b-3ccc5de7ceee to worker[183] qsize 0 RESULT 2 OKREADY 2022-04-27 17:54:00,449 DEBUG awx.main.dispatch task e476582e-dac4-41a6-801b-3ccc5de7ceee starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:54:00,465 DEBUG awx.main.dispatch task e476582e-dac4-41a6-801b-3ccc5de7ceee is finished 2022-04-27 17:54:07,778 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(83ae3065-ef6b-478c-a579-096128d15bdc, queue=awx_private_queue) [2022-04-27 17:54:07,778: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(83ae3065-ef6b-478c-a579-096128d15bdc, queue=awx_private_queue) 2022-04-27 17:54:07,960 DEBUG awx.main.dispatch delivered 83ae3065-ef6b-478c-a579-096128d15bdc to worker[183] qsize 0 2022-04-27 17:54:07,963 DEBUG awx.main.dispatch task 83ae3065-ef6b-478c-a579-096128d15bdc starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:54:07,964 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:54:07,982 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:54:08,015 DEBUG awx.main.dispatch task 83ae3065-ef6b-478c-a579-096128d15bdc is finished 2022-04-27 17:54:27,789 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(465dc719-6b68-4b37-8a40-c479e684ec60, queue=awx_private_queue) [2022-04-27 17:54:27,789: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(465dc719-6b68-4b37-8a40-c479e684ec60, queue=awx_private_queue) 2022-04-27 17:54:27,806 DEBUG awx.main.dispatch delivered 465dc719-6b68-4b37-8a40-c479e684ec60 to worker[183] qsize 0 2022-04-27 17:54:27,810 DEBUG awx.main.dispatch task 465dc719-6b68-4b37-8a40-c479e684ec60 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:54:27,811 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:54:27,833 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:54:27,862 DEBUG awx.main.dispatch task 465dc719-6b68-4b37-8a40-c479e684ec60 is finished 2022-04-27 17:54:29,746 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d262f9d6-e229-48d9-b05b-b45c10a9bc7d, queue=awx_private_queue) [2022-04-27 17:54:29,746: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d262f9d6-e229-48d9-b05b-b45c10a9bc7d, queue=awx_private_queue) 2022-04-27 17:54:29,770 DEBUG awx.main.dispatch delivered d262f9d6-e229-48d9-b05b-b45c10a9bc7d to worker[183] qsize 0 2022-04-27 17:54:29,773 DEBUG awx.main.dispatch task d262f9d6-e229-48d9-b05b-b45c10a9bc7d starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:54:29,783 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:54:29,786 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:53:59.800419+00:00 2022-04-27 17:54:30,096 DEBUG awx.main.dispatch task d262f9d6-e229-48d9-b05b-b45c10a9bc7d is finished 2022-04-27 17:54:47,797 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e869f754-0977-4f16-ab58-001dbefe0e7e, queue=awx_private_queue) [2022-04-27 17:54:47,797: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e869f754-0977-4f16-ab58-001dbefe0e7e, queue=awx_private_queue) 2022-04-27 17:54:47,818 DEBUG awx.main.dispatch delivered e869f754-0977-4f16-ab58-001dbefe0e7e to worker[182] qsize 0 2022-04-27 17:54:47,823 DEBUG awx.main.dispatch task e869f754-0977-4f16-ab58-001dbefe0e7e starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:54:47,826 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:54:47,848 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:54:47,879 DEBUG awx.main.dispatch task e869f754-0977-4f16-ab58-001dbefe0e7e is finished 2022-04-27 17:54:59,749 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(a74eefad-dd7f-4cb5-9351-250d25b6f189, queue=awx_private_queue) [2022-04-27 17:54:59,749: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(a74eefad-dd7f-4cb5-9351-250d25b6f189, queue=awx_private_queue) 2022-04-27 17:54:59,772 DEBUG awx.main.dispatch delivered a74eefad-dd7f-4cb5-9351-250d25b6f189 to worker[182] qsize 0 2022-04-27 17:54:59,775 DEBUG awx.main.dispatch task a74eefad-dd7f-4cb5-9351-250d25b6f189 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:54:59,788 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:54:59,791 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:54:29.783896+00:00 2022-04-27 17:54:59,863 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(229efb76-bcf0-47ec-81db-2df819a18a86, queue=onap-awx-0) [2022-04-27 17:54:59,863: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(229efb76-bcf0-47ec-81db-2df819a18a86, queue=onap-awx-0) 2022-04-27 17:54:59,897 DEBUG awx.main.dispatch delivered 229efb76-bcf0-47ec-81db-2df819a18a86 to worker[180] qsize 0 2022-04-27 17:54:59,899 DEBUG awx.main.dispatch task 229efb76-bcf0-47ec-81db-2df819a18a86 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:54:59,902 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:55:00,130 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(7793e460-e21a-4bce-a0ec-8a2542a755c0, queue=onap-awx-0) [2022-04-27 17:55:00,130: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(7793e460-e21a-4bce-a0ec-8a2542a755c0, queue=onap-awx-0) 2022-04-27 17:55:00,150 DEBUG awx.main.dispatch publish awx.main.tasks.awx_isolated_heartbeat(79993eca-71ad-4fe3-9a4e-7c0150c5be29, queue=onap-awx-0) [2022-04-27 17:55:00,150: DEBUG/Process-1] publish awx.main.tasks.awx_isolated_heartbeat(79993eca-71ad-4fe3-9a4e-7c0150c5be29, queue=onap-awx-0) RESULT 2 OKREADY 2022-04-27 17:55:00,329 DEBUG awx.main.dispatch task 229efb76-bcf0-47ec-81db-2df819a18a86 is finished 2022-04-27 17:55:00,416 DEBUG awx.main.dispatch task a74eefad-dd7f-4cb5-9351-250d25b6f189 is finished 2022-04-27 17:55:00,434 DEBUG awx.main.dispatch delivered 7793e460-e21a-4bce-a0ec-8a2542a755c0 to worker[183] qsize 0 2022-04-27 17:55:00,437 DEBUG awx.main.dispatch delivered 79993eca-71ad-4fe3-9a4e-7c0150c5be29 to worker[180] qsize 0 2022-04-27 17:55:00,437 DEBUG awx.main.dispatch task 7793e460-e21a-4bce-a0ec-8a2542a755c0 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:55:00,439 DEBUG awx.main.dispatch task 79993eca-71ad-4fe3-9a4e-7c0150c5be29 starting awx.main.tasks.awx_isolated_heartbeat(*[]) 2022-04-27 17:55:00,441 DEBUG awx.main.tasks Controlling node checking for any isolated management tasks. 2022-04-27 17:55:00,453 DEBUG awx.main.dispatch task 7793e460-e21a-4bce-a0ec-8a2542a755c0 is finished 2022-04-27 17:55:00,456 DEBUG awx.main.dispatch task 79993eca-71ad-4fe3-9a4e-7c0150c5be29 is finished 2022-04-27 17:55:07,797 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(800909cf-2d6b-46bc-b6b6-0de5f5b68d76, queue=awx_private_queue) [2022-04-27 17:55:07,797: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(800909cf-2d6b-46bc-b6b6-0de5f5b68d76, queue=awx_private_queue) 2022-04-27 17:55:08,010 DEBUG awx.main.dispatch delivered 800909cf-2d6b-46bc-b6b6-0de5f5b68d76 to worker[183] qsize 0 2022-04-27 17:55:08,013 DEBUG awx.main.dispatch task 800909cf-2d6b-46bc-b6b6-0de5f5b68d76 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:55:08,015 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:55:08,033 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:55:08,062 DEBUG awx.main.dispatch task 800909cf-2d6b-46bc-b6b6-0de5f5b68d76 is finished 2022-04-27 17:55:28,110 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(fa80cbf5-fad2-49df-82d9-87727277f533, queue=awx_private_queue) [2022-04-27 17:55:28,110: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(fa80cbf5-fad2-49df-82d9-87727277f533, queue=awx_private_queue) 2022-04-27 17:55:28,126 DEBUG awx.main.dispatch delivered fa80cbf5-fad2-49df-82d9-87727277f533 to worker[183] qsize 0 2022-04-27 17:55:28,129 DEBUG awx.main.dispatch task fa80cbf5-fad2-49df-82d9-87727277f533 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:55:28,131 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:55:28,149 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:55:28,184 DEBUG awx.main.dispatch task fa80cbf5-fad2-49df-82d9-87727277f533 is finished 2022-04-27 17:55:29,749 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(7df96ef9-b880-4ad8-b18d-86e725c0b5e8, queue=awx_private_queue) [2022-04-27 17:55:29,749: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(7df96ef9-b880-4ad8-b18d-86e725c0b5e8, queue=awx_private_queue) 2022-04-27 17:55:29,765 DEBUG awx.main.dispatch delivered 7df96ef9-b880-4ad8-b18d-86e725c0b5e8 to worker[180] qsize 0 2022-04-27 17:55:29,768 DEBUG awx.main.dispatch task 7df96ef9-b880-4ad8-b18d-86e725c0b5e8 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:55:29,778 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:55:29,782 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:54:59.788580+00:00 2022-04-27 17:55:29,801 DEBUG awx.main.dispatch task 7df96ef9-b880-4ad8-b18d-86e725c0b5e8 is finished 2022-04-27 17:55:48,119 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(830c9a8a-bafb-4ce6-8906-26b7d2e177b1, queue=awx_private_queue) [2022-04-27 17:55:48,119: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(830c9a8a-bafb-4ce6-8906-26b7d2e177b1, queue=awx_private_queue) 2022-04-27 17:55:48,135 DEBUG awx.main.dispatch delivered 830c9a8a-bafb-4ce6-8906-26b7d2e177b1 to worker[182] qsize 0 2022-04-27 17:55:48,139 DEBUG awx.main.dispatch task 830c9a8a-bafb-4ce6-8906-26b7d2e177b1 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:55:48,144 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:55:48,164 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:55:48,193 DEBUG awx.main.dispatch task 830c9a8a-bafb-4ce6-8906-26b7d2e177b1 is finished 2022-04-27 17:55:59,752 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(2d789131-6a85-4e98-a4ef-5f27ab8a1e38, queue=awx_private_queue) [2022-04-27 17:55:59,752: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(2d789131-6a85-4e98-a4ef-5f27ab8a1e38, queue=awx_private_queue) 2022-04-27 17:55:59,775 DEBUG awx.main.dispatch delivered 2d789131-6a85-4e98-a4ef-5f27ab8a1e38 to worker[180] qsize 0 2022-04-27 17:55:59,778 DEBUG awx.main.dispatch task 2d789131-6a85-4e98-a4ef-5f27ab8a1e38 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:55:59,791 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:55:59,794 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:55:29.779125+00:00 2022-04-27 17:55:59,863 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(7146d0c1-bae0-4c58-9be1-f687fc143958, queue=onap-awx-0) [2022-04-27 17:55:59,863: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(7146d0c1-bae0-4c58-9be1-f687fc143958, queue=onap-awx-0) 2022-04-27 17:55:59,894 DEBUG awx.main.dispatch delivered 7146d0c1-bae0-4c58-9be1-f687fc143958 to worker[181] qsize 0 2022-04-27 17:55:59,897 DEBUG awx.main.dispatch task 7146d0c1-bae0-4c58-9be1-f687fc143958 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:55:59,901 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:56:00,129 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(89b8bf62-d0de-4852-a557-1f136b72f57e, queue=onap-awx-0) [2022-04-27 17:56:00,129: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(89b8bf62-d0de-4852-a557-1f136b72f57e, queue=onap-awx-0) RESULT 2 OKREADY 2022-04-27 17:56:00,146 DEBUG awx.main.dispatch task 7146d0c1-bae0-4c58-9be1-f687fc143958 is finished 2022-04-27 17:56:00,300 DEBUG awx.main.dispatch task 2d789131-6a85-4e98-a4ef-5f27ab8a1e38 is finished 2022-04-27 17:56:00,954 DEBUG awx.main.dispatch delivered 89b8bf62-d0de-4852-a557-1f136b72f57e to worker[182] qsize 0 2022-04-27 17:56:00,957 DEBUG awx.main.dispatch task 89b8bf62-d0de-4852-a557-1f136b72f57e starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:56:00,973 DEBUG awx.main.dispatch task 89b8bf62-d0de-4852-a557-1f136b72f57e is finished 2022-04-27 17:56:08,119 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(98fc54fb-a40e-44c4-9e76-33ccbc8cf626, queue=awx_private_queue) [2022-04-27 17:56:08,119: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(98fc54fb-a40e-44c4-9e76-33ccbc8cf626, queue=awx_private_queue) 2022-04-27 17:56:08,309 DEBUG awx.main.dispatch delivered 98fc54fb-a40e-44c4-9e76-33ccbc8cf626 to worker[181] qsize 0 2022-04-27 17:56:08,312 DEBUG awx.main.dispatch task 98fc54fb-a40e-44c4-9e76-33ccbc8cf626 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:56:08,314 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:56:08,333 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:56:08,363 DEBUG awx.main.dispatch task 98fc54fb-a40e-44c4-9e76-33ccbc8cf626 is finished 2022-04-27 17:56:28,119 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(9dfaed42-a51f-477a-bfe0-2f1f9430de42, queue=awx_private_queue) [2022-04-27 17:56:28,119: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(9dfaed42-a51f-477a-bfe0-2f1f9430de42, queue=awx_private_queue) 2022-04-27 17:56:28,137 DEBUG awx.main.dispatch delivered 9dfaed42-a51f-477a-bfe0-2f1f9430de42 to worker[182] qsize 0 2022-04-27 17:56:28,143 DEBUG awx.main.dispatch task 9dfaed42-a51f-477a-bfe0-2f1f9430de42 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:56:28,145 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:56:28,167 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:56:28,196 DEBUG awx.main.dispatch task 9dfaed42-a51f-477a-bfe0-2f1f9430de42 is finished 2022-04-27 17:56:29,751 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(06738dc4-45d5-429b-a490-7a343c756c08, queue=awx_private_queue) [2022-04-27 17:56:29,751: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(06738dc4-45d5-429b-a490-7a343c756c08, queue=awx_private_queue) 2022-04-27 17:56:29,771 DEBUG awx.main.dispatch delivered 06738dc4-45d5-429b-a490-7a343c756c08 to worker[183] qsize 0 2022-04-27 17:56:29,774 DEBUG awx.main.dispatch task 06738dc4-45d5-429b-a490-7a343c756c08 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:56:29,786 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:56:29,790 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:55:59.791530+00:00 2022-04-27 17:56:29,808 DEBUG awx.main.dispatch task 06738dc4-45d5-429b-a490-7a343c756c08 is finished 2022-04-27 17:56:48,127 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d9f78185-6713-47c6-b1cb-21d120033639, queue=awx_private_queue) [2022-04-27 17:56:48,127: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d9f78185-6713-47c6-b1cb-21d120033639, queue=awx_private_queue) 2022-04-27 17:56:48,150 DEBUG awx.main.dispatch delivered d9f78185-6713-47c6-b1cb-21d120033639 to worker[183] qsize 0 2022-04-27 17:56:48,153 DEBUG awx.main.dispatch task d9f78185-6713-47c6-b1cb-21d120033639 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:56:48,154 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:56:48,178 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:56:48,208 DEBUG awx.main.dispatch task d9f78185-6713-47c6-b1cb-21d120033639 is finished 2022-04-27 17:56:59,754 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(bf59d838-0af3-4bbf-bcfa-30b6f8c35279, queue=awx_private_queue) [2022-04-27 17:56:59,754: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(bf59d838-0af3-4bbf-bcfa-30b6f8c35279, queue=awx_private_queue) 2022-04-27 17:56:59,774 DEBUG awx.main.dispatch delivered bf59d838-0af3-4bbf-bcfa-30b6f8c35279 to worker[181] qsize 0 2022-04-27 17:56:59,777 DEBUG awx.main.dispatch task bf59d838-0af3-4bbf-bcfa-30b6f8c35279 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:56:59,790 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:56:59,794 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:56:29.786625+00:00 2022-04-27 17:56:59,863 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(09ce2e01-674b-4171-ba6e-ff1d5671e93d, queue=onap-awx-0) [2022-04-27 17:56:59,863: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(09ce2e01-674b-4171-ba6e-ff1d5671e93d, queue=onap-awx-0) 2022-04-27 17:56:59,893 DEBUG awx.main.dispatch delivered 09ce2e01-674b-4171-ba6e-ff1d5671e93d to worker[180] qsize 0 2022-04-27 17:56:59,896 DEBUG awx.main.dispatch task 09ce2e01-674b-4171-ba6e-ff1d5671e93d starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:56:59,898 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:57:00,128 DEBUG awx.main.dispatch task 09ce2e01-674b-4171-ba6e-ff1d5671e93d is finished 2022-04-27 17:57:00,129 DEBUG awx.main.dispatch task bf59d838-0af3-4bbf-bcfa-30b6f8c35279 is finished RESULT 2 OKREADY 2022-04-27 17:57:00,130 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(e2e42ca2-220f-4fb1-8aed-411597a04cc2, queue=onap-awx-0) [2022-04-27 17:57:00,130: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(e2e42ca2-220f-4fb1-8aed-411597a04cc2, queue=onap-awx-0) 2022-04-27 17:57:00,429 DEBUG awx.main.dispatch delivered e2e42ca2-220f-4fb1-8aed-411597a04cc2 to worker[181] qsize 0 2022-04-27 17:57:00,431 DEBUG awx.main.dispatch task e2e42ca2-220f-4fb1-8aed-411597a04cc2 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:57:00,446 DEBUG awx.main.dispatch task e2e42ca2-220f-4fb1-8aed-411597a04cc2 is finished 2022-04-27 17:57:08,128 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(2b15dfe1-4162-4ce8-90c6-092adf055dee, queue=awx_private_queue) [2022-04-27 17:57:08,128: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(2b15dfe1-4162-4ce8-90c6-092adf055dee, queue=awx_private_queue) 2022-04-27 17:57:08,321 DEBUG awx.main.dispatch delivered 2b15dfe1-4162-4ce8-90c6-092adf055dee to worker[182] qsize 0 2022-04-27 17:57:08,324 DEBUG awx.main.dispatch task 2b15dfe1-4162-4ce8-90c6-092adf055dee starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:57:08,327 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:57:08,344 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:57:08,374 DEBUG awx.main.dispatch task 2b15dfe1-4162-4ce8-90c6-092adf055dee is finished 2022-04-27 17:57:28,138 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c4a98fcf-623b-4d57-8801-7166bd31b6bc, queue=awx_private_queue) [2022-04-27 17:57:28,138: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c4a98fcf-623b-4d57-8801-7166bd31b6bc, queue=awx_private_queue) 2022-04-27 17:57:28,155 DEBUG awx.main.dispatch delivered c4a98fcf-623b-4d57-8801-7166bd31b6bc to worker[182] qsize 0 2022-04-27 17:57:28,159 DEBUG awx.main.dispatch task c4a98fcf-623b-4d57-8801-7166bd31b6bc starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:57:28,161 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:57:28,186 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:57:28,219 DEBUG awx.main.dispatch task c4a98fcf-623b-4d57-8801-7166bd31b6bc is finished 2022-04-27 17:57:29,754 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(cb16b983-0c20-4443-bf52-f4a7853fbbfe, queue=awx_private_queue) [2022-04-27 17:57:29,754: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(cb16b983-0c20-4443-bf52-f4a7853fbbfe, queue=awx_private_queue) 2022-04-27 17:57:29,774 DEBUG awx.main.dispatch delivered cb16b983-0c20-4443-bf52-f4a7853fbbfe to worker[182] qsize 0 2022-04-27 17:57:29,777 DEBUG awx.main.dispatch task cb16b983-0c20-4443-bf52-f4a7853fbbfe starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:57:29,789 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:57:29,792 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:56:59.791019+00:00 2022-04-27 17:57:30,006 DEBUG awx.main.dispatch task cb16b983-0c20-4443-bf52-f4a7853fbbfe is finished 2022-04-27 17:57:48,146 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(94c2c6c6-77ff-416f-8c19-a35681b7b91a, queue=awx_private_queue) [2022-04-27 17:57:48,146: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(94c2c6c6-77ff-416f-8c19-a35681b7b91a, queue=awx_private_queue) 2022-04-27 17:57:48,165 DEBUG awx.main.dispatch delivered 94c2c6c6-77ff-416f-8c19-a35681b7b91a to worker[180] qsize 0 2022-04-27 17:57:48,168 DEBUG awx.main.dispatch task 94c2c6c6-77ff-416f-8c19-a35681b7b91a starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:57:48,169 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:57:48,189 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:57:48,224 DEBUG awx.main.dispatch task 94c2c6c6-77ff-416f-8c19-a35681b7b91a is finished 2022-04-27 17:57:59,757 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(aaff6d20-8716-4618-af22-4ccb4f591b8f, queue=awx_private_queue) [2022-04-27 17:57:59,757: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(aaff6d20-8716-4618-af22-4ccb4f591b8f, queue=awx_private_queue) 2022-04-27 17:57:59,778 DEBUG awx.main.dispatch delivered aaff6d20-8716-4618-af22-4ccb4f591b8f to worker[181] qsize 0 2022-04-27 17:57:59,782 DEBUG awx.main.dispatch task aaff6d20-8716-4618-af22-4ccb4f591b8f starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:57:59,796 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:57:59,800 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:57:29.789693+00:00 2022-04-27 17:57:59,863 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(a5197364-ab81-477b-bace-045801adb459, queue=onap-awx-0) [2022-04-27 17:57:59,863: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(a5197364-ab81-477b-bace-045801adb459, queue=onap-awx-0) 2022-04-27 17:57:59,900 DEBUG awx.main.dispatch delivered a5197364-ab81-477b-bace-045801adb459 to worker[183] qsize 0 2022-04-27 17:57:59,903 DEBUG awx.main.dispatch task a5197364-ab81-477b-bace-045801adb459 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:57:59,905 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:58:00,130 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(aaf0facd-3f09-44c6-92e0-5901d35b8bc9, queue=onap-awx-0) [2022-04-27 17:58:00,130: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(aaf0facd-3f09-44c6-92e0-5901d35b8bc9, queue=onap-awx-0) 2022-04-27 17:58:00,292 DEBUG awx.main.dispatch task a5197364-ab81-477b-bace-045801adb459 is finished RESULT 2 OKREADY 2022-04-27 17:58:00,297 DEBUG awx.main.dispatch task aaff6d20-8716-4618-af22-4ccb4f591b8f is finished 2022-04-27 17:58:00,759 DEBUG awx.main.dispatch delivered aaf0facd-3f09-44c6-92e0-5901d35b8bc9 to worker[183] qsize 0 2022-04-27 17:58:00,763 DEBUG awx.main.dispatch task aaf0facd-3f09-44c6-92e0-5901d35b8bc9 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:58:00,777 DEBUG awx.main.dispatch task aaf0facd-3f09-44c6-92e0-5901d35b8bc9 is finished 2022-04-27 17:58:08,147 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(604fe7d1-e370-4d0c-aa8a-9ba9367ff0af, queue=awx_private_queue) [2022-04-27 17:58:08,147: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(604fe7d1-e370-4d0c-aa8a-9ba9367ff0af, queue=awx_private_queue) 2022-04-27 17:58:08,357 DEBUG awx.main.dispatch delivered 604fe7d1-e370-4d0c-aa8a-9ba9367ff0af to worker[183] qsize 0 2022-04-27 17:58:08,360 DEBUG awx.main.dispatch task 604fe7d1-e370-4d0c-aa8a-9ba9367ff0af starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:58:08,362 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:58:08,380 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:58:08,411 DEBUG awx.main.dispatch task 604fe7d1-e370-4d0c-aa8a-9ba9367ff0af is finished 2022-04-27 17:58:28,265 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a8e0a34b-4f59-4aeb-8c0d-201474494ab3, queue=awx_private_queue) [2022-04-27 17:58:28,265: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a8e0a34b-4f59-4aeb-8c0d-201474494ab3, queue=awx_private_queue) 2022-04-27 17:58:28,285 DEBUG awx.main.dispatch delivered a8e0a34b-4f59-4aeb-8c0d-201474494ab3 to worker[182] qsize 0 2022-04-27 17:58:28,290 DEBUG awx.main.dispatch task a8e0a34b-4f59-4aeb-8c0d-201474494ab3 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:58:28,294 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:58:28,314 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:58:28,349 DEBUG awx.main.dispatch task a8e0a34b-4f59-4aeb-8c0d-201474494ab3 is finished 2022-04-27 17:58:29,756 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(f7be4a16-fb22-4b54-bc0b-9de459a0b71a, queue=awx_private_queue) [2022-04-27 17:58:29,756: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(f7be4a16-fb22-4b54-bc0b-9de459a0b71a, queue=awx_private_queue) 2022-04-27 17:58:29,779 DEBUG awx.main.dispatch delivered f7be4a16-fb22-4b54-bc0b-9de459a0b71a to worker[181] qsize 0 2022-04-27 17:58:29,782 DEBUG awx.main.dispatch task f7be4a16-fb22-4b54-bc0b-9de459a0b71a starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:58:29,793 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:58:29,796 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:57:59.796311+00:00 2022-04-27 17:58:30,008 DEBUG awx.main.dispatch task f7be4a16-fb22-4b54-bc0b-9de459a0b71a is finished 2022-04-27 17:58:48,273 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d5adb465-1f0a-44ab-b3d6-10c2ec86cd9c, queue=awx_private_queue) [2022-04-27 17:58:48,273: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d5adb465-1f0a-44ab-b3d6-10c2ec86cd9c, queue=awx_private_queue) 2022-04-27 17:58:48,295 DEBUG awx.main.dispatch delivered d5adb465-1f0a-44ab-b3d6-10c2ec86cd9c to worker[181] qsize 0 2022-04-27 17:58:48,298 DEBUG awx.main.dispatch task d5adb465-1f0a-44ab-b3d6-10c2ec86cd9c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:58:48,300 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:58:48,322 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:58:48,356 DEBUG awx.main.dispatch task d5adb465-1f0a-44ab-b3d6-10c2ec86cd9c is finished 2022-04-27 17:58:59,758 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(ef08fe55-d8c4-46e6-ac4b-b0edfac50782, queue=awx_private_queue) [2022-04-27 17:58:59,758: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(ef08fe55-d8c4-46e6-ac4b-b0edfac50782, queue=awx_private_queue) 2022-04-27 17:58:59,777 DEBUG awx.main.dispatch delivered ef08fe55-d8c4-46e6-ac4b-b0edfac50782 to worker[180] qsize 0 2022-04-27 17:58:59,780 DEBUG awx.main.dispatch task ef08fe55-d8c4-46e6-ac4b-b0edfac50782 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:58:59,792 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:58:59,796 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:58:29.793972+00:00 2022-04-27 17:58:59,813 DEBUG awx.main.dispatch task ef08fe55-d8c4-46e6-ac4b-b0edfac50782 is finished 2022-04-27 17:58:59,863 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(256bc633-f735-40cb-8065-2ec33b93ac9f, queue=onap-awx-0) [2022-04-27 17:58:59,863: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(256bc633-f735-40cb-8065-2ec33b93ac9f, queue=onap-awx-0) 2022-04-27 17:58:59,889 DEBUG awx.main.dispatch delivered 256bc633-f735-40cb-8065-2ec33b93ac9f to worker[183] qsize 0 2022-04-27 17:58:59,891 DEBUG awx.main.dispatch task 256bc633-f735-40cb-8065-2ec33b93ac9f starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:58:59,893 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 17:58:59,920 DEBUG awx.main.dispatch task 256bc633-f735-40cb-8065-2ec33b93ac9f is finished 2022-04-27 17:59:00,130 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(75fa8e52-60ea-46ea-b21d-00af95893687, queue=onap-awx-0) [2022-04-27 17:59:00,130: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(75fa8e52-60ea-46ea-b21d-00af95893687, queue=onap-awx-0) 2022-04-27 17:59:00,637 DEBUG awx.main.dispatch delivered 75fa8e52-60ea-46ea-b21d-00af95893687 to worker[182] qsize 0 RESULT 2 OKREADY 2022-04-27 17:59:00,640 DEBUG awx.main.dispatch task 75fa8e52-60ea-46ea-b21d-00af95893687 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 17:59:00,653 DEBUG awx.main.dispatch task 75fa8e52-60ea-46ea-b21d-00af95893687 is finished 2022-04-27 17:59:08,273 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c88d5d72-77d5-4fa4-b7fa-f708d940516a, queue=awx_private_queue) [2022-04-27 17:59:08,273: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c88d5d72-77d5-4fa4-b7fa-f708d940516a, queue=awx_private_queue) 2022-04-27 17:59:08,465 DEBUG awx.main.dispatch delivered c88d5d72-77d5-4fa4-b7fa-f708d940516a to worker[181] qsize 0 2022-04-27 17:59:08,469 DEBUG awx.main.dispatch task c88d5d72-77d5-4fa4-b7fa-f708d940516a starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:59:08,472 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:59:08,488 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:59:08,515 DEBUG awx.main.dispatch task c88d5d72-77d5-4fa4-b7fa-f708d940516a is finished 2022-04-27 17:59:28,273 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(aefb26e8-153a-4caa-b0f4-aaace51e60d0, queue=awx_private_queue) [2022-04-27 17:59:28,273: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(aefb26e8-153a-4caa-b0f4-aaace51e60d0, queue=awx_private_queue) 2022-04-27 17:59:28,290 DEBUG awx.main.dispatch delivered aefb26e8-153a-4caa-b0f4-aaace51e60d0 to worker[181] qsize 0 2022-04-27 17:59:28,294 DEBUG awx.main.dispatch task aefb26e8-153a-4caa-b0f4-aaace51e60d0 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:59:28,295 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:59:28,324 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:59:28,354 DEBUG awx.main.dispatch task aefb26e8-153a-4caa-b0f4-aaace51e60d0 is finished 2022-04-27 17:59:29,759 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(9614c14d-371c-45b4-94b3-1346bb9f64d4, queue=awx_private_queue) [2022-04-27 17:59:29,759: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(9614c14d-371c-45b4-94b3-1346bb9f64d4, queue=awx_private_queue) 2022-04-27 17:59:29,777 DEBUG awx.main.dispatch delivered 9614c14d-371c-45b4-94b3-1346bb9f64d4 to worker[180] qsize 0 2022-04-27 17:59:29,787 DEBUG awx.main.dispatch task 9614c14d-371c-45b4-94b3-1346bb9f64d4 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:59:29,797 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:59:29,800 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:58:59.793145+00:00 2022-04-27 17:59:30,147 DEBUG awx.main.dispatch task 9614c14d-371c-45b4-94b3-1346bb9f64d4 is finished 2022-04-27 17:59:48,280 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c924fd28-726d-4dfb-802d-050eaae51605, queue=awx_private_queue) [2022-04-27 17:59:48,280: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c924fd28-726d-4dfb-802d-050eaae51605, queue=awx_private_queue) 2022-04-27 17:59:48,302 DEBUG awx.main.dispatch delivered c924fd28-726d-4dfb-802d-050eaae51605 to worker[180] qsize 0 2022-04-27 17:59:48,304 DEBUG awx.main.dispatch task c924fd28-726d-4dfb-802d-050eaae51605 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 17:59:48,306 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 17:59:48,322 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 17:59:48,348 DEBUG awx.main.dispatch task c924fd28-726d-4dfb-802d-050eaae51605 is finished 2022-04-27 17:59:59,761 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(de65ea0f-372f-46d6-afba-bbde27bb5508, queue=awx_private_queue) [2022-04-27 17:59:59,761: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(de65ea0f-372f-46d6-afba-bbde27bb5508, queue=awx_private_queue) 2022-04-27 17:59:59,780 DEBUG awx.main.dispatch delivered de65ea0f-372f-46d6-afba-bbde27bb5508 to worker[181] qsize 0 2022-04-27 17:59:59,783 DEBUG awx.main.dispatch task de65ea0f-372f-46d6-afba-bbde27bb5508 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 17:59:59,795 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 17:59:59,799 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:59:29.797707+00:00 2022-04-27 17:59:59,863 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(c432005f-2056-4270-b3d9-6fa88cac4422, queue=onap-awx-0) [2022-04-27 17:59:59,863: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(c432005f-2056-4270-b3d9-6fa88cac4422, queue=onap-awx-0) 2022-04-27 17:59:59,895 DEBUG awx.main.dispatch delivered c432005f-2056-4270-b3d9-6fa88cac4422 to worker[182] qsize 0 2022-04-27 17:59:59,898 DEBUG awx.main.dispatch task c432005f-2056-4270-b3d9-6fa88cac4422 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 17:59:59,901 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 18:00:00,001 DEBUG awx.main.dispatch publish awx.main.tasks.gather_analytics(b84e669c-6d8c-49ac-8b2f-4349e27f5503, queue=awx_private_queue) [2022-04-27 18:00:00,001: DEBUG/Process-1] publish awx.main.tasks.gather_analytics(b84e669c-6d8c-49ac-8b2f-4349e27f5503, queue=awx_private_queue) 2022-04-27 18:00:00,130 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(8b057496-8977-4fb8-8960-b49525a35c43, queue=onap-awx-0) [2022-04-27 18:00:00,130: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(8b057496-8977-4fb8-8960-b49525a35c43, queue=onap-awx-0) RESULT 2 OKREADY 2022-04-27 18:00:00,207 DEBUG awx.main.dispatch task c432005f-2056-4270-b3d9-6fa88cac4422 is finished 2022-04-27 18:00:00,221 DEBUG awx.main.dispatch task de65ea0f-372f-46d6-afba-bbde27bb5508 is finished 2022-04-27 18:00:00,376 DEBUG awx.main.dispatch delivered b84e669c-6d8c-49ac-8b2f-4349e27f5503 to worker[182] qsize 0 2022-04-27 18:00:00,379 DEBUG awx.main.dispatch task b84e669c-6d8c-49ac-8b2f-4349e27f5503 starting awx.main.tasks.gather_analytics(*[]) 2022-04-27 18:00:00,380 DEBUG awx.main.dispatch delivered 8b057496-8977-4fb8-8960-b49525a35c43 to worker[180] qsize 0 2022-04-27 18:00:00,381 DEBUG awx.main.dispatch task b84e669c-6d8c-49ac-8b2f-4349e27f5503 is finished 2022-04-27 18:00:00,382 DEBUG awx.main.dispatch task 8b057496-8977-4fb8-8960-b49525a35c43 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 18:00:00,397 DEBUG awx.main.dispatch task 8b057496-8977-4fb8-8960-b49525a35c43 is finished 2022-04-27 18:00:08,280 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c2545f95-193a-4dc7-9f63-6af24754fa8d, queue=awx_private_queue) [2022-04-27 18:00:08,280: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c2545f95-193a-4dc7-9f63-6af24754fa8d, queue=awx_private_queue) 2022-04-27 18:00:08,479 DEBUG awx.main.dispatch delivered c2545f95-193a-4dc7-9f63-6af24754fa8d to worker[182] qsize 0 2022-04-27 18:00:08,481 DEBUG awx.main.dispatch task c2545f95-193a-4dc7-9f63-6af24754fa8d starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:00:08,483 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:00:08,501 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:00:08,532 DEBUG awx.main.dispatch task c2545f95-193a-4dc7-9f63-6af24754fa8d is finished 2022-04-27 18:00:28,281 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(fd445850-b1d4-42b1-b21c-7ff99f304caa, queue=awx_private_queue) [2022-04-27 18:00:28,281: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(fd445850-b1d4-42b1-b21c-7ff99f304caa, queue=awx_private_queue) 2022-04-27 18:00:28,298 DEBUG awx.main.dispatch delivered fd445850-b1d4-42b1-b21c-7ff99f304caa to worker[182] qsize 0 2022-04-27 18:00:28,302 DEBUG awx.main.dispatch task fd445850-b1d4-42b1-b21c-7ff99f304caa starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:00:28,303 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:00:28,321 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:00:28,347 DEBUG awx.main.dispatch task fd445850-b1d4-42b1-b21c-7ff99f304caa is finished 2022-04-27 18:00:29,760 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(96ed06c5-de04-4298-985a-b8d2100e7174, queue=awx_private_queue) [2022-04-27 18:00:29,760: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(96ed06c5-de04-4298-985a-b8d2100e7174, queue=awx_private_queue) 2022-04-27 18:00:29,777 DEBUG awx.main.dispatch delivered 96ed06c5-de04-4298-985a-b8d2100e7174 to worker[182] qsize 0 2022-04-27 18:00:29,780 DEBUG awx.main.dispatch task 96ed06c5-de04-4298-985a-b8d2100e7174 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:00:29,790 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:00:29,793 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 17:59:59.796285+00:00 2022-04-27 18:00:30,182 DEBUG awx.main.dispatch task 96ed06c5-de04-4298-985a-b8d2100e7174 is finished 2022-04-27 18:00:48,286 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e8eabfc5-54a9-4bf1-b5e4-0890299b66e1, queue=awx_private_queue) [2022-04-27 18:00:48,286: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e8eabfc5-54a9-4bf1-b5e4-0890299b66e1, queue=awx_private_queue) 2022-04-27 18:00:48,306 DEBUG awx.main.dispatch delivered e8eabfc5-54a9-4bf1-b5e4-0890299b66e1 to worker[182] qsize 0 2022-04-27 18:00:48,309 DEBUG awx.main.dispatch task e8eabfc5-54a9-4bf1-b5e4-0890299b66e1 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:00:48,311 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:00:48,328 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:00:48,356 DEBUG awx.main.dispatch task e8eabfc5-54a9-4bf1-b5e4-0890299b66e1 is finished 2022-04-27 18:00:59,763 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d630e116-7d3a-4956-8a39-e5434a39d704, queue=awx_private_queue) [2022-04-27 18:00:59,763: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d630e116-7d3a-4956-8a39-e5434a39d704, queue=awx_private_queue) 2022-04-27 18:00:59,787 DEBUG awx.main.dispatch delivered d630e116-7d3a-4956-8a39-e5434a39d704 to worker[180] qsize 0 2022-04-27 18:00:59,790 DEBUG awx.main.dispatch task d630e116-7d3a-4956-8a39-e5434a39d704 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:00:59,804 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:00:59,807 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:00:29.790735+00:00 2022-04-27 18:00:59,826 DEBUG awx.main.dispatch task d630e116-7d3a-4956-8a39-e5434a39d704 is finished 2022-04-27 18:00:59,863 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(b93e32d7-9f64-46da-8c27-6f9f9b736746, queue=onap-awx-0) [2022-04-27 18:00:59,863: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(b93e32d7-9f64-46da-8c27-6f9f9b736746, queue=onap-awx-0) 2022-04-27 18:00:59,895 DEBUG awx.main.dispatch delivered b93e32d7-9f64-46da-8c27-6f9f9b736746 to worker[182] qsize 0 2022-04-27 18:00:59,898 DEBUG awx.main.dispatch task b93e32d7-9f64-46da-8c27-6f9f9b736746 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 18:00:59,900 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 18:00:59,924 DEBUG awx.main.dispatch task b93e32d7-9f64-46da-8c27-6f9f9b736746 is finished 2022-04-27 18:01:00,001 DEBUG awx.main.dispatch publish awx.main.tasks.gather_analytics(b1eb74bf-b1c0-4a0b-80d8-7fde54698461, queue=awx_private_queue) [2022-04-27 18:01:00,001: DEBUG/Process-1] publish awx.main.tasks.gather_analytics(b1eb74bf-b1c0-4a0b-80d8-7fde54698461, queue=awx_private_queue) 2022-04-27 18:01:00,130 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(421df548-de0e-487e-8b9b-ec9b1fc8f90f, queue=onap-awx-0) [2022-04-27 18:01:00,130: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(421df548-de0e-487e-8b9b-ec9b1fc8f90f, queue=onap-awx-0) RESULT 2 OKREADY 2022-04-27 18:01:00,398 DEBUG awx.main.dispatch delivered b1eb74bf-b1c0-4a0b-80d8-7fde54698461 to worker[183] qsize 0 2022-04-27 18:01:00,402 DEBUG awx.main.dispatch task b1eb74bf-b1c0-4a0b-80d8-7fde54698461 starting awx.main.tasks.gather_analytics(*[]) 2022-04-27 18:01:00,407 DEBUG awx.main.dispatch task b1eb74bf-b1c0-4a0b-80d8-7fde54698461 is finished 2022-04-27 18:01:00,426 DEBUG awx.main.dispatch delivered 421df548-de0e-487e-8b9b-ec9b1fc8f90f to worker[180] qsize 0 2022-04-27 18:01:00,429 DEBUG awx.main.dispatch task 421df548-de0e-487e-8b9b-ec9b1fc8f90f starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 18:01:00,445 DEBUG awx.main.dispatch task 421df548-de0e-487e-8b9b-ec9b1fc8f90f is finished 2022-04-27 18:01:08,286 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f630a8b5-37c9-41c6-ac17-3d5321794858, queue=awx_private_queue) [2022-04-27 18:01:08,286: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f630a8b5-37c9-41c6-ac17-3d5321794858, queue=awx_private_queue) 2022-04-27 18:01:08,482 DEBUG awx.main.dispatch delivered f630a8b5-37c9-41c6-ac17-3d5321794858 to worker[181] qsize 0 2022-04-27 18:01:08,485 DEBUG awx.main.dispatch task f630a8b5-37c9-41c6-ac17-3d5321794858 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:01:08,490 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:01:08,505 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:01:08,535 DEBUG awx.main.dispatch task f630a8b5-37c9-41c6-ac17-3d5321794858 is finished 2022-04-27 18:01:28,551 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c38a9778-afcb-42c6-be8d-62bd40478525, queue=awx_private_queue) [2022-04-27 18:01:28,551: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c38a9778-afcb-42c6-be8d-62bd40478525, queue=awx_private_queue) 2022-04-27 18:01:28,575 DEBUG awx.main.dispatch delivered c38a9778-afcb-42c6-be8d-62bd40478525 to worker[182] qsize 0 2022-04-27 18:01:28,579 DEBUG awx.main.dispatch task c38a9778-afcb-42c6-be8d-62bd40478525 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:01:28,581 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:01:28,605 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:01:28,633 DEBUG awx.main.dispatch task c38a9778-afcb-42c6-be8d-62bd40478525 is finished 2022-04-27 18:01:29,763 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(74a6d3cc-a041-481e-86c6-f106814e8363, queue=awx_private_queue) [2022-04-27 18:01:29,763: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(74a6d3cc-a041-481e-86c6-f106814e8363, queue=awx_private_queue) 2022-04-27 18:01:29,779 DEBUG awx.main.dispatch delivered 74a6d3cc-a041-481e-86c6-f106814e8363 to worker[180] qsize 0 2022-04-27 18:01:29,783 DEBUG awx.main.dispatch task 74a6d3cc-a041-481e-86c6-f106814e8363 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:01:29,793 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:01:29,796 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:00:59.804255+00:00 2022-04-27 18:01:30,204 DEBUG awx.main.dispatch task 74a6d3cc-a041-481e-86c6-f106814e8363 is finished 2022-04-27 18:01:48,553 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(24142d06-3a57-4a5e-8af5-cc78835f0065, queue=awx_private_queue) [2022-04-27 18:01:48,553: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(24142d06-3a57-4a5e-8af5-cc78835f0065, queue=awx_private_queue) 2022-04-27 18:01:48,571 DEBUG awx.main.dispatch delivered 24142d06-3a57-4a5e-8af5-cc78835f0065 to worker[183] qsize 0 2022-04-27 18:01:48,573 DEBUG awx.main.dispatch task 24142d06-3a57-4a5e-8af5-cc78835f0065 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:01:48,574 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:01:48,594 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:01:48,623 DEBUG awx.main.dispatch task 24142d06-3a57-4a5e-8af5-cc78835f0065 is finished 2022-04-27 18:01:59,764 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(4ddb060e-fd9f-42b4-a805-91ed60633d39, queue=awx_private_queue) [2022-04-27 18:01:59,764: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(4ddb060e-fd9f-42b4-a805-91ed60633d39, queue=awx_private_queue) 2022-04-27 18:01:59,782 DEBUG awx.main.dispatch delivered 4ddb060e-fd9f-42b4-a805-91ed60633d39 to worker[181] qsize 0 2022-04-27 18:01:59,785 DEBUG awx.main.dispatch task 4ddb060e-fd9f-42b4-a805-91ed60633d39 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:01:59,798 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:01:59,800 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:01:29.793266+00:00 2022-04-27 18:01:59,819 DEBUG awx.main.dispatch task 4ddb060e-fd9f-42b4-a805-91ed60633d39 is finished 2022-04-27 18:01:59,863 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(da9a9f7e-8cbe-443c-906a-43fc45971aa8, queue=onap-awx-0) [2022-04-27 18:01:59,863: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(da9a9f7e-8cbe-443c-906a-43fc45971aa8, queue=onap-awx-0) 2022-04-27 18:01:59,894 DEBUG awx.main.dispatch delivered da9a9f7e-8cbe-443c-906a-43fc45971aa8 to worker[183] qsize 0 2022-04-27 18:01:59,897 DEBUG awx.main.dispatch task da9a9f7e-8cbe-443c-906a-43fc45971aa8 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 18:01:59,899 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 18:02:00,001 DEBUG awx.main.dispatch publish awx.main.tasks.gather_analytics(645dcdf9-89fc-42c9-8276-c1475d3ea4e3, queue=awx_private_queue) [2022-04-27 18:02:00,001: DEBUG/Process-1] publish awx.main.tasks.gather_analytics(645dcdf9-89fc-42c9-8276-c1475d3ea4e3, queue=awx_private_queue) RESULT 2 OKREADY 2022-04-27 18:02:00,130 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(75a481f5-6e4a-40a4-8265-d2fb301d4fd1, queue=onap-awx-0) [2022-04-27 18:02:00,130: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(75a481f5-6e4a-40a4-8265-d2fb301d4fd1, queue=onap-awx-0) 2022-04-27 18:02:00,136 DEBUG awx.main.dispatch task da9a9f7e-8cbe-443c-906a-43fc45971aa8 is finished 2022-04-27 18:02:00,267 DEBUG awx.main.dispatch delivered 645dcdf9-89fc-42c9-8276-c1475d3ea4e3 to worker[181] qsize 0 2022-04-27 18:02:00,270 DEBUG awx.main.dispatch task 645dcdf9-89fc-42c9-8276-c1475d3ea4e3 starting awx.main.tasks.gather_analytics(*[]) 2022-04-27 18:02:00,272 DEBUG awx.main.dispatch task 645dcdf9-89fc-42c9-8276-c1475d3ea4e3 is finished 2022-04-27 18:02:00,343 DEBUG awx.main.dispatch delivered 75a481f5-6e4a-40a4-8265-d2fb301d4fd1 to worker[180] qsize 0 2022-04-27 18:02:00,347 DEBUG awx.main.dispatch task 75a481f5-6e4a-40a4-8265-d2fb301d4fd1 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 18:02:00,362 DEBUG awx.main.dispatch task 75a481f5-6e4a-40a4-8265-d2fb301d4fd1 is finished 2022-04-27 18:02:08,553 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f4cc5343-5dfa-4898-adaa-88db59160ab7, queue=awx_private_queue) [2022-04-27 18:02:08,553: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f4cc5343-5dfa-4898-adaa-88db59160ab7, queue=awx_private_queue) 2022-04-27 18:02:08,766 DEBUG awx.main.dispatch delivered f4cc5343-5dfa-4898-adaa-88db59160ab7 to worker[182] qsize 0 2022-04-27 18:02:08,770 DEBUG awx.main.dispatch task f4cc5343-5dfa-4898-adaa-88db59160ab7 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:02:08,773 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:02:08,791 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:02:08,818 DEBUG awx.main.dispatch task f4cc5343-5dfa-4898-adaa-88db59160ab7 is finished 2022-04-27 18:02:28,564 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(1df6ade8-777b-4d8c-9a23-d8e37b20fca7, queue=awx_private_queue) [2022-04-27 18:02:28,564: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(1df6ade8-777b-4d8c-9a23-d8e37b20fca7, queue=awx_private_queue) 2022-04-27 18:02:28,579 DEBUG awx.main.dispatch delivered 1df6ade8-777b-4d8c-9a23-d8e37b20fca7 to worker[181] qsize 0 2022-04-27 18:02:28,582 DEBUG awx.main.dispatch task 1df6ade8-777b-4d8c-9a23-d8e37b20fca7 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:02:28,585 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:02:28,606 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:02:28,637 DEBUG awx.main.dispatch task 1df6ade8-777b-4d8c-9a23-d8e37b20fca7 is finished 2022-04-27 18:02:29,764 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d60fcc9d-f0fc-49d9-8a54-265adbd0a468, queue=awx_private_queue) [2022-04-27 18:02:29,764: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d60fcc9d-f0fc-49d9-8a54-265adbd0a468, queue=awx_private_queue) 2022-04-27 18:02:29,779 DEBUG awx.main.dispatch delivered d60fcc9d-f0fc-49d9-8a54-265adbd0a468 to worker[181] qsize 0 2022-04-27 18:02:29,783 DEBUG awx.main.dispatch task d60fcc9d-f0fc-49d9-8a54-265adbd0a468 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:02:29,794 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:02:29,796 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:01:59.798363+00:00 2022-04-27 18:02:29,812 DEBUG awx.main.dispatch task d60fcc9d-f0fc-49d9-8a54-265adbd0a468 is finished 2022-04-27 18:02:48,573 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5c1ee612-6e61-4977-947c-2b55e4fe6edf, queue=awx_private_queue) [2022-04-27 18:02:48,573: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5c1ee612-6e61-4977-947c-2b55e4fe6edf, queue=awx_private_queue) 2022-04-27 18:02:48,596 DEBUG awx.main.dispatch delivered 5c1ee612-6e61-4977-947c-2b55e4fe6edf to worker[183] qsize 0 2022-04-27 18:02:48,600 DEBUG awx.main.dispatch task 5c1ee612-6e61-4977-947c-2b55e4fe6edf starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:02:48,602 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:02:48,619 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:02:48,653 DEBUG awx.main.dispatch task 5c1ee612-6e61-4977-947c-2b55e4fe6edf is finished 2022-04-27 18:02:59,766 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(a453d4eb-1a03-42e3-989d-82b64df53be8, queue=awx_private_queue) [2022-04-27 18:02:59,766: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(a453d4eb-1a03-42e3-989d-82b64df53be8, queue=awx_private_queue) 2022-04-27 18:02:59,788 DEBUG awx.main.dispatch delivered a453d4eb-1a03-42e3-989d-82b64df53be8 to worker[181] qsize 0 2022-04-27 18:02:59,791 DEBUG awx.main.dispatch task a453d4eb-1a03-42e3-989d-82b64df53be8 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:02:59,803 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:02:59,806 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:02:29.794277+00:00 2022-04-27 18:02:59,864 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(cdbc7be7-6c89-497b-8de0-ee1ff7271b2b, queue=onap-awx-0) [2022-04-27 18:02:59,864: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(cdbc7be7-6c89-497b-8de0-ee1ff7271b2b, queue=onap-awx-0) 2022-04-27 18:02:59,893 DEBUG awx.main.dispatch delivered cdbc7be7-6c89-497b-8de0-ee1ff7271b2b to worker[180] qsize 0 2022-04-27 18:02:59,896 DEBUG awx.main.dispatch task cdbc7be7-6c89-497b-8de0-ee1ff7271b2b starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 18:02:59,898 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 18:03:00,001 DEBUG awx.main.dispatch publish awx.main.tasks.gather_analytics(bfba27bf-0a34-4d56-a949-d4a5aecedf7d, queue=awx_private_queue) [2022-04-27 18:03:00,001: DEBUG/Process-1] publish awx.main.tasks.gather_analytics(bfba27bf-0a34-4d56-a949-d4a5aecedf7d, queue=awx_private_queue) 2022-04-27 18:03:00,131 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(8c6dd882-f35c-4c33-940f-e6b8948b9af5, queue=onap-awx-0) [2022-04-27 18:03:00,131: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(8c6dd882-f35c-4c33-940f-e6b8948b9af5, queue=onap-awx-0) RESULT 2 OKREADY 2022-04-27 18:03:00,206 DEBUG awx.main.dispatch task cdbc7be7-6c89-497b-8de0-ee1ff7271b2b is finished 2022-04-27 18:03:00,259 DEBUG awx.main.dispatch task a453d4eb-1a03-42e3-989d-82b64df53be8 is finished 2022-04-27 18:03:00,649 DEBUG awx.main.dispatch delivered bfba27bf-0a34-4d56-a949-d4a5aecedf7d to worker[180] qsize 0 2022-04-27 18:03:00,651 DEBUG awx.main.dispatch task bfba27bf-0a34-4d56-a949-d4a5aecedf7d starting awx.main.tasks.gather_analytics(*[]) 2022-04-27 18:03:00,654 DEBUG awx.main.dispatch task bfba27bf-0a34-4d56-a949-d4a5aecedf7d is finished 2022-04-27 18:03:00,770 DEBUG awx.main.dispatch delivered 8c6dd882-f35c-4c33-940f-e6b8948b9af5 to worker[182] qsize 0 2022-04-27 18:03:00,773 DEBUG awx.main.dispatch task 8c6dd882-f35c-4c33-940f-e6b8948b9af5 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 18:03:00,788 DEBUG awx.main.dispatch task 8c6dd882-f35c-4c33-940f-e6b8948b9af5 is finished 2022-04-27 18:03:08,573 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(dce3e296-5476-404a-b415-2a9c0d17ccb0, queue=awx_private_queue) [2022-04-27 18:03:08,573: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(dce3e296-5476-404a-b415-2a9c0d17ccb0, queue=awx_private_queue) 2022-04-27 18:03:08,761 DEBUG awx.main.dispatch delivered dce3e296-5476-404a-b415-2a9c0d17ccb0 to worker[181] qsize 0 2022-04-27 18:03:08,764 DEBUG awx.main.dispatch task dce3e296-5476-404a-b415-2a9c0d17ccb0 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:03:08,765 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:03:08,781 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:03:08,811 DEBUG awx.main.dispatch task dce3e296-5476-404a-b415-2a9c0d17ccb0 is finished 2022-04-27 18:03:28,574 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(010e34af-8f8e-40a9-ad2d-4b4d55630539, queue=awx_private_queue) [2022-04-27 18:03:28,574: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(010e34af-8f8e-40a9-ad2d-4b4d55630539, queue=awx_private_queue) 2022-04-27 18:03:28,593 DEBUG awx.main.dispatch delivered 010e34af-8f8e-40a9-ad2d-4b4d55630539 to worker[183] qsize 0 2022-04-27 18:03:28,598 DEBUG awx.main.dispatch task 010e34af-8f8e-40a9-ad2d-4b4d55630539 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:03:28,600 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:03:28,619 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:03:28,649 DEBUG awx.main.dispatch task 010e34af-8f8e-40a9-ad2d-4b4d55630539 is finished 2022-04-27 18:03:29,766 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(6ba6fcaf-cb11-40fb-b134-80ed9d5d9174, queue=awx_private_queue) [2022-04-27 18:03:29,766: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(6ba6fcaf-cb11-40fb-b134-80ed9d5d9174, queue=awx_private_queue) 2022-04-27 18:03:29,785 DEBUG awx.main.dispatch delivered 6ba6fcaf-cb11-40fb-b134-80ed9d5d9174 to worker[182] qsize 0 2022-04-27 18:03:29,788 DEBUG awx.main.dispatch task 6ba6fcaf-cb11-40fb-b134-80ed9d5d9174 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:03:29,800 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:03:29,802 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:02:59.803638+00:00 2022-04-27 18:03:29,822 DEBUG awx.main.dispatch task 6ba6fcaf-cb11-40fb-b134-80ed9d5d9174 is finished 2022-04-27 18:03:48,584 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(071a572c-d137-4523-94c4-9662caaccd2f, queue=awx_private_queue) [2022-04-27 18:03:48,584: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(071a572c-d137-4523-94c4-9662caaccd2f, queue=awx_private_queue) 2022-04-27 18:03:48,625 DEBUG awx.main.dispatch delivered 071a572c-d137-4523-94c4-9662caaccd2f to worker[180] qsize 0 2022-04-27 18:03:48,627 DEBUG awx.main.dispatch task 071a572c-d137-4523-94c4-9662caaccd2f starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:03:48,629 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:03:48,648 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:03:48,678 DEBUG awx.main.dispatch task 071a572c-d137-4523-94c4-9662caaccd2f is finished 2022-04-27 18:03:59,769 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(bb3f3d5f-dc1f-4030-aa03-fd1715253d28, queue=awx_private_queue) [2022-04-27 18:03:59,769: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(bb3f3d5f-dc1f-4030-aa03-fd1715253d28, queue=awx_private_queue) 2022-04-27 18:03:59,791 DEBUG awx.main.dispatch delivered bb3f3d5f-dc1f-4030-aa03-fd1715253d28 to worker[181] qsize 0 2022-04-27 18:03:59,795 DEBUG awx.main.dispatch task bb3f3d5f-dc1f-4030-aa03-fd1715253d28 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:03:59,807 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:03:59,811 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:03:29.800617+00:00 2022-04-27 18:03:59,863 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(84765716-8a0a-46b6-a0c9-d1ad331276d2, queue=onap-awx-0) [2022-04-27 18:03:59,863: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(84765716-8a0a-46b6-a0c9-d1ad331276d2, queue=onap-awx-0) 2022-04-27 18:03:59,896 DEBUG awx.main.dispatch delivered 84765716-8a0a-46b6-a0c9-d1ad331276d2 to worker[180] qsize 0 2022-04-27 18:03:59,899 DEBUG awx.main.dispatch task 84765716-8a0a-46b6-a0c9-d1ad331276d2 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 18:03:59,902 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 18:04:00,001 DEBUG awx.main.dispatch publish awx.main.tasks.gather_analytics(bfefee61-61c4-4a0c-968a-ca52d666d643, queue=awx_private_queue) [2022-04-27 18:04:00,001: DEBUG/Process-1] publish awx.main.tasks.gather_analytics(bfefee61-61c4-4a0c-968a-ca52d666d643, queue=awx_private_queue) 2022-04-27 18:04:00,035 DEBUG awx.main.dispatch task bb3f3d5f-dc1f-4030-aa03-fd1715253d28 is finished RESULT 2 OKREADY 2022-04-27 18:04:00,130 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(a50afd52-dc9d-464b-87d3-06efb6bcb524, queue=onap-awx-0) [2022-04-27 18:04:00,130: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(a50afd52-dc9d-464b-87d3-06efb6bcb524, queue=onap-awx-0) 2022-04-27 18:04:00,314 DEBUG awx.main.dispatch task 84765716-8a0a-46b6-a0c9-d1ad331276d2 is finished 2022-04-27 18:04:00,674 DEBUG awx.main.dispatch delivered bfefee61-61c4-4a0c-968a-ca52d666d643 to worker[181] qsize 0 2022-04-27 18:04:00,677 DEBUG awx.main.dispatch task bfefee61-61c4-4a0c-968a-ca52d666d643 starting awx.main.tasks.gather_analytics(*[]) 2022-04-27 18:04:00,679 DEBUG awx.main.dispatch task bfefee61-61c4-4a0c-968a-ca52d666d643 is finished 2022-04-27 18:04:00,987 DEBUG awx.main.dispatch delivered a50afd52-dc9d-464b-87d3-06efb6bcb524 to worker[181] qsize 0 2022-04-27 18:04:00,989 DEBUG awx.main.dispatch task a50afd52-dc9d-464b-87d3-06efb6bcb524 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 18:04:01,004 DEBUG awx.main.dispatch task a50afd52-dc9d-464b-87d3-06efb6bcb524 is finished 2022-04-27 18:04:08,583 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(453c8d56-6f46-4cb2-a1e9-4ecdc4df5f98, queue=awx_private_queue) [2022-04-27 18:04:08,583: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(453c8d56-6f46-4cb2-a1e9-4ecdc4df5f98, queue=awx_private_queue) 2022-04-27 18:04:08,771 DEBUG awx.main.dispatch delivered 453c8d56-6f46-4cb2-a1e9-4ecdc4df5f98 to worker[181] qsize 0 2022-04-27 18:04:08,774 DEBUG awx.main.dispatch task 453c8d56-6f46-4cb2-a1e9-4ecdc4df5f98 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:04:08,775 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:04:08,789 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:04:08,816 DEBUG awx.main.dispatch task 453c8d56-6f46-4cb2-a1e9-4ecdc4df5f98 is finished 2022-04-27 18:04:28,826 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ad82bd0a-d7e6-4ac6-9456-811572bafaae, queue=awx_private_queue) [2022-04-27 18:04:28,826: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ad82bd0a-d7e6-4ac6-9456-811572bafaae, queue=awx_private_queue) 2022-04-27 18:04:28,845 DEBUG awx.main.dispatch delivered ad82bd0a-d7e6-4ac6-9456-811572bafaae to worker[181] qsize 0 2022-04-27 18:04:28,849 DEBUG awx.main.dispatch task ad82bd0a-d7e6-4ac6-9456-811572bafaae starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:04:28,851 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:04:28,870 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:04:28,899 DEBUG awx.main.dispatch task ad82bd0a-d7e6-4ac6-9456-811572bafaae is finished 2022-04-27 18:04:29,768 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(ffd20087-4d67-4c9b-ba7c-8d20f26d6f03, queue=awx_private_queue) [2022-04-27 18:04:29,768: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(ffd20087-4d67-4c9b-ba7c-8d20f26d6f03, queue=awx_private_queue) 2022-04-27 18:04:29,784 DEBUG awx.main.dispatch delivered ffd20087-4d67-4c9b-ba7c-8d20f26d6f03 to worker[180] qsize 0 2022-04-27 18:04:29,787 DEBUG awx.main.dispatch task ffd20087-4d67-4c9b-ba7c-8d20f26d6f03 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:04:29,796 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:04:29,799 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:03:59.807800+00:00 2022-04-27 18:04:29,854 DEBUG awx.main.dispatch task ffd20087-4d67-4c9b-ba7c-8d20f26d6f03 is finished 2022-04-27 18:04:48,834 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(26be4bf4-c21d-46dd-87d6-7d489032a0d7, queue=awx_private_queue) [2022-04-27 18:04:48,834: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(26be4bf4-c21d-46dd-87d6-7d489032a0d7, queue=awx_private_queue) 2022-04-27 18:04:48,850 DEBUG awx.main.dispatch delivered 26be4bf4-c21d-46dd-87d6-7d489032a0d7 to worker[182] qsize 0 2022-04-27 18:04:48,852 DEBUG awx.main.dispatch task 26be4bf4-c21d-46dd-87d6-7d489032a0d7 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:04:48,855 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:04:48,876 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:04:48,908 DEBUG awx.main.dispatch task 26be4bf4-c21d-46dd-87d6-7d489032a0d7 is finished 2022-04-27 18:04:59,768 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(2f84bd80-1405-4a45-8877-efdfab8a7f98, queue=awx_private_queue) [2022-04-27 18:04:59,768: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(2f84bd80-1405-4a45-8877-efdfab8a7f98, queue=awx_private_queue) 2022-04-27 18:04:59,789 DEBUG awx.main.dispatch delivered 2f84bd80-1405-4a45-8877-efdfab8a7f98 to worker[182] qsize 0 2022-04-27 18:04:59,792 DEBUG awx.main.dispatch task 2f84bd80-1405-4a45-8877-efdfab8a7f98 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:04:59,804 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:04:59,807 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:04:29.797093+00:00 2022-04-27 18:04:59,863 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(38ebf311-e0b0-4ebe-82dd-2cac400240f8, queue=onap-awx-0) [2022-04-27 18:04:59,863: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(38ebf311-e0b0-4ebe-82dd-2cac400240f8, queue=onap-awx-0) 2022-04-27 18:04:59,895 DEBUG awx.main.dispatch delivered 38ebf311-e0b0-4ebe-82dd-2cac400240f8 to worker[180] qsize 0 2022-04-27 18:04:59,896 DEBUG awx.main.dispatch task 38ebf311-e0b0-4ebe-82dd-2cac400240f8 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 18:04:59,898 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 18:04:59,962 DEBUG awx.main.dispatch task 38ebf311-e0b0-4ebe-82dd-2cac400240f8 is finished 2022-04-27 18:05:00,001 DEBUG awx.main.dispatch publish awx.main.tasks.gather_analytics(614b8113-2fae-465e-a349-596297b1bf0d, queue=awx_private_queue) [2022-04-27 18:05:00,001: DEBUG/Process-1] publish awx.main.tasks.gather_analytics(614b8113-2fae-465e-a349-596297b1bf0d, queue=awx_private_queue) 2022-04-27 18:05:00,131 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(6c2d453d-81a3-4719-ad2e-62e29dde4cae, queue=onap-awx-0) [2022-04-27 18:05:00,131: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(6c2d453d-81a3-4719-ad2e-62e29dde4cae, queue=onap-awx-0) RESULT 2 OKREADY 2022-04-27 18:05:00,153 DEBUG awx.main.dispatch publish awx.main.tasks.awx_isolated_heartbeat(b7188e73-e0b8-43a6-9e20-6e341a20f049, queue=onap-awx-0) [2022-04-27 18:05:00,153: DEBUG/Process-1] publish awx.main.tasks.awx_isolated_heartbeat(b7188e73-e0b8-43a6-9e20-6e341a20f049, queue=onap-awx-0) 2022-04-27 18:05:00,185 DEBUG awx.main.dispatch task 2f84bd80-1405-4a45-8877-efdfab8a7f98 is finished 2022-04-27 18:05:00,246 DEBUG awx.main.dispatch delivered 614b8113-2fae-465e-a349-596297b1bf0d to worker[182] qsize 0 2022-04-27 18:05:00,248 DEBUG awx.main.dispatch task 614b8113-2fae-465e-a349-596297b1bf0d starting awx.main.tasks.gather_analytics(*[]) 2022-04-27 18:05:00,252 DEBUG awx.main.dispatch task 614b8113-2fae-465e-a349-596297b1bf0d is finished 2022-04-27 18:05:00,472 DEBUG awx.main.dispatch delivered 6c2d453d-81a3-4719-ad2e-62e29dde4cae to worker[180] qsize 0 2022-04-27 18:05:00,475 DEBUG awx.main.dispatch delivered b7188e73-e0b8-43a6-9e20-6e341a20f049 to worker[181] qsize 0 2022-04-27 18:05:00,475 DEBUG awx.main.dispatch task 6c2d453d-81a3-4719-ad2e-62e29dde4cae starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 18:05:00,477 DEBUG awx.main.dispatch task b7188e73-e0b8-43a6-9e20-6e341a20f049 starting awx.main.tasks.awx_isolated_heartbeat(*[]) 2022-04-27 18:05:00,480 DEBUG awx.main.tasks Controlling node checking for any isolated management tasks. 2022-04-27 18:05:00,487 DEBUG awx.main.dispatch task 6c2d453d-81a3-4719-ad2e-62e29dde4cae is finished 2022-04-27 18:05:00,499 DEBUG awx.main.dispatch task b7188e73-e0b8-43a6-9e20-6e341a20f049 is finished 2022-04-27 18:05:08,834 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6301d41a-01ac-4f5d-8432-ac5724dfb20b, queue=awx_private_queue) [2022-04-27 18:05:08,834: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6301d41a-01ac-4f5d-8432-ac5724dfb20b, queue=awx_private_queue) 2022-04-27 18:05:09,016 DEBUG awx.main.dispatch delivered 6301d41a-01ac-4f5d-8432-ac5724dfb20b to worker[180] qsize 0 2022-04-27 18:05:09,019 DEBUG awx.main.dispatch task 6301d41a-01ac-4f5d-8432-ac5724dfb20b starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:05:09,022 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:05:09,038 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:05:09,069 DEBUG awx.main.dispatch task 6301d41a-01ac-4f5d-8432-ac5724dfb20b is finished 2022-04-27 18:05:28,846 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(aaf19716-fcb5-43f2-87ff-1a85ad13acf4, queue=awx_private_queue) [2022-04-27 18:05:28,846: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(aaf19716-fcb5-43f2-87ff-1a85ad13acf4, queue=awx_private_queue) 2022-04-27 18:05:28,870 DEBUG awx.main.dispatch delivered aaf19716-fcb5-43f2-87ff-1a85ad13acf4 to worker[182] qsize 0 2022-04-27 18:05:28,874 DEBUG awx.main.dispatch task aaf19716-fcb5-43f2-87ff-1a85ad13acf4 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:05:28,875 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:05:28,896 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:05:28,926 DEBUG awx.main.dispatch task aaf19716-fcb5-43f2-87ff-1a85ad13acf4 is finished 2022-04-27 18:05:29,769 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(388d371f-aefd-49d6-8888-501e881edd40, queue=awx_private_queue) [2022-04-27 18:05:29,769: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(388d371f-aefd-49d6-8888-501e881edd40, queue=awx_private_queue) 2022-04-27 18:05:29,786 DEBUG awx.main.dispatch delivered 388d371f-aefd-49d6-8888-501e881edd40 to worker[182] qsize 0 2022-04-27 18:05:29,790 DEBUG awx.main.dispatch task 388d371f-aefd-49d6-8888-501e881edd40 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:05:29,800 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:05:29,802 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:04:59.804789+00:00 2022-04-27 18:05:30,126 DEBUG awx.main.dispatch task 388d371f-aefd-49d6-8888-501e881edd40 is finished 2022-04-27 18:05:48,854 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(4a551244-069c-4bd4-aec6-10d561e39078, queue=awx_private_queue) [2022-04-27 18:05:48,854: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(4a551244-069c-4bd4-aec6-10d561e39078, queue=awx_private_queue) 2022-04-27 18:05:48,874 DEBUG awx.main.dispatch delivered 4a551244-069c-4bd4-aec6-10d561e39078 to worker[181] qsize 0 2022-04-27 18:05:48,877 DEBUG awx.main.dispatch task 4a551244-069c-4bd4-aec6-10d561e39078 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:05:48,879 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:05:48,898 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:05:48,925 DEBUG awx.main.dispatch task 4a551244-069c-4bd4-aec6-10d561e39078 is finished 2022-04-27 18:05:59,770 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(3ee8fbaa-b436-46a4-b4f1-ec697d9871fe, queue=awx_private_queue) [2022-04-27 18:05:59,770: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(3ee8fbaa-b436-46a4-b4f1-ec697d9871fe, queue=awx_private_queue) 2022-04-27 18:05:59,789 DEBUG awx.main.dispatch delivered 3ee8fbaa-b436-46a4-b4f1-ec697d9871fe to worker[180] qsize 0 2022-04-27 18:05:59,792 DEBUG awx.main.dispatch task 3ee8fbaa-b436-46a4-b4f1-ec697d9871fe starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:05:59,807 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:05:59,810 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:05:29.800531+00:00 2022-04-27 18:05:59,829 DEBUG awx.main.dispatch task 3ee8fbaa-b436-46a4-b4f1-ec697d9871fe is finished 2022-04-27 18:05:59,864 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(cc0ba4a1-6ea1-4477-a501-d43c14519c86, queue=onap-awx-0) [2022-04-27 18:05:59,864: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(cc0ba4a1-6ea1-4477-a501-d43c14519c86, queue=onap-awx-0) 2022-04-27 18:05:59,895 DEBUG awx.main.dispatch delivered cc0ba4a1-6ea1-4477-a501-d43c14519c86 to worker[182] qsize 0 2022-04-27 18:05:59,898 DEBUG awx.main.dispatch task cc0ba4a1-6ea1-4477-a501-d43c14519c86 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 18:05:59,900 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 18:05:59,925 DEBUG awx.main.dispatch task cc0ba4a1-6ea1-4477-a501-d43c14519c86 is finished 2022-04-27 18:06:00,001 DEBUG awx.main.dispatch publish awx.main.tasks.gather_analytics(39a373dc-124a-4540-8558-d6c9842fe295, queue=awx_private_queue) [2022-04-27 18:06:00,001: DEBUG/Process-1] publish awx.main.tasks.gather_analytics(39a373dc-124a-4540-8558-d6c9842fe295, queue=awx_private_queue) 2022-04-27 18:06:00,132 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(6cb8fe88-29a3-4220-a2b8-5cbc1589c2d8, queue=onap-awx-0) [2022-04-27 18:06:00,132: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(6cb8fe88-29a3-4220-a2b8-5cbc1589c2d8, queue=onap-awx-0) RESULT 2 OKREADY 2022-04-27 18:06:00,253 DEBUG awx.main.dispatch delivered 39a373dc-124a-4540-8558-d6c9842fe295 to worker[181] qsize 0 2022-04-27 18:06:00,256 DEBUG awx.main.dispatch task 39a373dc-124a-4540-8558-d6c9842fe295 starting awx.main.tasks.gather_analytics(*[]) 2022-04-27 18:06:00,260 DEBUG awx.main.dispatch task 39a373dc-124a-4540-8558-d6c9842fe295 is finished 2022-04-27 18:06:00,470 DEBUG awx.main.dispatch delivered 6cb8fe88-29a3-4220-a2b8-5cbc1589c2d8 to worker[180] qsize 0 2022-04-27 18:06:00,473 DEBUG awx.main.dispatch task 6cb8fe88-29a3-4220-a2b8-5cbc1589c2d8 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 18:06:00,490 DEBUG awx.main.dispatch task 6cb8fe88-29a3-4220-a2b8-5cbc1589c2d8 is finished 2022-04-27 18:06:08,854 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c095ac8d-211e-4556-98ae-a06cddfafc3f, queue=awx_private_queue) [2022-04-27 18:06:08,854: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c095ac8d-211e-4556-98ae-a06cddfafc3f, queue=awx_private_queue) 2022-04-27 18:06:08,888 DEBUG awx.main.dispatch delivered c095ac8d-211e-4556-98ae-a06cddfafc3f to worker[182] qsize 0 2022-04-27 18:06:08,892 DEBUG awx.main.dispatch task c095ac8d-211e-4556-98ae-a06cddfafc3f starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:06:08,894 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:06:08,912 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:06:08,945 DEBUG awx.main.dispatch task c095ac8d-211e-4556-98ae-a06cddfafc3f is finished 2022-04-27 18:06:28,865 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ee35cf30-583e-479c-b48e-aa1ee877997b, queue=awx_private_queue) [2022-04-27 18:06:28,865: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ee35cf30-583e-479c-b48e-aa1ee877997b, queue=awx_private_queue) 2022-04-27 18:06:28,886 DEBUG awx.main.dispatch delivered ee35cf30-583e-479c-b48e-aa1ee877997b to worker[181] qsize 0 2022-04-27 18:06:29,080 DEBUG awx.main.dispatch task ee35cf30-583e-479c-b48e-aa1ee877997b starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:06:29,084 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:06:29,105 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:06:29,136 DEBUG awx.main.dispatch task ee35cf30-583e-479c-b48e-aa1ee877997b is finished 2022-04-27 18:06:29,770 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(04e72dd8-4360-465a-8b38-ff55ceb64b59, queue=awx_private_queue) [2022-04-27 18:06:29,770: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(04e72dd8-4360-465a-8b38-ff55ceb64b59, queue=awx_private_queue) 2022-04-27 18:06:29,790 DEBUG awx.main.dispatch delivered 04e72dd8-4360-465a-8b38-ff55ceb64b59 to worker[183] qsize 0 2022-04-27 18:06:29,793 DEBUG awx.main.dispatch task 04e72dd8-4360-465a-8b38-ff55ceb64b59 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:06:29,806 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:06:29,809 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:05:59.807412+00:00 2022-04-27 18:06:29,850 DEBUG awx.main.dispatch task 04e72dd8-4360-465a-8b38-ff55ceb64b59 is finished 2022-04-27 18:06:48,874 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0d46d997-00c7-474b-8036-4e30532617d4, queue=awx_private_queue) [2022-04-27 18:06:48,874: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0d46d997-00c7-474b-8036-4e30532617d4, queue=awx_private_queue) 2022-04-27 18:06:48,896 DEBUG awx.main.dispatch delivered 0d46d997-00c7-474b-8036-4e30532617d4 to worker[182] qsize 0 2022-04-27 18:06:48,900 DEBUG awx.main.dispatch task 0d46d997-00c7-474b-8036-4e30532617d4 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:06:48,902 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:06:48,922 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:06:48,955 DEBUG awx.main.dispatch task 0d46d997-00c7-474b-8036-4e30532617d4 is finished 2022-04-27 18:06:59,771 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(dd8d9ae1-5d0e-415a-bed0-61e9952bdfa0, queue=awx_private_queue) [2022-04-27 18:06:59,771: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(dd8d9ae1-5d0e-415a-bed0-61e9952bdfa0, queue=awx_private_queue) 2022-04-27 18:06:59,790 DEBUG awx.main.dispatch delivered dd8d9ae1-5d0e-415a-bed0-61e9952bdfa0 to worker[183] qsize 0 2022-04-27 18:06:59,792 DEBUG awx.main.dispatch task dd8d9ae1-5d0e-415a-bed0-61e9952bdfa0 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:06:59,805 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:06:59,808 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:06:29.806584+00:00 2022-04-27 18:06:59,864 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(696e3d1b-1871-4cd3-802a-cf1c3e961612, queue=onap-awx-0) [2022-04-27 18:06:59,864: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(696e3d1b-1871-4cd3-802a-cf1c3e961612, queue=onap-awx-0) 2022-04-27 18:06:59,906 DEBUG awx.main.dispatch delivered 696e3d1b-1871-4cd3-802a-cf1c3e961612 to worker[180] qsize 0 2022-04-27 18:06:59,908 DEBUG awx.main.dispatch task 696e3d1b-1871-4cd3-802a-cf1c3e961612 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 18:06:59,909 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 18:07:00,001 DEBUG awx.main.dispatch publish awx.main.tasks.gather_analytics(22c47ed3-e45d-4dec-abb8-bded86b6fa88, queue=awx_private_queue) [2022-04-27 18:07:00,001: DEBUG/Process-1] publish awx.main.tasks.gather_analytics(22c47ed3-e45d-4dec-abb8-bded86b6fa88, queue=awx_private_queue) 2022-04-27 18:07:00,121 DEBUG awx.main.dispatch delivered 22c47ed3-e45d-4dec-abb8-bded86b6fa88 to worker[182] qsize 0 RESULT 2 OKREADY 2022-04-27 18:07:00,124 DEBUG awx.main.dispatch task 22c47ed3-e45d-4dec-abb8-bded86b6fa88 starting awx.main.tasks.gather_analytics(*[]) 2022-04-27 18:07:00,129 DEBUG awx.main.dispatch task 22c47ed3-e45d-4dec-abb8-bded86b6fa88 is finished 2022-04-27 18:07:00,131 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(b6ed5afb-5a8f-47df-9528-5aef87931e97, queue=onap-awx-0) [2022-04-27 18:07:00,131: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(b6ed5afb-5a8f-47df-9528-5aef87931e97, queue=onap-awx-0) 2022-04-27 18:07:00,203 DEBUG awx.main.dispatch task 696e3d1b-1871-4cd3-802a-cf1c3e961612 is finished 2022-04-27 18:07:00,380 DEBUG awx.main.dispatch delivered b6ed5afb-5a8f-47df-9528-5aef87931e97 to worker[182] qsize 0 2022-04-27 18:07:00,382 DEBUG awx.main.dispatch task b6ed5afb-5a8f-47df-9528-5aef87931e97 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 18:07:00,399 DEBUG awx.main.dispatch task b6ed5afb-5a8f-47df-9528-5aef87931e97 is finished 2022-04-27 18:07:00,426 DEBUG awx.main.dispatch task dd8d9ae1-5d0e-415a-bed0-61e9952bdfa0 is finished 2022-04-27 18:07:08,873 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(197346f1-01c5-4820-8723-dfa013174cff, queue=awx_private_queue) [2022-04-27 18:07:08,873: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(197346f1-01c5-4820-8723-dfa013174cff, queue=awx_private_queue) 2022-04-27 18:07:08,894 DEBUG awx.main.dispatch delivered 197346f1-01c5-4820-8723-dfa013174cff to worker[180] qsize 0 2022-04-27 18:07:08,896 DEBUG awx.main.dispatch task 197346f1-01c5-4820-8723-dfa013174cff starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:07:08,897 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:07:08,915 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:07:08,943 DEBUG awx.main.dispatch task 197346f1-01c5-4820-8723-dfa013174cff is finished 2022-04-27 18:07:29,160 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5cac87b3-9f8e-4c8b-b332-458a189a4c68, queue=awx_private_queue) [2022-04-27 18:07:29,160: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5cac87b3-9f8e-4c8b-b332-458a189a4c68, queue=awx_private_queue) 2022-04-27 18:07:29,198 DEBUG awx.main.dispatch delivered 5cac87b3-9f8e-4c8b-b332-458a189a4c68 to worker[181] qsize 0 2022-04-27 18:07:29,396 DEBUG awx.main.dispatch task 5cac87b3-9f8e-4c8b-b332-458a189a4c68 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:07:29,400 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:07:29,419 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:07:29,451 DEBUG awx.main.dispatch task 5cac87b3-9f8e-4c8b-b332-458a189a4c68 is finished 2022-04-27 18:07:29,771 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(ec458bb6-5206-4fa2-8ff9-5ecf7fac8ba0, queue=awx_private_queue) [2022-04-27 18:07:29,771: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(ec458bb6-5206-4fa2-8ff9-5ecf7fac8ba0, queue=awx_private_queue) 2022-04-27 18:07:29,791 DEBUG awx.main.dispatch delivered ec458bb6-5206-4fa2-8ff9-5ecf7fac8ba0 to worker[182] qsize 0 2022-04-27 18:07:29,795 DEBUG awx.main.dispatch task ec458bb6-5206-4fa2-8ff9-5ecf7fac8ba0 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:07:29,809 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:07:29,813 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:06:59.805775+00:00 2022-04-27 18:07:29,830 DEBUG awx.main.dispatch task ec458bb6-5206-4fa2-8ff9-5ecf7fac8ba0 is finished 2022-04-27 18:07:49,170 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(26e6b393-f80a-445e-98be-c44a5b33ad66, queue=awx_private_queue) [2022-04-27 18:07:49,170: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(26e6b393-f80a-445e-98be-c44a5b33ad66, queue=awx_private_queue) 2022-04-27 18:07:49,192 DEBUG awx.main.dispatch delivered 26e6b393-f80a-445e-98be-c44a5b33ad66 to worker[182] qsize 0 2022-04-27 18:07:49,196 DEBUG awx.main.dispatch task 26e6b393-f80a-445e-98be-c44a5b33ad66 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:07:49,197 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:07:49,218 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:07:49,248 DEBUG awx.main.dispatch task 26e6b393-f80a-445e-98be-c44a5b33ad66 is finished 2022-04-27 18:07:59,772 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(709a7943-1b73-46ac-b945-ffffd26483e4, queue=awx_private_queue) [2022-04-27 18:07:59,772: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(709a7943-1b73-46ac-b945-ffffd26483e4, queue=awx_private_queue) 2022-04-27 18:07:59,797 DEBUG awx.main.dispatch delivered 709a7943-1b73-46ac-b945-ffffd26483e4 to worker[181] qsize 0 2022-04-27 18:07:59,800 DEBUG awx.main.dispatch task 709a7943-1b73-46ac-b945-ffffd26483e4 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:07:59,811 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:07:59,814 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:07:29.809885+00:00 2022-04-27 18:07:59,832 DEBUG awx.main.dispatch task 709a7943-1b73-46ac-b945-ffffd26483e4 is finished 2022-04-27 18:07:59,865 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(59cd85b4-242c-45fa-bf09-b18ed00e964a, queue=onap-awx-0) [2022-04-27 18:07:59,865: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(59cd85b4-242c-45fa-bf09-b18ed00e964a, queue=onap-awx-0) 2022-04-27 18:07:59,896 DEBUG awx.main.dispatch delivered 59cd85b4-242c-45fa-bf09-b18ed00e964a to worker[181] qsize 0 2022-04-27 18:07:59,898 DEBUG awx.main.dispatch task 59cd85b4-242c-45fa-bf09-b18ed00e964a starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 18:07:59,900 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 18:07:59,925 DEBUG awx.main.dispatch task 59cd85b4-242c-45fa-bf09-b18ed00e964a is finished 2022-04-27 18:08:00,001 DEBUG awx.main.dispatch publish awx.main.tasks.gather_analytics(e4c49741-f77d-4a1d-9775-ad7100404690, queue=awx_private_queue) [2022-04-27 18:08:00,001: DEBUG/Process-1] publish awx.main.tasks.gather_analytics(e4c49741-f77d-4a1d-9775-ad7100404690, queue=awx_private_queue) 2022-04-27 18:08:00,131 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(3f9726af-05b8-47b4-9a32-07ba75c30031, queue=onap-awx-0) [2022-04-27 18:08:00,131: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(3f9726af-05b8-47b4-9a32-07ba75c30031, queue=onap-awx-0) RESULT 2 OKREADY 2022-04-27 18:08:00,505 DEBUG awx.main.dispatch delivered e4c49741-f77d-4a1d-9775-ad7100404690 to worker[183] qsize 0 2022-04-27 18:08:00,508 DEBUG awx.main.dispatch task e4c49741-f77d-4a1d-9775-ad7100404690 starting awx.main.tasks.gather_analytics(*[]) 2022-04-27 18:08:00,511 DEBUG awx.main.dispatch task e4c49741-f77d-4a1d-9775-ad7100404690 is finished 2022-04-27 18:08:00,664 DEBUG awx.main.dispatch delivered 3f9726af-05b8-47b4-9a32-07ba75c30031 to worker[181] qsize 0 2022-04-27 18:08:00,667 DEBUG awx.main.dispatch task 3f9726af-05b8-47b4-9a32-07ba75c30031 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 18:08:00,679 DEBUG awx.main.dispatch task 3f9726af-05b8-47b4-9a32-07ba75c30031 is finished 2022-04-27 18:08:09,170 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f27680de-2e43-4afe-8792-79cd9ff26c61, queue=awx_private_queue) [2022-04-27 18:08:09,170: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f27680de-2e43-4afe-8792-79cd9ff26c61, queue=awx_private_queue) 2022-04-27 18:08:09,190 DEBUG awx.main.dispatch delivered f27680de-2e43-4afe-8792-79cd9ff26c61 to worker[181] qsize 0 2022-04-27 18:08:09,193 DEBUG awx.main.dispatch task f27680de-2e43-4afe-8792-79cd9ff26c61 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:08:09,195 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:08:09,214 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:08:09,247 DEBUG awx.main.dispatch task f27680de-2e43-4afe-8792-79cd9ff26c61 is finished 2022-04-27 18:08:29,174 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0b0fa5ae-ed34-4de2-aa3e-229acab05e3e, queue=awx_private_queue) [2022-04-27 18:08:29,174: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0b0fa5ae-ed34-4de2-aa3e-229acab05e3e, queue=awx_private_queue) 2022-04-27 18:08:29,197 DEBUG awx.main.dispatch delivered 0b0fa5ae-ed34-4de2-aa3e-229acab05e3e to worker[180] qsize 0 2022-04-27 18:08:29,206 DEBUG awx.main.dispatch task 0b0fa5ae-ed34-4de2-aa3e-229acab05e3e starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:08:29,391 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:08:29,400 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:08:29,426 DEBUG awx.main.dispatch task 0b0fa5ae-ed34-4de2-aa3e-229acab05e3e is finished 2022-04-27 18:08:29,773 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(9c694538-8b05-4edb-b5b0-362a86afde85, queue=awx_private_queue) [2022-04-27 18:08:29,773: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(9c694538-8b05-4edb-b5b0-362a86afde85, queue=awx_private_queue) 2022-04-27 18:08:29,791 DEBUG awx.main.dispatch delivered 9c694538-8b05-4edb-b5b0-362a86afde85 to worker[183] qsize 0 2022-04-27 18:08:29,794 DEBUG awx.main.dispatch task 9c694538-8b05-4edb-b5b0-362a86afde85 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:08:29,805 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:08:29,809 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:07:59.812116+00:00 2022-04-27 18:08:30,333 DEBUG awx.main.dispatch task 9c694538-8b05-4edb-b5b0-362a86afde85 is finished 2022-04-27 18:08:49,183 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(1f98242f-dc0c-4487-b632-387622c6f465, queue=awx_private_queue) [2022-04-27 18:08:49,183: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(1f98242f-dc0c-4487-b632-387622c6f465, queue=awx_private_queue) 2022-04-27 18:08:49,203 DEBUG awx.main.dispatch delivered 1f98242f-dc0c-4487-b632-387622c6f465 to worker[183] qsize 0 2022-04-27 18:08:49,205 DEBUG awx.main.dispatch task 1f98242f-dc0c-4487-b632-387622c6f465 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:08:49,206 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:08:49,224 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:08:49,258 DEBUG awx.main.dispatch task 1f98242f-dc0c-4487-b632-387622c6f465 is finished 2022-04-27 18:08:59,773 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d453dfc9-629c-44ca-9b5e-7c7002cce56d, queue=awx_private_queue) [2022-04-27 18:08:59,773: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d453dfc9-629c-44ca-9b5e-7c7002cce56d, queue=awx_private_queue) 2022-04-27 18:08:59,791 DEBUG awx.main.dispatch delivered d453dfc9-629c-44ca-9b5e-7c7002cce56d to worker[180] qsize 0 2022-04-27 18:08:59,795 DEBUG awx.main.dispatch task d453dfc9-629c-44ca-9b5e-7c7002cce56d starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:08:59,808 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:08:59,810 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:08:29.806021+00:00 2022-04-27 18:08:59,865 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(2d683294-a34b-4280-a9b9-990eb2b835c5, queue=onap-awx-0) [2022-04-27 18:08:59,865: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(2d683294-a34b-4280-a9b9-990eb2b835c5, queue=onap-awx-0) 2022-04-27 18:08:59,893 DEBUG awx.main.dispatch delivered 2d683294-a34b-4280-a9b9-990eb2b835c5 to worker[181] qsize 0 2022-04-27 18:08:59,896 DEBUG awx.main.dispatch task 2d683294-a34b-4280-a9b9-990eb2b835c5 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 18:08:59,898 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 18:09:00,001 DEBUG awx.main.dispatch publish awx.main.tasks.gather_analytics(82e83a0a-e6b7-4269-acf5-7afbceae3313, queue=awx_private_queue) [2022-04-27 18:09:00,001: DEBUG/Process-1] publish awx.main.tasks.gather_analytics(82e83a0a-e6b7-4269-acf5-7afbceae3313, queue=awx_private_queue) 2022-04-27 18:09:00,029 DEBUG awx.main.dispatch task 2d683294-a34b-4280-a9b9-990eb2b835c5 is finished RESULT 2 OKREADY 2022-04-27 18:09:00,039 DEBUG awx.main.dispatch task d453dfc9-629c-44ca-9b5e-7c7002cce56d is finished 2022-04-27 18:09:00,048 DEBUG awx.main.dispatch delivered 82e83a0a-e6b7-4269-acf5-7afbceae3313 to worker[183] qsize 0 2022-04-27 18:09:00,051 DEBUG awx.main.dispatch task 82e83a0a-e6b7-4269-acf5-7afbceae3313 starting awx.main.tasks.gather_analytics(*[]) 2022-04-27 18:09:00,053 DEBUG awx.main.dispatch task 82e83a0a-e6b7-4269-acf5-7afbceae3313 is finished 2022-04-27 18:09:00,131 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(24457f9f-ad96-48d2-bc86-749bb0077dd5, queue=onap-awx-0) [2022-04-27 18:09:00,131: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(24457f9f-ad96-48d2-bc86-749bb0077dd5, queue=onap-awx-0) 2022-04-27 18:09:00,199 DEBUG awx.main.dispatch delivered 24457f9f-ad96-48d2-bc86-749bb0077dd5 to worker[183] qsize 0 2022-04-27 18:09:00,202 DEBUG awx.main.dispatch task 24457f9f-ad96-48d2-bc86-749bb0077dd5 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 18:09:00,220 DEBUG awx.main.dispatch task 24457f9f-ad96-48d2-bc86-749bb0077dd5 is finished 2022-04-27 18:09:09,182 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(cbf89025-28b9-4667-a0d7-90ddd7a9e665, queue=awx_private_queue) [2022-04-27 18:09:09,182: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(cbf89025-28b9-4667-a0d7-90ddd7a9e665, queue=awx_private_queue) 2022-04-27 18:09:09,199 DEBUG awx.main.dispatch delivered cbf89025-28b9-4667-a0d7-90ddd7a9e665 to worker[181] qsize 0 2022-04-27 18:09:09,202 DEBUG awx.main.dispatch task cbf89025-28b9-4667-a0d7-90ddd7a9e665 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:09:09,205 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:09:09,225 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:09:09,253 DEBUG awx.main.dispatch task cbf89025-28b9-4667-a0d7-90ddd7a9e665 is finished 2022-04-27 18:09:29,193 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(fb33181c-1db4-421a-aec2-9aafc325724b, queue=awx_private_queue) [2022-04-27 18:09:29,193: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(fb33181c-1db4-421a-aec2-9aafc325724b, queue=awx_private_queue) 2022-04-27 18:09:29,214 DEBUG awx.main.dispatch delivered fb33181c-1db4-421a-aec2-9aafc325724b to worker[180] qsize 0 2022-04-27 18:09:29,218 DEBUG awx.main.dispatch task fb33181c-1db4-421a-aec2-9aafc325724b starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:09:29,221 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:09:29,241 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:09:29,277 DEBUG awx.main.dispatch task fb33181c-1db4-421a-aec2-9aafc325724b is finished 2022-04-27 18:09:29,773 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(c828351d-bef6-4435-8a06-1de4ae1fe742, queue=awx_private_queue) [2022-04-27 18:09:29,773: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(c828351d-bef6-4435-8a06-1de4ae1fe742, queue=awx_private_queue) 2022-04-27 18:09:29,792 DEBUG awx.main.dispatch delivered c828351d-bef6-4435-8a06-1de4ae1fe742 to worker[182] qsize 0 2022-04-27 18:09:29,984 DEBUG awx.main.dispatch task c828351d-bef6-4435-8a06-1de4ae1fe742 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:09:29,995 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:09:29,998 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:08:59.808286+00:00 2022-04-27 18:09:30,231 DEBUG awx.main.dispatch task c828351d-bef6-4435-8a06-1de4ae1fe742 is finished 2022-04-27 18:09:49,203 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a72024da-e082-48de-a9e0-bde021cc0f90, queue=awx_private_queue) [2022-04-27 18:09:49,203: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a72024da-e082-48de-a9e0-bde021cc0f90, queue=awx_private_queue) 2022-04-27 18:09:49,223 DEBUG awx.main.dispatch delivered a72024da-e082-48de-a9e0-bde021cc0f90 to worker[182] qsize 0 2022-04-27 18:09:49,227 DEBUG awx.main.dispatch task a72024da-e082-48de-a9e0-bde021cc0f90 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:09:49,229 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:09:49,246 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:09:49,278 DEBUG awx.main.dispatch task a72024da-e082-48de-a9e0-bde021cc0f90 is finished 2022-04-27 18:09:59,774 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(99b2df09-086d-47bc-97a4-e8b139bc3316, queue=awx_private_queue) [2022-04-27 18:09:59,774: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(99b2df09-086d-47bc-97a4-e8b139bc3316, queue=awx_private_queue) 2022-04-27 18:09:59,806 DEBUG awx.main.dispatch delivered 99b2df09-086d-47bc-97a4-e8b139bc3316 to worker[180] qsize 0 2022-04-27 18:09:59,810 DEBUG awx.main.dispatch task 99b2df09-086d-47bc-97a4-e8b139bc3316 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:09:59,823 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:09:59,825 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:09:29.995790+00:00 2022-04-27 18:09:59,865 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(ad433bf1-e48d-4341-a63b-593aac6d1e7e, queue=onap-awx-0) [2022-04-27 18:09:59,865: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(ad433bf1-e48d-4341-a63b-593aac6d1e7e, queue=onap-awx-0) 2022-04-27 18:09:59,896 DEBUG awx.main.dispatch delivered ad433bf1-e48d-4341-a63b-593aac6d1e7e to worker[182] qsize 0 2022-04-27 18:09:59,898 DEBUG awx.main.dispatch task ad433bf1-e48d-4341-a63b-593aac6d1e7e starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 18:09:59,900 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 18:10:00,001 DEBUG awx.main.dispatch publish awx.main.tasks.gather_analytics(bd4318a0-b697-43d4-9e56-32b3745706bb, queue=awx_private_queue) [2022-04-27 18:10:00,001: DEBUG/Process-1] publish awx.main.tasks.gather_analytics(bd4318a0-b697-43d4-9e56-32b3745706bb, queue=awx_private_queue) 2022-04-27 18:10:00,074 DEBUG awx.main.dispatch delivered bd4318a0-b697-43d4-9e56-32b3745706bb to worker[183] qsize 0 RESULT 2 OKREADY 2022-04-27 18:10:00,078 DEBUG awx.main.dispatch task bd4318a0-b697-43d4-9e56-32b3745706bb starting awx.main.tasks.gather_analytics(*[]) 2022-04-27 18:10:00,082 DEBUG awx.main.dispatch task bd4318a0-b697-43d4-9e56-32b3745706bb is finished 2022-04-27 18:10:00,091 DEBUG awx.main.dispatch task 99b2df09-086d-47bc-97a4-e8b139bc3316 is finished 2022-04-27 18:10:00,119 DEBUG awx.main.dispatch task ad433bf1-e48d-4341-a63b-593aac6d1e7e is finished 2022-04-27 18:10:00,131 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(7f721b97-c8f5-42ab-9ca1-dae59a48968d, queue=onap-awx-0) [2022-04-27 18:10:00,131: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(7f721b97-c8f5-42ab-9ca1-dae59a48968d, queue=onap-awx-0) 2022-04-27 18:10:00,515 DEBUG awx.main.dispatch delivered 7f721b97-c8f5-42ab-9ca1-dae59a48968d to worker[182] qsize 0 2022-04-27 18:10:00,519 DEBUG awx.main.dispatch task 7f721b97-c8f5-42ab-9ca1-dae59a48968d starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 18:10:00,533 DEBUG awx.main.dispatch task 7f721b97-c8f5-42ab-9ca1-dae59a48968d is finished 2022-04-27 18:10:09,203 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b3ddb939-6913-4bfa-89ba-177313f11616, queue=awx_private_queue) [2022-04-27 18:10:09,203: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b3ddb939-6913-4bfa-89ba-177313f11616, queue=awx_private_queue) 2022-04-27 18:10:09,227 DEBUG awx.main.dispatch delivered b3ddb939-6913-4bfa-89ba-177313f11616 to worker[181] qsize 0 2022-04-27 18:10:09,230 DEBUG awx.main.dispatch task b3ddb939-6913-4bfa-89ba-177313f11616 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:10:09,233 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:10:09,252 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:10:09,282 DEBUG awx.main.dispatch task b3ddb939-6913-4bfa-89ba-177313f11616 is finished 2022-04-27 18:10:29,476 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(28d2310c-4650-4176-8827-af23a60ecc7a, queue=awx_private_queue) [2022-04-27 18:10:29,476: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(28d2310c-4650-4176-8827-af23a60ecc7a, queue=awx_private_queue) 2022-04-27 18:10:29,510 DEBUG awx.main.dispatch delivered 28d2310c-4650-4176-8827-af23a60ecc7a to worker[183] qsize 0 2022-04-27 18:10:29,512 DEBUG awx.main.dispatch task 28d2310c-4650-4176-8827-af23a60ecc7a starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:10:29,513 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:10:29,530 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:10:29,562 DEBUG awx.main.dispatch task 28d2310c-4650-4176-8827-af23a60ecc7a is finished 2022-04-27 18:10:29,774 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(b653b96b-06ff-4434-9130-f585af3f8ab7, queue=awx_private_queue) [2022-04-27 18:10:29,774: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(b653b96b-06ff-4434-9130-f585af3f8ab7, queue=awx_private_queue) 2022-04-27 18:10:30,198 DEBUG awx.main.dispatch delivered b653b96b-06ff-4434-9130-f585af3f8ab7 to worker[181] qsize 0 2022-04-27 18:10:30,386 DEBUG awx.main.dispatch task b653b96b-06ff-4434-9130-f585af3f8ab7 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:10:30,396 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:10:30,398 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:09:59.823524+00:00 2022-04-27 18:10:30,427 DEBUG awx.main.dispatch task b653b96b-06ff-4434-9130-f585af3f8ab7 is finished 2022-04-27 18:10:49,486 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(851eac99-0e2b-4819-bef7-04d1a9649f30, queue=awx_private_queue) [2022-04-27 18:10:49,486: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(851eac99-0e2b-4819-bef7-04d1a9649f30, queue=awx_private_queue) 2022-04-27 18:10:49,509 DEBUG awx.main.dispatch delivered 851eac99-0e2b-4819-bef7-04d1a9649f30 to worker[183] qsize 0 2022-04-27 18:10:49,512 DEBUG awx.main.dispatch task 851eac99-0e2b-4819-bef7-04d1a9649f30 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:10:49,513 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:10:49,532 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:10:49,567 DEBUG awx.main.dispatch task 851eac99-0e2b-4819-bef7-04d1a9649f30 is finished 2022-04-27 18:10:59,774 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(36c55e50-a932-4b85-a80e-9f2592193357, queue=awx_private_queue) [2022-04-27 18:10:59,774: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(36c55e50-a932-4b85-a80e-9f2592193357, queue=awx_private_queue) 2022-04-27 18:10:59,792 DEBUG awx.main.dispatch delivered 36c55e50-a932-4b85-a80e-9f2592193357 to worker[183] qsize 0 2022-04-27 18:10:59,795 DEBUG awx.main.dispatch task 36c55e50-a932-4b85-a80e-9f2592193357 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:10:59,806 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:10:59,809 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:10:30.396851+00:00 2022-04-27 18:10:59,865 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(36d81dbd-af11-4307-9f3f-00f39fad74ff, queue=onap-awx-0) [2022-04-27 18:10:59,865: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(36d81dbd-af11-4307-9f3f-00f39fad74ff, queue=onap-awx-0) 2022-04-27 18:10:59,895 DEBUG awx.main.dispatch delivered 36d81dbd-af11-4307-9f3f-00f39fad74ff to worker[181] qsize 0 2022-04-27 18:10:59,898 DEBUG awx.main.dispatch task 36d81dbd-af11-4307-9f3f-00f39fad74ff starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 18:10:59,901 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 18:11:00,001 DEBUG awx.main.dispatch publish awx.main.tasks.gather_analytics(8c3a6505-f5b3-4389-a767-0db444531c6d, queue=awx_private_queue) [2022-04-27 18:11:00,001: DEBUG/Process-1] publish awx.main.tasks.gather_analytics(8c3a6505-f5b3-4389-a767-0db444531c6d, queue=awx_private_queue) 2022-04-27 18:11:00,131 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(ba05fdc7-81f9-419e-b5ba-6e592a40372e, queue=onap-awx-0) [2022-04-27 18:11:00,131: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(ba05fdc7-81f9-419e-b5ba-6e592a40372e, queue=onap-awx-0) RESULT 2 OKREADY 2022-04-27 18:11:00,226 DEBUG awx.main.dispatch delivered 8c3a6505-f5b3-4389-a767-0db444531c6d to worker[180] qsize 0 2022-04-27 18:11:00,229 DEBUG awx.main.dispatch task 8c3a6505-f5b3-4389-a767-0db444531c6d starting awx.main.tasks.gather_analytics(*[]) 2022-04-27 18:11:00,233 DEBUG awx.main.dispatch task 8c3a6505-f5b3-4389-a767-0db444531c6d is finished 2022-04-27 18:11:00,257 DEBUG awx.main.dispatch task 36d81dbd-af11-4307-9f3f-00f39fad74ff is finished 2022-04-27 18:11:00,418 DEBUG awx.main.dispatch task 36c55e50-a932-4b85-a80e-9f2592193357 is finished 2022-04-27 18:11:00,508 DEBUG awx.main.dispatch delivered ba05fdc7-81f9-419e-b5ba-6e592a40372e to worker[183] qsize 0 2022-04-27 18:11:00,511 DEBUG awx.main.dispatch task ba05fdc7-81f9-419e-b5ba-6e592a40372e starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 18:11:00,525 DEBUG awx.main.dispatch task ba05fdc7-81f9-419e-b5ba-6e592a40372e is finished 2022-04-27 18:11:09,487 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(4b564fc2-d6f1-4e7b-8947-5c3ada2cbdbb, queue=awx_private_queue) [2022-04-27 18:11:09,487: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(4b564fc2-d6f1-4e7b-8947-5c3ada2cbdbb, queue=awx_private_queue) 2022-04-27 18:11:09,512 DEBUG awx.main.dispatch delivered 4b564fc2-d6f1-4e7b-8947-5c3ada2cbdbb to worker[182] qsize 0 2022-04-27 18:11:09,514 DEBUG awx.main.dispatch task 4b564fc2-d6f1-4e7b-8947-5c3ada2cbdbb starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:11:09,517 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:11:09,539 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:11:09,567 DEBUG awx.main.dispatch task 4b564fc2-d6f1-4e7b-8947-5c3ada2cbdbb is finished 2022-04-27 18:11:29,497 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(1fc0269d-2887-4b01-a759-178ae24f4469, queue=awx_private_queue) [2022-04-27 18:11:29,497: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(1fc0269d-2887-4b01-a759-178ae24f4469, queue=awx_private_queue) 2022-04-27 18:11:29,533 DEBUG awx.main.dispatch delivered 1fc0269d-2887-4b01-a759-178ae24f4469 to worker[181] qsize 0 2022-04-27 18:11:29,536 DEBUG awx.main.dispatch task 1fc0269d-2887-4b01-a759-178ae24f4469 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:11:29,538 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:11:29,554 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:11:29,585 DEBUG awx.main.dispatch task 1fc0269d-2887-4b01-a759-178ae24f4469 is finished 2022-04-27 18:11:29,774 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(b83271eb-882e-4e26-835c-54c2d44cd1e9, queue=awx_private_queue) [2022-04-27 18:11:29,774: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(b83271eb-882e-4e26-835c-54c2d44cd1e9, queue=awx_private_queue) 2022-04-27 18:11:29,854 DEBUG awx.main.dispatch delivered b83271eb-882e-4e26-835c-54c2d44cd1e9 to worker[182] qsize 0 2022-04-27 18:11:29,858 DEBUG awx.main.dispatch task b83271eb-882e-4e26-835c-54c2d44cd1e9 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:11:29,867 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:11:29,870 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:10:59.806251+00:00 2022-04-27 18:11:29,887 DEBUG awx.main.dispatch task b83271eb-882e-4e26-835c-54c2d44cd1e9 is finished 2022-04-27 18:11:49,508 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(4d05c667-e587-4082-8e90-bcd0bbbbaa54, queue=awx_private_queue) [2022-04-27 18:11:49,508: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(4d05c667-e587-4082-8e90-bcd0bbbbaa54, queue=awx_private_queue) 2022-04-27 18:11:49,529 DEBUG awx.main.dispatch delivered 4d05c667-e587-4082-8e90-bcd0bbbbaa54 to worker[183] qsize 0 2022-04-27 18:11:49,713 DEBUG awx.main.dispatch task 4d05c667-e587-4082-8e90-bcd0bbbbaa54 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:11:49,715 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:11:49,733 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:11:49,761 DEBUG awx.main.dispatch task 4d05c667-e587-4082-8e90-bcd0bbbbaa54 is finished 2022-04-27 18:11:59,775 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(ff81f909-4c28-4ec7-b782-0f251974b5dc, queue=awx_private_queue) [2022-04-27 18:11:59,775: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(ff81f909-4c28-4ec7-b782-0f251974b5dc, queue=awx_private_queue) 2022-04-27 18:11:59,797 DEBUG awx.main.dispatch delivered ff81f909-4c28-4ec7-b782-0f251974b5dc to worker[180] qsize 0 2022-04-27 18:11:59,800 DEBUG awx.main.dispatch task ff81f909-4c28-4ec7-b782-0f251974b5dc starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:11:59,813 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:11:59,816 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:11:29.868011+00:00 2022-04-27 18:11:59,864 DEBUG awx.main.dispatch task ff81f909-4c28-4ec7-b782-0f251974b5dc is finished 2022-04-27 18:11:59,865 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(4f7f2014-2981-4c6f-8f1b-6b9a29ff92a3, queue=onap-awx-0) [2022-04-27 18:11:59,865: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(4f7f2014-2981-4c6f-8f1b-6b9a29ff92a3, queue=onap-awx-0) 2022-04-27 18:11:59,895 DEBUG awx.main.dispatch delivered 4f7f2014-2981-4c6f-8f1b-6b9a29ff92a3 to worker[183] qsize 0 2022-04-27 18:11:59,898 DEBUG awx.main.dispatch task 4f7f2014-2981-4c6f-8f1b-6b9a29ff92a3 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 18:11:59,899 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 18:11:59,923 DEBUG awx.main.dispatch task 4f7f2014-2981-4c6f-8f1b-6b9a29ff92a3 is finished 2022-04-27 18:12:00,001 DEBUG awx.main.dispatch publish awx.main.tasks.gather_analytics(b15592b4-bcf0-4c1f-9617-0e93addbe92f, queue=awx_private_queue) [2022-04-27 18:12:00,001: DEBUG/Process-1] publish awx.main.tasks.gather_analytics(b15592b4-bcf0-4c1f-9617-0e93addbe92f, queue=awx_private_queue) 2022-04-27 18:12:00,131 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(02625092-f69c-4ee3-8502-123c7e60e09a, queue=onap-awx-0) [2022-04-27 18:12:00,131: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(02625092-f69c-4ee3-8502-123c7e60e09a, queue=onap-awx-0) RESULT 2 OKREADY 2022-04-27 18:12:00,415 DEBUG awx.main.dispatch delivered b15592b4-bcf0-4c1f-9617-0e93addbe92f to worker[183] qsize 0 2022-04-27 18:12:00,418 DEBUG awx.main.dispatch task b15592b4-bcf0-4c1f-9617-0e93addbe92f starting awx.main.tasks.gather_analytics(*[]) 2022-04-27 18:12:00,423 DEBUG awx.main.dispatch task b15592b4-bcf0-4c1f-9617-0e93addbe92f is finished 2022-04-27 18:12:00,718 DEBUG awx.main.dispatch delivered 02625092-f69c-4ee3-8502-123c7e60e09a to worker[182] qsize 0 2022-04-27 18:12:00,722 DEBUG awx.main.dispatch task 02625092-f69c-4ee3-8502-123c7e60e09a starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 18:12:00,736 DEBUG awx.main.dispatch task 02625092-f69c-4ee3-8502-123c7e60e09a is finished 2022-04-27 18:12:09,507 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ec49cae1-1bb8-4706-a820-999949ca37a3, queue=awx_private_queue) [2022-04-27 18:12:09,507: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ec49cae1-1bb8-4706-a820-999949ca37a3, queue=awx_private_queue) 2022-04-27 18:12:09,527 DEBUG awx.main.dispatch delivered ec49cae1-1bb8-4706-a820-999949ca37a3 to worker[182] qsize 0 2022-04-27 18:12:09,530 DEBUG awx.main.dispatch task ec49cae1-1bb8-4706-a820-999949ca37a3 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:12:09,533 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:12:09,556 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:12:09,588 DEBUG awx.main.dispatch task ec49cae1-1bb8-4706-a820-999949ca37a3 is finished 2022-04-27 18:12:29,517 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a519ca14-ceb6-4011-b59e-7eb2d8d01cea, queue=awx_private_queue) [2022-04-27 18:12:29,517: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a519ca14-ceb6-4011-b59e-7eb2d8d01cea, queue=awx_private_queue) 2022-04-27 18:12:29,538 DEBUG awx.main.dispatch delivered a519ca14-ceb6-4011-b59e-7eb2d8d01cea to worker[183] qsize 0 2022-04-27 18:12:29,541 DEBUG awx.main.dispatch task a519ca14-ceb6-4011-b59e-7eb2d8d01cea starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:12:29,543 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:12:29,563 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:12:29,593 DEBUG awx.main.dispatch task a519ca14-ceb6-4011-b59e-7eb2d8d01cea is finished 2022-04-27 18:12:29,774 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(02b1ae13-18f3-4b2e-87e3-126376b5afae, queue=awx_private_queue) [2022-04-27 18:12:29,774: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(02b1ae13-18f3-4b2e-87e3-126376b5afae, queue=awx_private_queue) 2022-04-27 18:12:30,121 DEBUG awx.main.dispatch delivered 02b1ae13-18f3-4b2e-87e3-126376b5afae to worker[182] qsize 0 2022-04-27 18:12:30,124 DEBUG awx.main.dispatch task 02b1ae13-18f3-4b2e-87e3-126376b5afae starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:12:30,135 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:12:30,138 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:11:59.813322+00:00 2022-04-27 18:12:30,334 DEBUG awx.main.dispatch task 02b1ae13-18f3-4b2e-87e3-126376b5afae is finished 2022-04-27 18:12:49,528 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(95256c96-c288-45ce-a112-f811c568ac73, queue=awx_private_queue) [2022-04-27 18:12:49,528: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(95256c96-c288-45ce-a112-f811c568ac73, queue=awx_private_queue) 2022-04-27 18:12:49,563 DEBUG awx.main.dispatch delivered 95256c96-c288-45ce-a112-f811c568ac73 to worker[181] qsize 0 2022-04-27 18:12:49,725 DEBUG awx.main.dispatch task 95256c96-c288-45ce-a112-f811c568ac73 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:12:49,728 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:12:49,743 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:12:49,773 DEBUG awx.main.dispatch task 95256c96-c288-45ce-a112-f811c568ac73 is finished 2022-04-27 18:12:59,777 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(1ff601be-efca-481d-a4be-e9897b2acd96, queue=awx_private_queue) [2022-04-27 18:12:59,777: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(1ff601be-efca-481d-a4be-e9897b2acd96, queue=awx_private_queue) 2022-04-27 18:12:59,799 DEBUG awx.main.dispatch delivered 1ff601be-efca-481d-a4be-e9897b2acd96 to worker[183] qsize 0 2022-04-27 18:12:59,802 DEBUG awx.main.dispatch task 1ff601be-efca-481d-a4be-e9897b2acd96 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:12:59,816 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:12:59,819 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:12:30.135852+00:00 2022-04-27 18:12:59,866 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(9868464c-2948-42fa-8b2c-63c87f64bd48, queue=onap-awx-0) [2022-04-27 18:12:59,866: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(9868464c-2948-42fa-8b2c-63c87f64bd48, queue=onap-awx-0) 2022-04-27 18:12:59,899 DEBUG awx.main.dispatch delivered 9868464c-2948-42fa-8b2c-63c87f64bd48 to worker[180] qsize 0 2022-04-27 18:12:59,901 DEBUG awx.main.dispatch task 9868464c-2948-42fa-8b2c-63c87f64bd48 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 18:12:59,905 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 18:13:00,001 DEBUG awx.main.dispatch publish awx.main.tasks.gather_analytics(f5ab5112-be9e-4e94-9105-6593b2c995af, queue=awx_private_queue) [2022-04-27 18:13:00,001: DEBUG/Process-1] publish awx.main.tasks.gather_analytics(f5ab5112-be9e-4e94-9105-6593b2c995af, queue=awx_private_queue) RESULT 2 OKREADY 2022-04-27 18:13:00,123 DEBUG awx.main.dispatch task 9868464c-2948-42fa-8b2c-63c87f64bd48 is finished 2022-04-27 18:13:00,131 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(09733a1a-4b3a-4e22-b17c-68007b8216a9, queue=onap-awx-0) [2022-04-27 18:13:00,131: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(09733a1a-4b3a-4e22-b17c-68007b8216a9, queue=onap-awx-0) 2022-04-27 18:13:00,153 DEBUG awx.main.dispatch delivered f5ab5112-be9e-4e94-9105-6593b2c995af to worker[182] qsize 0 2022-04-27 18:13:00,156 DEBUG awx.main.dispatch task f5ab5112-be9e-4e94-9105-6593b2c995af starting awx.main.tasks.gather_analytics(*[]) 2022-04-27 18:13:00,159 DEBUG awx.main.dispatch task f5ab5112-be9e-4e94-9105-6593b2c995af is finished 2022-04-27 18:13:00,172 DEBUG awx.main.dispatch delivered 09733a1a-4b3a-4e22-b17c-68007b8216a9 to worker[182] qsize 0 2022-04-27 18:13:00,176 DEBUG awx.main.dispatch task 09733a1a-4b3a-4e22-b17c-68007b8216a9 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 18:13:00,192 DEBUG awx.main.dispatch task 09733a1a-4b3a-4e22-b17c-68007b8216a9 is finished 2022-04-27 18:13:00,409 DEBUG awx.main.dispatch task 1ff601be-efca-481d-a4be-e9897b2acd96 is finished 2022-04-27 18:13:09,528 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(82cb8133-ba5c-4001-aac6-d69a3cd334b2, queue=awx_private_queue) [2022-04-27 18:13:09,528: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(82cb8133-ba5c-4001-aac6-d69a3cd334b2, queue=awx_private_queue) 2022-04-27 18:13:09,545 DEBUG awx.main.dispatch delivered 82cb8133-ba5c-4001-aac6-d69a3cd334b2 to worker[180] qsize 0 2022-04-27 18:13:09,548 DEBUG awx.main.dispatch task 82cb8133-ba5c-4001-aac6-d69a3cd334b2 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:13:09,550 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:13:09,570 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:13:09,598 DEBUG awx.main.dispatch task 82cb8133-ba5c-4001-aac6-d69a3cd334b2 is finished 2022-04-27 18:13:29,605 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(1db0791f-2178-4aeb-bbf7-5989b5f050d8, queue=awx_private_queue) [2022-04-27 18:13:29,605: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(1db0791f-2178-4aeb-bbf7-5989b5f050d8, queue=awx_private_queue) 2022-04-27 18:13:29,625 DEBUG awx.main.dispatch delivered 1db0791f-2178-4aeb-bbf7-5989b5f050d8 to worker[181] qsize 0 2022-04-27 18:13:29,628 DEBUG awx.main.dispatch task 1db0791f-2178-4aeb-bbf7-5989b5f050d8 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:13:29,630 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:13:29,652 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:13:29,686 DEBUG awx.main.dispatch task 1db0791f-2178-4aeb-bbf7-5989b5f050d8 is finished 2022-04-27 18:13:29,775 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(be6e9f0d-6033-40fa-8232-f0e7e77ad9be, queue=awx_private_queue) [2022-04-27 18:13:29,775: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(be6e9f0d-6033-40fa-8232-f0e7e77ad9be, queue=awx_private_queue) 2022-04-27 18:13:29,791 DEBUG awx.main.dispatch delivered be6e9f0d-6033-40fa-8232-f0e7e77ad9be to worker[182] qsize 0 2022-04-27 18:13:29,795 DEBUG awx.main.dispatch task be6e9f0d-6033-40fa-8232-f0e7e77ad9be starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:13:29,807 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:13:29,811 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:12:59.816666+00:00 2022-04-27 18:13:30,156 DEBUG awx.main.dispatch task be6e9f0d-6033-40fa-8232-f0e7e77ad9be is finished 2022-04-27 18:13:49,606 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3d4706c6-eaf0-4720-949a-7e286ca5a19e, queue=awx_private_queue) [2022-04-27 18:13:49,606: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3d4706c6-eaf0-4720-949a-7e286ca5a19e, queue=awx_private_queue) 2022-04-27 18:13:49,644 DEBUG awx.main.dispatch delivered 3d4706c6-eaf0-4720-949a-7e286ca5a19e to worker[180] qsize 0 2022-04-27 18:13:49,826 DEBUG awx.main.dispatch task 3d4706c6-eaf0-4720-949a-7e286ca5a19e starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:13:49,829 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:13:49,846 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:13:49,875 DEBUG awx.main.dispatch task 3d4706c6-eaf0-4720-949a-7e286ca5a19e is finished 2022-04-27 18:13:59,776 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(825ef86a-375b-4303-a261-1a08b802bcac, queue=awx_private_queue) [2022-04-27 18:13:59,776: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(825ef86a-375b-4303-a261-1a08b802bcac, queue=awx_private_queue) 2022-04-27 18:13:59,797 DEBUG awx.main.dispatch delivered 825ef86a-375b-4303-a261-1a08b802bcac to worker[180] qsize 0 2022-04-27 18:13:59,800 DEBUG awx.main.dispatch task 825ef86a-375b-4303-a261-1a08b802bcac starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:13:59,813 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:13:59,816 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:13:29.808112+00:00 2022-04-27 18:13:59,866 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(934a5b6e-c1d5-4746-8302-f3000957699d, queue=onap-awx-0) [2022-04-27 18:13:59,866: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(934a5b6e-c1d5-4746-8302-f3000957699d, queue=onap-awx-0) 2022-04-27 18:13:59,899 DEBUG awx.main.dispatch delivered 934a5b6e-c1d5-4746-8302-f3000957699d to worker[182] qsize 0 2022-04-27 18:13:59,902 DEBUG awx.main.dispatch task 934a5b6e-c1d5-4746-8302-f3000957699d starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 18:13:59,904 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 18:14:00,001 DEBUG awx.main.dispatch publish awx.main.tasks.gather_analytics(a83b6835-fd2b-4f22-89f0-f0f950d3bf59, queue=awx_private_queue) [2022-04-27 18:14:00,001: DEBUG/Process-1] publish awx.main.tasks.gather_analytics(a83b6835-fd2b-4f22-89f0-f0f950d3bf59, queue=awx_private_queue) RESULT 2 OKREADY 2022-04-27 18:14:00,132 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(9c00cc3e-27b4-4886-9bd2-ff2525687098, queue=onap-awx-0) [2022-04-27 18:14:00,132: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(9c00cc3e-27b4-4886-9bd2-ff2525687098, queue=onap-awx-0) 2022-04-27 18:14:00,305 DEBUG awx.main.dispatch task 934a5b6e-c1d5-4746-8302-f3000957699d is finished 2022-04-27 18:14:00,352 DEBUG awx.main.dispatch task 825ef86a-375b-4303-a261-1a08b802bcac is finished 2022-04-27 18:14:00,638 DEBUG awx.main.dispatch delivered a83b6835-fd2b-4f22-89f0-f0f950d3bf59 to worker[180] qsize 0 2022-04-27 18:14:00,641 DEBUG awx.main.dispatch task a83b6835-fd2b-4f22-89f0-f0f950d3bf59 starting awx.main.tasks.gather_analytics(*[]) 2022-04-27 18:14:00,643 DEBUG awx.main.dispatch task a83b6835-fd2b-4f22-89f0-f0f950d3bf59 is finished 2022-04-27 18:14:00,777 DEBUG awx.main.dispatch delivered 9c00cc3e-27b4-4886-9bd2-ff2525687098 to worker[181] qsize 0 2022-04-27 18:14:00,779 DEBUG awx.main.dispatch task 9c00cc3e-27b4-4886-9bd2-ff2525687098 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 18:14:00,794 DEBUG awx.main.dispatch task 9c00cc3e-27b4-4886-9bd2-ff2525687098 is finished 2022-04-27 18:14:09,606 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(29fdb4ae-5bcd-4bd3-a6d0-27fe832df77c, queue=awx_private_queue) [2022-04-27 18:14:09,606: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(29fdb4ae-5bcd-4bd3-a6d0-27fe832df77c, queue=awx_private_queue) 2022-04-27 18:14:09,631 DEBUG awx.main.dispatch delivered 29fdb4ae-5bcd-4bd3-a6d0-27fe832df77c to worker[180] qsize 0 2022-04-27 18:14:09,634 DEBUG awx.main.dispatch task 29fdb4ae-5bcd-4bd3-a6d0-27fe832df77c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:14:09,637 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:14:09,656 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:14:09,686 DEBUG awx.main.dispatch task 29fdb4ae-5bcd-4bd3-a6d0-27fe832df77c is finished 2022-04-27 18:14:29,609 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(059b171d-3a77-4dfe-a387-1a00362306d5, queue=awx_private_queue) [2022-04-27 18:14:29,609: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(059b171d-3a77-4dfe-a387-1a00362306d5, queue=awx_private_queue) 2022-04-27 18:14:29,629 DEBUG awx.main.dispatch delivered 059b171d-3a77-4dfe-a387-1a00362306d5 to worker[182] qsize 0 2022-04-27 18:14:29,633 DEBUG awx.main.dispatch task 059b171d-3a77-4dfe-a387-1a00362306d5 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:14:29,635 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:14:29,656 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:14:29,690 DEBUG awx.main.dispatch task 059b171d-3a77-4dfe-a387-1a00362306d5 is finished 2022-04-27 18:14:29,776 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(5ee1ce4c-cde5-4e2f-a52b-2a2547f94684, queue=awx_private_queue) [2022-04-27 18:14:29,776: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(5ee1ce4c-cde5-4e2f-a52b-2a2547f94684, queue=awx_private_queue) 2022-04-27 18:14:29,796 DEBUG awx.main.dispatch delivered 5ee1ce4c-cde5-4e2f-a52b-2a2547f94684 to worker[182] qsize 0 2022-04-27 18:14:29,800 DEBUG awx.main.dispatch task 5ee1ce4c-cde5-4e2f-a52b-2a2547f94684 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:14:29,811 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:14:29,814 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:13:59.813882+00:00 2022-04-27 18:14:30,116 DEBUG awx.main.dispatch task 5ee1ce4c-cde5-4e2f-a52b-2a2547f94684 is finished 2022-04-27 18:14:49,619 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(aec3e253-4287-4408-8b43-189c8ee8eba9, queue=awx_private_queue) [2022-04-27 18:14:49,619: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(aec3e253-4287-4408-8b43-189c8ee8eba9, queue=awx_private_queue) 2022-04-27 18:14:49,651 DEBUG awx.main.dispatch delivered aec3e253-4287-4408-8b43-189c8ee8eba9 to worker[181] qsize 0 2022-04-27 18:14:49,815 DEBUG awx.main.dispatch task aec3e253-4287-4408-8b43-189c8ee8eba9 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:14:49,817 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:14:49,833 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:14:49,863 DEBUG awx.main.dispatch task aec3e253-4287-4408-8b43-189c8ee8eba9 is finished 2022-04-27 18:14:59,776 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(04175b3d-9506-4fa3-87da-3f04347f145d, queue=awx_private_queue) [2022-04-27 18:14:59,776: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(04175b3d-9506-4fa3-87da-3f04347f145d, queue=awx_private_queue) 2022-04-27 18:14:59,793 DEBUG awx.main.dispatch delivered 04175b3d-9506-4fa3-87da-3f04347f145d to worker[180] qsize 0 2022-04-27 18:14:59,796 DEBUG awx.main.dispatch task 04175b3d-9506-4fa3-87da-3f04347f145d starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:14:59,809 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:14:59,812 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:14:29.811687+00:00 2022-04-27 18:14:59,830 DEBUG awx.main.dispatch task 04175b3d-9506-4fa3-87da-3f04347f145d is finished 2022-04-27 18:14:59,865 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(a1b59cc3-bf55-4e51-8e16-0ffad6e26258, queue=onap-awx-0) [2022-04-27 18:14:59,865: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(a1b59cc3-bf55-4e51-8e16-0ffad6e26258, queue=onap-awx-0) 2022-04-27 18:14:59,890 DEBUG awx.main.dispatch delivered a1b59cc3-bf55-4e51-8e16-0ffad6e26258 to worker[180] qsize 0 2022-04-27 18:14:59,892 DEBUG awx.main.dispatch task a1b59cc3-bf55-4e51-8e16-0ffad6e26258 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 18:14:59,893 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 18:14:59,916 DEBUG awx.main.dispatch task a1b59cc3-bf55-4e51-8e16-0ffad6e26258 is finished 2022-04-27 18:15:00,001 DEBUG awx.main.dispatch publish awx.main.tasks.gather_analytics(e64ebbfc-eef0-41bf-b0c5-d0433573543a, queue=awx_private_queue) [2022-04-27 18:15:00,001: DEBUG/Process-1] publish awx.main.tasks.gather_analytics(e64ebbfc-eef0-41bf-b0c5-d0433573543a, queue=awx_private_queue) 2022-04-27 18:15:00,132 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(17b78beb-0d25-45f4-a914-f2c1eb6d4eb9, queue=onap-awx-0) [2022-04-27 18:15:00,132: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(17b78beb-0d25-45f4-a914-f2c1eb6d4eb9, queue=onap-awx-0) RESULT 2 OKREADY 2022-04-27 18:15:00,153 DEBUG awx.main.dispatch publish awx.main.tasks.awx_isolated_heartbeat(f8bc84da-a894-44a6-a3ca-ba4a30aaa986, queue=onap-awx-0) [2022-04-27 18:15:00,153: DEBUG/Process-1] publish awx.main.tasks.awx_isolated_heartbeat(f8bc84da-a894-44a6-a3ca-ba4a30aaa986, queue=onap-awx-0) 2022-04-27 18:15:00,565 DEBUG awx.main.dispatch delivered e64ebbfc-eef0-41bf-b0c5-d0433573543a to worker[183] qsize 0 2022-04-27 18:15:00,567 DEBUG awx.main.dispatch task e64ebbfc-eef0-41bf-b0c5-d0433573543a starting awx.main.tasks.gather_analytics(*[]) 2022-04-27 18:15:00,572 DEBUG awx.main.dispatch task e64ebbfc-eef0-41bf-b0c5-d0433573543a is finished 2022-04-27 18:15:00,586 DEBUG awx.main.dispatch delivered 17b78beb-0d25-45f4-a914-f2c1eb6d4eb9 to worker[183] qsize 0 2022-04-27 18:15:00,589 DEBUG awx.main.dispatch task 17b78beb-0d25-45f4-a914-f2c1eb6d4eb9 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 18:15:00,589 DEBUG awx.main.dispatch delivered f8bc84da-a894-44a6-a3ca-ba4a30aaa986 to worker[181] qsize 0 2022-04-27 18:15:00,592 DEBUG awx.main.dispatch task f8bc84da-a894-44a6-a3ca-ba4a30aaa986 starting awx.main.tasks.awx_isolated_heartbeat(*[]) 2022-04-27 18:15:00,593 DEBUG awx.main.tasks Controlling node checking for any isolated management tasks. 2022-04-27 18:15:00,602 DEBUG awx.main.dispatch task 17b78beb-0d25-45f4-a914-f2c1eb6d4eb9 is finished 2022-04-27 18:15:00,613 DEBUG awx.main.dispatch task f8bc84da-a894-44a6-a3ca-ba4a30aaa986 is finished 2022-04-27 18:15:09,619 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(64a42c3a-bd63-42f8-ab5b-7db98956f9ae, queue=awx_private_queue) [2022-04-27 18:15:09,619: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(64a42c3a-bd63-42f8-ab5b-7db98956f9ae, queue=awx_private_queue) 2022-04-27 18:15:09,650 DEBUG awx.main.dispatch delivered 64a42c3a-bd63-42f8-ab5b-7db98956f9ae to worker[181] qsize 0 2022-04-27 18:15:09,653 DEBUG awx.main.dispatch task 64a42c3a-bd63-42f8-ab5b-7db98956f9ae starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:15:09,655 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:15:09,673 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:15:09,705 DEBUG awx.main.dispatch task 64a42c3a-bd63-42f8-ab5b-7db98956f9ae is finished 2022-04-27 18:15:29,619 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3ef864d8-c12e-4d7d-8df0-1ac6c63408b6, queue=awx_private_queue) [2022-04-27 18:15:29,619: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3ef864d8-c12e-4d7d-8df0-1ac6c63408b6, queue=awx_private_queue) 2022-04-27 18:15:29,659 DEBUG awx.main.dispatch delivered 3ef864d8-c12e-4d7d-8df0-1ac6c63408b6 to worker[182] qsize 0 2022-04-27 18:15:29,662 DEBUG awx.main.dispatch task 3ef864d8-c12e-4d7d-8df0-1ac6c63408b6 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:15:29,664 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:15:29,684 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:15:29,711 DEBUG awx.main.dispatch task 3ef864d8-c12e-4d7d-8df0-1ac6c63408b6 is finished 2022-04-27 18:15:29,776 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(35cd0857-39e9-48db-a087-7a218bb11387, queue=awx_private_queue) [2022-04-27 18:15:29,776: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(35cd0857-39e9-48db-a087-7a218bb11387, queue=awx_private_queue) 2022-04-27 18:15:29,795 DEBUG awx.main.dispatch delivered 35cd0857-39e9-48db-a087-7a218bb11387 to worker[181] qsize 0 2022-04-27 18:15:29,799 DEBUG awx.main.dispatch task 35cd0857-39e9-48db-a087-7a218bb11387 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:15:29,810 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:15:29,813 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:14:59.809416+00:00 2022-04-27 18:15:30,154 DEBUG awx.main.dispatch task 35cd0857-39e9-48db-a087-7a218bb11387 is finished 2022-04-27 18:15:49,629 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(bcec7298-87c2-40f8-abbc-49a0026c6bf0, queue=awx_private_queue) [2022-04-27 18:15:49,629: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(bcec7298-87c2-40f8-abbc-49a0026c6bf0, queue=awx_private_queue) 2022-04-27 18:15:49,665 DEBUG awx.main.dispatch delivered bcec7298-87c2-40f8-abbc-49a0026c6bf0 to worker[183] qsize 0 2022-04-27 18:15:49,839 DEBUG awx.main.dispatch task bcec7298-87c2-40f8-abbc-49a0026c6bf0 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:15:49,841 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:15:49,858 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:15:49,886 DEBUG awx.main.dispatch task bcec7298-87c2-40f8-abbc-49a0026c6bf0 is finished 2022-04-27 18:15:59,777 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(8172e76d-831f-4cb3-b638-685f3008ed4e, queue=awx_private_queue) [2022-04-27 18:15:59,777: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(8172e76d-831f-4cb3-b638-685f3008ed4e, queue=awx_private_queue) 2022-04-27 18:15:59,794 DEBUG awx.main.dispatch delivered 8172e76d-831f-4cb3-b638-685f3008ed4e to worker[181] qsize 0 2022-04-27 18:15:59,798 DEBUG awx.main.dispatch task 8172e76d-831f-4cb3-b638-685f3008ed4e starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:15:59,815 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:15:59,818 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:15:29.810440+00:00 2022-04-27 18:15:59,865 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(d6397b06-5d55-4b52-8354-df8c2637ec40, queue=onap-awx-0) [2022-04-27 18:15:59,865: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(d6397b06-5d55-4b52-8354-df8c2637ec40, queue=onap-awx-0) 2022-04-27 18:15:59,895 DEBUG awx.main.dispatch delivered d6397b06-5d55-4b52-8354-df8c2637ec40 to worker[183] qsize 0 2022-04-27 18:15:59,897 DEBUG awx.main.dispatch task d6397b06-5d55-4b52-8354-df8c2637ec40 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-04-27 18:15:59,899 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-04-27 18:15:59,978 DEBUG awx.main.dispatch task d6397b06-5d55-4b52-8354-df8c2637ec40 is finished 2022-04-27 18:15:59,992 DEBUG awx.main.dispatch task 8172e76d-831f-4cb3-b638-685f3008ed4e is finished 2022-04-27 18:16:00,001 DEBUG awx.main.dispatch publish awx.main.tasks.gather_analytics(08b25c0a-b6b0-426e-b43e-d0c510a03e78, queue=awx_private_queue) [2022-04-27 18:16:00,001: DEBUG/Process-1] publish awx.main.tasks.gather_analytics(08b25c0a-b6b0-426e-b43e-d0c510a03e78, queue=awx_private_queue) 2022-04-27 18:16:00,053 DEBUG awx.main.dispatch delivered 08b25c0a-b6b0-426e-b43e-d0c510a03e78 to worker[180] qsize 0 RESULT 2 OKREADY 2022-04-27 18:16:00,056 DEBUG awx.main.dispatch task 08b25c0a-b6b0-426e-b43e-d0c510a03e78 starting awx.main.tasks.gather_analytics(*[]) 2022-04-27 18:16:00,059 DEBUG awx.main.dispatch task 08b25c0a-b6b0-426e-b43e-d0c510a03e78 is finished 2022-04-27 18:16:00,131 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(99665123-c5c7-4c04-8ffb-1866afe368ec, queue=onap-awx-0) [2022-04-27 18:16:00,131: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(99665123-c5c7-4c04-8ffb-1866afe368ec, queue=onap-awx-0) 2022-04-27 18:16:00,430 DEBUG awx.main.dispatch delivered 99665123-c5c7-4c04-8ffb-1866afe368ec to worker[182] qsize 0 2022-04-27 18:16:00,433 DEBUG awx.main.dispatch task 99665123-c5c7-4c04-8ffb-1866afe368ec starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-04-27 18:16:00,448 DEBUG awx.main.dispatch task 99665123-c5c7-4c04-8ffb-1866afe368ec is finished 2022-04-27 18:16:09,629 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(28055145-a134-4ba8-8283-0c9245340f34, queue=awx_private_queue) [2022-04-27 18:16:09,629: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(28055145-a134-4ba8-8283-0c9245340f34, queue=awx_private_queue) 2022-04-27 18:16:09,646 DEBUG awx.main.dispatch delivered 28055145-a134-4ba8-8283-0c9245340f34 to worker[180] qsize 0 2022-04-27 18:16:09,648 DEBUG awx.main.dispatch task 28055145-a134-4ba8-8283-0c9245340f34 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:16:09,649 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:16:09,668 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:16:09,697 DEBUG awx.main.dispatch task 28055145-a134-4ba8-8283-0c9245340f34 is finished 2022-04-27 18:16:29,788 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(46b65a5a-3e7a-4cf6-8af3-52ca5379d00e, queue=awx_private_queue) [2022-04-27 18:16:29,788: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(46b65a5a-3e7a-4cf6-8af3-52ca5379d00e, queue=awx_private_queue) 2022-04-27 18:16:29,813 DEBUG awx.main.dispatch delivered 46b65a5a-3e7a-4cf6-8af3-52ca5379d00e to worker[182] qsize 0 2022-04-27 18:16:29,815 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(a7e7c061-deb4-4ce8-a06c-95772e6eabee, queue=awx_private_queue) [2022-04-27 18:16:29,815: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(a7e7c061-deb4-4ce8-a06c-95772e6eabee, queue=awx_private_queue) 2022-04-27 18:16:29,816 DEBUG awx.main.dispatch task 46b65a5a-3e7a-4cf6-8af3-52ca5379d00e starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:16:29,817 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:16:29,833 DEBUG awx.main.dispatch delivered a7e7c061-deb4-4ce8-a06c-95772e6eabee to worker[181] qsize 0 2022-04-27 18:16:29,836 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:16:29,836 DEBUG awx.main.dispatch task a7e7c061-deb4-4ce8-a06c-95772e6eabee starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-04-27 18:16:29,849 DEBUG awx.main.tasks Starting periodic scheduler 2022-04-27 18:16:29,851 DEBUG awx.main.tasks Last scheduler run was: 2022-04-27 18:15:59.815390+00:00 2022-04-27 18:16:29,869 DEBUG awx.main.dispatch task 46b65a5a-3e7a-4cf6-8af3-52ca5379d00e is finished 2022-04-27 18:16:30,315 DEBUG awx.main.dispatch task a7e7c061-deb4-4ce8-a06c-95772e6eabee is finished 2022-04-27 18:16:49,790 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(44714652-9ac9-4b6c-b796-217ccb7cd844, queue=awx_private_queue) [2022-04-27 18:16:49,790: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(44714652-9ac9-4b6c-b796-217ccb7cd844, queue=awx_private_queue) 2022-04-27 18:16:49,827 DEBUG awx.main.dispatch delivered 44714652-9ac9-4b6c-b796-217ccb7cd844 to worker[181] qsize 0 2022-04-27 18:16:49,989 DEBUG awx.main.dispatch task 44714652-9ac9-4b6c-b796-217ccb7cd844 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-04-27 18:16:49,991 DEBUG awx.main.scheduler Running Tower task manager. 2022-04-27 18:16:50,007 DEBUG awx.main.scheduler Starting Scheduler 2022-04-27 18:16:50,037 DEBUG awx.main.dispatch task 44714652-9ac9-4b6c-b796-217ccb7cd844 is finished