By type
Using /etc/ansible/ansible.cfg as config file 127.0.0.1 | SUCCESS => { "ansible_facts": { "discovered_interpreter_python": "/usr/libexec/platform-python" }, "changed": false, "elapsed": 0, "match_groupdict": {}, "match_groups": [], "path": null, "port": 5432, "search_regex": null, "state": "started" } Using /etc/ansible/ansible.cfg as config file 127.0.0.1 | FAILED! => { "ansible_facts": { "discovered_interpreter_python": "/usr/libexec/platform-python" }, "changed": false, "msg": "argument port is of type
and we were unable to convert to int: cannot be converted to an int" } Using /etc/ansible/ansible.cfg as config file 127.0.0.1 | FAILED! => { "ansible_facts": { "discovered_interpreter_python": "/usr/libexec/platform-python" }, "changed": false, "msg": "argument port is of type and we were unable to convert to int: cannot be converted to an int" } Using /etc/ansible/ansible.cfg as config file 127.0.0.1 | SUCCESS => { "ansible_facts": { "discovered_interpreter_python": "/usr/libexec/platform-python" }, "changed": false, "db": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER" } Default organization added. Demo Credential, Inventory, and Job Template added. (changed: True) 2022-05-21 02:42:30,671 DEBUG awx.main.dispatch publish awx.main.tasks.apply_cluster_membership_policies(3dcc3f6f-a12d-4c3d-a5f2-e2bb113667bf, queue=awx_private_queue) Successfully registered instance onap-awx-0 (changed: True) 2022-05-21 02:44:06,349 DEBUG awx.main.dispatch publish awx.main.tasks.apply_cluster_membership_policies(17a8091a-54c6-4ddf-8e86-83df3158d67d, queue=awx_private_queue) 2022-05-21 02:44:07,104 DEBUG awx.main.dispatch publish awx.main.tasks.apply_cluster_membership_policies(7d61be65-fd0d-44e1-b0c1-98d78c9a213b, queue=awx_private_queue) Creating instance group tower (changed: True) /usr/bin/launch_awx_task.sh: line 27: unset: `#!/bin/sh': not a valid identifier 2022-05-21 02:44:07,924 INFO RPC interface 'supervisor' initialized 2022-05-21 02:44:07,924 CRIT Server 'unix_http_server' running without any HTTP authentication checking 2022-05-21 02:44:07,925 INFO supervisord started with pid 150 2022-05-21 02:44:08,929 INFO spawned: 'awx-config-watcher' with pid 153 2022-05-21 02:44:08,933 INFO spawned: 'dispatcher' with pid 154 2022-05-21 02:44:08,936 INFO spawned: 'callback-receiver' with pid 155 2022-05-21 02:44:08,940 INFO spawned: 'channels-worker' with pid 156 READY 2022-05-21 02:44:10,077 INFO success: awx-config-watcher entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-21 02:44:10,078 INFO success: dispatcher entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-21 02:44:10,078 INFO success: callback-receiver entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-21 02:44:10,078 INFO success: channels-worker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-21 02:44:12,356 WARNING awx.main.dispatch scaling up worker pid:176 2022-05-21 02:44:12,367 WARNING awx.main.dispatch scaling up worker pid:177 2022-05-21 02:44:12,380 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:179 2022-05-21 02:44:12,380 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:179 2022-05-21 02:44:12,376 WARNING awx.main.dispatch scaling up worker pid:178 2022-05-21 02:44:12,386 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:180 2022-05-21 02:44:12,386 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:180 2022-05-21 02:44:12,388 WARNING awx.main.dispatch scaling up worker pid:181 2022-05-21 02:44:12,392 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:182 2022-05-21 02:44:12,392 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:182 2022-05-21 02:44:12,393 DEBUG awx.main.tasks Syncing Schedules 2022-05-21 02:44:12,398 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:183 2022-05-21 02:44:12,398 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:183 2022-05-21 02:44:12,472 - INFO - runworker - Using single-threaded worker. 2022-05-21 02:44:12,473 - INFO - runworker - Running worker against channel layer default (asgi_amqp.core.AMQPChannelLayer) 2022-05-21 02:44:12,474 - INFO - worker - Listening on channels websocket.connect, websocket.disconnect, websocket.receive 2022-05-21 02:44:13,239 ERROR celery.beat Removing corrupted schedule file '/var/lib/awx/beat.db': error(11, 'Resource temporarily unavailable') Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/celery/beat.py", line 485, in setup_schedule self._store = self._open_schedule() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/celery/beat.py", line 475, in _open_schedule return self.persistence.open(self.schedule_filename, writeback=True) File "/usr/lib64/python3.6/shelve.py", line 243, in open return DbfilenameShelf(filename, flag, protocol, writeback) File "/usr/lib64/python3.6/shelve.py", line 227, in __init__ Shelf.__init__(self, dbm.open(filename, flag), protocol, writeback) File "/usr/lib64/python3.6/dbm/__init__.py", line 94, in open return mod.open(file, flag, mode) _gdbm.error: [Errno 11] Resource temporarily unavailable 2022-05-21 02:44:14,774 DEBUG awx.main.tasks Waited 0.0017769336700439453 seconds to obtain lock name: cluster_policy_lock 2022-05-21 02:44:14,788 DEBUG awx.main.tasks Total non-isolated instances:1 available for policy: 1 2022-05-21 02:44:14,788 DEBUG awx.main.tasks Policy percentage, adding Instances [1] to Group tower 2022-05-21 02:44:14,789 DEBUG awx.main.tasks Adding instances [1] to group tower 2022-05-21 02:44:15,012 DEBUG awx.main.tasks Cluster policy computation finished in 0.23794031143188477 seconds 2022-05-21 02:44:15,013 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 02:44:15,379 DEBUG awx.main.dispatch listening on ['awx_private_queue [direct]', 'onap-awx-0 [direct]', 'tower_broadcast_all_onap-awx-0 [fanout]'] 2022-05-21 02:44:35,125 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(4ef60d21-bb09-4819-947a-f35fb9c98dff, queue=awx_private_queue) [2022-05-21 02:44:35,125: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(4ef60d21-bb09-4819-947a-f35fb9c98dff, queue=awx_private_queue) 2022-05-21 02:44:35,144 DEBUG awx.main.dispatch delivered 4ef60d21-bb09-4819-947a-f35fb9c98dff to worker[178] qsize 0 2022-05-21 02:44:35,149 DEBUG awx.main.dispatch task 4ef60d21-bb09-4819-947a-f35fb9c98dff starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:44:35,151 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:44:35,182 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:44:35,244 DEBUG awx.main.dispatch task 4ef60d21-bb09-4819-947a-f35fb9c98dff is finished 2022-05-21 02:44:44,980 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(a67b97a7-810c-410a-b362-0f0e833f8ea6, queue=awx_private_queue) [2022-05-21 02:44:44,980: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(a67b97a7-810c-410a-b362-0f0e833f8ea6, queue=awx_private_queue) 2022-05-21 02:44:44,999 DEBUG awx.main.dispatch delivered a67b97a7-810c-410a-b362-0f0e833f8ea6 to worker[176] qsize 0 2022-05-21 02:44:45,002 DEBUG awx.main.dispatch task a67b97a7-810c-410a-b362-0f0e833f8ea6 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:44:45,019 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 02:44:45,033 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:44:45.026116+00:00 2022-05-21 02:44:45,116 DEBUG awx.main.dispatch task a67b97a7-810c-410a-b362-0f0e833f8ea6 is finished 2022-05-21 02:44:55,107 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3e360309-79f8-4d3e-bd7e-560c20d1aa2f, queue=awx_private_queue) [2022-05-21 02:44:55,107: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3e360309-79f8-4d3e-bd7e-560c20d1aa2f, queue=awx_private_queue) 2022-05-21 02:44:55,123 DEBUG awx.main.dispatch delivered 3e360309-79f8-4d3e-bd7e-560c20d1aa2f to worker[178] qsize 0 2022-05-21 02:44:55,125 DEBUG awx.main.dispatch task 3e360309-79f8-4d3e-bd7e-560c20d1aa2f starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:44:55,129 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:44:55,153 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:44:55,188 DEBUG awx.main.dispatch task 3e360309-79f8-4d3e-bd7e-560c20d1aa2f is finished RESULT 2 OKREADY 2022-05-21 02:45:14,990 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(594cc19a-7f26-4db7-ace4-8aad0527b8cf, queue=onap-awx-0) [2022-05-21 02:45:14,990: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(594cc19a-7f26-4db7-ace4-8aad0527b8cf, queue=onap-awx-0) 2022-05-21 02:45:15,217 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(d7bb1a2e-249b-48de-b5ba-89e9fa9e9e20, queue=onap-awx-0) [2022-05-21 02:45:15,217: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(d7bb1a2e-249b-48de-b5ba-89e9fa9e9e20, queue=onap-awx-0) 2022-05-21 02:45:15,232 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(76015671-f369-4e97-bf5a-f79d121942ef, queue=awx_private_queue) [2022-05-21 02:45:15,232: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(76015671-f369-4e97-bf5a-f79d121942ef, queue=awx_private_queue) 2022-05-21 02:45:15,237 DEBUG awx.main.dispatch delivered 594cc19a-7f26-4db7-ace4-8aad0527b8cf to worker[177] qsize 0 2022-05-21 02:45:15,242 DEBUG awx.main.dispatch delivered d7bb1a2e-249b-48de-b5ba-89e9fa9e9e20 to worker[178] qsize 0 2022-05-21 02:45:15,243 DEBUG awx.main.dispatch task 594cc19a-7f26-4db7-ace4-8aad0527b8cf starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 02:45:15,248 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 02:45:15,245 DEBUG awx.main.dispatch task d7bb1a2e-249b-48de-b5ba-89e9fa9e9e20 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 02:45:15,248 DEBUG awx.main.dispatch delivered 76015671-f369-4e97-bf5a-f79d121942ef to worker[176] qsize 0 2022-05-21 02:45:15,249 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0a470571-4340-4a5a-afba-8a8a63a2f365, queue=awx_private_queue) [2022-05-21 02:45:15,249: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0a470571-4340-4a5a-afba-8a8a63a2f365, queue=awx_private_queue) 2022-05-21 02:45:15,251 DEBUG awx.main.dispatch task 76015671-f369-4e97-bf5a-f79d121942ef starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:45:15,263 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 02:45:15,264 DEBUG awx.main.dispatch task d7bb1a2e-249b-48de-b5ba-89e9fa9e9e20 is finished 2022-05-21 02:45:15,265 DEBUG awx.main.dispatch delivered 0a470571-4340-4a5a-afba-8a8a63a2f365 to worker[181] qsize 0 2022-05-21 02:45:15,267 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:44:45.019596+00:00 2022-05-21 02:45:15,269 DEBUG awx.main.dispatch task 0a470571-4340-4a5a-afba-8a8a63a2f365 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:45:15,273 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:45:15,298 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:45:15,357 DEBUG awx.main.dispatch task 0a470571-4340-4a5a-afba-8a8a63a2f365 is finished 2022-05-21 02:45:15,780 DEBUG awx.main.dispatch task 594cc19a-7f26-4db7-ace4-8aad0527b8cf is finished 2022-05-21 02:45:16,026 DEBUG awx.main.dispatch task 76015671-f369-4e97-bf5a-f79d121942ef is finished 2022-05-21 02:45:35,259 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e2284c54-a977-4938-aa20-8f96727d0519, queue=awx_private_queue) [2022-05-21 02:45:35,259: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e2284c54-a977-4938-aa20-8f96727d0519, queue=awx_private_queue) 2022-05-21 02:45:35,276 DEBUG awx.main.dispatch delivered e2284c54-a977-4938-aa20-8f96727d0519 to worker[177] qsize 0 2022-05-21 02:45:35,279 DEBUG awx.main.dispatch task e2284c54-a977-4938-aa20-8f96727d0519 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:45:35,281 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:45:35,305 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:45:35,360 DEBUG awx.main.dispatch task e2284c54-a977-4938-aa20-8f96727d0519 is finished 2022-05-21 02:45:45,233 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(8c1ea994-0b30-44da-ac15-4c2632f68558, queue=awx_private_queue) [2022-05-21 02:45:45,233: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(8c1ea994-0b30-44da-ac15-4c2632f68558, queue=awx_private_queue) 2022-05-21 02:45:45,251 DEBUG awx.main.dispatch delivered 8c1ea994-0b30-44da-ac15-4c2632f68558 to worker[177] qsize 0 2022-05-21 02:45:45,254 DEBUG awx.main.dispatch task 8c1ea994-0b30-44da-ac15-4c2632f68558 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:45:45,269 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 02:45:45,273 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:45:15.263844+00:00 2022-05-21 02:45:45,644 DEBUG awx.main.dispatch task 8c1ea994-0b30-44da-ac15-4c2632f68558 is finished 2022-05-21 02:45:55,260 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7a7e965a-7037-462c-b3b5-397350976814, queue=awx_private_queue) [2022-05-21 02:45:55,260: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7a7e965a-7037-462c-b3b5-397350976814, queue=awx_private_queue) 2022-05-21 02:45:55,278 DEBUG awx.main.dispatch delivered 7a7e965a-7037-462c-b3b5-397350976814 to worker[176] qsize 0 2022-05-21 02:45:55,283 DEBUG awx.main.dispatch task 7a7e965a-7037-462c-b3b5-397350976814 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:45:55,284 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:45:55,309 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:45:55,361 DEBUG awx.main.dispatch task 7a7e965a-7037-462c-b3b5-397350976814 is finished RESULT 2 OKREADY 2022-05-21 02:46:15,000 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(1b0a5546-8aaf-404f-9acc-c5f0f01b94c4, queue=onap-awx-0) [2022-05-21 02:46:15,000: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(1b0a5546-8aaf-404f-9acc-c5f0f01b94c4, queue=onap-awx-0) 2022-05-21 02:46:15,217 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(8b0d5d8d-2432-46ef-9649-07f6d0698b5d, queue=onap-awx-0) [2022-05-21 02:46:15,217: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(8b0d5d8d-2432-46ef-9649-07f6d0698b5d, queue=onap-awx-0) 2022-05-21 02:46:15,220 DEBUG awx.main.dispatch delivered 1b0a5546-8aaf-404f-9acc-c5f0f01b94c4 to worker[178] qsize 0 2022-05-21 02:46:15,223 DEBUG awx.main.dispatch task 1b0a5546-8aaf-404f-9acc-c5f0f01b94c4 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 02:46:15,225 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 02:46:15,234 DEBUG awx.main.dispatch delivered 8b0d5d8d-2432-46ef-9649-07f6d0698b5d to worker[177] qsize 0 2022-05-21 02:46:15,236 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(5bbaeba8-4ec9-402c-8ea4-fe60bbcc79fe, queue=awx_private_queue) [2022-05-21 02:46:15,236: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(5bbaeba8-4ec9-402c-8ea4-fe60bbcc79fe, queue=awx_private_queue) 2022-05-21 02:46:15,236 DEBUG awx.main.dispatch task 8b0d5d8d-2432-46ef-9649-07f6d0698b5d starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 02:46:15,252 DEBUG awx.main.dispatch task 8b0d5d8d-2432-46ef-9649-07f6d0698b5d is finished 2022-05-21 02:46:15,259 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a58a2382-97a6-4697-b918-5894fde2f1f2, queue=awx_private_queue) [2022-05-21 02:46:15,259: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a58a2382-97a6-4697-b918-5894fde2f1f2, queue=awx_private_queue) 2022-05-21 02:46:15,479 DEBUG awx.main.dispatch task 1b0a5546-8aaf-404f-9acc-c5f0f01b94c4 is finished 2022-05-21 02:46:35,271 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(109bf8e2-34f2-4c32-b6e8-f808de69d1e8, queue=awx_private_queue) [2022-05-21 02:46:35,271: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(109bf8e2-34f2-4c32-b6e8-f808de69d1e8, queue=awx_private_queue) 2022-05-21 02:46:46,686 DEBUG awx.main.dispatch delivered 5bbaeba8-4ec9-402c-8ea4-fe60bbcc79fe to worker[176] qsize 0 2022-05-21 02:46:46,690 DEBUG awx.main.dispatch delivered a58a2382-97a6-4697-b918-5894fde2f1f2 to worker[178] qsize 0 2022-05-21 02:46:46,690 DEBUG awx.main.dispatch task 5bbaeba8-4ec9-402c-8ea4-fe60bbcc79fe starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:46:46,692 DEBUG awx.main.dispatch task a58a2382-97a6-4697-b918-5894fde2f1f2 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:46:46,695 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:46:46,706 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 02:46:46,710 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:45:45.269328+00:00 2022-05-21 02:46:46,720 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:46:46,768 DEBUG awx.main.dispatch task a58a2382-97a6-4697-b918-5894fde2f1f2 is finished 2022-05-21 02:46:47,042 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(2c25519d-1a4e-41a7-9576-93db97316174, queue=awx_private_queue) [2022-05-21 02:46:47,042: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(2c25519d-1a4e-41a7-9576-93db97316174, queue=awx_private_queue) 2022-05-21 02:46:48,666 DEBUG awx.main.dispatch task 5bbaeba8-4ec9-402c-8ea4-fe60bbcc79fe is finished 2022-05-21 02:46:50,224 DEBUG awx.main.dispatch delivered 109bf8e2-34f2-4c32-b6e8-f808de69d1e8 to worker[177] qsize 0 2022-05-21 02:46:50,226 DEBUG awx.main.dispatch delivered 2c25519d-1a4e-41a7-9576-93db97316174 to worker[178] qsize 0 2022-05-21 02:46:50,228 DEBUG awx.main.dispatch task 109bf8e2-34f2-4c32-b6e8-f808de69d1e8 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:46:50,230 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:46:50,230 DEBUG awx.main.dispatch task 2c25519d-1a4e-41a7-9576-93db97316174 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:46:50,242 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 02:46:50,245 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:46:46.707048+00:00 2022-05-21 02:46:50,251 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:46:50,293 DEBUG awx.main.dispatch task 109bf8e2-34f2-4c32-b6e8-f808de69d1e8 is finished 2022-05-21 02:46:50,714 DEBUG awx.main.dispatch task 2c25519d-1a4e-41a7-9576-93db97316174 is finished 2022-05-21 02:46:55,273 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(df97327c-980b-433a-8922-8b2e1736d230, queue=awx_private_queue) [2022-05-21 02:46:55,273: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(df97327c-980b-433a-8922-8b2e1736d230, queue=awx_private_queue) RESULT 2 OKREADY 2022-05-21 02:47:15,009 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(42d64b23-cfc5-40c9-96c1-980d659810eb, queue=onap-awx-0) [2022-05-21 02:47:15,009: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(42d64b23-cfc5-40c9-96c1-980d659810eb, queue=onap-awx-0) 2022-05-21 02:47:15,218 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(5b053f05-def5-4158-9f84-fb5a7b313616, queue=onap-awx-0) [2022-05-21 02:47:15,218: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(5b053f05-def5-4158-9f84-fb5a7b313616, queue=onap-awx-0) 2022-05-21 02:47:15,235 DEBUG awx.main.dispatch delivered 42d64b23-cfc5-40c9-96c1-980d659810eb to worker[178] qsize 0 2022-05-21 02:47:15,239 DEBUG awx.main.dispatch task 42d64b23-cfc5-40c9-96c1-980d659810eb starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 02:47:15,241 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 02:47:15,239 DEBUG awx.main.dispatch delivered 5b053f05-def5-4158-9f84-fb5a7b313616 to worker[176] qsize 0 2022-05-21 02:47:15,243 DEBUG awx.main.dispatch task 5b053f05-def5-4158-9f84-fb5a7b313616 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 02:47:15,259 DEBUG awx.main.dispatch task 5b053f05-def5-4158-9f84-fb5a7b313616 is finished 2022-05-21 02:47:15,271 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(655e59f4-d5ee-472d-a41e-40ad57a9a5bf, queue=awx_private_queue) [2022-05-21 02:47:15,271: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(655e59f4-d5ee-472d-a41e-40ad57a9a5bf, queue=awx_private_queue) 2022-05-21 02:47:15,826 DEBUG awx.main.dispatch task 42d64b23-cfc5-40c9-96c1-980d659810eb is finished 2022-05-21 02:47:17,043 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(aa12b635-5cee-4fde-9109-071895b4c65c, queue=awx_private_queue) [2022-05-21 02:47:17,043: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(aa12b635-5cee-4fde-9109-071895b4c65c, queue=awx_private_queue) 2022-05-21 02:47:19,592 DEBUG awx.main.dispatch delivered df97327c-980b-433a-8922-8b2e1736d230 to worker[178] qsize 0 2022-05-21 02:47:19,596 DEBUG awx.main.dispatch delivered 655e59f4-d5ee-472d-a41e-40ad57a9a5bf to worker[181] qsize 0 2022-05-21 02:47:19,596 DEBUG awx.main.dispatch task df97327c-980b-433a-8922-8b2e1736d230 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:47:19,598 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:47:19,599 DEBUG awx.main.dispatch delivered aa12b635-5cee-4fde-9109-071895b4c65c to worker[176] qsize 0 2022-05-21 02:47:19,599 DEBUG awx.main.dispatch task 655e59f4-d5ee-472d-a41e-40ad57a9a5bf starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:47:19,603 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:47:19,602 DEBUG awx.main.dispatch task aa12b635-5cee-4fde-9109-071895b4c65c starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:47:19,615 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 02:47:19,618 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:46:50.242541+00:00 2022-05-21 02:47:19,622 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:47:19,622 DEBUG awx.main.scheduler Not running scheduler, another task holds lock 2022-05-21 02:47:19,622 DEBUG awx.main.dispatch task 655e59f4-d5ee-472d-a41e-40ad57a9a5bf is finished 2022-05-21 02:47:19,661 DEBUG awx.main.dispatch task df97327c-980b-433a-8922-8b2e1736d230 is finished 2022-05-21 02:47:23,201 DEBUG awx.main.dispatch task aa12b635-5cee-4fde-9109-071895b4c65c is finished 2022-05-21 02:47:36,344 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e1b501f0-fba8-493b-b208-08a4e58ed575, queue=awx_private_queue) [2022-05-21 02:47:36,344: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e1b501f0-fba8-493b-b208-08a4e58ed575, queue=awx_private_queue) 2022-05-21 02:47:47,043 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(c4aaa3b8-ac39-46fa-b23a-ca0dae2aeefc, queue=awx_private_queue) [2022-05-21 02:47:47,043: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(c4aaa3b8-ac39-46fa-b23a-ca0dae2aeefc, queue=awx_private_queue) 2022-05-21 02:47:56,346 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(1e9ab5a5-34e8-4700-84f2-0b427e753934, queue=awx_private_queue) [2022-05-21 02:47:56,346: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(1e9ab5a5-34e8-4700-84f2-0b427e753934, queue=awx_private_queue) RESULT 2 OKREADY 2022-05-21 02:48:04,492 DEBUG awx.main.dispatch delivered e1b501f0-fba8-493b-b208-08a4e58ed575 to worker[181] qsize 0 2022-05-21 02:48:04,497 DEBUG awx.main.dispatch delivered c4aaa3b8-ac39-46fa-b23a-ca0dae2aeefc to worker[177] qsize 0 2022-05-21 02:48:04,497 DEBUG awx.main.dispatch task e1b501f0-fba8-493b-b208-08a4e58ed575 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:48:04,499 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:48:04,499 DEBUG awx.main.dispatch delivered 1e9ab5a5-34e8-4700-84f2-0b427e753934 to worker[178] qsize 0 2022-05-21 02:48:04,501 DEBUG awx.main.dispatch task 1e9ab5a5-34e8-4700-84f2-0b427e753934 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:48:04,503 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:48:04,500 DEBUG awx.main.dispatch task c4aaa3b8-ac39-46fa-b23a-ca0dae2aeefc starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:48:04,512 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 02:48:04,516 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:47:19.615589+00:00 2022-05-21 02:48:04,521 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:48:04,522 DEBUG awx.main.scheduler Not running scheduler, another task holds lock 2022-05-21 02:48:04,522 DEBUG awx.main.dispatch task e1b501f0-fba8-493b-b208-08a4e58ed575 is finished 2022-05-21 02:48:04,556 DEBUG awx.main.dispatch task 1e9ab5a5-34e8-4700-84f2-0b427e753934 is finished 2022-05-21 02:48:05,097 DEBUG awx.main.dispatch task c4aaa3b8-ac39-46fa-b23a-ca0dae2aeefc is finished 2022-05-21 02:48:15,006 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(289a1799-8e12-43a1-990e-b26790f7c5d5, queue=onap-awx-0) [2022-05-21 02:48:15,006: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(289a1799-8e12-43a1-990e-b26790f7c5d5, queue=onap-awx-0) 2022-05-21 02:48:15,061 DEBUG awx.main.dispatch delivered 289a1799-8e12-43a1-990e-b26790f7c5d5 to worker[177] qsize 0 2022-05-21 02:48:15,064 DEBUG awx.main.dispatch task 289a1799-8e12-43a1-990e-b26790f7c5d5 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 02:48:15,066 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 02:48:15,217 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(a3e91b7e-f254-4b38-9d6c-f8e2b44bb2f1, queue=onap-awx-0) [2022-05-21 02:48:15,217: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(a3e91b7e-f254-4b38-9d6c-f8e2b44bb2f1, queue=onap-awx-0) 2022-05-21 02:48:16,344 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f70d94cc-255f-4228-8513-813ec0818d31, queue=awx_private_queue) [2022-05-21 02:48:16,344: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f70d94cc-255f-4228-8513-813ec0818d31, queue=awx_private_queue) 2022-05-21 02:48:17,043 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(5e1459c2-0a58-4d24-aa64-726283734fce, queue=awx_private_queue) [2022-05-21 02:48:17,043: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(5e1459c2-0a58-4d24-aa64-726283734fce, queue=awx_private_queue) 2022-05-21 02:48:19,613 DEBUG awx.main.dispatch delivered f70d94cc-255f-4228-8513-813ec0818d31 to worker[178] qsize 0 2022-05-21 02:48:19,616 DEBUG awx.main.dispatch delivered 5e1459c2-0a58-4d24-aa64-726283734fce to worker[176] qsize 0 2022-05-21 02:48:19,616 DEBUG awx.main.dispatch task f70d94cc-255f-4228-8513-813ec0818d31 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:48:19,619 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:48:19,619 DEBUG awx.main.dispatch task 5e1459c2-0a58-4d24-aa64-726283734fce starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:48:19,632 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 02:48:19,635 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:48:04.513045+00:00 2022-05-21 02:48:19,641 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:48:19,682 DEBUG awx.main.dispatch task f70d94cc-255f-4228-8513-813ec0818d31 is finished 2022-05-21 02:48:22,543 DEBUG awx.main.dispatch task 289a1799-8e12-43a1-990e-b26790f7c5d5 is finished 2022-05-21 02:48:27,898 DEBUG awx.main.dispatch task 5e1459c2-0a58-4d24-aa64-726283734fce is finished 2022-05-21 02:48:36,344 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d82d01a4-378b-4e70-99da-efab15e18f5d, queue=awx_private_queue) [2022-05-21 02:48:36,344: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d82d01a4-378b-4e70-99da-efab15e18f5d, queue=awx_private_queue) 2022-05-21 02:48:47,044 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(0a4bbc92-5274-4838-a8ad-9bcf3a0ccc9c, queue=awx_private_queue) [2022-05-21 02:48:47,044: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(0a4bbc92-5274-4838-a8ad-9bcf3a0ccc9c, queue=awx_private_queue) 2022-05-21 02:48:55,624 DEBUG awx.main.dispatch delivered a3e91b7e-f254-4b38-9d6c-f8e2b44bb2f1 to worker[178] qsize 0 2022-05-21 02:48:55,627 DEBUG awx.main.dispatch task a3e91b7e-f254-4b38-9d6c-f8e2b44bb2f1 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 02:48:55,649 DEBUG awx.main.dispatch task a3e91b7e-f254-4b38-9d6c-f8e2b44bb2f1 is finished 2022-05-21 02:48:56,344 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d7b3c8ef-074c-442b-a38d-079a727713d1, queue=awx_private_queue) [2022-05-21 02:48:56,344: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d7b3c8ef-074c-442b-a38d-079a727713d1, queue=awx_private_queue) 2022-05-21 02:48:56,374 DEBUG awx.main.dispatch delivered d82d01a4-378b-4e70-99da-efab15e18f5d to worker[176] qsize 0 2022-05-21 02:48:56,377 DEBUG awx.main.dispatch task d82d01a4-378b-4e70-99da-efab15e18f5d starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:48:56,378 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:48:56,377 DEBUG awx.main.dispatch delivered 0a4bbc92-5274-4838-a8ad-9bcf3a0ccc9c to worker[177] qsize 0 2022-05-21 02:48:56,381 DEBUG awx.main.dispatch task 0a4bbc92-5274-4838-a8ad-9bcf3a0ccc9c starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:48:56,381 DEBUG awx.main.dispatch delivered d7b3c8ef-074c-442b-a38d-079a727713d1 to worker[178] qsize 0 2022-05-21 02:48:56,384 DEBUG awx.main.dispatch task d7b3c8ef-074c-442b-a38d-079a727713d1 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:48:56,385 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:48:56,391 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 02:48:56,394 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:48:19.632557+00:00 2022-05-21 02:48:56,401 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:48:56,401 DEBUG awx.main.scheduler Not running scheduler, another task holds lock 2022-05-21 02:48:56,401 DEBUG awx.main.dispatch task d82d01a4-378b-4e70-99da-efab15e18f5d is finished 2022-05-21 02:48:56,443 DEBUG awx.main.dispatch task d7b3c8ef-074c-442b-a38d-079a727713d1 is finished 2022-05-21 02:48:57,181 DEBUG awx.main.dispatch task 0a4bbc92-5274-4838-a8ad-9bcf3a0ccc9c is finished RESULT 2 OKREADY 2022-05-21 02:49:15,017 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(30a347bf-7317-462e-a0db-a99a228a64e1, queue=onap-awx-0) [2022-05-21 02:49:15,017: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(30a347bf-7317-462e-a0db-a99a228a64e1, queue=onap-awx-0) 2022-05-21 02:49:15,073 DEBUG awx.main.dispatch delivered 30a347bf-7317-462e-a0db-a99a228a64e1 to worker[176] qsize 0 2022-05-21 02:49:15,266 DEBUG awx.main.dispatch task 30a347bf-7317-462e-a0db-a99a228a64e1 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 02:49:15,268 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 02:49:15,364 DEBUG awx.main.dispatch task 30a347bf-7317-462e-a0db-a99a228a64e1 is finished 2022-05-21 02:49:15,218 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(f935f554-8759-4ff2-9c4b-26482251e37c, queue=onap-awx-0) [2022-05-21 02:49:15,218: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(f935f554-8759-4ff2-9c4b-26482251e37c, queue=onap-awx-0) 2022-05-21 02:49:16,344 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b23ff637-1782-4e9c-b238-e92185ba557c, queue=awx_private_queue) [2022-05-21 02:49:16,344: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b23ff637-1782-4e9c-b238-e92185ba557c, queue=awx_private_queue) 2022-05-21 02:49:16,359 DEBUG awx.main.dispatch delivered b23ff637-1782-4e9c-b238-e92185ba557c to worker[181] qsize 0 2022-05-21 02:49:16,361 DEBUG awx.main.dispatch task b23ff637-1782-4e9c-b238-e92185ba557c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:49:16,365 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:49:16,387 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:49:16,424 DEBUG awx.main.dispatch delivered f935f554-8759-4ff2-9c4b-26482251e37c to worker[176] qsize 0 2022-05-21 02:49:16,424 DEBUG awx.main.dispatch task b23ff637-1782-4e9c-b238-e92185ba557c is finished 2022-05-21 02:49:16,427 DEBUG awx.main.dispatch task f935f554-8759-4ff2-9c4b-26482251e37c starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 02:49:16,444 DEBUG awx.main.dispatch task f935f554-8759-4ff2-9c4b-26482251e37c is finished 2022-05-21 02:49:17,044 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(fc91545b-a8ae-4f1b-95bb-f46d39830d2b, queue=awx_private_queue) [2022-05-21 02:49:17,044: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(fc91545b-a8ae-4f1b-95bb-f46d39830d2b, queue=awx_private_queue) 2022-05-21 02:49:17,060 DEBUG awx.main.dispatch delivered fc91545b-a8ae-4f1b-95bb-f46d39830d2b to worker[176] qsize 0 2022-05-21 02:49:17,063 DEBUG awx.main.dispatch task fc91545b-a8ae-4f1b-95bb-f46d39830d2b starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:49:17,074 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 02:49:17,078 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:48:56.391937+00:00 2022-05-21 02:49:17,782 DEBUG awx.main.dispatch task fc91545b-a8ae-4f1b-95bb-f46d39830d2b is finished 2022-05-21 02:49:36,353 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ceb9c10a-80a6-45fc-b996-aebaa75cdc36, queue=awx_private_queue) [2022-05-21 02:49:36,353: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ceb9c10a-80a6-45fc-b996-aebaa75cdc36, queue=awx_private_queue) 2022-05-21 02:49:36,372 DEBUG awx.main.dispatch delivered ceb9c10a-80a6-45fc-b996-aebaa75cdc36 to worker[181] qsize 0 2022-05-21 02:49:36,375 DEBUG awx.main.dispatch task ceb9c10a-80a6-45fc-b996-aebaa75cdc36 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:49:36,377 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:49:36,400 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:49:36,438 DEBUG awx.main.dispatch task ceb9c10a-80a6-45fc-b996-aebaa75cdc36 is finished 2022-05-21 02:49:47,046 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(097e89dc-bfb0-43e8-8e2d-7d3b98dfa67c, queue=awx_private_queue) [2022-05-21 02:49:47,046: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(097e89dc-bfb0-43e8-8e2d-7d3b98dfa67c, queue=awx_private_queue) 2022-05-21 02:49:47,066 DEBUG awx.main.dispatch delivered 097e89dc-bfb0-43e8-8e2d-7d3b98dfa67c to worker[181] qsize 0 2022-05-21 02:49:47,068 DEBUG awx.main.dispatch task 097e89dc-bfb0-43e8-8e2d-7d3b98dfa67c starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:49:47,082 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 02:49:47,087 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:49:17.075279+00:00 2022-05-21 02:49:47,650 DEBUG awx.main.dispatch task 097e89dc-bfb0-43e8-8e2d-7d3b98dfa67c is finished 2022-05-21 02:49:56,353 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5a602a53-ba90-4212-84b8-6ad2fde0879b, queue=awx_private_queue) [2022-05-21 02:49:56,353: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5a602a53-ba90-4212-84b8-6ad2fde0879b, queue=awx_private_queue) 2022-05-21 02:49:56,373 DEBUG awx.main.dispatch delivered 5a602a53-ba90-4212-84b8-6ad2fde0879b to worker[177] qsize 0 2022-05-21 02:49:56,376 DEBUG awx.main.dispatch task 5a602a53-ba90-4212-84b8-6ad2fde0879b starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:49:56,378 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:49:56,399 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:49:56,434 DEBUG awx.main.dispatch task 5a602a53-ba90-4212-84b8-6ad2fde0879b is finished RESULT 2 OKREADY 2022-05-21 02:50:15,017 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(668b37ab-2980-4a78-bd47-f842eee40265, queue=onap-awx-0) [2022-05-21 02:50:15,017: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(668b37ab-2980-4a78-bd47-f842eee40265, queue=onap-awx-0) 2022-05-21 02:50:15,217 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(bd4923f7-4225-42f7-bbc3-2dbf532cb96d, queue=onap-awx-0) [2022-05-21 02:50:15,217: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(bd4923f7-4225-42f7-bbc3-2dbf532cb96d, queue=onap-awx-0) 2022-05-21 02:50:15,073 DEBUG awx.main.dispatch delivered 668b37ab-2980-4a78-bd47-f842eee40265 to worker[181] qsize 0 2022-05-21 02:50:15,246 DEBUG awx.main.dispatch delivered bd4923f7-4225-42f7-bbc3-2dbf532cb96d to worker[176] qsize 0 2022-05-21 02:50:15,246 DEBUG awx.main.dispatch task 668b37ab-2980-4a78-bd47-f842eee40265 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 02:50:15,249 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 02:50:15,248 DEBUG awx.main.dispatch task bd4923f7-4225-42f7-bbc3-2dbf532cb96d starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 02:50:15,299 DEBUG awx.main.dispatch task bd4923f7-4225-42f7-bbc3-2dbf532cb96d is finished 2022-05-21 02:50:15,504 DEBUG awx.main.dispatch task 668b37ab-2980-4a78-bd47-f842eee40265 is finished 2022-05-21 02:50:16,352 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f00644c6-7158-48ca-95e1-ea9f7911864b, queue=awx_private_queue) [2022-05-21 02:50:16,352: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f00644c6-7158-48ca-95e1-ea9f7911864b, queue=awx_private_queue) 2022-05-21 02:50:16,371 DEBUG awx.main.dispatch delivered f00644c6-7158-48ca-95e1-ea9f7911864b to worker[178] qsize 0 2022-05-21 02:50:16,374 DEBUG awx.main.dispatch task f00644c6-7158-48ca-95e1-ea9f7911864b starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:50:16,377 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:50:16,398 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:50:16,441 DEBUG awx.main.dispatch task f00644c6-7158-48ca-95e1-ea9f7911864b is finished 2022-05-21 02:50:17,045 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(281d7702-f077-4f48-ae61-79e005c04f43, queue=awx_private_queue) [2022-05-21 02:50:17,045: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(281d7702-f077-4f48-ae61-79e005c04f43, queue=awx_private_queue) 2022-05-21 02:50:17,072 DEBUG awx.main.dispatch delivered 281d7702-f077-4f48-ae61-79e005c04f43 to worker[177] qsize 0 2022-05-21 02:50:17,075 DEBUG awx.main.dispatch task 281d7702-f077-4f48-ae61-79e005c04f43 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:50:17,088 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 02:50:17,091 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:49:47.082979+00:00 2022-05-21 02:50:17,692 DEBUG awx.main.dispatch task 281d7702-f077-4f48-ae61-79e005c04f43 is finished 2022-05-21 02:50:38,100 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(25ba6809-024a-43ea-95a2-a7ea55adf5d2, queue=awx_private_queue) [2022-05-21 02:50:38,100: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(25ba6809-024a-43ea-95a2-a7ea55adf5d2, queue=awx_private_queue) 2022-05-21 02:50:38,119 DEBUG awx.main.dispatch delivered 25ba6809-024a-43ea-95a2-a7ea55adf5d2 to worker[177] qsize 0 2022-05-21 02:50:38,122 DEBUG awx.main.dispatch task 25ba6809-024a-43ea-95a2-a7ea55adf5d2 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:50:38,123 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:50:38,145 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:50:38,180 DEBUG awx.main.dispatch task 25ba6809-024a-43ea-95a2-a7ea55adf5d2 is finished 2022-05-21 02:50:47,046 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(f17376ed-1a1d-4a1e-bb33-6a88367e44a0, queue=awx_private_queue) [2022-05-21 02:50:47,046: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(f17376ed-1a1d-4a1e-bb33-6a88367e44a0, queue=awx_private_queue) 2022-05-21 02:50:47,069 DEBUG awx.main.dispatch delivered f17376ed-1a1d-4a1e-bb33-6a88367e44a0 to worker[181] qsize 0 2022-05-21 02:50:47,071 DEBUG awx.main.dispatch task f17376ed-1a1d-4a1e-bb33-6a88367e44a0 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:50:47,088 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 02:50:47,092 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:50:17.088542+00:00 2022-05-21 02:50:47,663 DEBUG awx.main.dispatch task f17376ed-1a1d-4a1e-bb33-6a88367e44a0 is finished 2022-05-21 02:50:58,099 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(21f2838c-a0eb-4b16-82ed-03bf91e03b3d, queue=awx_private_queue) [2022-05-21 02:50:58,099: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(21f2838c-a0eb-4b16-82ed-03bf91e03b3d, queue=awx_private_queue) 2022-05-21 02:50:58,115 DEBUG awx.main.dispatch delivered 21f2838c-a0eb-4b16-82ed-03bf91e03b3d to worker[181] qsize 0 2022-05-21 02:50:58,117 DEBUG awx.main.dispatch task 21f2838c-a0eb-4b16-82ed-03bf91e03b3d starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:50:58,118 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:50:58,142 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:50:58,178 DEBUG awx.main.dispatch task 21f2838c-a0eb-4b16-82ed-03bf91e03b3d is finished RESULT 2 OKREADY 2022-05-21 02:51:15,017 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(2491287b-f909-4949-9b64-088c6837c1cd, queue=onap-awx-0) [2022-05-21 02:51:15,017: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(2491287b-f909-4949-9b64-088c6837c1cd, queue=onap-awx-0) 2022-05-21 02:51:15,069 DEBUG awx.main.dispatch delivered 2491287b-f909-4949-9b64-088c6837c1cd to worker[176] qsize 0 2022-05-21 02:51:15,071 DEBUG awx.main.dispatch task 2491287b-f909-4949-9b64-088c6837c1cd starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 02:51:15,072 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 02:51:15,217 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(e57ecea4-0adc-4051-ae21-e940abed8bd8, queue=onap-awx-0) [2022-05-21 02:51:15,217: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(e57ecea4-0adc-4051-ae21-e940abed8bd8, queue=onap-awx-0) 2022-05-21 02:51:15,231 DEBUG awx.main.dispatch delivered e57ecea4-0adc-4051-ae21-e940abed8bd8 to worker[177] qsize 0 2022-05-21 02:51:15,428 DEBUG awx.main.dispatch task e57ecea4-0adc-4051-ae21-e940abed8bd8 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 02:51:15,448 DEBUG awx.main.dispatch task e57ecea4-0adc-4051-ae21-e940abed8bd8 is finished 2022-05-21 02:51:15,687 DEBUG awx.main.dispatch task 2491287b-f909-4949-9b64-088c6837c1cd is finished 2022-05-21 02:51:17,045 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(f2e22eae-44c2-4eb8-921c-8d73259d49f0, queue=awx_private_queue) [2022-05-21 02:51:17,045: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(f2e22eae-44c2-4eb8-921c-8d73259d49f0, queue=awx_private_queue) 2022-05-21 02:51:17,063 DEBUG awx.main.dispatch delivered f2e22eae-44c2-4eb8-921c-8d73259d49f0 to worker[176] qsize 0 2022-05-21 02:51:17,066 DEBUG awx.main.dispatch task f2e22eae-44c2-4eb8-921c-8d73259d49f0 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:51:17,077 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 02:51:17,080 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:50:47.088692+00:00 2022-05-21 02:51:17,902 DEBUG awx.main.dispatch task f2e22eae-44c2-4eb8-921c-8d73259d49f0 is finished 2022-05-21 02:51:18,100 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(256170b9-ecc5-41b0-a069-e867f83ca70a, queue=awx_private_queue) [2022-05-21 02:51:18,100: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(256170b9-ecc5-41b0-a069-e867f83ca70a, queue=awx_private_queue) 2022-05-21 02:51:19,121 DEBUG awx.main.dispatch delivered 256170b9-ecc5-41b0-a069-e867f83ca70a to worker[181] qsize 0 2022-05-21 02:51:19,123 DEBUG awx.main.dispatch task 256170b9-ecc5-41b0-a069-e867f83ca70a starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:51:19,125 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:51:19,145 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:51:19,183 DEBUG awx.main.dispatch task 256170b9-ecc5-41b0-a069-e867f83ca70a is finished 2022-05-21 02:51:38,108 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(96f6dd9d-c511-410b-89b9-901697ca36ef, queue=awx_private_queue) [2022-05-21 02:51:38,108: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(96f6dd9d-c511-410b-89b9-901697ca36ef, queue=awx_private_queue) 2022-05-21 02:51:38,134 DEBUG awx.main.dispatch delivered 96f6dd9d-c511-410b-89b9-901697ca36ef to worker[177] qsize 0 2022-05-21 02:51:38,137 DEBUG awx.main.dispatch task 96f6dd9d-c511-410b-89b9-901697ca36ef starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:51:38,138 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:51:38,163 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:51:38,201 DEBUG awx.main.dispatch task 96f6dd9d-c511-410b-89b9-901697ca36ef is finished 2022-05-21 02:51:47,046 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(7f460d0c-0cdd-42dd-a0ce-e9fcc443ee80, queue=awx_private_queue) [2022-05-21 02:51:47,046: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(7f460d0c-0cdd-42dd-a0ce-e9fcc443ee80, queue=awx_private_queue) 2022-05-21 02:51:58,109 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(17471f41-53ce-4368-bd21-d8a5bc500d42, queue=awx_private_queue) [2022-05-21 02:51:58,109: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(17471f41-53ce-4368-bd21-d8a5bc500d42, queue=awx_private_queue) RESULT 2 OKREADY 2022-05-21 02:52:15,018 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(bf7663b5-5498-40bf-9f80-633ec770b399, queue=onap-awx-0) [2022-05-21 02:52:15,018: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(bf7663b5-5498-40bf-9f80-633ec770b399, queue=onap-awx-0) 2022-05-21 02:52:15,070 DEBUG awx.main.dispatch delivered bf7663b5-5498-40bf-9f80-633ec770b399 to worker[178] qsize 0 2022-05-21 02:52:15,218 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(cadf666b-cd8b-4ac5-ad09-6b12d247b16b, queue=onap-awx-0) [2022-05-21 02:52:15,218: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(cadf666b-cd8b-4ac5-ad09-6b12d247b16b, queue=onap-awx-0) 2022-05-21 02:52:15,073 DEBUG awx.main.dispatch task bf7663b5-5498-40bf-9f80-633ec770b399 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 02:52:15,260 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 02:52:15,392 DEBUG awx.main.dispatch task bf7663b5-5498-40bf-9f80-633ec770b399 is finished 2022-05-21 02:52:15,236 DEBUG awx.main.dispatch delivered cadf666b-cd8b-4ac5-ad09-6b12d247b16b to worker[176] qsize 0 2022-05-21 02:52:15,408 DEBUG awx.main.dispatch task cadf666b-cd8b-4ac5-ad09-6b12d247b16b starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 02:52:15,422 DEBUG awx.main.dispatch task cadf666b-cd8b-4ac5-ad09-6b12d247b16b is finished 2022-05-21 02:52:17,045 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(7957f71d-21f2-421a-8558-078928c9457f, queue=awx_private_queue) [2022-05-21 02:52:17,045: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(7957f71d-21f2-421a-8558-078928c9457f, queue=awx_private_queue) 2022-05-21 02:52:18,110 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7728cfd8-8a34-4e4d-9b18-d17766b72a90, queue=awx_private_queue) [2022-05-21 02:52:18,110: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7728cfd8-8a34-4e4d-9b18-d17766b72a90, queue=awx_private_queue) 2022-05-21 02:52:25,460 DEBUG awx.main.dispatch delivered 7f460d0c-0cdd-42dd-a0ce-e9fcc443ee80 to worker[176] qsize 0 2022-05-21 02:52:25,464 DEBUG awx.main.dispatch delivered 17471f41-53ce-4368-bd21-d8a5bc500d42 to worker[178] qsize 0 2022-05-21 02:52:25,463 DEBUG awx.main.dispatch task 7f460d0c-0cdd-42dd-a0ce-e9fcc443ee80 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:52:25,467 DEBUG awx.main.dispatch task 17471f41-53ce-4368-bd21-d8a5bc500d42 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:52:25,469 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:52:25,467 DEBUG awx.main.dispatch delivered 7957f71d-21f2-421a-8558-078928c9457f to worker[181] qsize 0 2022-05-21 02:52:25,470 DEBUG awx.main.dispatch delivered 7728cfd8-8a34-4e4d-9b18-d17766b72a90 to worker[177] qsize 0 2022-05-21 02:52:25,470 DEBUG awx.main.dispatch task 7957f71d-21f2-421a-8558-078928c9457f starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:52:25,473 DEBUG awx.main.dispatch task 7728cfd8-8a34-4e4d-9b18-d17766b72a90 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:52:25,475 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:52:25,479 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 02:52:25,481 DEBUG awx.main.tasks Not running periodic scheduler, another task holds lock 2022-05-21 02:52:25,481 DEBUG awx.main.dispatch task 7957f71d-21f2-421a-8558-078928c9457f is finished 2022-05-21 02:52:25,483 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:51:17.077650+00:00 2022-05-21 02:52:25,491 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:52:25,493 DEBUG awx.main.scheduler Not running scheduler, another task holds lock 2022-05-21 02:52:25,494 DEBUG awx.main.dispatch task 7728cfd8-8a34-4e4d-9b18-d17766b72a90 is finished 2022-05-21 02:52:25,534 DEBUG awx.main.dispatch task 17471f41-53ce-4368-bd21-d8a5bc500d42 is finished 2022-05-21 02:52:26,078 DEBUG awx.main.dispatch task 7f460d0c-0cdd-42dd-a0ce-e9fcc443ee80 is finished 2022-05-21 02:52:38,120 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ce079378-bf85-4ee2-a917-01cc0e330659, queue=awx_private_queue) [2022-05-21 02:52:38,120: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ce079378-bf85-4ee2-a917-01cc0e330659, queue=awx_private_queue) 2022-05-21 02:52:38,137 DEBUG awx.main.dispatch delivered ce079378-bf85-4ee2-a917-01cc0e330659 to worker[177] qsize 0 2022-05-21 02:52:38,140 DEBUG awx.main.dispatch task ce079378-bf85-4ee2-a917-01cc0e330659 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:52:38,141 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:52:38,166 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:52:38,212 DEBUG awx.main.dispatch task ce079378-bf85-4ee2-a917-01cc0e330659 is finished 2022-05-21 02:52:47,046 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(4373d3b6-d719-4f18-a183-522a86901665, queue=awx_private_queue) [2022-05-21 02:52:47,046: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(4373d3b6-d719-4f18-a183-522a86901665, queue=awx_private_queue) 2022-05-21 02:52:58,120 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7ec4863e-ba93-43c9-9990-e9577bf11aa5, queue=awx_private_queue) [2022-05-21 02:52:58,120: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7ec4863e-ba93-43c9-9990-e9577bf11aa5, queue=awx_private_queue) RESULT 2 OKREADY 2022-05-21 02:53:15,023 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(90a25697-54b6-48d5-a48b-b443e629a04f, queue=onap-awx-0) [2022-05-21 02:53:15,023: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(90a25697-54b6-48d5-a48b-b443e629a04f, queue=onap-awx-0) 2022-05-21 02:53:15,075 DEBUG awx.main.dispatch delivered 90a25697-54b6-48d5-a48b-b443e629a04f to worker[177] qsize 0 2022-05-21 02:53:15,078 DEBUG awx.main.dispatch task 90a25697-54b6-48d5-a48b-b443e629a04f starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 02:53:15,080 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 02:53:15,218 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(a21dc3f3-dc3f-4691-b676-05b532255230, queue=onap-awx-0) [2022-05-21 02:53:15,218: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(a21dc3f3-dc3f-4691-b676-05b532255230, queue=onap-awx-0) 2022-05-21 02:53:15,332 DEBUG awx.main.dispatch task 90a25697-54b6-48d5-a48b-b443e629a04f is finished 2022-05-21 02:53:15,237 DEBUG awx.main.dispatch delivered a21dc3f3-dc3f-4691-b676-05b532255230 to worker[176] qsize 0 2022-05-21 02:53:15,432 DEBUG awx.main.dispatch task a21dc3f3-dc3f-4691-b676-05b532255230 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 02:53:15,451 DEBUG awx.main.dispatch task a21dc3f3-dc3f-4691-b676-05b532255230 is finished 2022-05-21 02:53:17,047 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(c70849e3-b19d-457f-a5bf-5407d62e9a01, queue=awx_private_queue) [2022-05-21 02:53:17,047: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(c70849e3-b19d-457f-a5bf-5407d62e9a01, queue=awx_private_queue) 2022-05-21 02:53:18,119 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7683e873-603d-4778-aaff-fe81e4b8b424, queue=awx_private_queue) [2022-05-21 02:53:18,119: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7683e873-603d-4778-aaff-fe81e4b8b424, queue=awx_private_queue) 2022-05-21 02:53:27,515 DEBUG awx.main.dispatch delivered 4373d3b6-d719-4f18-a183-522a86901665 to worker[181] qsize 0 2022-05-21 02:53:27,518 DEBUG awx.main.dispatch delivered 7ec4863e-ba93-43c9-9990-e9577bf11aa5 to worker[178] qsize 0 2022-05-21 02:53:27,518 DEBUG awx.main.dispatch task 4373d3b6-d719-4f18-a183-522a86901665 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:53:27,520 DEBUG awx.main.dispatch delivered c70849e3-b19d-457f-a5bf-5407d62e9a01 to worker[176] qsize 0 2022-05-21 02:53:27,523 DEBUG awx.main.dispatch task 7ec4863e-ba93-43c9-9990-e9577bf11aa5 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:53:27,525 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:53:27,524 DEBUG awx.main.dispatch delivered 7683e873-603d-4778-aaff-fe81e4b8b424 to worker[177] qsize 0 2022-05-21 02:53:27,525 DEBUG awx.main.dispatch task c70849e3-b19d-457f-a5bf-5407d62e9a01 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:53:27,527 DEBUG awx.main.dispatch task 7683e873-603d-4778-aaff-fe81e4b8b424 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:53:27,530 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:53:27,534 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 02:53:27,536 DEBUG awx.main.tasks Not running periodic scheduler, another task holds lock 2022-05-21 02:53:27,536 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:52:25.480213+00:00 2022-05-21 02:53:27,536 DEBUG awx.main.dispatch task c70849e3-b19d-457f-a5bf-5407d62e9a01 is finished 2022-05-21 02:53:27,544 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:53:27,546 DEBUG awx.main.scheduler Not running scheduler, another task holds lock 2022-05-21 02:53:27,546 DEBUG awx.main.dispatch task 7683e873-603d-4778-aaff-fe81e4b8b424 is finished 2022-05-21 02:53:27,579 DEBUG awx.main.dispatch task 7ec4863e-ba93-43c9-9990-e9577bf11aa5 is finished 2022-05-21 02:53:27,925 DEBUG awx.main.dispatch task 4373d3b6-d719-4f18-a183-522a86901665 is finished 2022-05-21 02:53:59,386 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(faf8691e-41ae-498f-aa97-fdeb2233f43d, queue=awx_private_queue) [2022-05-21 02:53:59,386: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(faf8691e-41ae-498f-aa97-fdeb2233f43d, queue=awx_private_queue) 2022-05-21 02:53:59,408 DEBUG awx.main.dispatch delivered faf8691e-41ae-498f-aa97-fdeb2233f43d to worker[177] qsize 0 2022-05-21 02:53:59,409 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(dea29075-149f-4cef-a286-b1ff20eb95a9, queue=awx_private_queue) [2022-05-21 02:53:59,409: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(dea29075-149f-4cef-a286-b1ff20eb95a9, queue=awx_private_queue) 2022-05-21 02:53:59,411 DEBUG awx.main.dispatch task faf8691e-41ae-498f-aa97-fdeb2233f43d starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:53:59,413 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:53:59,425 DEBUG awx.main.dispatch delivered dea29075-149f-4cef-a286-b1ff20eb95a9 to worker[178] qsize 0 2022-05-21 02:53:59,428 DEBUG awx.main.dispatch task dea29075-149f-4cef-a286-b1ff20eb95a9 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:53:59,440 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 02:53:59,440 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:53:59,444 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:53:27.534200+00:00 2022-05-21 02:53:59,476 DEBUG awx.main.dispatch task faf8691e-41ae-498f-aa97-fdeb2233f43d is finished 2022-05-21 02:54:00,198 DEBUG awx.main.dispatch task dea29075-149f-4cef-a286-b1ff20eb95a9 is finished RESULT 2 OKREADY 2022-05-21 02:54:14,987 DEBUG awx.main.dispatch publish awx.main.tasks.awx_isolated_heartbeat(22e1c103-57bb-4027-9577-47a32f891465, queue=onap-awx-0) [2022-05-21 02:54:14,987: DEBUG/Process-1] publish awx.main.tasks.awx_isolated_heartbeat(22e1c103-57bb-4027-9577-47a32f891465, queue=onap-awx-0) 2022-05-21 02:54:15,011 DEBUG awx.main.dispatch delivered 22e1c103-57bb-4027-9577-47a32f891465 to worker[178] qsize 0 2022-05-21 02:54:15,020 DEBUG awx.main.dispatch task 22e1c103-57bb-4027-9577-47a32f891465 starting awx.main.tasks.awx_isolated_heartbeat(*[]) 2022-05-21 02:54:15,022 DEBUG awx.main.tasks Controlling node checking for any isolated management tasks. 2022-05-21 02:54:15,022 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(e8f034a5-fba9-4856-919e-e0564986d4e6, queue=onap-awx-0) [2022-05-21 02:54:15,022: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(e8f034a5-fba9-4856-919e-e0564986d4e6, queue=onap-awx-0) 2022-05-21 02:54:15,050 DEBUG awx.main.dispatch delivered e8f034a5-fba9-4856-919e-e0564986d4e6 to worker[177] qsize 0 2022-05-21 02:54:15,051 DEBUG awx.main.dispatch task 22e1c103-57bb-4027-9577-47a32f891465 is finished 2022-05-21 02:54:15,053 DEBUG awx.main.dispatch task e8f034a5-fba9-4856-919e-e0564986d4e6 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 02:54:15,055 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 02:54:15,086 DEBUG awx.main.dispatch task e8f034a5-fba9-4856-919e-e0564986d4e6 is finished 2022-05-21 02:54:15,218 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(1ab31cd0-4889-4035-bf8c-6cddc327ccfc, queue=onap-awx-0) [2022-05-21 02:54:15,218: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(1ab31cd0-4889-4035-bf8c-6cddc327ccfc, queue=onap-awx-0) 2022-05-21 02:54:15,238 DEBUG awx.main.dispatch delivered 1ab31cd0-4889-4035-bf8c-6cddc327ccfc to worker[176] qsize 0 2022-05-21 02:54:15,433 DEBUG awx.main.dispatch task 1ab31cd0-4889-4035-bf8c-6cddc327ccfc starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 02:54:15,452 DEBUG awx.main.dispatch task 1ab31cd0-4889-4035-bf8c-6cddc327ccfc is finished 2022-05-21 02:54:19,385 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(242b5125-5008-4959-a7b6-5f12b220dbdc, queue=awx_private_queue) [2022-05-21 02:54:19,385: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(242b5125-5008-4959-a7b6-5f12b220dbdc, queue=awx_private_queue) 2022-05-21 02:54:19,408 DEBUG awx.main.dispatch delivered 242b5125-5008-4959-a7b6-5f12b220dbdc to worker[176] qsize 0 2022-05-21 02:54:19,411 DEBUG awx.main.dispatch task 242b5125-5008-4959-a7b6-5f12b220dbdc starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:54:19,413 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:54:19,435 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:54:19,474 DEBUG awx.main.dispatch task 242b5125-5008-4959-a7b6-5f12b220dbdc is finished 2022-05-21 02:54:29,410 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(494bb966-9bdb-4cad-8727-7da4eb3db754, queue=awx_private_queue) [2022-05-21 02:54:29,410: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(494bb966-9bdb-4cad-8727-7da4eb3db754, queue=awx_private_queue) 2022-05-21 02:54:29,436 DEBUG awx.main.dispatch delivered 494bb966-9bdb-4cad-8727-7da4eb3db754 to worker[178] qsize 0 2022-05-21 02:54:29,438 DEBUG awx.main.dispatch task 494bb966-9bdb-4cad-8727-7da4eb3db754 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:54:29,453 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 02:54:29,457 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:53:59.441166+00:00 2022-05-21 02:54:30,299 DEBUG awx.main.dispatch task 494bb966-9bdb-4cad-8727-7da4eb3db754 is finished 2022-05-21 02:54:39,385 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(15f63e49-9622-4893-b4a7-bd2812c2049d, queue=awx_private_queue) [2022-05-21 02:54:39,385: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(15f63e49-9622-4893-b4a7-bd2812c2049d, queue=awx_private_queue) 2022-05-21 02:54:39,401 DEBUG awx.main.dispatch delivered 15f63e49-9622-4893-b4a7-bd2812c2049d to worker[177] qsize 0 2022-05-21 02:54:39,404 DEBUG awx.main.dispatch task 15f63e49-9622-4893-b4a7-bd2812c2049d starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:54:39,406 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:54:39,427 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:54:39,468 DEBUG awx.main.dispatch task 15f63e49-9622-4893-b4a7-bd2812c2049d is finished 2022-05-21 02:54:59,386 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0f9085b2-1a29-4403-8dac-0ee55ab104e6, queue=awx_private_queue) [2022-05-21 02:54:59,386: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0f9085b2-1a29-4403-8dac-0ee55ab104e6, queue=awx_private_queue) 2022-05-21 02:54:59,404 DEBUG awx.main.dispatch delivered 0f9085b2-1a29-4403-8dac-0ee55ab104e6 to worker[177] qsize 0 2022-05-21 02:54:59,406 DEBUG awx.main.dispatch task 0f9085b2-1a29-4403-8dac-0ee55ab104e6 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:54:59,408 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:54:59,410 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(9d759f1c-d3ab-472f-a91a-b9c146af237c, queue=awx_private_queue) [2022-05-21 02:54:59,410: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(9d759f1c-d3ab-472f-a91a-b9c146af237c, queue=awx_private_queue) 2022-05-21 02:54:59,425 DEBUG awx.main.dispatch delivered 9d759f1c-d3ab-472f-a91a-b9c146af237c to worker[178] qsize 0 2022-05-21 02:54:59,429 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:54:59,428 DEBUG awx.main.dispatch task 9d759f1c-d3ab-472f-a91a-b9c146af237c starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:54:59,440 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 02:54:59,443 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:54:29.454325+00:00 2022-05-21 02:54:59,465 DEBUG awx.main.dispatch task 0f9085b2-1a29-4403-8dac-0ee55ab104e6 is finished 2022-05-21 02:54:59,921 DEBUG awx.main.dispatch task 9d759f1c-d3ab-472f-a91a-b9c146af237c is finished RESULT 2 OKREADY 2022-05-21 02:55:15,033 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(77b66672-4224-4760-bb7b-94f9290efcd4, queue=onap-awx-0) [2022-05-21 02:55:15,033: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(77b66672-4224-4760-bb7b-94f9290efcd4, queue=onap-awx-0) 2022-05-21 02:55:15,081 DEBUG awx.main.dispatch delivered 77b66672-4224-4760-bb7b-94f9290efcd4 to worker[176] qsize 0 2022-05-21 02:55:15,219 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(d6992ec6-68d2-404a-840d-ad6a224ec659, queue=onap-awx-0) [2022-05-21 02:55:15,219: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(d6992ec6-68d2-404a-840d-ad6a224ec659, queue=onap-awx-0) 2022-05-21 02:55:15,234 DEBUG awx.main.dispatch delivered d6992ec6-68d2-404a-840d-ad6a224ec659 to worker[178] qsize 0 2022-05-21 02:55:15,237 DEBUG awx.main.dispatch task d6992ec6-68d2-404a-840d-ad6a224ec659 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 02:55:15,258 DEBUG awx.main.dispatch task d6992ec6-68d2-404a-840d-ad6a224ec659 is finished 2022-05-21 02:55:15,088 DEBUG awx.main.dispatch task 77b66672-4224-4760-bb7b-94f9290efcd4 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 02:55:15,297 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 02:55:15,336 DEBUG awx.main.dispatch task 77b66672-4224-4760-bb7b-94f9290efcd4 is finished 2022-05-21 02:55:19,386 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ba6c09ed-5458-407f-a125-2debdcb54936, queue=awx_private_queue) [2022-05-21 02:55:19,386: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ba6c09ed-5458-407f-a125-2debdcb54936, queue=awx_private_queue) 2022-05-21 02:55:19,403 DEBUG awx.main.dispatch delivered ba6c09ed-5458-407f-a125-2debdcb54936 to worker[178] qsize 0 2022-05-21 02:55:19,406 DEBUG awx.main.dispatch task ba6c09ed-5458-407f-a125-2debdcb54936 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:55:19,407 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:55:19,430 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:55:19,465 DEBUG awx.main.dispatch task ba6c09ed-5458-407f-a125-2debdcb54936 is finished 2022-05-21 02:55:29,411 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(6b0bb76f-b682-482c-bcb9-00e4321b5ee6, queue=awx_private_queue) [2022-05-21 02:55:29,411: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(6b0bb76f-b682-482c-bcb9-00e4321b5ee6, queue=awx_private_queue) 2022-05-21 02:55:39,386 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(81376caf-41de-4248-b0da-ff4900bc451f, queue=awx_private_queue) [2022-05-21 02:55:39,386: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(81376caf-41de-4248-b0da-ff4900bc451f, queue=awx_private_queue) 2022-05-21 02:55:53,282 DEBUG awx.main.dispatch delivered 6b0bb76f-b682-482c-bcb9-00e4321b5ee6 to worker[176] qsize 0 2022-05-21 02:55:53,284 DEBUG awx.main.dispatch delivered 81376caf-41de-4248-b0da-ff4900bc451f to worker[181] qsize 0 2022-05-21 02:55:53,285 DEBUG awx.main.dispatch task 6b0bb76f-b682-482c-bcb9-00e4321b5ee6 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:55:53,287 DEBUG awx.main.dispatch task 81376caf-41de-4248-b0da-ff4900bc451f starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:55:53,292 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:55:53,298 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 02:55:53,301 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:54:59.441275+00:00 2022-05-21 02:55:53,315 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:55:53,354 DEBUG awx.main.dispatch task 81376caf-41de-4248-b0da-ff4900bc451f is finished 2022-05-21 02:55:53,371 DEBUG awx.main.dispatch task 6b0bb76f-b682-482c-bcb9-00e4321b5ee6 is finished 2022-05-21 02:55:59,386 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3432b0ff-6dd8-4e3e-b547-8865fe6ab737, queue=awx_private_queue) [2022-05-21 02:55:59,386: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3432b0ff-6dd8-4e3e-b547-8865fe6ab737, queue=awx_private_queue) 2022-05-21 02:55:59,407 DEBUG awx.main.dispatch delivered 3432b0ff-6dd8-4e3e-b547-8865fe6ab737 to worker[177] qsize 0 2022-05-21 02:55:59,411 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(870af570-2490-4739-8576-4a4965885fd8, queue=awx_private_queue) [2022-05-21 02:55:59,411: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(870af570-2490-4739-8576-4a4965885fd8, queue=awx_private_queue) 2022-05-21 02:55:59,410 DEBUG awx.main.dispatch task 3432b0ff-6dd8-4e3e-b547-8865fe6ab737 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:55:59,413 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:55:59,427 DEBUG awx.main.dispatch delivered 870af570-2490-4739-8576-4a4965885fd8 to worker[178] qsize 0 2022-05-21 02:55:59,429 DEBUG awx.main.dispatch task 870af570-2490-4739-8576-4a4965885fd8 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:55:59,437 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:55:59,440 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 02:55:59,443 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:55:53.299041+00:00 2022-05-21 02:55:59,474 DEBUG awx.main.dispatch task 3432b0ff-6dd8-4e3e-b547-8865fe6ab737 is finished 2022-05-21 02:55:59,717 DEBUG awx.main.dispatch task 870af570-2490-4739-8576-4a4965885fd8 is finished RESULT 2 OKREADY 2022-05-21 02:56:15,030 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(89c7247f-ea40-41ca-9f21-ebcbafc7155a, queue=onap-awx-0) [2022-05-21 02:56:15,030: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(89c7247f-ea40-41ca-9f21-ebcbafc7155a, queue=onap-awx-0) 2022-05-21 02:56:15,066 DEBUG awx.main.dispatch delivered 89c7247f-ea40-41ca-9f21-ebcbafc7155a to worker[176] qsize 0 2022-05-21 02:56:15,069 DEBUG awx.main.dispatch task 89c7247f-ea40-41ca-9f21-ebcbafc7155a starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 02:56:15,070 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 02:56:15,218 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(d812bdcf-dbaf-4113-97a4-e303d445e2b8, queue=onap-awx-0) [2022-05-21 02:56:15,218: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(d812bdcf-dbaf-4113-97a4-e303d445e2b8, queue=onap-awx-0) 2022-05-21 02:56:15,257 DEBUG awx.main.dispatch delivered d812bdcf-dbaf-4113-97a4-e303d445e2b8 to worker[177] qsize 0 2022-05-21 02:56:15,259 DEBUG awx.main.dispatch task d812bdcf-dbaf-4113-97a4-e303d445e2b8 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 02:56:15,276 DEBUG awx.main.dispatch task d812bdcf-dbaf-4113-97a4-e303d445e2b8 is finished 2022-05-21 02:56:15,330 DEBUG awx.main.dispatch task 89c7247f-ea40-41ca-9f21-ebcbafc7155a is finished 2022-05-21 02:56:19,386 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(926a5d31-9a89-4af0-9c3a-e5b74754a7a0, queue=awx_private_queue) [2022-05-21 02:56:19,386: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(926a5d31-9a89-4af0-9c3a-e5b74754a7a0, queue=awx_private_queue) 2022-05-21 02:56:19,403 DEBUG awx.main.dispatch delivered 926a5d31-9a89-4af0-9c3a-e5b74754a7a0 to worker[176] qsize 0 2022-05-21 02:56:19,407 DEBUG awx.main.dispatch task 926a5d31-9a89-4af0-9c3a-e5b74754a7a0 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:56:19,408 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:56:19,426 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:56:19,465 DEBUG awx.main.dispatch task 926a5d31-9a89-4af0-9c3a-e5b74754a7a0 is finished 2022-05-21 02:56:29,412 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(4e810b6f-d9bd-4aa8-b0b0-969068e199ff, queue=awx_private_queue) [2022-05-21 02:56:29,412: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(4e810b6f-d9bd-4aa8-b0b0-969068e199ff, queue=awx_private_queue) 2022-05-21 02:56:39,386 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(1616fc87-09d7-45e2-9b58-117dd61707a2, queue=awx_private_queue) [2022-05-21 02:56:39,386: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(1616fc87-09d7-45e2-9b58-117dd61707a2, queue=awx_private_queue) 2022-05-21 02:56:57,552 DEBUG awx.main.dispatch delivered 4e810b6f-d9bd-4aa8-b0b0-969068e199ff to worker[176] qsize 0 2022-05-21 02:56:57,555 DEBUG awx.main.dispatch delivered 1616fc87-09d7-45e2-9b58-117dd61707a2 to worker[178] qsize 0 2022-05-21 02:56:57,556 DEBUG awx.main.dispatch task 4e810b6f-d9bd-4aa8-b0b0-969068e199ff starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:56:57,558 DEBUG awx.main.dispatch task 1616fc87-09d7-45e2-9b58-117dd61707a2 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:56:57,559 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:56:57,569 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 02:56:57,572 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:55:59.440910+00:00 2022-05-21 02:56:57,582 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:56:57,592 DEBUG awx.main.dispatch task 4e810b6f-d9bd-4aa8-b0b0-969068e199ff is finished 2022-05-21 02:56:57,619 DEBUG awx.main.dispatch task 1616fc87-09d7-45e2-9b58-117dd61707a2 is finished 2022-05-21 02:56:59,883 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(06a9df88-89e6-4cc8-ac46-046daaf0b8ba, queue=awx_private_queue) [2022-05-21 02:56:59,883: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(06a9df88-89e6-4cc8-ac46-046daaf0b8ba, queue=awx_private_queue) 2022-05-21 02:56:59,901 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(93c4999c-0123-450b-a369-a4ee6f3e2b52, queue=awx_private_queue) [2022-05-21 02:56:59,901: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(93c4999c-0123-450b-a369-a4ee6f3e2b52, queue=awx_private_queue) RESULT 2 OKREADY 2022-05-21 02:57:03,839 DEBUG awx.main.dispatch delivered 06a9df88-89e6-4cc8-ac46-046daaf0b8ba to worker[178] qsize 0 2022-05-21 02:57:03,842 DEBUG awx.main.dispatch delivered 93c4999c-0123-450b-a369-a4ee6f3e2b52 to worker[181] qsize 0 2022-05-21 02:57:03,842 DEBUG awx.main.dispatch task 06a9df88-89e6-4cc8-ac46-046daaf0b8ba starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:57:03,844 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:57:03,844 DEBUG awx.main.dispatch task 93c4999c-0123-450b-a369-a4ee6f3e2b52 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:57:03,856 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 02:57:03,859 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:56:57.569894+00:00 2022-05-21 02:57:03,865 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:57:03,902 DEBUG awx.main.dispatch task 06a9df88-89e6-4cc8-ac46-046daaf0b8ba is finished 2022-05-21 02:57:04,132 DEBUG awx.main.dispatch task 93c4999c-0123-450b-a369-a4ee6f3e2b52 is finished 2022-05-21 02:57:15,036 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(d85e6876-2611-479c-9fd4-9080d5041195, queue=onap-awx-0) [2022-05-21 02:57:15,036: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(d85e6876-2611-479c-9fd4-9080d5041195, queue=onap-awx-0) 2022-05-21 02:57:15,076 DEBUG awx.main.dispatch delivered d85e6876-2611-479c-9fd4-9080d5041195 to worker[176] qsize 0 2022-05-21 02:57:15,080 DEBUG awx.main.dispatch task d85e6876-2611-479c-9fd4-9080d5041195 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 02:57:15,083 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 02:57:15,218 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(1f1ed861-a1d0-4429-b318-e0daefcc0ee3, queue=onap-awx-0) [2022-05-21 02:57:15,218: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(1f1ed861-a1d0-4429-b318-e0daefcc0ee3, queue=onap-awx-0) 2022-05-21 02:57:15,255 DEBUG awx.main.dispatch delivered 1f1ed861-a1d0-4429-b318-e0daefcc0ee3 to worker[181] qsize 0 2022-05-21 02:57:15,258 DEBUG awx.main.dispatch task 1f1ed861-a1d0-4429-b318-e0daefcc0ee3 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 02:57:15,279 DEBUG awx.main.dispatch task 1f1ed861-a1d0-4429-b318-e0daefcc0ee3 is finished 2022-05-21 02:57:15,467 DEBUG awx.main.dispatch task d85e6876-2611-479c-9fd4-9080d5041195 is finished 2022-05-21 02:57:19,884 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(556b5169-3b38-4bdc-ac25-47329f6b6b56, queue=awx_private_queue) [2022-05-21 02:57:19,884: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(556b5169-3b38-4bdc-ac25-47329f6b6b56, queue=awx_private_queue) 2022-05-21 02:57:19,909 DEBUG awx.main.dispatch delivered 556b5169-3b38-4bdc-ac25-47329f6b6b56 to worker[176] qsize 0 2022-05-21 02:57:19,912 DEBUG awx.main.dispatch task 556b5169-3b38-4bdc-ac25-47329f6b6b56 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:57:19,914 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:57:19,934 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:57:19,971 DEBUG awx.main.dispatch task 556b5169-3b38-4bdc-ac25-47329f6b6b56 is finished 2022-05-21 02:57:29,901 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(8a1288be-c657-41ce-8408-ee40dca82348, queue=awx_private_queue) [2022-05-21 02:57:29,901: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(8a1288be-c657-41ce-8408-ee40dca82348, queue=awx_private_queue) 2022-05-21 02:57:39,883 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b33b9420-69aa-4766-b350-823df254e53e, queue=awx_private_queue) [2022-05-21 02:57:39,883: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b33b9420-69aa-4766-b350-823df254e53e, queue=awx_private_queue) 2022-05-21 02:57:43,255 DEBUG awx.main.dispatch delivered 8a1288be-c657-41ce-8408-ee40dca82348 to worker[176] qsize 0 2022-05-21 02:57:43,257 DEBUG awx.main.dispatch task 8a1288be-c657-41ce-8408-ee40dca82348 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:57:43,258 DEBUG awx.main.dispatch delivered b33b9420-69aa-4766-b350-823df254e53e to worker[178] qsize 0 2022-05-21 02:57:43,260 DEBUG awx.main.dispatch task b33b9420-69aa-4766-b350-823df254e53e starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:57:43,261 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:57:43,271 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 02:57:43,275 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:57:03.856794+00:00 2022-05-21 02:57:43,282 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:57:43,328 DEBUG awx.main.dispatch task b33b9420-69aa-4766-b350-823df254e53e is finished 2022-05-21 02:57:43,392 DEBUG awx.main.dispatch task 8a1288be-c657-41ce-8408-ee40dca82348 is finished 2022-05-21 02:57:59,889 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(baf61e25-1956-47c0-bbb2-e7a3ebc7a0c4, queue=awx_private_queue) [2022-05-21 02:57:59,889: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(baf61e25-1956-47c0-bbb2-e7a3ebc7a0c4, queue=awx_private_queue) 2022-05-21 02:57:59,919 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(2727081f-edc8-430b-b49c-e73d1f98fa56, queue=awx_private_queue) [2022-05-21 02:57:59,919: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(2727081f-edc8-430b-b49c-e73d1f98fa56, queue=awx_private_queue) 2022-05-21 02:57:59,918 DEBUG awx.main.dispatch delivered baf61e25-1956-47c0-bbb2-e7a3ebc7a0c4 to worker[176] qsize 0 2022-05-21 02:57:59,922 DEBUG awx.main.dispatch task baf61e25-1956-47c0-bbb2-e7a3ebc7a0c4 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:57:59,923 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:57:59,933 DEBUG awx.main.dispatch delivered 2727081f-edc8-430b-b49c-e73d1f98fa56 to worker[181] qsize 0 2022-05-21 02:57:59,936 DEBUG awx.main.dispatch task 2727081f-edc8-430b-b49c-e73d1f98fa56 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:57:59,945 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:57:59,949 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 02:57:59,952 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:57:43.271650+00:00 2022-05-21 02:57:59,980 DEBUG awx.main.dispatch task baf61e25-1956-47c0-bbb2-e7a3ebc7a0c4 is finished 2022-05-21 02:58:00,345 DEBUG awx.main.dispatch task 2727081f-edc8-430b-b49c-e73d1f98fa56 is finished RESULT 2 OKREADY 2022-05-21 02:58:15,040 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(96ff4c86-1159-4720-8073-55ca34e21d4a, queue=onap-awx-0) [2022-05-21 02:58:15,040: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(96ff4c86-1159-4720-8073-55ca34e21d4a, queue=onap-awx-0) 2022-05-21 02:58:15,077 DEBUG awx.main.dispatch delivered 96ff4c86-1159-4720-8073-55ca34e21d4a to worker[178] qsize 0 2022-05-21 02:58:15,079 DEBUG awx.main.dispatch task 96ff4c86-1159-4720-8073-55ca34e21d4a starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 02:58:15,082 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 02:58:15,139 DEBUG awx.main.dispatch task 96ff4c86-1159-4720-8073-55ca34e21d4a is finished 2022-05-21 02:58:15,218 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(d95b846d-d7a8-4dfb-a8c3-ab63ba6d8a41, queue=onap-awx-0) [2022-05-21 02:58:15,218: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(d95b846d-d7a8-4dfb-a8c3-ab63ba6d8a41, queue=onap-awx-0) 2022-05-21 02:58:15,236 DEBUG awx.main.dispatch delivered d95b846d-d7a8-4dfb-a8c3-ab63ba6d8a41 to worker[178] qsize 0 2022-05-21 02:58:15,239 DEBUG awx.main.dispatch task d95b846d-d7a8-4dfb-a8c3-ab63ba6d8a41 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 02:58:15,254 DEBUG awx.main.dispatch task d95b846d-d7a8-4dfb-a8c3-ab63ba6d8a41 is finished 2022-05-21 02:58:19,889 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5335a165-2093-4d0c-838c-abb3b1e9bb03, queue=awx_private_queue) [2022-05-21 02:58:19,889: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5335a165-2093-4d0c-838c-abb3b1e9bb03, queue=awx_private_queue) 2022-05-21 02:58:20,099 DEBUG awx.main.dispatch delivered 5335a165-2093-4d0c-838c-abb3b1e9bb03 to worker[178] qsize 0 2022-05-21 02:58:20,103 DEBUG awx.main.dispatch task 5335a165-2093-4d0c-838c-abb3b1e9bb03 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:58:20,105 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:58:20,128 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:58:20,169 DEBUG awx.main.dispatch task 5335a165-2093-4d0c-838c-abb3b1e9bb03 is finished 2022-05-21 02:58:29,919 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(93564f6b-c6b6-48c0-b6d5-9290443ce3b9, queue=awx_private_queue) [2022-05-21 02:58:29,919: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(93564f6b-c6b6-48c0-b6d5-9290443ce3b9, queue=awx_private_queue) 2022-05-21 02:58:29,936 DEBUG awx.main.dispatch delivered 93564f6b-c6b6-48c0-b6d5-9290443ce3b9 to worker[177] qsize 0 2022-05-21 02:58:29,938 DEBUG awx.main.dispatch task 93564f6b-c6b6-48c0-b6d5-9290443ce3b9 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:58:29,954 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 02:58:29,957 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:57:59.949568+00:00 2022-05-21 02:58:30,431 DEBUG awx.main.dispatch task 93564f6b-c6b6-48c0-b6d5-9290443ce3b9 is finished 2022-05-21 02:58:39,890 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(212a3562-3dd1-479a-bc38-8b05aaaed1c0, queue=awx_private_queue) [2022-05-21 02:58:39,890: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(212a3562-3dd1-479a-bc38-8b05aaaed1c0, queue=awx_private_queue) 2022-05-21 02:58:39,910 DEBUG awx.main.dispatch delivered 212a3562-3dd1-479a-bc38-8b05aaaed1c0 to worker[181] qsize 0 2022-05-21 02:58:39,913 DEBUG awx.main.dispatch task 212a3562-3dd1-479a-bc38-8b05aaaed1c0 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:58:39,916 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:58:39,940 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:58:39,980 DEBUG awx.main.dispatch task 212a3562-3dd1-479a-bc38-8b05aaaed1c0 is finished 2022-05-21 02:58:59,899 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0e8f1397-7932-4c2b-95c2-97dc0610bd46, queue=awx_private_queue) [2022-05-21 02:58:59,899: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0e8f1397-7932-4c2b-95c2-97dc0610bd46, queue=awx_private_queue) 2022-05-21 02:58:59,920 DEBUG awx.main.dispatch delivered 0e8f1397-7932-4c2b-95c2-97dc0610bd46 to worker[176] qsize 0 2022-05-21 02:58:59,922 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(9f345d8c-45eb-49a1-a720-6e18c007a4c2, queue=awx_private_queue) [2022-05-21 02:58:59,922: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(9f345d8c-45eb-49a1-a720-6e18c007a4c2, queue=awx_private_queue) 2022-05-21 02:58:59,923 DEBUG awx.main.dispatch task 0e8f1397-7932-4c2b-95c2-97dc0610bd46 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:58:59,926 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:58:59,939 DEBUG awx.main.dispatch delivered 9f345d8c-45eb-49a1-a720-6e18c007a4c2 to worker[181] qsize 0 2022-05-21 02:58:59,941 DEBUG awx.main.dispatch task 9f345d8c-45eb-49a1-a720-6e18c007a4c2 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:58:59,951 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 02:58:59,951 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:58:59,954 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:58:29.954694+00:00 2022-05-21 02:58:59,992 DEBUG awx.main.dispatch task 0e8f1397-7932-4c2b-95c2-97dc0610bd46 is finished 2022-05-21 02:59:00,563 DEBUG awx.main.dispatch task 9f345d8c-45eb-49a1-a720-6e18c007a4c2 is finished RESULT 2 OKREADY 2022-05-21 02:59:15,041 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(d2a0854a-b327-4547-ba25-55b08c9294b8, queue=onap-awx-0) [2022-05-21 02:59:15,041: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(d2a0854a-b327-4547-ba25-55b08c9294b8, queue=onap-awx-0) 2022-05-21 02:59:15,072 DEBUG awx.main.dispatch delivered d2a0854a-b327-4547-ba25-55b08c9294b8 to worker[176] qsize 0 2022-05-21 02:59:15,075 DEBUG awx.main.dispatch task d2a0854a-b327-4547-ba25-55b08c9294b8 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 02:59:15,076 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 02:59:15,218 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(d63e0134-a664-4a9a-a9a1-e3a6d84ea760, queue=onap-awx-0) [2022-05-21 02:59:15,218: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(d63e0134-a664-4a9a-a9a1-e3a6d84ea760, queue=onap-awx-0) 2022-05-21 02:59:15,235 DEBUG awx.main.dispatch delivered d63e0134-a664-4a9a-a9a1-e3a6d84ea760 to worker[177] qsize 0 2022-05-21 02:59:15,238 DEBUG awx.main.dispatch task d63e0134-a664-4a9a-a9a1-e3a6d84ea760 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 02:59:15,258 DEBUG awx.main.dispatch task d63e0134-a664-4a9a-a9a1-e3a6d84ea760 is finished 2022-05-21 02:59:15,498 DEBUG awx.main.dispatch task d2a0854a-b327-4547-ba25-55b08c9294b8 is finished 2022-05-21 02:59:19,899 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(de86c475-2e92-483b-9cb3-01d9ae0b58d2, queue=awx_private_queue) [2022-05-21 02:59:19,899: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(de86c475-2e92-483b-9cb3-01d9ae0b58d2, queue=awx_private_queue) 2022-05-21 02:59:20,098 DEBUG awx.main.dispatch delivered de86c475-2e92-483b-9cb3-01d9ae0b58d2 to worker[176] qsize 0 2022-05-21 02:59:20,100 DEBUG awx.main.dispatch task de86c475-2e92-483b-9cb3-01d9ae0b58d2 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:59:20,102 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:59:20,124 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:59:20,165 DEBUG awx.main.dispatch task de86c475-2e92-483b-9cb3-01d9ae0b58d2 is finished 2022-05-21 02:59:29,922 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(1e52edeb-3949-40d8-bcfa-37fb43af7cae, queue=awx_private_queue) [2022-05-21 02:59:29,922: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(1e52edeb-3949-40d8-bcfa-37fb43af7cae, queue=awx_private_queue) 2022-05-21 02:59:39,900 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(dae890c6-3e6e-4c42-bbf1-e19b8b85eee1, queue=awx_private_queue) [2022-05-21 02:59:39,900: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(dae890c6-3e6e-4c42-bbf1-e19b8b85eee1, queue=awx_private_queue) 2022-05-21 02:59:46,477 DEBUG awx.main.dispatch delivered 1e52edeb-3949-40d8-bcfa-37fb43af7cae to worker[176] qsize 0 2022-05-21 02:59:46,480 DEBUG awx.main.dispatch task 1e52edeb-3949-40d8-bcfa-37fb43af7cae starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 02:59:46,480 DEBUG awx.main.dispatch delivered dae890c6-3e6e-4c42-bbf1-e19b8b85eee1 to worker[177] qsize 0 2022-05-21 02:59:46,482 DEBUG awx.main.dispatch task dae890c6-3e6e-4c42-bbf1-e19b8b85eee1 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 02:59:46,484 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 02:59:46,494 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 02:59:46,498 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:58:59.951662+00:00 2022-05-21 02:59:46,506 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 02:59:46,547 DEBUG awx.main.dispatch task dae890c6-3e6e-4c42-bbf1-e19b8b85eee1 is finished 2022-05-21 02:59:46,772 DEBUG awx.main.dispatch task 1e52edeb-3949-40d8-bcfa-37fb43af7cae is finished RESULT 2 OKREADY 2022-05-21 03:00:54,886 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(453e9c85-0a11-444c-9d72-bf2aaff5e980, queue=awx_private_queue) [2022-05-21 03:00:54,886: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(453e9c85-0a11-444c-9d72-bf2aaff5e980, queue=awx_private_queue) 2022-05-21 03:00:55,088 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(5a95c23b-b5ae-4f02-a56c-e5b304c70f64, queue=awx_private_queue) [2022-05-21 03:00:55,088: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(5a95c23b-b5ae-4f02-a56c-e5b304c70f64, queue=awx_private_queue) 2022-05-21 03:00:55,087 DEBUG awx.main.dispatch delivered 453e9c85-0a11-444c-9d72-bf2aaff5e980 to worker[176] qsize 0 2022-05-21 03:00:55,091 DEBUG awx.main.dispatch task 453e9c85-0a11-444c-9d72-bf2aaff5e980 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:00:55,094 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:00:55,102 DEBUG awx.main.dispatch delivered 5a95c23b-b5ae-4f02-a56c-e5b304c70f64 to worker[177] qsize 0 2022-05-21 03:00:55,104 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(84f90968-226d-43c2-bc02-bb892e68c6f2, queue=onap-awx-0) [2022-05-21 03:00:55,104: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(84f90968-226d-43c2-bc02-bb892e68c6f2, queue=onap-awx-0) 2022-05-21 03:00:55,105 DEBUG awx.main.dispatch task 5a95c23b-b5ae-4f02-a56c-e5b304c70f64 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:00:55,113 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:00:55,120 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:00:55,122 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 02:59:46.494850+00:00 2022-05-21 03:00:55,125 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(0e1a5cdf-672e-484b-a484-5d1b83790f8e, queue=onap-awx-0) [2022-05-21 03:00:55,125: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(0e1a5cdf-672e-484b-a484-5d1b83790f8e, queue=onap-awx-0) 2022-05-21 03:00:55,139 DEBUG awx.main.dispatch delivered 84f90968-226d-43c2-bc02-bb892e68c6f2 to worker[178] qsize 0 2022-05-21 03:00:55,141 DEBUG awx.main.dispatch delivered 0e1a5cdf-672e-484b-a484-5d1b83790f8e to worker[181] qsize 0 2022-05-21 03:00:55,141 DEBUG awx.main.dispatch task 84f90968-226d-43c2-bc02-bb892e68c6f2 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:00:55,144 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:00:55,144 DEBUG awx.main.dispatch task 0e1a5cdf-672e-484b-a484-5d1b83790f8e starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:00:55,149 DEBUG awx.main.dispatch task 453e9c85-0a11-444c-9d72-bf2aaff5e980 is finished 2022-05-21 03:00:55,162 DEBUG awx.main.dispatch task 5a95c23b-b5ae-4f02-a56c-e5b304c70f64 is finished 2022-05-21 03:00:55,165 DEBUG awx.main.dispatch task 0e1a5cdf-672e-484b-a484-5d1b83790f8e is finished 2022-05-21 03:00:55,177 DEBUG awx.main.dispatch task 84f90968-226d-43c2-bc02-bb892e68c6f2 is finished RESULT 2 OKREADY 2022-05-21 03:01:14,896 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7dec4999-2a7a-4fad-87cd-9501e908376d, queue=awx_private_queue) [2022-05-21 03:01:14,896: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7dec4999-2a7a-4fad-87cd-9501e908376d, queue=awx_private_queue) 2022-05-21 03:01:17,636 DEBUG awx.main.dispatch delivered 7dec4999-2a7a-4fad-87cd-9501e908376d to worker[178] qsize 0 2022-05-21 03:01:17,639 DEBUG awx.main.dispatch task 7dec4999-2a7a-4fad-87cd-9501e908376d starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:01:17,640 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:01:17,662 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:01:17,702 DEBUG awx.main.dispatch task 7dec4999-2a7a-4fad-87cd-9501e908376d is finished 2022-05-21 03:01:25,089 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(b1e59746-9c80-4b80-82dd-9b26a016759a, queue=awx_private_queue) [2022-05-21 03:01:25,089: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(b1e59746-9c80-4b80-82dd-9b26a016759a, queue=awx_private_queue) 2022-05-21 03:01:34,094 DEBUG awx.main.dispatch delivered b1e59746-9c80-4b80-82dd-9b26a016759a to worker[176] qsize 0 2022-05-21 03:01:34,097 DEBUG awx.main.dispatch task b1e59746-9c80-4b80-82dd-9b26a016759a starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:01:34,110 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:01:34,113 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:00:55.120344+00:00 2022-05-21 03:01:34,496 DEBUG awx.main.dispatch task b1e59746-9c80-4b80-82dd-9b26a016759a is finished 2022-05-21 03:01:34,896 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0639cac9-5562-4cce-8dbc-1a4e39d7ae42, queue=awx_private_queue) [2022-05-21 03:01:34,896: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0639cac9-5562-4cce-8dbc-1a4e39d7ae42, queue=awx_private_queue) 2022-05-21 03:01:54,907 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6e0a3700-19c0-4fa1-bbb1-671204ee2361, queue=awx_private_queue) [2022-05-21 03:01:54,907: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6e0a3700-19c0-4fa1-bbb1-671204ee2361, queue=awx_private_queue) 2022-05-21 03:01:55,108 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(fec70c86-0ab8-4eff-8678-c4c259c05b02, queue=awx_private_queue) [2022-05-21 03:01:55,108: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(fec70c86-0ab8-4eff-8678-c4c259c05b02, queue=awx_private_queue) 2022-05-21 03:01:55,127 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(587033cc-c647-422d-b497-3c2b1c72ee41, queue=onap-awx-0) [2022-05-21 03:01:55,127: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(587033cc-c647-422d-b497-3c2b1c72ee41, queue=onap-awx-0) 2022-05-21 03:01:55,145 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(66721693-39d9-424d-8049-cdfe954440f8, queue=onap-awx-0) [2022-05-21 03:01:55,145: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(66721693-39d9-424d-8049-cdfe954440f8, queue=onap-awx-0) 2022-05-21 03:01:55,159 DEBUG awx.main.dispatch delivered 587033cc-c647-422d-b497-3c2b1c72ee41 to worker[181] qsize 0 2022-05-21 03:01:55,165 DEBUG awx.main.dispatch delivered 66721693-39d9-424d-8049-cdfe954440f8 to worker[176] qsize 0 2022-05-21 03:01:55,163 DEBUG awx.main.dispatch task 587033cc-c647-422d-b497-3c2b1c72ee41 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:01:55,166 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:01:55,167 DEBUG awx.main.dispatch task 66721693-39d9-424d-8049-cdfe954440f8 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:01:55,187 DEBUG awx.main.dispatch task 66721693-39d9-424d-8049-cdfe954440f8 is finished 2022-05-21 03:01:55,461 DEBUG awx.main.dispatch task 587033cc-c647-422d-b497-3c2b1c72ee41 is finished 2022-05-21 03:01:56,232 DEBUG awx.main.dispatch delivered 0639cac9-5562-4cce-8dbc-1a4e39d7ae42 to worker[177] qsize 0 2022-05-21 03:01:56,235 DEBUG awx.main.dispatch delivered 6e0a3700-19c0-4fa1-bbb1-671204ee2361 to worker[176] qsize 0 2022-05-21 03:01:56,235 DEBUG awx.main.dispatch task 0639cac9-5562-4cce-8dbc-1a4e39d7ae42 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:01:56,237 DEBUG awx.main.dispatch delivered fec70c86-0ab8-4eff-8678-c4c259c05b02 to worker[178] qsize 0 2022-05-21 03:01:56,238 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:01:56,237 DEBUG awx.main.dispatch task 6e0a3700-19c0-4fa1-bbb1-671204ee2361 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:01:56,239 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:01:56,239 DEBUG awx.main.dispatch task fec70c86-0ab8-4eff-8678-c4c259c05b02 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:01:56,253 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:01:56,256 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:01:34.110950+00:00 2022-05-21 03:01:56,257 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:01:56,260 DEBUG awx.main.scheduler Not running scheduler, another task holds lock 2022-05-21 03:01:56,260 DEBUG awx.main.dispatch task 0639cac9-5562-4cce-8dbc-1a4e39d7ae42 is finished 2022-05-21 03:01:56,299 DEBUG awx.main.dispatch task 6e0a3700-19c0-4fa1-bbb1-671204ee2361 is finished 2022-05-21 03:01:56,662 DEBUG awx.main.dispatch task fec70c86-0ab8-4eff-8678-c4c259c05b02 is finished RESULT 2 OKREADY 2022-05-21 03:02:14,927 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5413c3e4-df21-4a2a-ac37-0d206adc3f05, queue=awx_private_queue) [2022-05-21 03:02:14,927: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5413c3e4-df21-4a2a-ac37-0d206adc3f05, queue=awx_private_queue) 2022-05-21 03:02:14,947 DEBUG awx.main.dispatch delivered 5413c3e4-df21-4a2a-ac37-0d206adc3f05 to worker[176] qsize 0 2022-05-21 03:02:14,952 DEBUG awx.main.dispatch task 5413c3e4-df21-4a2a-ac37-0d206adc3f05 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:02:14,953 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:02:14,976 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:02:15,017 DEBUG awx.main.dispatch task 5413c3e4-df21-4a2a-ac37-0d206adc3f05 is finished 2022-05-21 03:02:25,109 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(7289fc9b-5fd3-4dca-8f8b-8e78c134eb4a, queue=awx_private_queue) [2022-05-21 03:02:25,109: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(7289fc9b-5fd3-4dca-8f8b-8e78c134eb4a, queue=awx_private_queue) 2022-05-21 03:02:25,131 DEBUG awx.main.dispatch delivered 7289fc9b-5fd3-4dca-8f8b-8e78c134eb4a to worker[176] qsize 0 2022-05-21 03:02:25,136 DEBUG awx.main.dispatch task 7289fc9b-5fd3-4dca-8f8b-8e78c134eb4a starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:02:25,153 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:02:25,157 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:01:56.253662+00:00 2022-05-21 03:02:25,493 DEBUG awx.main.dispatch task 7289fc9b-5fd3-4dca-8f8b-8e78c134eb4a is finished 2022-05-21 03:02:34,927 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(9d066797-48a8-446d-907a-72f1040b5096, queue=awx_private_queue) [2022-05-21 03:02:34,927: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(9d066797-48a8-446d-907a-72f1040b5096, queue=awx_private_queue) 2022-05-21 03:02:34,949 DEBUG awx.main.dispatch delivered 9d066797-48a8-446d-907a-72f1040b5096 to worker[178] qsize 0 2022-05-21 03:02:34,952 DEBUG awx.main.dispatch task 9d066797-48a8-446d-907a-72f1040b5096 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:02:34,954 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:02:34,979 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:02:35,016 DEBUG awx.main.dispatch task 9d066797-48a8-446d-907a-72f1040b5096 is finished 2022-05-21 03:02:54,945 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(4bd76a4e-5570-4839-808c-e368fb1b2303, queue=awx_private_queue) [2022-05-21 03:02:54,945: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(4bd76a4e-5570-4839-808c-e368fb1b2303, queue=awx_private_queue) 2022-05-21 03:02:55,153 DEBUG awx.main.dispatch delivered 4bd76a4e-5570-4839-808c-e368fb1b2303 to worker[178] qsize 0 2022-05-21 03:02:55,155 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(49588c17-8d2d-47fe-a664-2d5d81d5a5ca, queue=awx_private_queue) [2022-05-21 03:02:55,155: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(49588c17-8d2d-47fe-a664-2d5d81d5a5ca, queue=awx_private_queue) 2022-05-21 03:02:55,157 DEBUG awx.main.dispatch task 4bd76a4e-5570-4839-808c-e368fb1b2303 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:02:55,160 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:02:55,177 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:02:55,174 DEBUG awx.main.dispatch delivered 49588c17-8d2d-47fe-a664-2d5d81d5a5ca to worker[181] qsize 0 2022-05-21 03:02:55,176 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(76a53688-bfc6-4b02-8f49-2ca14767d5ca, queue=onap-awx-0) [2022-05-21 03:02:55,176: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(76a53688-bfc6-4b02-8f49-2ca14767d5ca, queue=onap-awx-0) 2022-05-21 03:02:55,179 DEBUG awx.main.dispatch task 49588c17-8d2d-47fe-a664-2d5d81d5a5ca starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:02:55,193 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:02:55,197 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:02:25.153470+00:00 2022-05-21 03:02:55,200 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(3507536a-3f66-4686-962e-eff4d02849b7, queue=onap-awx-0) [2022-05-21 03:02:55,200: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(3507536a-3f66-4686-962e-eff4d02849b7, queue=onap-awx-0) 2022-05-21 03:02:55,217 DEBUG awx.main.dispatch task 4bd76a4e-5570-4839-808c-e368fb1b2303 is finished 2022-05-21 03:02:55,218 DEBUG awx.main.dispatch delivered 76a53688-bfc6-4b02-8f49-2ca14767d5ca to worker[176] qsize 0 2022-05-21 03:02:55,221 DEBUG awx.main.dispatch delivered 3507536a-3f66-4686-962e-eff4d02849b7 to worker[177] qsize 0 2022-05-21 03:02:55,221 DEBUG awx.main.dispatch task 76a53688-bfc6-4b02-8f49-2ca14767d5ca starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:02:55,225 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:02:55,223 DEBUG awx.main.dispatch task 3507536a-3f66-4686-962e-eff4d02849b7 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:02:55,240 DEBUG awx.main.dispatch task 3507536a-3f66-4686-962e-eff4d02849b7 is finished 2022-05-21 03:02:55,712 DEBUG awx.main.dispatch task 76a53688-bfc6-4b02-8f49-2ca14767d5ca is finished 2022-05-21 03:02:55,998 DEBUG awx.main.dispatch task 49588c17-8d2d-47fe-a664-2d5d81d5a5ca is finished RESULT 2 OKREADY 2022-05-21 03:03:14,946 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7e81a77c-8ffa-4819-b7d9-d7d8b336ced4, queue=awx_private_queue) [2022-05-21 03:03:14,946: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7e81a77c-8ffa-4819-b7d9-d7d8b336ced4, queue=awx_private_queue) 2022-05-21 03:03:14,970 DEBUG awx.main.dispatch delivered 7e81a77c-8ffa-4819-b7d9-d7d8b336ced4 to worker[177] qsize 0 2022-05-21 03:03:14,973 DEBUG awx.main.dispatch task 7e81a77c-8ffa-4819-b7d9-d7d8b336ced4 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:03:14,976 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:03:14,999 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:03:15,034 DEBUG awx.main.dispatch task 7e81a77c-8ffa-4819-b7d9-d7d8b336ced4 is finished 2022-05-21 03:03:25,155 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(64f6ef0c-0dba-449f-8620-b74d61ce75bc, queue=awx_private_queue) [2022-05-21 03:03:25,155: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(64f6ef0c-0dba-449f-8620-b74d61ce75bc, queue=awx_private_queue) 2022-05-21 03:03:25,176 DEBUG awx.main.dispatch delivered 64f6ef0c-0dba-449f-8620-b74d61ce75bc to worker[176] qsize 0 2022-05-21 03:03:25,179 DEBUG awx.main.dispatch task 64f6ef0c-0dba-449f-8620-b74d61ce75bc starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:03:25,195 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:03:25,198 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:02:55.193508+00:00 2022-05-21 03:03:25,220 DEBUG awx.main.dispatch task 64f6ef0c-0dba-449f-8620-b74d61ce75bc is finished 2022-05-21 03:03:34,945 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(90a502c2-114c-4707-8b6a-84c43551a021, queue=awx_private_queue) [2022-05-21 03:03:34,945: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(90a502c2-114c-4707-8b6a-84c43551a021, queue=awx_private_queue) 2022-05-21 03:03:34,964 DEBUG awx.main.dispatch delivered 90a502c2-114c-4707-8b6a-84c43551a021 to worker[178] qsize 0 2022-05-21 03:03:34,967 DEBUG awx.main.dispatch task 90a502c2-114c-4707-8b6a-84c43551a021 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:03:34,969 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:03:34,991 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:03:35,032 DEBUG awx.main.dispatch task 90a502c2-114c-4707-8b6a-84c43551a021 is finished 2022-05-21 03:03:55,143 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(1a19cf86-8f99-4b35-96c8-d6cf70e199a3, queue=awx_private_queue) [2022-05-21 03:03:55,143: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(1a19cf86-8f99-4b35-96c8-d6cf70e199a3, queue=awx_private_queue) 2022-05-21 03:03:55,342 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(84d9e06e-34b3-4f3f-a993-b40850a6fc33, queue=awx_private_queue) [2022-05-21 03:03:55,342: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(84d9e06e-34b3-4f3f-a993-b40850a6fc33, queue=awx_private_queue) 2022-05-21 03:03:55,341 DEBUG awx.main.dispatch delivered 1a19cf86-8f99-4b35-96c8-d6cf70e199a3 to worker[178] qsize 0 2022-05-21 03:03:55,346 DEBUG awx.main.dispatch task 1a19cf86-8f99-4b35-96c8-d6cf70e199a3 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:03:55,348 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:03:55,358 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(a1c3892b-4477-40e4-8c41-6084ef2764db, queue=onap-awx-0) [2022-05-21 03:03:55,358: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(a1c3892b-4477-40e4-8c41-6084ef2764db, queue=onap-awx-0) 2022-05-21 03:03:55,357 DEBUG awx.main.dispatch delivered 84d9e06e-34b3-4f3f-a993-b40850a6fc33 to worker[176] qsize 0 2022-05-21 03:03:55,360 DEBUG awx.main.dispatch task 84d9e06e-34b3-4f3f-a993-b40850a6fc33 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:03:55,371 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:03:55,373 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(c1d790ea-ff73-4c05-9044-b05982c1087f, queue=onap-awx-0) [2022-05-21 03:03:55,373: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(c1d790ea-ff73-4c05-9044-b05982c1087f, queue=onap-awx-0) 2022-05-21 03:03:55,375 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:03:55,379 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:03:25.195890+00:00 2022-05-21 03:03:55,389 DEBUG awx.main.dispatch delivered a1c3892b-4477-40e4-8c41-6084ef2764db to worker[181] qsize 0 2022-05-21 03:03:55,392 DEBUG awx.main.dispatch delivered c1d790ea-ff73-4c05-9044-b05982c1087f to worker[177] qsize 0 2022-05-21 03:03:55,392 DEBUG awx.main.dispatch task a1c3892b-4477-40e4-8c41-6084ef2764db starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:03:55,394 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:03:55,394 DEBUG awx.main.dispatch task c1d790ea-ff73-4c05-9044-b05982c1087f starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:03:55,407 DEBUG awx.main.dispatch task c1d790ea-ff73-4c05-9044-b05982c1087f is finished 2022-05-21 03:03:55,414 DEBUG awx.main.dispatch task 1a19cf86-8f99-4b35-96c8-d6cf70e199a3 is finished 2022-05-21 03:03:55,803 DEBUG awx.main.dispatch task a1c3892b-4477-40e4-8c41-6084ef2764db is finished 2022-05-21 03:03:55,807 DEBUG awx.main.dispatch task 84d9e06e-34b3-4f3f-a993-b40850a6fc33 is finished RESULT 2 OKREADY 2022-05-21 03:04:14,996 DEBUG awx.main.dispatch publish awx.main.tasks.awx_isolated_heartbeat(258f31bb-3630-4a12-95d4-4017f7e3ae4e, queue=onap-awx-0) [2022-05-21 03:04:14,996: DEBUG/Process-1] publish awx.main.tasks.awx_isolated_heartbeat(258f31bb-3630-4a12-95d4-4017f7e3ae4e, queue=onap-awx-0) 2022-05-21 03:04:15,019 DEBUG awx.main.dispatch delivered 258f31bb-3630-4a12-95d4-4017f7e3ae4e to worker[178] qsize 0 2022-05-21 03:04:15,021 DEBUG awx.main.dispatch task 258f31bb-3630-4a12-95d4-4017f7e3ae4e starting awx.main.tasks.awx_isolated_heartbeat(*[]) 2022-05-21 03:04:15,022 DEBUG awx.main.tasks Controlling node checking for any isolated management tasks. 2022-05-21 03:04:15,046 DEBUG awx.main.dispatch task 258f31bb-3630-4a12-95d4-4017f7e3ae4e is finished 2022-05-21 03:04:15,143 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(82c8284c-c55b-425e-bfa8-405255fc3207, queue=awx_private_queue) [2022-05-21 03:04:15,143: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(82c8284c-c55b-425e-bfa8-405255fc3207, queue=awx_private_queue) 2022-05-21 03:04:15,160 DEBUG awx.main.dispatch delivered 82c8284c-c55b-425e-bfa8-405255fc3207 to worker[181] qsize 0 2022-05-21 03:04:15,164 DEBUG awx.main.dispatch task 82c8284c-c55b-425e-bfa8-405255fc3207 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:04:15,165 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:04:15,187 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:04:15,227 DEBUG awx.main.dispatch task 82c8284c-c55b-425e-bfa8-405255fc3207 is finished 2022-05-21 03:04:25,343 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(65c29abb-3193-46a2-8b3d-fbd9504559be, queue=awx_private_queue) [2022-05-21 03:04:25,343: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(65c29abb-3193-46a2-8b3d-fbd9504559be, queue=awx_private_queue) 2022-05-21 03:04:35,144 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5fdf26b6-d776-4e12-8e81-559e124f3ebd, queue=awx_private_queue) [2022-05-21 03:04:35,144: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5fdf26b6-d776-4e12-8e81-559e124f3ebd, queue=awx_private_queue) 2022-05-21 03:04:48,580 DEBUG awx.main.dispatch delivered 65c29abb-3193-46a2-8b3d-fbd9504559be to worker[181] qsize 0 2022-05-21 03:04:48,584 DEBUG awx.main.dispatch task 65c29abb-3193-46a2-8b3d-fbd9504559be starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:04:48,584 DEBUG awx.main.dispatch delivered 5fdf26b6-d776-4e12-8e81-559e124f3ebd to worker[176] qsize 0 2022-05-21 03:04:48,587 DEBUG awx.main.dispatch task 5fdf26b6-d776-4e12-8e81-559e124f3ebd starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:04:48,588 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:04:48,599 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:04:48,607 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:03:55.375962+00:00 2022-05-21 03:04:48,628 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:04:48,669 DEBUG awx.main.dispatch task 5fdf26b6-d776-4e12-8e81-559e124f3ebd is finished 2022-05-21 03:04:49,012 DEBUG awx.main.dispatch task 65c29abb-3193-46a2-8b3d-fbd9504559be is finished 2022-05-21 03:04:55,143 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7eab771d-7780-4d13-a80a-f0f0b21e195f, queue=awx_private_queue) [2022-05-21 03:04:55,143: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7eab771d-7780-4d13-a80a-f0f0b21e195f, queue=awx_private_queue) 2022-05-21 03:04:55,182 DEBUG awx.main.dispatch delivered 7eab771d-7780-4d13-a80a-f0f0b21e195f to worker[177] qsize 0 2022-05-21 03:04:55,185 DEBUG awx.main.dispatch task 7eab771d-7780-4d13-a80a-f0f0b21e195f starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:04:55,381 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:04:55,390 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:04:55,426 DEBUG awx.main.dispatch task 7eab771d-7780-4d13-a80a-f0f0b21e195f is finished 2022-05-21 03:04:55,344 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(6526ee99-ff54-4a26-a5ff-fd3693e2bb19, queue=awx_private_queue) [2022-05-21 03:04:55,344: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(6526ee99-ff54-4a26-a5ff-fd3693e2bb19, queue=awx_private_queue) 2022-05-21 03:04:55,535 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(4466c16b-44bf-43cd-8dae-373e8ab0dd4f, queue=onap-awx-0) [2022-05-21 03:04:55,535: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(4466c16b-44bf-43cd-8dae-373e8ab0dd4f, queue=onap-awx-0) 2022-05-21 03:04:55,551 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(4ca2b55a-cd2d-48a6-a441-aaff5906b57a, queue=onap-awx-0) [2022-05-21 03:04:55,551: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(4ca2b55a-cd2d-48a6-a441-aaff5906b57a, queue=onap-awx-0) 2022-05-21 03:04:55,568 DEBUG awx.main.dispatch delivered 4466c16b-44bf-43cd-8dae-373e8ab0dd4f to worker[178] qsize 0 2022-05-21 03:04:55,571 DEBUG awx.main.dispatch delivered 4ca2b55a-cd2d-48a6-a441-aaff5906b57a to worker[177] qsize 0 2022-05-21 03:04:55,571 DEBUG awx.main.dispatch task 4466c16b-44bf-43cd-8dae-373e8ab0dd4f starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:04:55,573 DEBUG awx.main.dispatch task 4ca2b55a-cd2d-48a6-a441-aaff5906b57a starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:04:55,575 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:04:55,589 DEBUG awx.main.dispatch task 4ca2b55a-cd2d-48a6-a441-aaff5906b57a is finished 2022-05-21 03:04:55,657 DEBUG awx.main.dispatch task 4466c16b-44bf-43cd-8dae-373e8ab0dd4f is finished RESULT 2 OKREADY 2022-05-21 03:05:13,485 DEBUG awx.main.dispatch delivered 6526ee99-ff54-4a26-a5ff-fd3693e2bb19 to worker[178] qsize 0 2022-05-21 03:05:13,488 DEBUG awx.main.dispatch task 6526ee99-ff54-4a26-a5ff-fd3693e2bb19 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:05:13,505 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:05:13,510 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:04:48.599888+00:00 2022-05-21 03:05:14,010 DEBUG awx.main.dispatch task 6526ee99-ff54-4a26-a5ff-fd3693e2bb19 is finished 2022-05-21 03:05:15,153 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7faf127a-657e-4557-b70e-55f7fd62fe08, queue=awx_private_queue) [2022-05-21 03:05:15,153: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7faf127a-657e-4557-b70e-55f7fd62fe08, queue=awx_private_queue) 2022-05-21 03:05:25,041 DEBUG awx.main.dispatch delivered 7faf127a-657e-4557-b70e-55f7fd62fe08 to worker[177] qsize 0 2022-05-21 03:05:25,045 DEBUG awx.main.dispatch task 7faf127a-657e-4557-b70e-55f7fd62fe08 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:05:25,047 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:05:25,071 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:05:25,108 DEBUG awx.main.dispatch task 7faf127a-657e-4557-b70e-55f7fd62fe08 is finished 2022-05-21 03:05:25,343 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(09854061-fe88-461c-8cd1-18746b5cad4c, queue=awx_private_queue) [2022-05-21 03:05:25,343: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(09854061-fe88-461c-8cd1-18746b5cad4c, queue=awx_private_queue) 2022-05-21 03:05:35,154 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b9ec05ab-dd6f-4014-a07a-035b052342b0, queue=awx_private_queue) [2022-05-21 03:05:35,154: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b9ec05ab-dd6f-4014-a07a-035b052342b0, queue=awx_private_queue) 2022-05-21 03:05:55,164 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b80e331c-6700-4756-9313-ee1db3b6fffa, queue=awx_private_queue) [2022-05-21 03:05:55,164: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b80e331c-6700-4756-9313-ee1db3b6fffa, queue=awx_private_queue) 2022-05-21 03:05:55,343 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(5c6ebf24-94c5-461b-ad9b-41c675214066, queue=awx_private_queue) [2022-05-21 03:05:55,343: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(5c6ebf24-94c5-461b-ad9b-41c675214066, queue=awx_private_queue) 2022-05-21 03:05:55,535 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(91697a06-d94c-468c-90e2-6b469ff7644e, queue=onap-awx-0) [2022-05-21 03:05:55,535: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(91697a06-d94c-468c-90e2-6b469ff7644e, queue=onap-awx-0) RESULT 2 OKREADY 2022-05-21 03:06:08,367 DEBUG awx.main.dispatch delivered 09854061-fe88-461c-8cd1-18746b5cad4c to worker[181] qsize 0 2022-05-21 03:06:08,371 DEBUG awx.main.dispatch delivered b9ec05ab-dd6f-4014-a07a-035b052342b0 to worker[176] qsize 0 2022-05-21 03:06:08,372 DEBUG awx.main.dispatch task 09854061-fe88-461c-8cd1-18746b5cad4c starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:06:08,374 DEBUG awx.main.dispatch delivered b80e331c-6700-4756-9313-ee1db3b6fffa to worker[178] qsize 0 2022-05-21 03:06:08,374 DEBUG awx.main.dispatch task b9ec05ab-dd6f-4014-a07a-035b052342b0 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:06:08,376 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:06:08,376 DEBUG awx.main.dispatch delivered 5c6ebf24-94c5-461b-ad9b-41c675214066 to worker[177] qsize 0 2022-05-21 03:06:08,376 DEBUG awx.main.dispatch task b80e331c-6700-4756-9313-ee1db3b6fffa starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:06:08,379 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:06:08,379 DEBUG awx.main.dispatch task 5c6ebf24-94c5-461b-ad9b-41c675214066 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:06:08,385 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:06:08,388 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:05:13.505795+00:00 2022-05-21 03:06:08,392 DEBUG awx.main.tasks Not running periodic scheduler, another task holds lock 2022-05-21 03:06:08,393 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:06:08,392 DEBUG awx.main.dispatch task 5c6ebf24-94c5-461b-ad9b-41c675214066 is finished 2022-05-21 03:06:08,401 DEBUG awx.main.scheduler Not running scheduler, another task holds lock 2022-05-21 03:06:08,401 DEBUG awx.main.dispatch task b80e331c-6700-4756-9313-ee1db3b6fffa is finished 2022-05-21 03:06:08,430 DEBUG awx.main.dispatch task b9ec05ab-dd6f-4014-a07a-035b052342b0 is finished 2022-05-21 03:06:08,953 DEBUG awx.main.dispatch task 09854061-fe88-461c-8cd1-18746b5cad4c is finished 2022-05-21 03:06:11,773 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(171b849b-90a6-4eec-9c14-6e1a2002d95b, queue=onap-awx-0) [2022-05-21 03:06:11,773: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(171b849b-90a6-4eec-9c14-6e1a2002d95b, queue=onap-awx-0) 2022-05-21 03:06:11,789 DEBUG awx.main.dispatch delivered 91697a06-d94c-468c-90e2-6b469ff7644e to worker[178] qsize 0 2022-05-21 03:06:11,792 DEBUG awx.main.dispatch delivered 171b849b-90a6-4eec-9c14-6e1a2002d95b to worker[177] qsize 0 2022-05-21 03:06:11,792 DEBUG awx.main.dispatch task 91697a06-d94c-468c-90e2-6b469ff7644e starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:06:11,794 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:06:11,794 DEBUG awx.main.dispatch task 171b849b-90a6-4eec-9c14-6e1a2002d95b starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:06:11,810 DEBUG awx.main.dispatch task 171b849b-90a6-4eec-9c14-6e1a2002d95b is finished 2022-05-21 03:06:11,867 DEBUG awx.main.dispatch task 91697a06-d94c-468c-90e2-6b469ff7644e is finished 2022-05-21 03:06:15,165 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(cf3ab6b8-317e-4d2f-9239-39bda76508f6, queue=awx_private_queue) [2022-05-21 03:06:15,165: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(cf3ab6b8-317e-4d2f-9239-39bda76508f6, queue=awx_private_queue) 2022-05-21 03:06:15,183 DEBUG awx.main.dispatch delivered cf3ab6b8-317e-4d2f-9239-39bda76508f6 to worker[181] qsize 0 2022-05-21 03:06:15,186 DEBUG awx.main.dispatch task cf3ab6b8-317e-4d2f-9239-39bda76508f6 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:06:15,188 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:06:15,213 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:06:15,250 DEBUG awx.main.dispatch task cf3ab6b8-317e-4d2f-9239-39bda76508f6 is finished 2022-05-21 03:06:25,344 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(590f8e56-7973-4d04-870e-7b9848659dbf, queue=awx_private_queue) [2022-05-21 03:06:25,344: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(590f8e56-7973-4d04-870e-7b9848659dbf, queue=awx_private_queue) 2022-05-21 03:06:35,165 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(042c41d2-1485-4c9c-854f-04e25bcbc6f1, queue=awx_private_queue) [2022-05-21 03:06:35,165: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(042c41d2-1485-4c9c-854f-04e25bcbc6f1, queue=awx_private_queue) 2022-05-21 03:06:53,705 DEBUG awx.main.dispatch delivered 590f8e56-7973-4d04-870e-7b9848659dbf to worker[181] qsize 0 2022-05-21 03:06:53,708 DEBUG awx.main.dispatch task 590f8e56-7973-4d04-870e-7b9848659dbf starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:06:53,709 DEBUG awx.main.dispatch delivered 042c41d2-1485-4c9c-854f-04e25bcbc6f1 to worker[176] qsize 0 2022-05-21 03:06:53,711 DEBUG awx.main.dispatch task 042c41d2-1485-4c9c-854f-04e25bcbc6f1 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:06:53,713 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:06:53,720 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:06:53,722 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:06:08.386101+00:00 2022-05-21 03:06:53,732 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:06:53,774 DEBUG awx.main.dispatch task 042c41d2-1485-4c9c-854f-04e25bcbc6f1 is finished 2022-05-21 03:06:54,350 DEBUG awx.main.dispatch task 590f8e56-7973-4d04-870e-7b9848659dbf is finished 2022-05-21 03:06:57,821 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(9e014eaa-79a7-4d29-95c0-ea4858e053dc, queue=awx_private_queue) [2022-05-21 03:06:57,821: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(9e014eaa-79a7-4d29-95c0-ea4858e053dc, queue=awx_private_queue) 2022-05-21 03:06:58,032 DEBUG awx.main.dispatch delivered 9e014eaa-79a7-4d29-95c0-ea4858e053dc to worker[181] qsize 0 2022-05-21 03:06:58,035 DEBUG awx.main.dispatch task 9e014eaa-79a7-4d29-95c0-ea4858e053dc starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:06:58,037 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:06:58,037 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(e3786f73-bad5-4878-8fb9-ca527a330011, queue=awx_private_queue) [2022-05-21 03:06:58,037: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(e3786f73-bad5-4878-8fb9-ca527a330011, queue=awx_private_queue) 2022-05-21 03:06:58,055 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:06:58,054 DEBUG awx.main.dispatch delivered e3786f73-bad5-4878-8fb9-ca527a330011 to worker[176] qsize 0 2022-05-21 03:06:58,056 DEBUG awx.main.dispatch task e3786f73-bad5-4878-8fb9-ca527a330011 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:06:58,060 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(565a788a-0690-46fc-9e1a-685e9d1ad2f5, queue=onap-awx-0) [2022-05-21 03:06:58,060: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(565a788a-0690-46fc-9e1a-685e9d1ad2f5, queue=onap-awx-0) 2022-05-21 03:06:58,067 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:06:58,070 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:06:53.720425+00:00 2022-05-21 03:06:58,087 DEBUG awx.main.dispatch task 9e014eaa-79a7-4d29-95c0-ea4858e053dc is finished 2022-05-21 03:06:58,093 DEBUG awx.main.dispatch delivered 565a788a-0690-46fc-9e1a-685e9d1ad2f5 to worker[178] qsize 0 2022-05-21 03:06:58,095 DEBUG awx.main.dispatch task 565a788a-0690-46fc-9e1a-685e9d1ad2f5 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:06:58,096 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:06:58,098 DEBUG awx.main.dispatch task e3786f73-bad5-4878-8fb9-ca527a330011 is finished 2022-05-21 03:06:58,124 DEBUG awx.main.dispatch task 565a788a-0690-46fc-9e1a-685e9d1ad2f5 is finished RESULT 2 OKREADY 2022-05-21 03:07:11,773 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(fb7ad384-7adc-4f62-b06f-153f647bece2, queue=onap-awx-0) [2022-05-21 03:07:11,773: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(fb7ad384-7adc-4f62-b06f-153f647bece2, queue=onap-awx-0) 2022-05-21 03:07:11,789 DEBUG awx.main.dispatch delivered fb7ad384-7adc-4f62-b06f-153f647bece2 to worker[178] qsize 0 2022-05-21 03:07:11,792 DEBUG awx.main.dispatch task fb7ad384-7adc-4f62-b06f-153f647bece2 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:07:11,812 DEBUG awx.main.dispatch task fb7ad384-7adc-4f62-b06f-153f647bece2 is finished 2022-05-21 03:07:17,822 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(27a7fd49-7522-4be0-b4d7-d86bc0b98755, queue=awx_private_queue) [2022-05-21 03:07:17,822: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(27a7fd49-7522-4be0-b4d7-d86bc0b98755, queue=awx_private_queue) 2022-05-21 03:07:17,841 DEBUG awx.main.dispatch delivered 27a7fd49-7522-4be0-b4d7-d86bc0b98755 to worker[177] qsize 0 2022-05-21 03:07:17,844 DEBUG awx.main.dispatch task 27a7fd49-7522-4be0-b4d7-d86bc0b98755 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:07:17,847 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:07:17,869 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:07:17,908 DEBUG awx.main.dispatch task 27a7fd49-7522-4be0-b4d7-d86bc0b98755 is finished 2022-05-21 03:07:28,037 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(80545e84-b046-4b12-9068-74bd0eb43f3a, queue=awx_private_queue) [2022-05-21 03:07:28,037: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(80545e84-b046-4b12-9068-74bd0eb43f3a, queue=awx_private_queue) 2022-05-21 03:07:28,054 DEBUG awx.main.dispatch delivered 80545e84-b046-4b12-9068-74bd0eb43f3a to worker[176] qsize 0 2022-05-21 03:07:28,056 DEBUG awx.main.dispatch task 80545e84-b046-4b12-9068-74bd0eb43f3a starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:07:28,070 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:07:28,073 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:06:58.068259+00:00 2022-05-21 03:07:28,608 DEBUG awx.main.dispatch task 80545e84-b046-4b12-9068-74bd0eb43f3a is finished 2022-05-21 03:07:37,822 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(726b7d5e-5b15-4ffe-bb87-3ecb74204862, queue=awx_private_queue) [2022-05-21 03:07:37,822: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(726b7d5e-5b15-4ffe-bb87-3ecb74204862, queue=awx_private_queue) 2022-05-21 03:07:37,845 DEBUG awx.main.dispatch delivered 726b7d5e-5b15-4ffe-bb87-3ecb74204862 to worker[176] qsize 0 2022-05-21 03:07:37,848 DEBUG awx.main.dispatch task 726b7d5e-5b15-4ffe-bb87-3ecb74204862 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:07:37,849 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:07:37,869 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:07:37,906 DEBUG awx.main.dispatch task 726b7d5e-5b15-4ffe-bb87-3ecb74204862 is finished 2022-05-21 03:07:57,833 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(57829a49-b893-44ee-8a78-d92a882d6e1f, queue=awx_private_queue) [2022-05-21 03:07:57,833: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(57829a49-b893-44ee-8a78-d92a882d6e1f, queue=awx_private_queue) 2022-05-21 03:07:58,059 DEBUG awx.main.dispatch delivered 57829a49-b893-44ee-8a78-d92a882d6e1f to worker[178] qsize 0 2022-05-21 03:07:58,060 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(e5822ebe-f441-4be7-9412-c745ff8b9434, queue=awx_private_queue) [2022-05-21 03:07:58,060: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(e5822ebe-f441-4be7-9412-c745ff8b9434, queue=awx_private_queue) 2022-05-21 03:07:58,061 DEBUG awx.main.dispatch task 57829a49-b893-44ee-8a78-d92a882d6e1f starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:07:58,062 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:07:58,074 DEBUG awx.main.dispatch delivered e5822ebe-f441-4be7-9412-c745ff8b9434 to worker[177] qsize 0 2022-05-21 03:07:58,075 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(9c35dcfb-8920-4696-b0b2-e7c4899d7b67, queue=onap-awx-0) [2022-05-21 03:07:58,075: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(9c35dcfb-8920-4696-b0b2-e7c4899d7b67, queue=onap-awx-0) 2022-05-21 03:07:58,077 DEBUG awx.main.dispatch task e5822ebe-f441-4be7-9412-c745ff8b9434 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:07:58,084 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:07:58,091 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:07:58,095 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:07:28.071101+00:00 2022-05-21 03:07:58,107 DEBUG awx.main.dispatch delivered 9c35dcfb-8920-4696-b0b2-e7c4899d7b67 to worker[181] qsize 0 2022-05-21 03:07:58,110 DEBUG awx.main.dispatch task 9c35dcfb-8920-4696-b0b2-e7c4899d7b67 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:07:58,112 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:07:58,125 DEBUG awx.main.dispatch task 57829a49-b893-44ee-8a78-d92a882d6e1f is finished 2022-05-21 03:07:58,433 DEBUG awx.main.dispatch task 9c35dcfb-8920-4696-b0b2-e7c4899d7b67 is finished 2022-05-21 03:07:58,470 DEBUG awx.main.dispatch task e5822ebe-f441-4be7-9412-c745ff8b9434 is finished RESULT 2 OKREADY 2022-05-21 03:08:11,774 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(6d7524d3-e6bf-491f-80ec-76ed613d91ef, queue=onap-awx-0) [2022-05-21 03:08:11,774: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(6d7524d3-e6bf-491f-80ec-76ed613d91ef, queue=onap-awx-0) 2022-05-21 03:08:11,792 DEBUG awx.main.dispatch delivered 6d7524d3-e6bf-491f-80ec-76ed613d91ef to worker[176] qsize 0 2022-05-21 03:08:11,796 DEBUG awx.main.dispatch task 6d7524d3-e6bf-491f-80ec-76ed613d91ef starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:08:11,815 DEBUG awx.main.dispatch task 6d7524d3-e6bf-491f-80ec-76ed613d91ef is finished 2022-05-21 03:08:17,832 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5796c8fc-5682-4426-a579-df3592e3177c, queue=awx_private_queue) [2022-05-21 03:08:17,832: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5796c8fc-5682-4426-a579-df3592e3177c, queue=awx_private_queue) 2022-05-21 03:08:17,845 DEBUG awx.main.dispatch delivered 5796c8fc-5682-4426-a579-df3592e3177c to worker[177] qsize 0 2022-05-21 03:08:17,847 DEBUG awx.main.dispatch task 5796c8fc-5682-4426-a579-df3592e3177c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:08:17,851 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:08:17,875 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:08:17,916 DEBUG awx.main.dispatch task 5796c8fc-5682-4426-a579-df3592e3177c is finished 2022-05-21 03:08:28,060 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(abe4e0dd-7614-41ee-b0c7-690abb3899e8, queue=awx_private_queue) [2022-05-21 03:08:28,060: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(abe4e0dd-7614-41ee-b0c7-690abb3899e8, queue=awx_private_queue) 2022-05-21 03:08:28,079 DEBUG awx.main.dispatch delivered abe4e0dd-7614-41ee-b0c7-690abb3899e8 to worker[177] qsize 0 2022-05-21 03:08:28,081 DEBUG awx.main.dispatch task abe4e0dd-7614-41ee-b0c7-690abb3899e8 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:08:28,094 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:08:28,097 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:07:58.091998+00:00 2022-05-21 03:08:28,599 DEBUG awx.main.dispatch task abe4e0dd-7614-41ee-b0c7-690abb3899e8 is finished 2022-05-21 03:08:37,833 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b6a061ac-f2c4-4e78-a025-5f1624412889, queue=awx_private_queue) [2022-05-21 03:08:37,833: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b6a061ac-f2c4-4e78-a025-5f1624412889, queue=awx_private_queue) 2022-05-21 03:08:37,853 DEBUG awx.main.dispatch delivered b6a061ac-f2c4-4e78-a025-5f1624412889 to worker[178] qsize 0 2022-05-21 03:08:37,855 DEBUG awx.main.dispatch task b6a061ac-f2c4-4e78-a025-5f1624412889 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:08:37,858 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:08:37,879 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:08:37,915 DEBUG awx.main.dispatch task b6a061ac-f2c4-4e78-a025-5f1624412889 is finished 2022-05-21 03:08:57,842 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(71fd761f-b1e6-4638-a3f7-2a04164476e0, queue=awx_private_queue) [2022-05-21 03:08:57,842: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(71fd761f-b1e6-4638-a3f7-2a04164476e0, queue=awx_private_queue) 2022-05-21 03:08:57,864 DEBUG awx.main.dispatch delivered 71fd761f-b1e6-4638-a3f7-2a04164476e0 to worker[176] qsize 0 2022-05-21 03:08:57,866 DEBUG awx.main.dispatch task 71fd761f-b1e6-4638-a3f7-2a04164476e0 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:08:57,868 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:08:57,892 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:08:57,939 DEBUG awx.main.dispatch task 71fd761f-b1e6-4638-a3f7-2a04164476e0 is finished 2022-05-21 03:08:58,061 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(8d4ad39f-a03d-4ad3-b8bb-ad777caef993, queue=awx_private_queue) [2022-05-21 03:08:58,061: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(8d4ad39f-a03d-4ad3-b8bb-ad777caef993, queue=awx_private_queue) 2022-05-21 03:08:58,082 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(73c5b592-1221-4b80-8889-3d7ac45cb653, queue=onap-awx-0) [2022-05-21 03:08:58,082: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(73c5b592-1221-4b80-8889-3d7ac45cb653, queue=onap-awx-0) 2022-05-21 03:08:58,111 DEBUG awx.main.dispatch delivered 73c5b592-1221-4b80-8889-3d7ac45cb653 to worker[178] qsize 0 2022-05-21 03:08:58,114 DEBUG awx.main.dispatch task 73c5b592-1221-4b80-8889-3d7ac45cb653 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:08:58,116 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:08:58,306 DEBUG awx.main.dispatch task 73c5b592-1221-4b80-8889-3d7ac45cb653 is finished 2022-05-21 03:08:58,462 DEBUG awx.main.dispatch delivered 8d4ad39f-a03d-4ad3-b8bb-ad777caef993 to worker[177] qsize 0 2022-05-21 03:08:58,466 DEBUG awx.main.dispatch task 8d4ad39f-a03d-4ad3-b8bb-ad777caef993 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:08:58,477 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:08:58,480 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:08:28.094378+00:00 2022-05-21 03:08:59,027 DEBUG awx.main.dispatch task 8d4ad39f-a03d-4ad3-b8bb-ad777caef993 is finished RESULT 2 OKREADY 2022-05-21 03:09:11,778 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(e530476f-9940-486c-b2e1-9d092cc56d18, queue=onap-awx-0) [2022-05-21 03:09:11,778: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(e530476f-9940-486c-b2e1-9d092cc56d18, queue=onap-awx-0) 2022-05-21 03:09:11,796 DEBUG awx.main.dispatch delivered e530476f-9940-486c-b2e1-9d092cc56d18 to worker[177] qsize 0 2022-05-21 03:09:11,993 DEBUG awx.main.dispatch task e530476f-9940-486c-b2e1-9d092cc56d18 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:09:12,011 DEBUG awx.main.dispatch task e530476f-9940-486c-b2e1-9d092cc56d18 is finished 2022-05-21 03:09:17,842 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(acbb0875-41b1-40ce-a0a8-e5841488b032, queue=awx_private_queue) [2022-05-21 03:09:17,842: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(acbb0875-41b1-40ce-a0a8-e5841488b032, queue=awx_private_queue) 2022-05-21 03:09:17,870 DEBUG awx.main.dispatch delivered acbb0875-41b1-40ce-a0a8-e5841488b032 to worker[181] qsize 0 2022-05-21 03:09:17,872 DEBUG awx.main.dispatch task acbb0875-41b1-40ce-a0a8-e5841488b032 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:09:17,875 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:09:17,897 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:09:17,938 DEBUG awx.main.dispatch task acbb0875-41b1-40ce-a0a8-e5841488b032 is finished 2022-05-21 03:09:28,060 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(97623cfd-403f-48fa-8140-468e53d8c16d, queue=awx_private_queue) [2022-05-21 03:09:28,060: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(97623cfd-403f-48fa-8140-468e53d8c16d, queue=awx_private_queue) 2022-05-21 03:09:28,080 DEBUG awx.main.dispatch delivered 97623cfd-403f-48fa-8140-468e53d8c16d to worker[181] qsize 0 2022-05-21 03:09:28,083 DEBUG awx.main.dispatch task 97623cfd-403f-48fa-8140-468e53d8c16d starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:09:28,097 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:09:28,100 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:08:58.477424+00:00 2022-05-21 03:09:28,190 DEBUG awx.main.dispatch task 97623cfd-403f-48fa-8140-468e53d8c16d is finished 2022-05-21 03:09:37,843 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(2999eec4-40cb-4e47-b913-687c2df9d603, queue=awx_private_queue) [2022-05-21 03:09:37,843: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(2999eec4-40cb-4e47-b913-687c2df9d603, queue=awx_private_queue) 2022-05-21 03:09:37,863 DEBUG awx.main.dispatch delivered 2999eec4-40cb-4e47-b913-687c2df9d603 to worker[178] qsize 0 2022-05-21 03:09:37,865 DEBUG awx.main.dispatch task 2999eec4-40cb-4e47-b913-687c2df9d603 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:09:37,867 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:09:37,890 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:09:37,930 DEBUG awx.main.dispatch task 2999eec4-40cb-4e47-b913-687c2df9d603 is finished 2022-05-21 03:09:58,054 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a2448126-e5f7-4cfe-a6de-4a5c3e7bcff3, queue=awx_private_queue) [2022-05-21 03:09:58,054: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a2448126-e5f7-4cfe-a6de-4a5c3e7bcff3, queue=awx_private_queue) 2022-05-21 03:09:58,074 DEBUG awx.main.dispatch delivered a2448126-e5f7-4cfe-a6de-4a5c3e7bcff3 to worker[178] qsize 0 2022-05-21 03:09:58,076 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(37031a39-080a-4c3e-90a1-3ef1168ebfd1, queue=awx_private_queue) [2022-05-21 03:09:58,076: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(37031a39-080a-4c3e-90a1-3ef1168ebfd1, queue=awx_private_queue) 2022-05-21 03:09:58,077 DEBUG awx.main.dispatch task a2448126-e5f7-4cfe-a6de-4a5c3e7bcff3 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:09:58,078 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:09:58,095 DEBUG awx.main.dispatch delivered 37031a39-080a-4c3e-90a1-3ef1168ebfd1 to worker[176] qsize 0 2022-05-21 03:09:58,098 DEBUG awx.main.dispatch task 37031a39-080a-4c3e-90a1-3ef1168ebfd1 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:09:58,095 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(3b6a2229-d8e0-4e8e-b4fc-362837e0e1a3, queue=onap-awx-0) [2022-05-21 03:09:58,095: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(3b6a2229-d8e0-4e8e-b4fc-362837e0e1a3, queue=onap-awx-0) 2022-05-21 03:09:58,106 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:09:58,108 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:09:58,111 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:09:28.097479+00:00 2022-05-21 03:09:58,135 DEBUG awx.main.dispatch delivered 3b6a2229-d8e0-4e8e-b4fc-362837e0e1a3 to worker[177] qsize 0 2022-05-21 03:09:58,137 DEBUG awx.main.dispatch task 3b6a2229-d8e0-4e8e-b4fc-362837e0e1a3 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:09:58,140 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:09:58,144 DEBUG awx.main.dispatch task a2448126-e5f7-4cfe-a6de-4a5c3e7bcff3 is finished 2022-05-21 03:09:58,498 DEBUG awx.main.dispatch task 3b6a2229-d8e0-4e8e-b4fc-362837e0e1a3 is finished 2022-05-21 03:09:58,663 DEBUG awx.main.dispatch task 37031a39-080a-4c3e-90a1-3ef1168ebfd1 is finished RESULT 2 OKREADY 2022-05-21 03:10:11,778 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(cd7bc7c3-47d6-41de-a58f-f729eabfde9e, queue=onap-awx-0) [2022-05-21 03:10:11,778: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(cd7bc7c3-47d6-41de-a58f-f729eabfde9e, queue=onap-awx-0) 2022-05-21 03:10:11,815 DEBUG awx.main.dispatch delivered cd7bc7c3-47d6-41de-a58f-f729eabfde9e to worker[176] qsize 0 2022-05-21 03:10:11,819 DEBUG awx.main.dispatch task cd7bc7c3-47d6-41de-a58f-f729eabfde9e starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:10:11,836 DEBUG awx.main.dispatch task cd7bc7c3-47d6-41de-a58f-f729eabfde9e is finished 2022-05-21 03:10:18,055 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f318506e-27c8-4234-8072-329f6d92c216, queue=awx_private_queue) [2022-05-21 03:10:18,055: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f318506e-27c8-4234-8072-329f6d92c216, queue=awx_private_queue) 2022-05-21 03:10:18,080 DEBUG awx.main.dispatch delivered f318506e-27c8-4234-8072-329f6d92c216 to worker[177] qsize 0 2022-05-21 03:10:18,082 DEBUG awx.main.dispatch task f318506e-27c8-4234-8072-329f6d92c216 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:10:18,083 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:10:18,112 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:10:18,152 DEBUG awx.main.dispatch task f318506e-27c8-4234-8072-329f6d92c216 is finished 2022-05-21 03:10:28,077 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(745fe465-b844-45cf-83bb-edb7269a1a29, queue=awx_private_queue) [2022-05-21 03:10:28,077: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(745fe465-b844-45cf-83bb-edb7269a1a29, queue=awx_private_queue) 2022-05-21 03:10:28,098 DEBUG awx.main.dispatch delivered 745fe465-b844-45cf-83bb-edb7269a1a29 to worker[178] qsize 0 2022-05-21 03:10:28,104 DEBUG awx.main.dispatch task 745fe465-b844-45cf-83bb-edb7269a1a29 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:10:28,119 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:10:28,124 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:09:58.108821+00:00 2022-05-21 03:10:28,525 DEBUG awx.main.dispatch task 745fe465-b844-45cf-83bb-edb7269a1a29 is finished 2022-05-21 03:10:38,054 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(4ebf12ec-57c7-4610-8fba-4b47bf2092c1, queue=awx_private_queue) [2022-05-21 03:10:38,054: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(4ebf12ec-57c7-4610-8fba-4b47bf2092c1, queue=awx_private_queue) 2022-05-21 03:10:38,069 DEBUG awx.main.dispatch delivered 4ebf12ec-57c7-4610-8fba-4b47bf2092c1 to worker[181] qsize 0 2022-05-21 03:10:38,072 DEBUG awx.main.dispatch task 4ebf12ec-57c7-4610-8fba-4b47bf2092c1 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:10:38,328 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:10:38,340 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:10:38,377 DEBUG awx.main.dispatch task 4ebf12ec-57c7-4610-8fba-4b47bf2092c1 is finished 2022-05-21 03:10:58,063 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(521f2d60-1c08-4882-b374-219e8b1916ef, queue=awx_private_queue) [2022-05-21 03:10:58,063: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(521f2d60-1c08-4882-b374-219e8b1916ef, queue=awx_private_queue) 2022-05-21 03:10:58,080 DEBUG awx.main.dispatch delivered 521f2d60-1c08-4882-b374-219e8b1916ef to worker[176] qsize 0 2022-05-21 03:10:58,081 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(e2ada138-166c-4930-8446-17f744956975, queue=awx_private_queue) [2022-05-21 03:10:58,081: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(e2ada138-166c-4930-8446-17f744956975, queue=awx_private_queue) 2022-05-21 03:10:58,083 DEBUG awx.main.dispatch task 521f2d60-1c08-4882-b374-219e8b1916ef starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:10:58,085 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:10:58,096 DEBUG awx.main.dispatch delivered e2ada138-166c-4930-8446-17f744956975 to worker[177] qsize 0 2022-05-21 03:10:58,099 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(b5ec31fe-01a8-4873-b9fc-3837a3351d74, queue=onap-awx-0) [2022-05-21 03:10:58,099: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(b5ec31fe-01a8-4873-b9fc-3837a3351d74, queue=onap-awx-0) 2022-05-21 03:10:58,099 DEBUG awx.main.dispatch task e2ada138-166c-4930-8446-17f744956975 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:10:58,111 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:10:58,111 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:10:58,114 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:10:28.120051+00:00 2022-05-21 03:10:58,131 DEBUG awx.main.dispatch delivered b5ec31fe-01a8-4873-b9fc-3837a3351d74 to worker[181] qsize 0 2022-05-21 03:10:58,134 DEBUG awx.main.dispatch task b5ec31fe-01a8-4873-b9fc-3837a3351d74 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:10:58,135 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:10:58,152 DEBUG awx.main.dispatch task 521f2d60-1c08-4882-b374-219e8b1916ef is finished 2022-05-21 03:10:58,394 DEBUG awx.main.dispatch task b5ec31fe-01a8-4873-b9fc-3837a3351d74 is finished 2022-05-21 03:10:58,543 DEBUG awx.main.dispatch task e2ada138-166c-4930-8446-17f744956975 is finished RESULT 2 OKREADY 2022-05-21 03:11:11,783 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(49fb1698-2df9-4c5c-97f6-511af6aaeda4, queue=onap-awx-0) [2022-05-21 03:11:11,783: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(49fb1698-2df9-4c5c-97f6-511af6aaeda4, queue=onap-awx-0) 2022-05-21 03:11:11,807 DEBUG awx.main.dispatch delivered 49fb1698-2df9-4c5c-97f6-511af6aaeda4 to worker[176] qsize 0 2022-05-21 03:11:11,810 DEBUG awx.main.dispatch task 49fb1698-2df9-4c5c-97f6-511af6aaeda4 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:11:11,829 DEBUG awx.main.dispatch task 49fb1698-2df9-4c5c-97f6-511af6aaeda4 is finished 2022-05-21 03:11:18,063 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(52ab3d9b-30a7-4eec-8c47-3b6c630d17f3, queue=awx_private_queue) [2022-05-21 03:11:18,063: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(52ab3d9b-30a7-4eec-8c47-3b6c630d17f3, queue=awx_private_queue) 2022-05-21 03:11:18,080 DEBUG awx.main.dispatch delivered 52ab3d9b-30a7-4eec-8c47-3b6c630d17f3 to worker[177] qsize 0 2022-05-21 03:11:18,084 DEBUG awx.main.dispatch task 52ab3d9b-30a7-4eec-8c47-3b6c630d17f3 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:11:18,085 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:11:18,110 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:11:18,151 DEBUG awx.main.dispatch task 52ab3d9b-30a7-4eec-8c47-3b6c630d17f3 is finished 2022-05-21 03:11:28,082 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(9cfaa131-5295-445a-bec4-380fd8c78d50, queue=awx_private_queue) [2022-05-21 03:11:28,082: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(9cfaa131-5295-445a-bec4-380fd8c78d50, queue=awx_private_queue) 2022-05-21 03:11:28,101 DEBUG awx.main.dispatch delivered 9cfaa131-5295-445a-bec4-380fd8c78d50 to worker[178] qsize 0 2022-05-21 03:11:28,103 DEBUG awx.main.dispatch task 9cfaa131-5295-445a-bec4-380fd8c78d50 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:11:28,118 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:11:28,121 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:10:58.111245+00:00 2022-05-21 03:11:28,183 DEBUG awx.main.dispatch task 9cfaa131-5295-445a-bec4-380fd8c78d50 is finished 2022-05-21 03:11:38,063 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(cb2970e9-b8bf-4cb2-9cb0-e4146dd596f6, queue=awx_private_queue) [2022-05-21 03:11:38,063: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(cb2970e9-b8bf-4cb2-9cb0-e4146dd596f6, queue=awx_private_queue) 2022-05-21 03:11:38,081 DEBUG awx.main.dispatch delivered cb2970e9-b8bf-4cb2-9cb0-e4146dd596f6 to worker[181] qsize 0 2022-05-21 03:11:38,083 DEBUG awx.main.dispatch task cb2970e9-b8bf-4cb2-9cb0-e4146dd596f6 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:11:38,292 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:11:38,302 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:11:38,335 DEBUG awx.main.dispatch task cb2970e9-b8bf-4cb2-9cb0-e4146dd596f6 is finished 2022-05-21 03:11:58,071 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0d176f13-175f-40fb-a15e-ea9456cffaac, queue=awx_private_queue) [2022-05-21 03:11:58,071: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0d176f13-175f-40fb-a15e-ea9456cffaac, queue=awx_private_queue) 2022-05-21 03:11:58,088 DEBUG awx.main.dispatch delivered 0d176f13-175f-40fb-a15e-ea9456cffaac to worker[178] qsize 0 2022-05-21 03:11:58,089 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(ed26e66f-6b09-48b4-acdf-e5f8a424eed6, queue=awx_private_queue) [2022-05-21 03:11:58,089: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(ed26e66f-6b09-48b4-acdf-e5f8a424eed6, queue=awx_private_queue) 2022-05-21 03:11:58,090 DEBUG awx.main.dispatch task 0d176f13-175f-40fb-a15e-ea9456cffaac starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:11:58,092 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:11:58,110 DEBUG awx.main.dispatch delivered ed26e66f-6b09-48b4-acdf-e5f8a424eed6 to worker[181] qsize 0 2022-05-21 03:11:58,114 DEBUG awx.main.dispatch task ed26e66f-6b09-48b4-acdf-e5f8a424eed6 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:11:58,116 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(d7c44343-993f-49d6-a12c-51761e947663, queue=onap-awx-0) [2022-05-21 03:11:58,116: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(d7c44343-993f-49d6-a12c-51761e947663, queue=onap-awx-0) 2022-05-21 03:11:58,118 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:11:58,127 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:11:58,131 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:11:28.118295+00:00 2022-05-21 03:11:58,153 DEBUG awx.main.dispatch delivered d7c44343-993f-49d6-a12c-51761e947663 to worker[176] qsize 0 2022-05-21 03:11:58,156 DEBUG awx.main.dispatch task d7c44343-993f-49d6-a12c-51761e947663 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:11:58,160 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:11:58,162 DEBUG awx.main.dispatch task 0d176f13-175f-40fb-a15e-ea9456cffaac is finished 2022-05-21 03:11:58,411 DEBUG awx.main.dispatch task d7c44343-993f-49d6-a12c-51761e947663 is finished 2022-05-21 03:11:58,569 DEBUG awx.main.dispatch task ed26e66f-6b09-48b4-acdf-e5f8a424eed6 is finished RESULT 2 OKREADY 2022-05-21 03:12:11,787 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(d340b3eb-25d4-44aa-8562-6ac6a8655e08, queue=onap-awx-0) [2022-05-21 03:12:11,787: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(d340b3eb-25d4-44aa-8562-6ac6a8655e08, queue=onap-awx-0) 2022-05-21 03:12:18,072 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(682af6d6-9ccc-40a5-a3e7-4f892048aa9f, queue=awx_private_queue) [2022-05-21 03:12:18,072: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(682af6d6-9ccc-40a5-a3e7-4f892048aa9f, queue=awx_private_queue) 2022-05-21 03:12:28,090 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(1cabc302-9db7-4c3d-97e9-8a51de46bde2, queue=awx_private_queue) [2022-05-21 03:12:28,090: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(1cabc302-9db7-4c3d-97e9-8a51de46bde2, queue=awx_private_queue) 2022-05-21 03:12:33,173 DEBUG awx.main.dispatch delivered 682af6d6-9ccc-40a5-a3e7-4f892048aa9f to worker[176] qsize 0 2022-05-21 03:12:33,177 DEBUG awx.main.dispatch task 682af6d6-9ccc-40a5-a3e7-4f892048aa9f starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:12:33,179 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:12:33,177 DEBUG awx.main.dispatch delivered d340b3eb-25d4-44aa-8562-6ac6a8655e08 to worker[181] qsize 0 2022-05-21 03:12:33,181 DEBUG awx.main.dispatch delivered 1cabc302-9db7-4c3d-97e9-8a51de46bde2 to worker[177] qsize 0 2022-05-21 03:12:33,182 DEBUG awx.main.dispatch task d340b3eb-25d4-44aa-8562-6ac6a8655e08 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:12:33,184 DEBUG awx.main.dispatch task 1cabc302-9db7-4c3d-97e9-8a51de46bde2 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:12:33,196 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:12:33,199 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:11:58.128248+00:00 2022-05-21 03:12:33,199 DEBUG awx.main.dispatch task d340b3eb-25d4-44aa-8562-6ac6a8655e08 is finished 2022-05-21 03:12:33,203 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:12:33,233 DEBUG awx.main.dispatch task 682af6d6-9ccc-40a5-a3e7-4f892048aa9f is finished 2022-05-21 03:12:33,735 DEBUG awx.main.dispatch task 1cabc302-9db7-4c3d-97e9-8a51de46bde2 is finished 2022-05-21 03:12:38,071 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3714c822-dd41-4c74-920c-3798ed318213, queue=awx_private_queue) [2022-05-21 03:12:38,071: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3714c822-dd41-4c74-920c-3798ed318213, queue=awx_private_queue) 2022-05-21 03:12:38,089 DEBUG awx.main.dispatch delivered 3714c822-dd41-4c74-920c-3798ed318213 to worker[181] qsize 0 2022-05-21 03:12:38,091 DEBUG awx.main.dispatch task 3714c822-dd41-4c74-920c-3798ed318213 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:12:38,094 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:12:38,119 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:12:38,161 DEBUG awx.main.dispatch task 3714c822-dd41-4c74-920c-3798ed318213 is finished 2022-05-21 03:12:58,862 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a8bfd4df-2e68-4f98-af38-9614b14f6597, queue=awx_private_queue) [2022-05-21 03:12:58,862: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a8bfd4df-2e68-4f98-af38-9614b14f6597, queue=awx_private_queue) 2022-05-21 03:12:59,105 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(283844e9-c8de-41a8-a9d4-05bb591d0f65, queue=awx_private_queue) [2022-05-21 03:12:59,105: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(283844e9-c8de-41a8-a9d4-05bb591d0f65, queue=awx_private_queue) 2022-05-21 03:12:59,124 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(59e952b2-9782-41db-82b0-bfd458cf9853, queue=onap-awx-0) [2022-05-21 03:12:59,124: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(59e952b2-9782-41db-82b0-bfd458cf9853, queue=onap-awx-0) 2022-05-21 03:12:59,156 DEBUG awx.main.dispatch delivered 59e952b2-9782-41db-82b0-bfd458cf9853 to worker[181] qsize 0 2022-05-21 03:12:59,159 DEBUG awx.main.dispatch task 59e952b2-9782-41db-82b0-bfd458cf9853 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:12:59,160 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:12:59,447 DEBUG awx.main.dispatch task 59e952b2-9782-41db-82b0-bfd458cf9853 is finished RESULT 2 OKREADY 2022-05-21 03:13:11,790 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(22fff749-586c-4117-b948-f7e3eb1206c8, queue=onap-awx-0) [2022-05-21 03:13:11,790: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(22fff749-586c-4117-b948-f7e3eb1206c8, queue=onap-awx-0) 2022-05-21 03:13:18,859 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7a2dd26f-5ed7-4e7d-affa-4abe721f06bf, queue=awx_private_queue) [2022-05-21 03:13:18,859: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7a2dd26f-5ed7-4e7d-affa-4abe721f06bf, queue=awx_private_queue) 2022-05-21 03:13:20,922 DEBUG awx.main.dispatch delivered a8bfd4df-2e68-4f98-af38-9614b14f6597 to worker[176] qsize 0 2022-05-21 03:13:20,925 DEBUG awx.main.dispatch delivered 283844e9-c8de-41a8-a9d4-05bb591d0f65 to worker[181] qsize 0 2022-05-21 03:13:20,926 DEBUG awx.main.dispatch task a8bfd4df-2e68-4f98-af38-9614b14f6597 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:13:20,930 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:13:20,929 DEBUG awx.main.dispatch task 283844e9-c8de-41a8-a9d4-05bb591d0f65 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:13:20,929 DEBUG awx.main.dispatch delivered 7a2dd26f-5ed7-4e7d-affa-4abe721f06bf to worker[177] qsize 0 2022-05-21 03:13:20,934 DEBUG awx.main.dispatch task 7a2dd26f-5ed7-4e7d-affa-4abe721f06bf starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:13:20,936 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:13:20,942 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:13:20,945 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:12:33.196918+00:00 2022-05-21 03:13:20,951 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:13:20,956 DEBUG awx.main.scheduler Not running scheduler, another task holds lock 2022-05-21 03:13:20,956 DEBUG awx.main.dispatch task 7a2dd26f-5ed7-4e7d-affa-4abe721f06bf is finished 2022-05-21 03:13:20,964 DEBUG awx.main.dispatch task 283844e9-c8de-41a8-a9d4-05bb591d0f65 is finished 2022-05-21 03:13:20,993 DEBUG awx.main.dispatch task a8bfd4df-2e68-4f98-af38-9614b14f6597 is finished 2022-05-21 03:13:29,105 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(e63f070b-aa6c-4e9e-8f98-74733308224e, queue=awx_private_queue) [2022-05-21 03:13:29,105: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(e63f070b-aa6c-4e9e-8f98-74733308224e, queue=awx_private_queue) 2022-05-21 03:13:38,859 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ca9355b5-92c3-4dab-9f24-4023396bf399, queue=awx_private_queue) [2022-05-21 03:13:38,859: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ca9355b5-92c3-4dab-9f24-4023396bf399, queue=awx_private_queue) 2022-05-21 03:13:45,218 DEBUG awx.main.dispatch delivered 22fff749-586c-4117-b948-f7e3eb1206c8 to worker[178] qsize 0 2022-05-21 03:13:45,222 DEBUG awx.main.dispatch task 22fff749-586c-4117-b948-f7e3eb1206c8 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:13:45,224 DEBUG awx.main.dispatch delivered e63f070b-aa6c-4e9e-8f98-74733308224e to worker[181] qsize 0 2022-05-21 03:13:45,229 DEBUG awx.main.dispatch delivered ca9355b5-92c3-4dab-9f24-4023396bf399 to worker[176] qsize 0 2022-05-21 03:13:45,229 DEBUG awx.main.dispatch task e63f070b-aa6c-4e9e-8f98-74733308224e starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:13:45,232 DEBUG awx.main.dispatch task ca9355b5-92c3-4dab-9f24-4023396bf399 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:13:45,234 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:13:45,241 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:13:45,241 DEBUG awx.main.dispatch task 22fff749-586c-4117-b948-f7e3eb1206c8 is finished 2022-05-21 03:13:45,245 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:13:20.942360+00:00 2022-05-21 03:13:45,252 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:13:45,292 DEBUG awx.main.dispatch task ca9355b5-92c3-4dab-9f24-4023396bf399 is finished 2022-05-21 03:13:45,293 DEBUG awx.main.dispatch task e63f070b-aa6c-4e9e-8f98-74733308224e is finished 2022-05-21 03:13:58,867 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(adc5ed6c-6e17-42e8-8453-c18899b5bdea, queue=awx_private_queue) [2022-05-21 03:13:58,867: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(adc5ed6c-6e17-42e8-8453-c18899b5bdea, queue=awx_private_queue) RESULT 2 2022-05-21 03:13:59,103 DEBUG awx.main.dispatch delivered adc5ed6c-6e17-42e8-8453-c18899b5bdea to worker[178] qsize 0 2022-05-21 03:13:59,105 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(16eae9c4-c92f-4e86-8f9e-a2f6a0118619, queue=awx_private_queue) [2022-05-21 03:13:59,105: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(16eae9c4-c92f-4e86-8f9e-a2f6a0118619, queue=awx_private_queue) 2022-05-21 03:13:59,106 DEBUG awx.main.dispatch task adc5ed6c-6e17-42e8-8453-c18899b5bdea starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:13:59,109 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:13:59,123 DEBUG awx.main.dispatch delivered 16eae9c4-c92f-4e86-8f9e-a2f6a0118619 to worker[177] qsize 0 2022-05-21 03:13:59,124 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(719c36e1-b7f0-46ca-923f-643d8a964c12, queue=onap-awx-0) [2022-05-21 03:13:59,124: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(719c36e1-b7f0-46ca-923f-643d8a964c12, queue=onap-awx-0) 2022-05-21 03:13:59,128 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:13:59,125 DEBUG awx.main.dispatch task 16eae9c4-c92f-4e86-8f9e-a2f6a0118619 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:13:59,136 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:13:59,139 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:13:45.242047+00:00 2022-05-21 03:13:59,160 DEBUG awx.main.dispatch delivered 719c36e1-b7f0-46ca-923f-643d8a964c12 to worker[176] qsize 0 2022-05-21 03:13:59,163 DEBUG awx.main.dispatch task 719c36e1-b7f0-46ca-923f-643d8a964c12 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:13:59,164 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:13:59,165 DEBUG awx.main.dispatch task adc5ed6c-6e17-42e8-8453-c18899b5bdea is finished 2022-05-21 03:13:59,610 DEBUG awx.main.dispatch task 719c36e1-b7f0-46ca-923f-643d8a964c12 is finished 2022-05-21 03:13:59,712 DEBUG awx.main.dispatch task 16eae9c4-c92f-4e86-8f9e-a2f6a0118619 is finished OKREADY 2022-05-21 03:14:11,791 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(fd9dc0ee-9bef-48ca-a856-fdd724978243, queue=onap-awx-0) [2022-05-21 03:14:11,791: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(fd9dc0ee-9bef-48ca-a856-fdd724978243, queue=onap-awx-0) 2022-05-21 03:14:14,996 DEBUG awx.main.dispatch publish awx.main.tasks.awx_isolated_heartbeat(6d48e6d6-f1ca-4654-add9-375e0d70300f, queue=onap-awx-0) [2022-05-21 03:14:14,996: DEBUG/Process-1] publish awx.main.tasks.awx_isolated_heartbeat(6d48e6d6-f1ca-4654-add9-375e0d70300f, queue=onap-awx-0) 2022-05-21 03:14:18,867 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(74a05587-d9f4-44ea-a06f-21b87b636a5c, queue=awx_private_queue) [2022-05-21 03:14:18,867: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(74a05587-d9f4-44ea-a06f-21b87b636a5c, queue=awx_private_queue) 2022-05-21 03:14:25,686 DEBUG awx.main.dispatch delivered 74a05587-d9f4-44ea-a06f-21b87b636a5c to worker[177] qsize 0 2022-05-21 03:14:25,690 DEBUG awx.main.dispatch delivered fd9dc0ee-9bef-48ca-a856-fdd724978243 to worker[178] qsize 0 2022-05-21 03:14:25,690 DEBUG awx.main.dispatch task 74a05587-d9f4-44ea-a06f-21b87b636a5c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:14:25,692 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:14:25,694 DEBUG awx.main.dispatch delivered 6d48e6d6-f1ca-4654-add9-375e0d70300f to worker[181] qsize 0 2022-05-21 03:14:25,693 DEBUG awx.main.dispatch task fd9dc0ee-9bef-48ca-a856-fdd724978243 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:14:25,697 DEBUG awx.main.dispatch task 6d48e6d6-f1ca-4654-add9-375e0d70300f starting awx.main.tasks.awx_isolated_heartbeat(*[]) 2022-05-21 03:14:25,699 DEBUG awx.main.tasks Controlling node checking for any isolated management tasks. 2022-05-21 03:14:25,708 DEBUG awx.main.dispatch task fd9dc0ee-9bef-48ca-a856-fdd724978243 is finished 2022-05-21 03:14:25,712 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:14:25,724 DEBUG awx.main.dispatch task 6d48e6d6-f1ca-4654-add9-375e0d70300f is finished 2022-05-21 03:14:25,746 DEBUG awx.main.dispatch task 74a05587-d9f4-44ea-a06f-21b87b636a5c is finished 2022-05-21 03:14:29,105 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(8af1151a-8dd3-458c-923d-8bafe13bdb49, queue=awx_private_queue) [2022-05-21 03:14:29,105: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(8af1151a-8dd3-458c-923d-8bafe13bdb49, queue=awx_private_queue) 2022-05-21 03:14:29,131 DEBUG awx.main.dispatch delivered 8af1151a-8dd3-458c-923d-8bafe13bdb49 to worker[178] qsize 0 2022-05-21 03:14:29,133 DEBUG awx.main.dispatch task 8af1151a-8dd3-458c-923d-8bafe13bdb49 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:14:29,145 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:14:29,148 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:13:59.136589+00:00 2022-05-21 03:14:29,723 DEBUG awx.main.dispatch task 8af1151a-8dd3-458c-923d-8bafe13bdb49 is finished 2022-05-21 03:14:38,867 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(2b5c41bc-93fd-45f7-ac95-c0b536710b86, queue=awx_private_queue) [2022-05-21 03:14:38,867: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(2b5c41bc-93fd-45f7-ac95-c0b536710b86, queue=awx_private_queue) 2022-05-21 03:14:38,882 DEBUG awx.main.dispatch delivered 2b5c41bc-93fd-45f7-ac95-c0b536710b86 to worker[177] qsize 0 2022-05-21 03:14:38,885 DEBUG awx.main.dispatch task 2b5c41bc-93fd-45f7-ac95-c0b536710b86 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:14:38,886 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:14:38,916 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:14:38,960 DEBUG awx.main.dispatch task 2b5c41bc-93fd-45f7-ac95-c0b536710b86 is finished 2022-05-21 03:14:58,877 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f8f3807b-2cf0-4d53-9b16-56642b106059, queue=awx_private_queue) [2022-05-21 03:14:58,877: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f8f3807b-2cf0-4d53-9b16-56642b106059, queue=awx_private_queue) 2022-05-21 03:14:59,090 DEBUG awx.main.dispatch delivered f8f3807b-2cf0-4d53-9b16-56642b106059 to worker[177] qsize 0 2022-05-21 03:14:59,093 DEBUG awx.main.dispatch task f8f3807b-2cf0-4d53-9b16-56642b106059 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:14:59,095 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:14:59,105 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(6267db90-233e-411a-a134-d4fdddf42e4b, queue=awx_private_queue) [2022-05-21 03:14:59,105: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(6267db90-233e-411a-a134-d4fdddf42e4b, queue=awx_private_queue) 2022-05-21 03:14:59,118 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:14:59,120 DEBUG awx.main.dispatch delivered 6267db90-233e-411a-a134-d4fdddf42e4b to worker[178] qsize 0 2022-05-21 03:14:59,123 DEBUG awx.main.dispatch task 6267db90-233e-411a-a134-d4fdddf42e4b starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:14:59,124 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(e9112c80-5a5c-4951-a565-91222d71003a, queue=onap-awx-0) [2022-05-21 03:14:59,124: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(e9112c80-5a5c-4951-a565-91222d71003a, queue=onap-awx-0) 2022-05-21 03:14:59,137 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:14:59,141 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:14:29.145479+00:00 2022-05-21 03:14:59,152 DEBUG awx.main.dispatch delivered e9112c80-5a5c-4951-a565-91222d71003a to worker[176] qsize 0 2022-05-21 03:14:59,154 DEBUG awx.main.dispatch task e9112c80-5a5c-4951-a565-91222d71003a starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:14:59,156 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:14:59,169 DEBUG awx.main.dispatch task f8f3807b-2cf0-4d53-9b16-56642b106059 is finished 2022-05-21 03:14:59,188 DEBUG awx.main.dispatch task 6267db90-233e-411a-a134-d4fdddf42e4b is finished 2022-05-21 03:14:59,185 DEBUG awx.main.dispatch task e9112c80-5a5c-4951-a565-91222d71003a is finished RESULT 2 OKREADY 2022-05-21 03:15:11,794 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(0efa9a85-ae3d-45b8-b1ae-74886072044b, queue=onap-awx-0) [2022-05-21 03:15:11,794: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(0efa9a85-ae3d-45b8-b1ae-74886072044b, queue=onap-awx-0) 2022-05-21 03:15:11,817 DEBUG awx.main.dispatch delivered 0efa9a85-ae3d-45b8-b1ae-74886072044b to worker[181] qsize 0 2022-05-21 03:15:11,820 DEBUG awx.main.dispatch task 0efa9a85-ae3d-45b8-b1ae-74886072044b starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:15:11,838 DEBUG awx.main.dispatch task 0efa9a85-ae3d-45b8-b1ae-74886072044b is finished 2022-05-21 03:15:18,877 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d47ad572-ef17-455d-b4e2-1b42f8696fe6, queue=awx_private_queue) [2022-05-21 03:15:18,877: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d47ad572-ef17-455d-b4e2-1b42f8696fe6, queue=awx_private_queue) 2022-05-21 03:15:18,897 DEBUG awx.main.dispatch delivered d47ad572-ef17-455d-b4e2-1b42f8696fe6 to worker[176] qsize 0 2022-05-21 03:15:18,900 DEBUG awx.main.dispatch task d47ad572-ef17-455d-b4e2-1b42f8696fe6 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:15:18,902 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:15:18,923 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:15:18,963 DEBUG awx.main.dispatch task d47ad572-ef17-455d-b4e2-1b42f8696fe6 is finished 2022-05-21 03:15:29,105 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(0249e4e9-5b30-4616-926c-0828b5b1bfec, queue=awx_private_queue) [2022-05-21 03:15:29,105: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(0249e4e9-5b30-4616-926c-0828b5b1bfec, queue=awx_private_queue) 2022-05-21 03:15:29,124 DEBUG awx.main.dispatch delivered 0249e4e9-5b30-4616-926c-0828b5b1bfec to worker[178] qsize 0 2022-05-21 03:15:29,127 DEBUG awx.main.dispatch task 0249e4e9-5b30-4616-926c-0828b5b1bfec starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:15:29,144 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:15:29,148 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:14:59.137486+00:00 2022-05-21 03:15:29,526 DEBUG awx.main.dispatch task 0249e4e9-5b30-4616-926c-0828b5b1bfec is finished 2022-05-21 03:15:38,877 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(21b23aad-31b6-4a4f-9680-bb5bd253b813, queue=awx_private_queue) [2022-05-21 03:15:38,877: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(21b23aad-31b6-4a4f-9680-bb5bd253b813, queue=awx_private_queue) 2022-05-21 03:15:38,893 DEBUG awx.main.dispatch delivered 21b23aad-31b6-4a4f-9680-bb5bd253b813 to worker[181] qsize 0 2022-05-21 03:15:38,895 DEBUG awx.main.dispatch task 21b23aad-31b6-4a4f-9680-bb5bd253b813 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:15:38,896 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:15:38,916 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:15:38,955 DEBUG awx.main.dispatch task 21b23aad-31b6-4a4f-9680-bb5bd253b813 is finished 2022-05-21 03:15:59,102 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6eeed10b-3c59-46ec-8430-bced9b4c718d, queue=awx_private_queue) [2022-05-21 03:15:59,102: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6eeed10b-3c59-46ec-8430-bced9b4c718d, queue=awx_private_queue) 2022-05-21 03:15:59,336 DEBUG awx.main.dispatch delivered 6eeed10b-3c59-46ec-8430-bced9b4c718d to worker[181] qsize 0 2022-05-21 03:15:59,337 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d85e8866-b763-46e8-94b9-ab17d143ea69, queue=awx_private_queue) [2022-05-21 03:15:59,337: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d85e8866-b763-46e8-94b9-ab17d143ea69, queue=awx_private_queue) 2022-05-21 03:15:59,338 DEBUG awx.main.dispatch task 6eeed10b-3c59-46ec-8430-bced9b4c718d starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:15:59,340 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:15:59,351 DEBUG awx.main.dispatch delivered d85e8866-b763-46e8-94b9-ab17d143ea69 to worker[177] qsize 0 2022-05-21 03:15:59,353 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(58402970-cc85-48e6-b868-c30d925f1e52, queue=onap-awx-0) [2022-05-21 03:15:59,353: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(58402970-cc85-48e6-b868-c30d925f1e52, queue=onap-awx-0) 2022-05-21 03:15:59,359 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:15:59,356 DEBUG awx.main.dispatch task d85e8866-b763-46e8-94b9-ab17d143ea69 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:15:59,369 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:15:59,372 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:15:29.145111+00:00 2022-05-21 03:15:59,388 DEBUG awx.main.dispatch delivered 58402970-cc85-48e6-b868-c30d925f1e52 to worker[176] qsize 0 2022-05-21 03:15:59,390 DEBUG awx.main.dispatch task 58402970-cc85-48e6-b868-c30d925f1e52 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:15:59,393 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:15:59,401 DEBUG awx.main.dispatch task 6eeed10b-3c59-46ec-8430-bced9b4c718d is finished 2022-05-21 03:15:59,688 DEBUG awx.main.dispatch task d85e8866-b763-46e8-94b9-ab17d143ea69 is finished 2022-05-21 03:15:59,891 DEBUG awx.main.dispatch task 58402970-cc85-48e6-b868-c30d925f1e52 is finished RESULT 2 OKREADY 2022-05-21 03:16:11,794 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(9568ac45-0a72-4a68-9e9a-f5daaac43316, queue=onap-awx-0) [2022-05-21 03:16:11,794: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(9568ac45-0a72-4a68-9e9a-f5daaac43316, queue=onap-awx-0) 2022-05-21 03:16:11,813 DEBUG awx.main.dispatch delivered 9568ac45-0a72-4a68-9e9a-f5daaac43316 to worker[178] qsize 0 2022-05-21 03:16:11,816 DEBUG awx.main.dispatch task 9568ac45-0a72-4a68-9e9a-f5daaac43316 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:16:11,836 DEBUG awx.main.dispatch task 9568ac45-0a72-4a68-9e9a-f5daaac43316 is finished 2022-05-21 03:16:19,103 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b71d34ee-163b-49e9-b6bf-8f5bf241f824, queue=awx_private_queue) [2022-05-21 03:16:19,103: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b71d34ee-163b-49e9-b6bf-8f5bf241f824, queue=awx_private_queue) 2022-05-21 03:16:19,121 DEBUG awx.main.dispatch delivered b71d34ee-163b-49e9-b6bf-8f5bf241f824 to worker[181] qsize 0 2022-05-21 03:16:19,123 DEBUG awx.main.dispatch task b71d34ee-163b-49e9-b6bf-8f5bf241f824 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:16:19,126 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:16:19,149 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:16:19,186 DEBUG awx.main.dispatch task b71d34ee-163b-49e9-b6bf-8f5bf241f824 is finished 2022-05-21 03:16:29,338 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(79c101d8-b5e8-46a7-a5fe-55bdd297d85f, queue=awx_private_queue) [2022-05-21 03:16:29,338: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(79c101d8-b5e8-46a7-a5fe-55bdd297d85f, queue=awx_private_queue) 2022-05-21 03:16:29,358 DEBUG awx.main.dispatch delivered 79c101d8-b5e8-46a7-a5fe-55bdd297d85f to worker[177] qsize 0 2022-05-21 03:16:29,362 DEBUG awx.main.dispatch task 79c101d8-b5e8-46a7-a5fe-55bdd297d85f starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:16:29,376 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:16:29,380 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:15:59.369462+00:00 2022-05-21 03:16:29,852 DEBUG awx.main.dispatch task 79c101d8-b5e8-46a7-a5fe-55bdd297d85f is finished 2022-05-21 03:16:39,103 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b33f56f4-4dc6-4fc9-94d8-ceb605d5adbe, queue=awx_private_queue) [2022-05-21 03:16:39,103: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b33f56f4-4dc6-4fc9-94d8-ceb605d5adbe, queue=awx_private_queue) 2022-05-21 03:16:39,123 DEBUG awx.main.dispatch delivered b33f56f4-4dc6-4fc9-94d8-ceb605d5adbe to worker[178] qsize 0 2022-05-21 03:16:39,125 DEBUG awx.main.dispatch task b33f56f4-4dc6-4fc9-94d8-ceb605d5adbe starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:16:39,127 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:16:39,151 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:16:39,190 DEBUG awx.main.dispatch task b33f56f4-4dc6-4fc9-94d8-ceb605d5adbe is finished 2022-05-21 03:16:59,113 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(aafd2f98-2263-48fc-a130-e1e6a1ac4cf4, queue=awx_private_queue) [2022-05-21 03:16:59,113: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(aafd2f98-2263-48fc-a130-e1e6a1ac4cf4, queue=awx_private_queue) 2022-05-21 03:16:59,327 DEBUG awx.main.dispatch delivered aafd2f98-2263-48fc-a130-e1e6a1ac4cf4 to worker[177] qsize 0 2022-05-21 03:16:59,330 DEBUG awx.main.dispatch task aafd2f98-2263-48fc-a130-e1e6a1ac4cf4 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:16:59,331 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:16:59,338 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(5716443b-7ab5-4295-83f0-77390a39e843, queue=awx_private_queue) [2022-05-21 03:16:59,338: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(5716443b-7ab5-4295-83f0-77390a39e843, queue=awx_private_queue) 2022-05-21 03:16:59,351 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:16:59,354 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(0a552962-32e8-4eea-8b36-356bd8b5f778, queue=onap-awx-0) [2022-05-21 03:16:59,354: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(0a552962-32e8-4eea-8b36-356bd8b5f778, queue=onap-awx-0) 2022-05-21 03:16:59,353 DEBUG awx.main.dispatch delivered 5716443b-7ab5-4295-83f0-77390a39e843 to worker[178] qsize 0 2022-05-21 03:16:59,358 DEBUG awx.main.dispatch task 5716443b-7ab5-4295-83f0-77390a39e843 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:16:59,371 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:16:59,374 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:16:29.376692+00:00 2022-05-21 03:16:59,386 DEBUG awx.main.dispatch delivered 0a552962-32e8-4eea-8b36-356bd8b5f778 to worker[181] qsize 0 2022-05-21 03:16:59,387 DEBUG awx.main.dispatch task aafd2f98-2263-48fc-a130-e1e6a1ac4cf4 is finished 2022-05-21 03:16:59,388 DEBUG awx.main.dispatch task 0a552962-32e8-4eea-8b36-356bd8b5f778 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:16:59,390 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:16:59,632 DEBUG awx.main.dispatch task 0a552962-32e8-4eea-8b36-356bd8b5f778 is finished 2022-05-21 03:16:59,635 DEBUG awx.main.dispatch task 5716443b-7ab5-4295-83f0-77390a39e843 is finished RESULT 2 OKREADY 2022-05-21 03:17:11,797 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(b526c79f-fd18-4a11-9ae0-b89fc033fd60, queue=onap-awx-0) [2022-05-21 03:17:11,797: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(b526c79f-fd18-4a11-9ae0-b89fc033fd60, queue=onap-awx-0) 2022-05-21 03:17:11,819 DEBUG awx.main.dispatch delivered b526c79f-fd18-4a11-9ae0-b89fc033fd60 to worker[177] qsize 0 2022-05-21 03:17:11,822 DEBUG awx.main.dispatch task b526c79f-fd18-4a11-9ae0-b89fc033fd60 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:17:11,838 DEBUG awx.main.dispatch task b526c79f-fd18-4a11-9ae0-b89fc033fd60 is finished 2022-05-21 03:17:19,114 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(9d321483-1671-4d17-939b-a38d5f8ab41f, queue=awx_private_queue) [2022-05-21 03:17:19,114: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(9d321483-1671-4d17-939b-a38d5f8ab41f, queue=awx_private_queue) 2022-05-21 03:17:19,134 DEBUG awx.main.dispatch delivered 9d321483-1671-4d17-939b-a38d5f8ab41f to worker[181] qsize 0 2022-05-21 03:17:19,137 DEBUG awx.main.dispatch task 9d321483-1671-4d17-939b-a38d5f8ab41f starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:17:19,140 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:17:19,166 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:17:19,201 DEBUG awx.main.dispatch task 9d321483-1671-4d17-939b-a38d5f8ab41f is finished 2022-05-21 03:17:29,338 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(b089b508-b68a-424e-9f4b-37b5e9038f25, queue=awx_private_queue) [2022-05-21 03:17:29,338: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(b089b508-b68a-424e-9f4b-37b5e9038f25, queue=awx_private_queue) 2022-05-21 03:17:29,354 DEBUG awx.main.dispatch delivered b089b508-b68a-424e-9f4b-37b5e9038f25 to worker[177] qsize 0 2022-05-21 03:17:29,357 DEBUG awx.main.dispatch task b089b508-b68a-424e-9f4b-37b5e9038f25 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:17:29,369 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:17:29,372 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:16:59.371339+00:00 2022-05-21 03:17:29,996 DEBUG awx.main.dispatch task b089b508-b68a-424e-9f4b-37b5e9038f25 is finished 2022-05-21 03:17:39,113 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a2ba2ba4-b456-4287-821c-9446d73bb95b, queue=awx_private_queue) [2022-05-21 03:17:39,113: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a2ba2ba4-b456-4287-821c-9446d73bb95b, queue=awx_private_queue) 2022-05-21 03:17:39,130 DEBUG awx.main.dispatch delivered a2ba2ba4-b456-4287-821c-9446d73bb95b to worker[181] qsize 0 2022-05-21 03:17:39,133 DEBUG awx.main.dispatch task a2ba2ba4-b456-4287-821c-9446d73bb95b starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:17:39,135 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:17:39,157 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:17:39,204 DEBUG awx.main.dispatch task a2ba2ba4-b456-4287-821c-9446d73bb95b is finished 2022-05-21 03:17:59,123 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(af3a8f0b-356d-4add-840a-29cd2131ac84, queue=awx_private_queue) [2022-05-21 03:17:59,123: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(af3a8f0b-356d-4add-840a-29cd2131ac84, queue=awx_private_queue) 2022-05-21 03:17:59,344 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(9fdcc827-e4a8-41c1-ba1f-ab01726293d4, queue=awx_private_queue) [2022-05-21 03:17:59,344: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(9fdcc827-e4a8-41c1-ba1f-ab01726293d4, queue=awx_private_queue) 2022-05-21 03:17:59,344 DEBUG awx.main.dispatch delivered af3a8f0b-356d-4add-840a-29cd2131ac84 to worker[181] qsize 0 2022-05-21 03:17:59,347 DEBUG awx.main.dispatch task af3a8f0b-356d-4add-840a-29cd2131ac84 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:17:59,349 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:17:59,360 DEBUG awx.main.dispatch delivered 9fdcc827-e4a8-41c1-ba1f-ab01726293d4 to worker[178] qsize 0 2022-05-21 03:17:59,361 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(162a8cf5-8b44-472d-b3b1-08d4bec5c693, queue=onap-awx-0) [2022-05-21 03:17:59,361: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(162a8cf5-8b44-472d-b3b1-08d4bec5c693, queue=onap-awx-0) 2022-05-21 03:17:59,363 DEBUG awx.main.dispatch task 9fdcc827-e4a8-41c1-ba1f-ab01726293d4 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:17:59,369 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:17:59,376 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:17:59,378 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:17:29.369443+00:00 2022-05-21 03:17:59,391 DEBUG awx.main.dispatch delivered 162a8cf5-8b44-472d-b3b1-08d4bec5c693 to worker[176] qsize 0 2022-05-21 03:17:59,394 DEBUG awx.main.dispatch task 162a8cf5-8b44-472d-b3b1-08d4bec5c693 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:17:59,397 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:17:59,411 DEBUG awx.main.dispatch task af3a8f0b-356d-4add-840a-29cd2131ac84 is finished 2022-05-21 03:17:59,940 DEBUG awx.main.dispatch task 162a8cf5-8b44-472d-b3b1-08d4bec5c693 is finished 2022-05-21 03:18:00,201 DEBUG awx.main.dispatch task 9fdcc827-e4a8-41c1-ba1f-ab01726293d4 is finished RESULT 2 OKREADY 2022-05-21 03:18:11,797 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(fa4a64d6-562e-4ead-b794-22d58f714157, queue=onap-awx-0) [2022-05-21 03:18:11,797: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(fa4a64d6-562e-4ead-b794-22d58f714157, queue=onap-awx-0) 2022-05-21 03:18:11,815 DEBUG awx.main.dispatch delivered fa4a64d6-562e-4ead-b794-22d58f714157 to worker[178] qsize 0 2022-05-21 03:18:11,819 DEBUG awx.main.dispatch task fa4a64d6-562e-4ead-b794-22d58f714157 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:18:11,836 DEBUG awx.main.dispatch task fa4a64d6-562e-4ead-b794-22d58f714157 is finished 2022-05-21 03:18:19,123 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(60a7ab01-ca2d-4049-b2a3-b66ddcf84858, queue=awx_private_queue) [2022-05-21 03:18:19,123: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(60a7ab01-ca2d-4049-b2a3-b66ddcf84858, queue=awx_private_queue) 2022-05-21 03:18:19,139 DEBUG awx.main.dispatch delivered 60a7ab01-ca2d-4049-b2a3-b66ddcf84858 to worker[181] qsize 0 2022-05-21 03:18:19,142 DEBUG awx.main.dispatch task 60a7ab01-ca2d-4049-b2a3-b66ddcf84858 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:18:19,145 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:18:19,170 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:18:19,208 DEBUG awx.main.dispatch task 60a7ab01-ca2d-4049-b2a3-b66ddcf84858 is finished 2022-05-21 03:18:29,345 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(a4611790-a73d-4cf7-8d0d-46035ca335e1, queue=awx_private_queue) [2022-05-21 03:18:29,345: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(a4611790-a73d-4cf7-8d0d-46035ca335e1, queue=awx_private_queue) 2022-05-21 03:18:29,363 DEBUG awx.main.dispatch delivered a4611790-a73d-4cf7-8d0d-46035ca335e1 to worker[178] qsize 0 2022-05-21 03:18:29,366 DEBUG awx.main.dispatch task a4611790-a73d-4cf7-8d0d-46035ca335e1 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:18:29,380 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:18:29,383 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:17:59.376349+00:00 2022-05-21 03:18:29,862 DEBUG awx.main.dispatch task a4611790-a73d-4cf7-8d0d-46035ca335e1 is finished 2022-05-21 03:18:39,124 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(28da2bfd-fd18-472e-8200-751b9b2c2762, queue=awx_private_queue) [2022-05-21 03:18:39,124: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(28da2bfd-fd18-472e-8200-751b9b2c2762, queue=awx_private_queue) 2022-05-21 03:18:39,150 DEBUG awx.main.dispatch delivered 28da2bfd-fd18-472e-8200-751b9b2c2762 to worker[181] qsize 0 2022-05-21 03:18:39,152 DEBUG awx.main.dispatch task 28da2bfd-fd18-472e-8200-751b9b2c2762 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:18:39,154 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:18:39,175 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:18:39,214 DEBUG awx.main.dispatch task 28da2bfd-fd18-472e-8200-751b9b2c2762 is finished 2022-05-21 03:18:59,503 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7e8d2b23-61b3-4c39-b1ab-9e66f4a6c96a, queue=awx_private_queue) [2022-05-21 03:18:59,503: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7e8d2b23-61b3-4c39-b1ab-9e66f4a6c96a, queue=awx_private_queue) 2022-05-21 03:18:59,713 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(f3273b6d-7ff0-47fa-bfca-38d9de97c897, queue=awx_private_queue) [2022-05-21 03:18:59,713: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(f3273b6d-7ff0-47fa-bfca-38d9de97c897, queue=awx_private_queue) 2022-05-21 03:18:59,713 DEBUG awx.main.dispatch delivered 7e8d2b23-61b3-4c39-b1ab-9e66f4a6c96a to worker[177] qsize 0 2022-05-21 03:18:59,717 DEBUG awx.main.dispatch task 7e8d2b23-61b3-4c39-b1ab-9e66f4a6c96a starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:18:59,720 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:18:59,728 DEBUG awx.main.dispatch delivered f3273b6d-7ff0-47fa-bfca-38d9de97c897 to worker[176] qsize 0 2022-05-21 03:18:59,729 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(c43722f0-050d-40e1-a40d-5457bb4d2427, queue=onap-awx-0) [2022-05-21 03:18:59,729: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(c43722f0-050d-40e1-a40d-5457bb4d2427, queue=onap-awx-0) 2022-05-21 03:18:59,730 DEBUG awx.main.dispatch task f3273b6d-7ff0-47fa-bfca-38d9de97c897 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:18:59,739 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:18:59,744 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:18:59,747 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:18:29.380521+00:00 2022-05-21 03:18:59,759 DEBUG awx.main.dispatch delivered c43722f0-050d-40e1-a40d-5457bb4d2427 to worker[178] qsize 0 2022-05-21 03:18:59,761 DEBUG awx.main.dispatch task c43722f0-050d-40e1-a40d-5457bb4d2427 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:18:59,764 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:18:59,785 DEBUG awx.main.dispatch task 7e8d2b23-61b3-4c39-b1ab-9e66f4a6c96a is finished 2022-05-21 03:19:00,266 DEBUG awx.main.dispatch task c43722f0-050d-40e1-a40d-5457bb4d2427 is finished 2022-05-21 03:19:00,520 DEBUG awx.main.dispatch task f3273b6d-7ff0-47fa-bfca-38d9de97c897 is finished RESULT 2 OKREADY 2022-05-21 03:19:11,799 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(a0f0b546-a015-4082-8d7e-817c4945de7d, queue=onap-awx-0) [2022-05-21 03:19:11,799: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(a0f0b546-a015-4082-8d7e-817c4945de7d, queue=onap-awx-0) 2022-05-21 03:19:11,818 DEBUG awx.main.dispatch delivered a0f0b546-a015-4082-8d7e-817c4945de7d to worker[181] qsize 0 2022-05-21 03:19:11,820 DEBUG awx.main.dispatch task a0f0b546-a015-4082-8d7e-817c4945de7d starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:19:11,836 DEBUG awx.main.dispatch task a0f0b546-a015-4082-8d7e-817c4945de7d is finished 2022-05-21 03:19:19,503 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ec2fcca4-e92b-4849-94e2-4fab1af8e896, queue=awx_private_queue) [2022-05-21 03:19:19,503: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ec2fcca4-e92b-4849-94e2-4fab1af8e896, queue=awx_private_queue) 2022-05-21 03:19:19,523 DEBUG awx.main.dispatch delivered ec2fcca4-e92b-4849-94e2-4fab1af8e896 to worker[176] qsize 0 2022-05-21 03:19:19,526 DEBUG awx.main.dispatch task ec2fcca4-e92b-4849-94e2-4fab1af8e896 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:19:19,528 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:19:19,552 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:19:19,594 DEBUG awx.main.dispatch task ec2fcca4-e92b-4849-94e2-4fab1af8e896 is finished 2022-05-21 03:19:29,714 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(c5b29dd0-b23f-45b4-98c7-5e496a2af591, queue=awx_private_queue) [2022-05-21 03:19:29,714: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(c5b29dd0-b23f-45b4-98c7-5e496a2af591, queue=awx_private_queue) 2022-05-21 03:19:29,729 DEBUG awx.main.dispatch delivered c5b29dd0-b23f-45b4-98c7-5e496a2af591 to worker[176] qsize 0 2022-05-21 03:19:29,731 DEBUG awx.main.dispatch task c5b29dd0-b23f-45b4-98c7-5e496a2af591 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:19:29,806 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:19:29,809 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:18:59.744363+00:00 2022-05-21 03:19:30,234 DEBUG awx.main.dispatch task c5b29dd0-b23f-45b4-98c7-5e496a2af591 is finished 2022-05-21 03:19:39,503 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(19117cc8-a8c8-4631-85c9-f995d0ad8427, queue=awx_private_queue) [2022-05-21 03:19:39,503: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(19117cc8-a8c8-4631-85c9-f995d0ad8427, queue=awx_private_queue) 2022-05-21 03:19:39,519 DEBUG awx.main.dispatch delivered 19117cc8-a8c8-4631-85c9-f995d0ad8427 to worker[176] qsize 0 2022-05-21 03:19:39,521 DEBUG awx.main.dispatch task 19117cc8-a8c8-4631-85c9-f995d0ad8427 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:19:39,523 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:19:39,547 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:19:39,587 DEBUG awx.main.dispatch task 19117cc8-a8c8-4631-85c9-f995d0ad8427 is finished 2022-05-21 03:19:59,513 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d0768855-a3cd-4c03-bdd6-b32eb559850e, queue=awx_private_queue) [2022-05-21 03:19:59,513: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d0768855-a3cd-4c03-bdd6-b32eb559850e, queue=awx_private_queue) RESULT 2 2022-05-21 03:19:59,531 DEBUG awx.main.dispatch delivered d0768855-a3cd-4c03-bdd6-b32eb559850e to worker[181] qsize 0 2022-05-21 03:19:59,534 DEBUG awx.main.dispatch task d0768855-a3cd-4c03-bdd6-b32eb559850e starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:19:59,537 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:19:59,558 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:19:59,595 DEBUG awx.main.dispatch task d0768855-a3cd-4c03-bdd6-b32eb559850e is finished 2022-05-21 03:19:59,715 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(f2dea21b-f5d9-4cca-84bd-08a1f9091ee0, queue=awx_private_queue) [2022-05-21 03:19:59,715: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(f2dea21b-f5d9-4cca-84bd-08a1f9091ee0, queue=awx_private_queue) 2022-05-21 03:19:59,747 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(493002a4-8625-4ff4-9ab2-15fce8a73da8, queue=onap-awx-0) [2022-05-21 03:19:59,747: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(493002a4-8625-4ff4-9ab2-15fce8a73da8, queue=onap-awx-0) 2022-05-21 03:19:59,776 DEBUG awx.main.dispatch delivered 493002a4-8625-4ff4-9ab2-15fce8a73da8 to worker[177] qsize 0 2022-05-21 03:19:59,981 DEBUG awx.main.dispatch task 493002a4-8625-4ff4-9ab2-15fce8a73da8 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:19:59,985 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:20:00,160 DEBUG awx.main.dispatch task 493002a4-8625-4ff4-9ab2-15fce8a73da8 is finished 2022-05-21 03:20:11,800 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(f7d55504-c2c8-4269-a66f-f5944ee8b37b, queue=onap-awx-0) [2022-05-21 03:20:11,800: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(f7d55504-c2c8-4269-a66f-f5944ee8b37b, queue=onap-awx-0) 2022-05-21 03:20:19,513 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7a1fb60b-f19a-424a-937b-724f32db6fd5, queue=awx_private_queue) [2022-05-21 03:20:19,513: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7a1fb60b-f19a-424a-937b-724f32db6fd5, queue=awx_private_queue) OKREADY 2022-05-21 03:20:26,951 DEBUG awx.main.dispatch delivered f2dea21b-f5d9-4cca-84bd-08a1f9091ee0 to worker[177] qsize 0 2022-05-21 03:20:26,954 DEBUG awx.main.dispatch delivered 7a1fb60b-f19a-424a-937b-724f32db6fd5 to worker[176] qsize 0 2022-05-21 03:20:26,954 DEBUG awx.main.dispatch task f2dea21b-f5d9-4cca-84bd-08a1f9091ee0 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:20:26,956 DEBUG awx.main.dispatch task 7a1fb60b-f19a-424a-937b-724f32db6fd5 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:20:26,959 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:20:26,968 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:20:26,971 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:19:29.807016+00:00 2022-05-21 03:20:26,981 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:20:27,020 DEBUG awx.main.dispatch task 7a1fb60b-f19a-424a-937b-724f32db6fd5 is finished 2022-05-21 03:20:27,369 DEBUG awx.main.dispatch task f2dea21b-f5d9-4cca-84bd-08a1f9091ee0 is finished 2022-05-21 03:20:29,715 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(ecfb26a6-6918-4d19-8b4c-b9f4dd30d8b4, queue=awx_private_queue) [2022-05-21 03:20:29,715: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(ecfb26a6-6918-4d19-8b4c-b9f4dd30d8b4, queue=awx_private_queue) 2022-05-21 03:20:31,831 DEBUG awx.main.dispatch delivered f7d55504-c2c8-4269-a66f-f5944ee8b37b to worker[181] qsize 0 2022-05-21 03:20:31,834 DEBUG awx.main.dispatch task f7d55504-c2c8-4269-a66f-f5944ee8b37b starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:20:31,854 DEBUG awx.main.dispatch task f7d55504-c2c8-4269-a66f-f5944ee8b37b is finished 2022-05-21 03:20:32,123 DEBUG awx.main.dispatch delivered ecfb26a6-6918-4d19-8b4c-b9f4dd30d8b4 to worker[181] qsize 0 2022-05-21 03:20:32,126 DEBUG awx.main.dispatch task ecfb26a6-6918-4d19-8b4c-b9f4dd30d8b4 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:20:32,140 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:20:32,144 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:20:26.968724+00:00 2022-05-21 03:20:32,692 DEBUG awx.main.dispatch task ecfb26a6-6918-4d19-8b4c-b9f4dd30d8b4 is finished 2022-05-21 03:20:39,514 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(72c5ab5c-e226-48bb-a2e5-9255274a1e21, queue=awx_private_queue) [2022-05-21 03:20:39,514: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(72c5ab5c-e226-48bb-a2e5-9255274a1e21, queue=awx_private_queue) 2022-05-21 03:20:39,535 DEBUG awx.main.dispatch delivered 72c5ab5c-e226-48bb-a2e5-9255274a1e21 to worker[177] qsize 0 2022-05-21 03:20:39,538 DEBUG awx.main.dispatch task 72c5ab5c-e226-48bb-a2e5-9255274a1e21 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:20:39,540 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:20:39,559 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:20:39,593 DEBUG awx.main.dispatch task 72c5ab5c-e226-48bb-a2e5-9255274a1e21 is finished 2022-05-21 03:20:59,525 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a03ecb42-7f2c-440e-ba1b-b094bd62fe49, queue=awx_private_queue) [2022-05-21 03:20:59,525: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a03ecb42-7f2c-440e-ba1b-b094bd62fe49, queue=awx_private_queue) 2022-05-21 03:20:59,715 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(092bd3d0-4c35-4b25-909c-908a40f130ac, queue=awx_private_queue) [2022-05-21 03:20:59,715: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(092bd3d0-4c35-4b25-909c-908a40f130ac, queue=awx_private_queue) 2022-05-21 03:20:59,749 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(59a67189-fca9-45e4-b897-04d40685daf6, queue=onap-awx-0) [2022-05-21 03:20:59,749: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(59a67189-fca9-45e4-b897-04d40685daf6, queue=onap-awx-0) 2022-05-21 03:20:59,782 DEBUG awx.main.dispatch delivered 59a67189-fca9-45e4-b897-04d40685daf6 to worker[181] qsize 0 2022-05-21 03:20:59,983 DEBUG awx.main.dispatch task 59a67189-fca9-45e4-b897-04d40685daf6 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:20:59,986 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:21:00,286 DEBUG awx.main.dispatch task 59a67189-fca9-45e4-b897-04d40685daf6 is finished RESULT 2 OKREADY 2022-05-21 03:21:11,800 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(80c04d0d-bb41-4c16-ba49-d162f37b9469, queue=onap-awx-0) [2022-05-21 03:21:11,800: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(80c04d0d-bb41-4c16-ba49-d162f37b9469, queue=onap-awx-0) 2022-05-21 03:21:13,965 DEBUG awx.main.dispatch delivered a03ecb42-7f2c-440e-ba1b-b094bd62fe49 to worker[178] qsize 0 2022-05-21 03:21:13,968 DEBUG awx.main.dispatch delivered 092bd3d0-4c35-4b25-909c-908a40f130ac to worker[177] qsize 0 2022-05-21 03:21:13,968 DEBUG awx.main.dispatch task a03ecb42-7f2c-440e-ba1b-b094bd62fe49 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:21:13,971 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:21:13,971 DEBUG awx.main.dispatch task 092bd3d0-4c35-4b25-909c-908a40f130ac starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:21:13,985 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:21:13,989 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:20:32.140741+00:00 2022-05-21 03:21:13,994 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:21:14,032 DEBUG awx.main.dispatch task a03ecb42-7f2c-440e-ba1b-b094bd62fe49 is finished 2022-05-21 03:21:14,385 DEBUG awx.main.dispatch task 092bd3d0-4c35-4b25-909c-908a40f130ac is finished 2022-05-21 03:21:19,524 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(9eaa439d-e27c-43d9-a598-a86cca4ad27e, queue=awx_private_queue) [2022-05-21 03:21:19,524: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(9eaa439d-e27c-43d9-a598-a86cca4ad27e, queue=awx_private_queue) 2022-05-21 03:21:29,715 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(b691eaa9-155a-41bf-aa48-6788fc22f89b, queue=awx_private_queue) [2022-05-21 03:21:29,715: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(b691eaa9-155a-41bf-aa48-6788fc22f89b, queue=awx_private_queue) 2022-05-21 03:21:34,458 DEBUG awx.main.dispatch delivered 80c04d0d-bb41-4c16-ba49-d162f37b9469 to worker[177] qsize 0 2022-05-21 03:21:34,461 DEBUG awx.main.dispatch delivered 9eaa439d-e27c-43d9-a598-a86cca4ad27e to worker[181] qsize 0 2022-05-21 03:21:34,461 DEBUG awx.main.dispatch task 80c04d0d-bb41-4c16-ba49-d162f37b9469 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:21:34,463 DEBUG awx.main.dispatch delivered b691eaa9-155a-41bf-aa48-6788fc22f89b to worker[178] qsize 0 2022-05-21 03:21:34,463 DEBUG awx.main.dispatch task 9eaa439d-e27c-43d9-a598-a86cca4ad27e starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:21:34,465 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:21:34,466 DEBUG awx.main.dispatch task b691eaa9-155a-41bf-aa48-6788fc22f89b starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:21:34,478 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:21:34,482 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:21:13.986104+00:00 2022-05-21 03:21:34,481 DEBUG awx.main.dispatch task 80c04d0d-bb41-4c16-ba49-d162f37b9469 is finished 2022-05-21 03:21:34,484 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:21:34,520 DEBUG awx.main.dispatch task 9eaa439d-e27c-43d9-a598-a86cca4ad27e is finished 2022-05-21 03:21:34,933 DEBUG awx.main.dispatch task b691eaa9-155a-41bf-aa48-6788fc22f89b is finished 2022-05-21 03:21:39,525 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0ff7753c-4a33-4ff3-b226-8193ae3cafbe, queue=awx_private_queue) [2022-05-21 03:21:39,525: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0ff7753c-4a33-4ff3-b226-8193ae3cafbe, queue=awx_private_queue) 2022-05-21 03:21:39,549 DEBUG awx.main.dispatch delivered 0ff7753c-4a33-4ff3-b226-8193ae3cafbe to worker[181] qsize 0 2022-05-21 03:21:39,552 DEBUG awx.main.dispatch task 0ff7753c-4a33-4ff3-b226-8193ae3cafbe starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:21:39,553 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:21:39,576 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:21:39,614 DEBUG awx.main.dispatch task 0ff7753c-4a33-4ff3-b226-8193ae3cafbe is finished 2022-05-21 03:22:01,389 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(1ce9c78c-619c-4c0c-965e-b356fbdf8ae8, queue=awx_private_queue) [2022-05-21 03:22:01,389: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(1ce9c78c-619c-4c0c-965e-b356fbdf8ae8, queue=awx_private_queue) RESULT 2 2022-05-21 03:22:01,583 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(1fe9e655-1c70-4e3c-a2b8-04ad9f9083ee, queue=awx_private_queue) 2022-05-21 03:22:01,582 DEBUG awx.main.dispatch delivered 1ce9c78c-619c-4c0c-965e-b356fbdf8ae8 to worker[178] qsize 0 [2022-05-21 03:22:01,583: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(1fe9e655-1c70-4e3c-a2b8-04ad9f9083ee, queue=awx_private_queue) 2022-05-21 03:22:01,585 DEBUG awx.main.dispatch task 1ce9c78c-619c-4c0c-965e-b356fbdf8ae8 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:22:01,586 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:22:01,600 DEBUG awx.main.dispatch delivered 1fe9e655-1c70-4e3c-a2b8-04ad9f9083ee to worker[177] qsize 0 2022-05-21 03:22:01,602 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(75f180cf-80c2-4159-8986-fe55818add16, queue=onap-awx-0) [2022-05-21 03:22:01,602: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(75f180cf-80c2-4159-8986-fe55818add16, queue=onap-awx-0) 2022-05-21 03:22:01,604 DEBUG awx.main.dispatch task 1fe9e655-1c70-4e3c-a2b8-04ad9f9083ee starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:22:01,608 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:22:01,617 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:22:01,621 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:21:34.478536+00:00 OKREADY 2022-05-21 03:22:01,635 DEBUG awx.main.dispatch delivered 75f180cf-80c2-4159-8986-fe55818add16 to worker[181] qsize 0 2022-05-21 03:22:01,638 DEBUG awx.main.dispatch task 75f180cf-80c2-4159-8986-fe55818add16 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:22:01,640 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:22:01,645 DEBUG awx.main.dispatch task 1ce9c78c-619c-4c0c-965e-b356fbdf8ae8 is finished 2022-05-21 03:22:01,779 DEBUG awx.main.dispatch task 75f180cf-80c2-4159-8986-fe55818add16 is finished 2022-05-21 03:22:01,794 DEBUG awx.main.dispatch task 1fe9e655-1c70-4e3c-a2b8-04ad9f9083ee is finished 2022-05-21 03:22:11,801 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(ea5f8a12-aa70-4aea-933a-f041f9ac7734, queue=onap-awx-0) [2022-05-21 03:22:11,801: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(ea5f8a12-aa70-4aea-933a-f041f9ac7734, queue=onap-awx-0) 2022-05-21 03:22:21,389 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(029c87c9-4f9d-494c-a058-e0647d31f17c, queue=awx_private_queue) [2022-05-21 03:22:21,389: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(029c87c9-4f9d-494c-a058-e0647d31f17c, queue=awx_private_queue) 2022-05-21 03:22:27,339 DEBUG awx.main.dispatch delivered ea5f8a12-aa70-4aea-933a-f041f9ac7734 to worker[176] qsize 0 2022-05-21 03:22:27,342 DEBUG awx.main.dispatch delivered 029c87c9-4f9d-494c-a058-e0647d31f17c to worker[177] qsize 0 2022-05-21 03:22:27,342 DEBUG awx.main.dispatch task ea5f8a12-aa70-4aea-933a-f041f9ac7734 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:22:27,344 DEBUG awx.main.dispatch task 029c87c9-4f9d-494c-a058-e0647d31f17c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:22:27,346 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:22:27,361 DEBUG awx.main.dispatch task ea5f8a12-aa70-4aea-933a-f041f9ac7734 is finished 2022-05-21 03:22:27,367 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:22:27,404 DEBUG awx.main.dispatch task 029c87c9-4f9d-494c-a058-e0647d31f17c is finished 2022-05-21 03:22:31,584 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(dfe34e2b-3892-4a6e-a5dc-68e75527ff8b, queue=awx_private_queue) [2022-05-21 03:22:31,584: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(dfe34e2b-3892-4a6e-a5dc-68e75527ff8b, queue=awx_private_queue) 2022-05-21 03:22:31,609 DEBUG awx.main.dispatch delivered dfe34e2b-3892-4a6e-a5dc-68e75527ff8b to worker[176] qsize 0 2022-05-21 03:22:31,612 DEBUG awx.main.dispatch task dfe34e2b-3892-4a6e-a5dc-68e75527ff8b starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:22:31,627 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:22:31,631 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:22:01.618152+00:00 2022-05-21 03:22:32,151 DEBUG awx.main.dispatch task dfe34e2b-3892-4a6e-a5dc-68e75527ff8b is finished 2022-05-21 03:22:41,389 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3764714c-2520-4e84-8983-e27480017011, queue=awx_private_queue) [2022-05-21 03:22:41,389: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3764714c-2520-4e84-8983-e27480017011, queue=awx_private_queue) 2022-05-21 03:22:41,409 DEBUG awx.main.dispatch delivered 3764714c-2520-4e84-8983-e27480017011 to worker[177] qsize 0 2022-05-21 03:22:41,412 DEBUG awx.main.dispatch task 3764714c-2520-4e84-8983-e27480017011 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:22:41,414 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:22:41,439 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:22:41,477 DEBUG awx.main.dispatch task 3764714c-2520-4e84-8983-e27480017011 is finished RESULT 2 OKREADY 2022-05-21 03:23:01,393 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b11455c4-f477-4adf-9691-cc406c5c4a83, queue=awx_private_queue) [2022-05-21 03:23:01,393: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b11455c4-f477-4adf-9691-cc406c5c4a83, queue=awx_private_queue) 2022-05-21 03:23:01,590 DEBUG awx.main.dispatch delivered b11455c4-f477-4adf-9691-cc406c5c4a83 to worker[178] qsize 0 2022-05-21 03:23:01,592 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(23727e4a-5913-432b-a5f9-1826a5888b79, queue=awx_private_queue) [2022-05-21 03:23:01,592: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(23727e4a-5913-432b-a5f9-1826a5888b79, queue=awx_private_queue) 2022-05-21 03:23:01,593 DEBUG awx.main.dispatch task b11455c4-f477-4adf-9691-cc406c5c4a83 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:23:01,595 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:23:01,608 DEBUG awx.main.dispatch delivered 23727e4a-5913-432b-a5f9-1826a5888b79 to worker[177] qsize 0 2022-05-21 03:23:01,609 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(4bcbd081-fbec-4eb7-accd-bc2e72e73da7, queue=onap-awx-0) [2022-05-21 03:23:01,609: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(4bcbd081-fbec-4eb7-accd-bc2e72e73da7, queue=onap-awx-0) 2022-05-21 03:23:01,610 DEBUG awx.main.dispatch task 23727e4a-5913-432b-a5f9-1826a5888b79 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:23:01,617 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:23:01,622 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:23:01,626 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:22:31.627294+00:00 2022-05-21 03:23:01,639 DEBUG awx.main.dispatch delivered 4bcbd081-fbec-4eb7-accd-bc2e72e73da7 to worker[181] qsize 0 2022-05-21 03:23:01,642 DEBUG awx.main.dispatch task 4bcbd081-fbec-4eb7-accd-bc2e72e73da7 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:23:01,645 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:23:01,653 DEBUG awx.main.dispatch task b11455c4-f477-4adf-9691-cc406c5c4a83 is finished 2022-05-21 03:23:02,178 DEBUG awx.main.dispatch task 4bcbd081-fbec-4eb7-accd-bc2e72e73da7 is finished 2022-05-21 03:23:02,180 DEBUG awx.main.dispatch task 23727e4a-5913-432b-a5f9-1826a5888b79 is finished 2022-05-21 03:23:11,802 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(28717c3d-83e2-41b2-8dda-654d38781cd7, queue=onap-awx-0) [2022-05-21 03:23:11,802: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(28717c3d-83e2-41b2-8dda-654d38781cd7, queue=onap-awx-0) 2022-05-21 03:23:11,823 DEBUG awx.main.dispatch delivered 28717c3d-83e2-41b2-8dda-654d38781cd7 to worker[178] qsize 0 2022-05-21 03:23:11,826 DEBUG awx.main.dispatch task 28717c3d-83e2-41b2-8dda-654d38781cd7 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:23:11,842 DEBUG awx.main.dispatch task 28717c3d-83e2-41b2-8dda-654d38781cd7 is finished 2022-05-21 03:23:21,392 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a3a80675-74ce-4e34-9905-0a7cc16704c7, queue=awx_private_queue) [2022-05-21 03:23:21,392: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a3a80675-74ce-4e34-9905-0a7cc16704c7, queue=awx_private_queue) 2022-05-21 03:23:21,412 DEBUG awx.main.dispatch delivered a3a80675-74ce-4e34-9905-0a7cc16704c7 to worker[181] qsize 0 2022-05-21 03:23:21,415 DEBUG awx.main.dispatch task a3a80675-74ce-4e34-9905-0a7cc16704c7 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:23:21,417 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:23:21,443 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:23:21,484 DEBUG awx.main.dispatch task a3a80675-74ce-4e34-9905-0a7cc16704c7 is finished 2022-05-21 03:23:31,593 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(6e162013-7b39-445f-979f-f26f9eae36bb, queue=awx_private_queue) [2022-05-21 03:23:31,593: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(6e162013-7b39-445f-979f-f26f9eae36bb, queue=awx_private_queue) 2022-05-21 03:23:31,613 DEBUG awx.main.dispatch delivered 6e162013-7b39-445f-979f-f26f9eae36bb to worker[176] qsize 0 2022-05-21 03:23:31,616 DEBUG awx.main.dispatch task 6e162013-7b39-445f-979f-f26f9eae36bb starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:23:31,632 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:23:31,636 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:23:01.622786+00:00 2022-05-21 03:23:31,656 DEBUG awx.main.dispatch task 6e162013-7b39-445f-979f-f26f9eae36bb is finished 2022-05-21 03:23:41,392 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5dfcde5c-263e-49c5-ba14-f544487789b0, queue=awx_private_queue) [2022-05-21 03:23:41,392: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5dfcde5c-263e-49c5-ba14-f544487789b0, queue=awx_private_queue) 2022-05-21 03:23:41,412 DEBUG awx.main.dispatch delivered 5dfcde5c-263e-49c5-ba14-f544487789b0 to worker[181] qsize 0 2022-05-21 03:23:41,416 DEBUG awx.main.dispatch task 5dfcde5c-263e-49c5-ba14-f544487789b0 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:23:41,418 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:23:41,441 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:23:41,477 DEBUG awx.main.dispatch task 5dfcde5c-263e-49c5-ba14-f544487789b0 is finished RESULT 2 OKREADY 2022-05-21 03:24:01,402 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(23f35312-9ad5-4328-8263-043417dd6c2e, queue=awx_private_queue) [2022-05-21 03:24:01,402: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(23f35312-9ad5-4328-8263-043417dd6c2e, queue=awx_private_queue) 2022-05-21 03:24:01,601 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(5909ca0a-8423-49df-800c-cf5097a6fa44, queue=awx_private_queue) [2022-05-21 03:24:01,601: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(5909ca0a-8423-49df-800c-cf5097a6fa44, queue=awx_private_queue) 2022-05-21 03:24:01,600 DEBUG awx.main.dispatch delivered 23f35312-9ad5-4328-8263-043417dd6c2e to worker[177] qsize 0 2022-05-21 03:24:01,604 DEBUG awx.main.dispatch task 23f35312-9ad5-4328-8263-043417dd6c2e starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:24:01,607 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:24:01,616 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(a477590d-e516-4ef7-8b9e-774993366ec6, queue=onap-awx-0) [2022-05-21 03:24:01,616: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(a477590d-e516-4ef7-8b9e-774993366ec6, queue=onap-awx-0) 2022-05-21 03:24:01,616 DEBUG awx.main.dispatch delivered 5909ca0a-8423-49df-800c-cf5097a6fa44 to worker[176] qsize 0 2022-05-21 03:24:01,619 DEBUG awx.main.dispatch task 5909ca0a-8423-49df-800c-cf5097a6fa44 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:24:01,629 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:24:01,631 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:24:01,635 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:23:31.632499+00:00 2022-05-21 03:24:01,645 DEBUG awx.main.dispatch delivered a477590d-e516-4ef7-8b9e-774993366ec6 to worker[181] qsize 0 2022-05-21 03:24:01,647 DEBUG awx.main.dispatch task a477590d-e516-4ef7-8b9e-774993366ec6 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:24:01,651 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:24:01,663 DEBUG awx.main.dispatch task 23f35312-9ad5-4328-8263-043417dd6c2e is finished 2022-05-21 03:24:01,984 DEBUG awx.main.dispatch task a477590d-e516-4ef7-8b9e-774993366ec6 is finished 2022-05-21 03:24:01,987 DEBUG awx.main.dispatch task 5909ca0a-8423-49df-800c-cf5097a6fa44 is finished 2022-05-21 03:24:11,803 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(361fcd99-0257-4b2c-9c34-a6dda53ab5a0, queue=onap-awx-0) [2022-05-21 03:24:11,803: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(361fcd99-0257-4b2c-9c34-a6dda53ab5a0, queue=onap-awx-0) 2022-05-21 03:24:11,820 DEBUG awx.main.dispatch delivered 361fcd99-0257-4b2c-9c34-a6dda53ab5a0 to worker[177] qsize 0 2022-05-21 03:24:11,823 DEBUG awx.main.dispatch task 361fcd99-0257-4b2c-9c34-a6dda53ab5a0 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:24:11,841 DEBUG awx.main.dispatch task 361fcd99-0257-4b2c-9c34-a6dda53ab5a0 is finished 2022-05-21 03:24:14,996 DEBUG awx.main.dispatch publish awx.main.tasks.awx_isolated_heartbeat(187b5d8a-5e81-490c-8674-b5d49ee8d656, queue=onap-awx-0) [2022-05-21 03:24:14,996: DEBUG/Process-1] publish awx.main.tasks.awx_isolated_heartbeat(187b5d8a-5e81-490c-8674-b5d49ee8d656, queue=onap-awx-0) 2022-05-21 03:24:15,013 DEBUG awx.main.dispatch delivered 187b5d8a-5e81-490c-8674-b5d49ee8d656 to worker[177] qsize 0 2022-05-21 03:24:15,015 DEBUG awx.main.dispatch task 187b5d8a-5e81-490c-8674-b5d49ee8d656 starting awx.main.tasks.awx_isolated_heartbeat(*[]) 2022-05-21 03:24:15,017 DEBUG awx.main.tasks Controlling node checking for any isolated management tasks. 2022-05-21 03:24:15,037 DEBUG awx.main.dispatch task 187b5d8a-5e81-490c-8674-b5d49ee8d656 is finished 2022-05-21 03:24:21,402 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(23646c8d-0d51-4646-9cf0-f0cb4e364492, queue=awx_private_queue) [2022-05-21 03:24:21,402: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(23646c8d-0d51-4646-9cf0-f0cb4e364492, queue=awx_private_queue) 2022-05-21 03:24:21,417 DEBUG awx.main.dispatch delivered 23646c8d-0d51-4646-9cf0-f0cb4e364492 to worker[178] qsize 0 2022-05-21 03:24:21,420 DEBUG awx.main.dispatch task 23646c8d-0d51-4646-9cf0-f0cb4e364492 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:24:21,423 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:24:21,444 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:24:21,482 DEBUG awx.main.dispatch task 23646c8d-0d51-4646-9cf0-f0cb4e364492 is finished 2022-05-21 03:24:31,601 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(54239fc8-e9d0-4bbc-8611-96c7dc8f6e19, queue=awx_private_queue) [2022-05-21 03:24:31,601: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(54239fc8-e9d0-4bbc-8611-96c7dc8f6e19, queue=awx_private_queue) 2022-05-21 03:24:31,632 DEBUG awx.main.dispatch delivered 54239fc8-e9d0-4bbc-8611-96c7dc8f6e19 to worker[176] qsize 0 2022-05-21 03:24:31,636 DEBUG awx.main.dispatch task 54239fc8-e9d0-4bbc-8611-96c7dc8f6e19 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:24:31,653 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:24:31,656 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:24:01.631889+00:00 2022-05-21 03:24:31,680 DEBUG awx.main.dispatch task 54239fc8-e9d0-4bbc-8611-96c7dc8f6e19 is finished 2022-05-21 03:24:41,403 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d50723f1-a3f2-4021-ae18-c5c9b9888174, queue=awx_private_queue) [2022-05-21 03:24:41,403: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d50723f1-a3f2-4021-ae18-c5c9b9888174, queue=awx_private_queue) 2022-05-21 03:24:41,422 DEBUG awx.main.dispatch delivered d50723f1-a3f2-4021-ae18-c5c9b9888174 to worker[178] qsize 0 2022-05-21 03:24:41,426 DEBUG awx.main.dispatch task d50723f1-a3f2-4021-ae18-c5c9b9888174 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:24:41,427 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:24:41,450 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:24:41,490 DEBUG awx.main.dispatch task d50723f1-a3f2-4021-ae18-c5c9b9888174 is finished RESULT 2 OKREADY 2022-05-21 03:25:01,609 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7973368d-b891-478b-83c3-465e8a5c5982, queue=awx_private_queue) [2022-05-21 03:25:01,609: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7973368d-b891-478b-83c3-465e8a5c5982, queue=awx_private_queue) 2022-05-21 03:25:01,812 DEBUG awx.main.dispatch delivered 7973368d-b891-478b-83c3-465e8a5c5982 to worker[177] qsize 0 2022-05-21 03:25:01,814 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(0cedab92-c2bd-4e45-bf37-e800a58a8ed7, queue=onap-awx-0) [2022-05-21 03:25:01,814: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(0cedab92-c2bd-4e45-bf37-e800a58a8ed7, queue=onap-awx-0) 2022-05-21 03:25:01,816 DEBUG awx.main.dispatch task 7973368d-b891-478b-83c3-465e8a5c5982 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:25:01,820 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:25:01,833 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(c98ca329-b7fc-49be-8e59-e51cb76c20ef, queue=awx_private_queue) [2022-05-21 03:25:01,833: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(c98ca329-b7fc-49be-8e59-e51cb76c20ef, queue=awx_private_queue) 2022-05-21 03:25:01,842 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:25:01,849 DEBUG awx.main.dispatch delivered 0cedab92-c2bd-4e45-bf37-e800a58a8ed7 to worker[178] qsize 0 2022-05-21 03:25:01,851 DEBUG awx.main.dispatch delivered c98ca329-b7fc-49be-8e59-e51cb76c20ef to worker[181] qsize 0 2022-05-21 03:25:01,851 DEBUG awx.main.dispatch task 0cedab92-c2bd-4e45-bf37-e800a58a8ed7 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:25:01,853 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:25:01,853 DEBUG awx.main.dispatch task c98ca329-b7fc-49be-8e59-e51cb76c20ef starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:25:01,864 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:25:01,867 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:24:31.653693+00:00 2022-05-21 03:25:01,882 DEBUG awx.main.dispatch task 7973368d-b891-478b-83c3-465e8a5c5982 is finished 2022-05-21 03:25:02,434 DEBUG awx.main.dispatch task 0cedab92-c2bd-4e45-bf37-e800a58a8ed7 is finished 2022-05-21 03:25:02,664 DEBUG awx.main.dispatch task c98ca329-b7fc-49be-8e59-e51cb76c20ef is finished 2022-05-21 03:25:11,804 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(6cbb3cae-2c34-4350-9f5e-93c28acbc35b, queue=onap-awx-0) [2022-05-21 03:25:11,804: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(6cbb3cae-2c34-4350-9f5e-93c28acbc35b, queue=onap-awx-0) 2022-05-21 03:25:11,820 DEBUG awx.main.dispatch delivered 6cbb3cae-2c34-4350-9f5e-93c28acbc35b to worker[176] qsize 0 2022-05-21 03:25:11,822 DEBUG awx.main.dispatch task 6cbb3cae-2c34-4350-9f5e-93c28acbc35b starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:25:11,840 DEBUG awx.main.dispatch task 6cbb3cae-2c34-4350-9f5e-93c28acbc35b is finished 2022-05-21 03:25:21,610 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(615212c1-bcb0-4187-83b7-d7d3bd1b6e50, queue=awx_private_queue) [2022-05-21 03:25:21,610: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(615212c1-bcb0-4187-83b7-d7d3bd1b6e50, queue=awx_private_queue) 2022-05-21 03:25:21,633 DEBUG awx.main.dispatch delivered 615212c1-bcb0-4187-83b7-d7d3bd1b6e50 to worker[176] qsize 0 2022-05-21 03:25:21,637 DEBUG awx.main.dispatch task 615212c1-bcb0-4187-83b7-d7d3bd1b6e50 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:25:21,640 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:25:21,664 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:25:21,702 DEBUG awx.main.dispatch task 615212c1-bcb0-4187-83b7-d7d3bd1b6e50 is finished 2022-05-21 03:25:31,835 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(70f971eb-a23b-45af-bf58-13624b8c3c8e, queue=awx_private_queue) [2022-05-21 03:25:31,835: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(70f971eb-a23b-45af-bf58-13624b8c3c8e, queue=awx_private_queue) 2022-05-21 03:25:31,852 DEBUG awx.main.dispatch delivered 70f971eb-a23b-45af-bf58-13624b8c3c8e to worker[177] qsize 0 2022-05-21 03:25:31,855 DEBUG awx.main.dispatch task 70f971eb-a23b-45af-bf58-13624b8c3c8e starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:25:31,870 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:25:31,874 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:25:01.864253+00:00 2022-05-21 03:25:32,144 DEBUG awx.main.dispatch task 70f971eb-a23b-45af-bf58-13624b8c3c8e is finished 2022-05-21 03:25:41,611 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ccd62a5e-afb8-4361-b090-fa18c1101878, queue=awx_private_queue) [2022-05-21 03:25:41,611: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ccd62a5e-afb8-4361-b090-fa18c1101878, queue=awx_private_queue) 2022-05-21 03:25:41,634 DEBUG awx.main.dispatch delivered ccd62a5e-afb8-4361-b090-fa18c1101878 to worker[178] qsize 0 2022-05-21 03:25:41,638 DEBUG awx.main.dispatch task ccd62a5e-afb8-4361-b090-fa18c1101878 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:25:41,642 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:25:41,669 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:25:41,705 DEBUG awx.main.dispatch task ccd62a5e-afb8-4361-b090-fa18c1101878 is finished RESULT 2 OKREADY 2022-05-21 03:26:01,621 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(fb488789-e0a1-4e74-9993-83bdbd063bbb, queue=awx_private_queue) [2022-05-21 03:26:01,621: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(fb488789-e0a1-4e74-9993-83bdbd063bbb, queue=awx_private_queue) 2022-05-21 03:26:01,840 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(e7a09bab-5887-4a70-a2ba-fa05f4bb2e54, queue=onap-awx-0) [2022-05-21 03:26:01,840: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(e7a09bab-5887-4a70-a2ba-fa05f4bb2e54, queue=onap-awx-0) 2022-05-21 03:26:01,839 DEBUG awx.main.dispatch delivered fb488789-e0a1-4e74-9993-83bdbd063bbb to worker[181] qsize 0 2022-05-21 03:26:01,844 DEBUG awx.main.dispatch task fb488789-e0a1-4e74-9993-83bdbd063bbb starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:26:01,846 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:26:01,854 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(4dd25ace-c3cb-4e5b-a05d-5496d4ffe938, queue=awx_private_queue) [2022-05-21 03:26:01,854: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(4dd25ace-c3cb-4e5b-a05d-5496d4ffe938, queue=awx_private_queue) 2022-05-21 03:26:01,864 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:26:01,866 DEBUG awx.main.dispatch delivered e7a09bab-5887-4a70-a2ba-fa05f4bb2e54 to worker[177] qsize 0 2022-05-21 03:26:01,869 DEBUG awx.main.dispatch delivered 4dd25ace-c3cb-4e5b-a05d-5496d4ffe938 to worker[178] qsize 0 2022-05-21 03:26:01,869 DEBUG awx.main.dispatch task e7a09bab-5887-4a70-a2ba-fa05f4bb2e54 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:26:01,872 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:26:01,871 DEBUG awx.main.dispatch task 4dd25ace-c3cb-4e5b-a05d-5496d4ffe938 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:26:01,881 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:26:01,884 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:25:31.870889+00:00 2022-05-21 03:26:01,898 DEBUG awx.main.dispatch task fb488789-e0a1-4e74-9993-83bdbd063bbb is finished 2022-05-21 03:26:02,233 DEBUG awx.main.dispatch task e7a09bab-5887-4a70-a2ba-fa05f4bb2e54 is finished 2022-05-21 03:26:02,378 DEBUG awx.main.dispatch task 4dd25ace-c3cb-4e5b-a05d-5496d4ffe938 is finished 2022-05-21 03:26:11,804 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(89085b72-7d46-4000-bb88-034b55ecb669, queue=onap-awx-0) [2022-05-21 03:26:11,804: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(89085b72-7d46-4000-bb88-034b55ecb669, queue=onap-awx-0) 2022-05-21 03:26:11,820 DEBUG awx.main.dispatch delivered 89085b72-7d46-4000-bb88-034b55ecb669 to worker[178] qsize 0 2022-05-21 03:26:11,822 DEBUG awx.main.dispatch task 89085b72-7d46-4000-bb88-034b55ecb669 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:26:11,839 DEBUG awx.main.dispatch task 89085b72-7d46-4000-bb88-034b55ecb669 is finished 2022-05-21 03:26:21,621 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(78ae2823-af60-4450-b365-6d8a9530bd4d, queue=awx_private_queue) [2022-05-21 03:26:21,621: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(78ae2823-af60-4450-b365-6d8a9530bd4d, queue=awx_private_queue) 2022-05-21 03:26:21,643 DEBUG awx.main.dispatch delivered 78ae2823-af60-4450-b365-6d8a9530bd4d to worker[181] qsize 0 2022-05-21 03:26:21,646 DEBUG awx.main.dispatch task 78ae2823-af60-4450-b365-6d8a9530bd4d starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:26:21,648 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:26:21,672 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:26:21,713 DEBUG awx.main.dispatch task 78ae2823-af60-4450-b365-6d8a9530bd4d is finished 2022-05-21 03:26:31,856 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(3858c7a2-7ed0-4fc9-a652-c45c006b24ea, queue=awx_private_queue) [2022-05-21 03:26:31,856: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(3858c7a2-7ed0-4fc9-a652-c45c006b24ea, queue=awx_private_queue) 2022-05-21 03:26:31,877 DEBUG awx.main.dispatch delivered 3858c7a2-7ed0-4fc9-a652-c45c006b24ea to worker[181] qsize 0 2022-05-21 03:26:31,879 DEBUG awx.main.dispatch task 3858c7a2-7ed0-4fc9-a652-c45c006b24ea starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:26:31,894 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:26:31,898 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:26:01.882015+00:00 2022-05-21 03:26:32,481 DEBUG awx.main.dispatch task 3858c7a2-7ed0-4fc9-a652-c45c006b24ea is finished 2022-05-21 03:26:41,621 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3aaf2892-3f2f-443e-b1d4-f183056d1ea7, queue=awx_private_queue) [2022-05-21 03:26:41,621: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3aaf2892-3f2f-443e-b1d4-f183056d1ea7, queue=awx_private_queue) 2022-05-21 03:26:41,639 DEBUG awx.main.dispatch delivered 3aaf2892-3f2f-443e-b1d4-f183056d1ea7 to worker[181] qsize 0 2022-05-21 03:26:41,642 DEBUG awx.main.dispatch task 3aaf2892-3f2f-443e-b1d4-f183056d1ea7 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:26:41,643 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:26:41,662 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:26:41,695 DEBUG awx.main.dispatch task 3aaf2892-3f2f-443e-b1d4-f183056d1ea7 is finished RESULT 2 OKREADY 2022-05-21 03:27:01,632 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(77cdf37f-addd-4258-a832-c23476063f51, queue=awx_private_queue) [2022-05-21 03:27:01,632: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(77cdf37f-addd-4258-a832-c23476063f51, queue=awx_private_queue) 2022-05-21 03:27:01,837 DEBUG awx.main.dispatch delivered 77cdf37f-addd-4258-a832-c23476063f51 to worker[177] qsize 0 2022-05-21 03:27:01,839 DEBUG awx.main.dispatch task 77cdf37f-addd-4258-a832-c23476063f51 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:27:01,841 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:27:01,840 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(374c4629-b98b-4fb8-9f2e-9c18bcaa2d3f, queue=onap-awx-0) [2022-05-21 03:27:01,840: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(374c4629-b98b-4fb8-9f2e-9c18bcaa2d3f, queue=onap-awx-0) 2022-05-21 03:27:01,857 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(63c34048-7928-4ee6-a0ff-52efe6e62eec, queue=awx_private_queue) [2022-05-21 03:27:01,857: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(63c34048-7928-4ee6-a0ff-52efe6e62eec, queue=awx_private_queue) 2022-05-21 03:27:01,863 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:27:01,869 DEBUG awx.main.dispatch delivered 374c4629-b98b-4fb8-9f2e-9c18bcaa2d3f to worker[181] qsize 0 2022-05-21 03:27:01,872 DEBUG awx.main.dispatch task 374c4629-b98b-4fb8-9f2e-9c18bcaa2d3f starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:27:01,874 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:27:01,875 DEBUG awx.main.dispatch delivered 63c34048-7928-4ee6-a0ff-52efe6e62eec to worker[176] qsize 0 2022-05-21 03:27:01,877 DEBUG awx.main.dispatch task 63c34048-7928-4ee6-a0ff-52efe6e62eec starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:27:01,889 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:27:01,892 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:26:31.894828+00:00 2022-05-21 03:27:01,903 DEBUG awx.main.dispatch task 77cdf37f-addd-4258-a832-c23476063f51 is finished 2022-05-21 03:27:02,132 DEBUG awx.main.dispatch task 374c4629-b98b-4fb8-9f2e-9c18bcaa2d3f is finished 2022-05-21 03:27:02,147 DEBUG awx.main.dispatch task 63c34048-7928-4ee6-a0ff-52efe6e62eec is finished 2022-05-21 03:27:11,804 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(b72812a7-b8ba-4579-a83e-71d0609f531b, queue=onap-awx-0) [2022-05-21 03:27:11,804: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(b72812a7-b8ba-4579-a83e-71d0609f531b, queue=onap-awx-0) 2022-05-21 03:27:21,633 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(83c1571f-1563-4433-b1f2-efe3d366c2a5, queue=awx_private_queue) [2022-05-21 03:27:21,633: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(83c1571f-1563-4433-b1f2-efe3d366c2a5, queue=awx_private_queue) 2022-05-21 03:27:31,858 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(ea9a9072-ea91-4bba-b5ad-e36418144fc6, queue=awx_private_queue) [2022-05-21 03:27:31,858: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(ea9a9072-ea91-4bba-b5ad-e36418144fc6, queue=awx_private_queue) 2022-05-21 03:27:37,624 DEBUG awx.main.dispatch delivered b72812a7-b8ba-4579-a83e-71d0609f531b to worker[181] qsize 0 2022-05-21 03:27:37,627 DEBUG awx.main.dispatch delivered 83c1571f-1563-4433-b1f2-efe3d366c2a5 to worker[176] qsize 0 2022-05-21 03:27:37,629 DEBUG awx.main.dispatch task b72812a7-b8ba-4579-a83e-71d0609f531b starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:27:37,630 DEBUG awx.main.dispatch task 83c1571f-1563-4433-b1f2-efe3d366c2a5 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:27:37,630 DEBUG awx.main.dispatch delivered ea9a9072-ea91-4bba-b5ad-e36418144fc6 to worker[178] qsize 0 2022-05-21 03:27:37,631 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:27:37,632 DEBUG awx.main.dispatch task ea9a9072-ea91-4bba-b5ad-e36418144fc6 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:27:37,656 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:27:37,659 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:27:01.889816+00:00 2022-05-21 03:27:37,658 DEBUG awx.main.dispatch task b72812a7-b8ba-4579-a83e-71d0609f531b is finished 2022-05-21 03:27:37,667 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:27:37,708 DEBUG awx.main.dispatch task 83c1571f-1563-4433-b1f2-efe3d366c2a5 is finished 2022-05-21 03:27:38,431 DEBUG awx.main.dispatch task ea9a9072-ea91-4bba-b5ad-e36418144fc6 is finished 2022-05-21 03:27:41,633 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(742c46f9-8284-441f-946b-e67be637b8dd, queue=awx_private_queue) [2022-05-21 03:27:41,633: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(742c46f9-8284-441f-946b-e67be637b8dd, queue=awx_private_queue) 2022-05-21 03:27:47,208 DEBUG awx.main.dispatch delivered 742c46f9-8284-441f-946b-e67be637b8dd to worker[176] qsize 0 2022-05-21 03:27:47,212 DEBUG awx.main.dispatch task 742c46f9-8284-441f-946b-e67be637b8dd starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:27:47,215 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:27:47,236 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:27:47,272 DEBUG awx.main.dispatch task 742c46f9-8284-441f-946b-e67be637b8dd is finished RESULT 2 OKREADY 2022-05-21 03:28:02,326 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(81d19c14-da08-4095-8031-52c1bf453785, queue=awx_private_queue) [2022-05-21 03:28:02,326: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(81d19c14-da08-4095-8031-52c1bf453785, queue=awx_private_queue) 2022-05-21 03:28:02,538 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(26f9705a-1445-4e57-97d4-097e0fb963db, queue=onap-awx-0) [2022-05-21 03:28:02,538: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(26f9705a-1445-4e57-97d4-097e0fb963db, queue=onap-awx-0) 2022-05-21 03:28:02,567 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(1ea5b7c5-86e4-455d-817c-ab8afb60ab50, queue=awx_private_queue) [2022-05-21 03:28:02,567: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(1ea5b7c5-86e4-455d-817c-ab8afb60ab50, queue=awx_private_queue) 2022-05-21 03:28:02,585 DEBUG awx.main.dispatch delivered 26f9705a-1445-4e57-97d4-097e0fb963db to worker[181] qsize 0 2022-05-21 03:28:02,589 DEBUG awx.main.dispatch task 26f9705a-1445-4e57-97d4-097e0fb963db starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:28:02,591 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:28:03,003 DEBUG awx.main.dispatch task 26f9705a-1445-4e57-97d4-097e0fb963db is finished 2022-05-21 03:28:11,805 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(6ab0a1da-1924-4a00-8e36-d68245495e25, queue=onap-awx-0) [2022-05-21 03:28:11,805: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(6ab0a1da-1924-4a00-8e36-d68245495e25, queue=onap-awx-0) 2022-05-21 03:28:22,328 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b1591218-92a6-42d2-be37-0a6627f68c2c, queue=awx_private_queue) [2022-05-21 03:28:22,328: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b1591218-92a6-42d2-be37-0a6627f68c2c, queue=awx_private_queue) 2022-05-21 03:28:32,567 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(c936519e-7b0c-4a07-9d88-1a299fe48796, queue=awx_private_queue) [2022-05-21 03:28:32,567: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(c936519e-7b0c-4a07-9d88-1a299fe48796, queue=awx_private_queue) 2022-05-21 03:28:42,327 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(8d8719d0-c56e-4e2d-a24b-c1b37466e13f, queue=awx_private_queue) [2022-05-21 03:28:42,327: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(8d8719d0-c56e-4e2d-a24b-c1b37466e13f, queue=awx_private_queue) 2022-05-21 03:28:48,720 DEBUG awx.main.dispatch delivered 81d19c14-da08-4095-8031-52c1bf453785 to worker[177] qsize 0 2022-05-21 03:28:48,723 DEBUG awx.main.dispatch delivered 1ea5b7c5-86e4-455d-817c-ab8afb60ab50 to worker[178] qsize 0 2022-05-21 03:28:48,723 DEBUG awx.main.dispatch task 81d19c14-da08-4095-8031-52c1bf453785 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:28:48,726 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:28:48,726 DEBUG awx.main.dispatch delivered b1591218-92a6-42d2-be37-0a6627f68c2c to worker[176] qsize 0 2022-05-21 03:28:48,726 DEBUG awx.main.dispatch task 1ea5b7c5-86e4-455d-817c-ab8afb60ab50 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:28:48,729 DEBUG awx.main.dispatch task b1591218-92a6-42d2-be37-0a6627f68c2c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:28:48,731 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:28:48,730 DEBUG awx.main.dispatch delivered c936519e-7b0c-4a07-9d88-1a299fe48796 to worker[181] qsize 0 2022-05-21 03:28:48,733 DEBUG awx.main.dispatch task c936519e-7b0c-4a07-9d88-1a299fe48796 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:28:48,744 DEBUG awx.main.tasks Not running periodic scheduler, another task holds lock 2022-05-21 03:28:48,740 WARNING awx.main.dispatch scaling up worker pid:192 2022-05-21 03:28:48,745 DEBUG awx.main.dispatch task 1ea5b7c5-86e4-455d-817c-ab8afb60ab50 is finished 2022-05-21 03:28:48,746 DEBUG awx.main.dispatch delivered 8d8719d0-c56e-4e2d-a24b-c1b37466e13f to worker[192] qsize 0 2022-05-21 03:28:48,748 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:28:48,752 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:28:48,752 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:27:37.657009+00:00 2022-05-21 03:28:48,751 DEBUG awx.main.dispatch delivered 6ab0a1da-1924-4a00-8e36-d68245495e25 to worker[178] qsize 0 2022-05-21 03:28:48,753 DEBUG awx.main.scheduler Not running scheduler, another task holds lock 2022-05-21 03:28:48,753 DEBUG awx.main.dispatch task 81d19c14-da08-4095-8031-52c1bf453785 is finished 2022-05-21 03:28:48,752 DEBUG awx.main.dispatch task 8d8719d0-c56e-4e2d-a24b-c1b37466e13f starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:28:48,753 DEBUG awx.main.dispatch task 6ab0a1da-1924-4a00-8e36-d68245495e25 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:28:48,755 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:28:48,769 DEBUG awx.main.dispatch task 6ab0a1da-1924-4a00-8e36-d68245495e25 is finished 2022-05-21 03:28:48,788 DEBUG awx.main.scheduler Not running scheduler, another task holds lock 2022-05-21 03:28:48,788 DEBUG awx.main.dispatch task 8d8719d0-c56e-4e2d-a24b-c1b37466e13f is finished 2022-05-21 03:28:48,793 DEBUG awx.main.dispatch task b1591218-92a6-42d2-be37-0a6627f68c2c is finished 2022-05-21 03:28:49,310 DEBUG awx.main.dispatch task c936519e-7b0c-4a07-9d88-1a299fe48796 is finished RESULT 2 OKREADY 2022-05-21 03:29:02,331 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e916320b-00f5-42d1-a29f-b435fbab49e8, queue=awx_private_queue) [2022-05-21 03:29:02,331: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e916320b-00f5-42d1-a29f-b435fbab49e8, queue=awx_private_queue) 2022-05-21 03:29:02,537 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(f4792a40-ff43-4b5b-ba6e-a6527c244ae1, queue=onap-awx-0) [2022-05-21 03:29:02,537: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(f4792a40-ff43-4b5b-ba6e-a6527c244ae1, queue=onap-awx-0) 2022-05-21 03:29:02,567 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(6875f5d9-695b-412b-bbc1-059943a1c2e0, queue=awx_private_queue) [2022-05-21 03:29:02,567: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(6875f5d9-695b-412b-bbc1-059943a1c2e0, queue=awx_private_queue) 2022-05-21 03:29:02,553 WARNING awx.main.dispatch scaling down worker pid:176 2022-05-21 03:29:08,842 DEBUG awx.main.dispatch delivered f4792a40-ff43-4b5b-ba6e-a6527c244ae1 to worker[178] qsize 0 2022-05-21 03:29:08,846 DEBUG awx.main.dispatch delivered e916320b-00f5-42d1-a29f-b435fbab49e8 to worker[177] qsize 0 2022-05-21 03:29:08,845 DEBUG awx.main.dispatch task f4792a40-ff43-4b5b-ba6e-a6527c244ae1 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:29:08,847 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:29:08,849 DEBUG awx.main.dispatch task e916320b-00f5-42d1-a29f-b435fbab49e8 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:29:08,851 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:29:08,849 DEBUG awx.main.dispatch delivered 6875f5d9-695b-412b-bbc1-059943a1c2e0 to worker[192] qsize 0 2022-05-21 03:29:08,853 DEBUG awx.main.dispatch task 6875f5d9-695b-412b-bbc1-059943a1c2e0 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:29:08,866 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:29:08,871 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:29:08,870 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:28:48.748717+00:00 2022-05-21 03:29:08,911 DEBUG awx.main.dispatch task e916320b-00f5-42d1-a29f-b435fbab49e8 is finished 2022-05-21 03:29:09,045 DEBUG awx.main.dispatch task f4792a40-ff43-4b5b-ba6e-a6527c244ae1 is finished 2022-05-21 03:29:08,803 WARNING awx.main.dispatch worker exiting gracefully pid:176 2022-05-21 03:29:09,112 DEBUG awx.main.dispatch task 6875f5d9-695b-412b-bbc1-059943a1c2e0 is finished 2022-05-21 03:29:11,804 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(33c67318-807f-4a4c-aa2f-32276588dc27, queue=onap-awx-0) [2022-05-21 03:29:11,804: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(33c67318-807f-4a4c-aa2f-32276588dc27, queue=onap-awx-0) 2022-05-21 03:29:14,512 DEBUG awx.main.dispatch delivered 33c67318-807f-4a4c-aa2f-32276588dc27 to worker[192] qsize 0 2022-05-21 03:29:14,516 DEBUG awx.main.dispatch task 33c67318-807f-4a4c-aa2f-32276588dc27 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:29:14,535 DEBUG awx.main.dispatch task 33c67318-807f-4a4c-aa2f-32276588dc27 is finished 2022-05-21 03:29:22,332 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e16d19eb-95be-4f03-adc2-d3d70d62b692, queue=awx_private_queue) [2022-05-21 03:29:22,332: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e16d19eb-95be-4f03-adc2-d3d70d62b692, queue=awx_private_queue) 2022-05-21 03:29:32,568 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(a7bbd429-97d8-4b19-a013-3fff9edcdc39, queue=awx_private_queue) [2022-05-21 03:29:32,568: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(a7bbd429-97d8-4b19-a013-3fff9edcdc39, queue=awx_private_queue) 2022-05-21 03:29:40,490 DEBUG awx.main.dispatch delivered e16d19eb-95be-4f03-adc2-d3d70d62b692 to worker[177] qsize 0 2022-05-21 03:29:40,493 DEBUG awx.main.dispatch task e16d19eb-95be-4f03-adc2-d3d70d62b692 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:29:40,493 DEBUG awx.main.dispatch delivered a7bbd429-97d8-4b19-a013-3fff9edcdc39 to worker[178] qsize 0 2022-05-21 03:29:40,495 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:29:40,496 DEBUG awx.main.dispatch task a7bbd429-97d8-4b19-a013-3fff9edcdc39 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:29:40,509 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:29:40,513 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:29:08.866766+00:00 2022-05-21 03:29:40,520 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:29:40,561 DEBUG awx.main.dispatch task e16d19eb-95be-4f03-adc2-d3d70d62b692 is finished 2022-05-21 03:29:40,681 DEBUG awx.main.dispatch task a7bbd429-97d8-4b19-a013-3fff9edcdc39 is finished 2022-05-21 03:29:42,127 WARNING kombu.mixins Connection to broker lost, trying to re-establish connection... Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/mixins.py", line 175, in run for _ in self.consume(limit=None, **kwargs): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/mixins.py", line 197, in consume conn.drain_events(timeout=safety_interval) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 315, in drain_events return self.transport.drain_events(self.connection, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 103, in drain_events return connection.drain_events(**kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 500, in drain_events while not self.blocking_read(timeout): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 505, in blocking_read frame = self.transport.read_frame() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 256, in read_frame frame_header = read(7, True) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 440, in _read s = recv(n - len(rbuf)) ConnectionResetError: [Errno 104] Connection reset by peer 2022-05-21 03:29:42,127 WARNING kombu.mixins Connection to broker lost, trying to re-establish connection... Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/mixins.py", line 175, in run for _ in self.consume(limit=None, **kwargs): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/mixins.py", line 197, in consume conn.drain_events(timeout=safety_interval) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 315, in drain_events return self.transport.drain_events(self.connection, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 103, in drain_events return connection.drain_events(**kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 500, in drain_events while not self.blocking_read(timeout): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 505, in blocking_read frame = self.transport.read_frame() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 256, in read_frame frame_header = read(7, True) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 440, in _read s = recv(n - len(rbuf)) ConnectionResetError: [Errno 104] Connection reset by peer 2022-05-21 03:29:42,139 WARNING kombu.mixins Broker connection error, trying again in 2.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-05-21 03:29:42,146 WARNING kombu.mixins Broker connection error, trying again in 2.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-05-21 03:29:42,333 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(33a717dc-6caa-41cb-a052-e17dec8c9c1c, queue=awx_private_queue) [2022-05-21 03:29:42,333: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(33a717dc-6caa-41cb-a052-e17dec8c9c1c, queue=awx_private_queue) 2022-05-21 03:29:44,157 WARNING kombu.mixins Broker connection error, trying again in 4.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-05-21 03:29:44,163 WARNING kombu.mixins Broker connection error, trying again in 4.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-05-21 03:29:48,175 WARNING kombu.mixins Broker connection error, trying again in 6.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-05-21 03:29:48,179 WARNING kombu.mixins Broker connection error, trying again in 6.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-05-21 03:29:54,192 WARNING kombu.mixins Broker connection error, trying again in 8.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-05-21 03:29:54,201 WARNING kombu.mixins Broker connection error, trying again in 8.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused RESULT 2 OKREADY 2022-05-21 03:30:02,213 WARNING kombu.mixins Broker connection error, trying again in 10.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-05-21 03:30:02,224 WARNING kombu.mixins Broker connection error, trying again in 10.0 seconds: ConnectionRefusedError(111, 'Connection refused'). Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 141, in _connect host, port, family, socket.SOCK_STREAM, SOL_TCP) File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -9] Address family for hostname not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/utils/functional.py", line 341, in retry_over_time return fun(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 275, in connect return self.connection File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 823, in connection self._connection = self._establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/connection.py", line 778, in _establish_connection conn = self.transport.establish_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection conn.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/connection.py", line 307, in connect self.transport.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 81, in connect self._connect(self.host, self.port, self.connect_timeout) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 152, in _connect "failed to resolve broker hostname")) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/amqp/transport.py", line 165, in _connect self.sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused 2022-05-21 03:30:12,252 DEBUG awx.main.dispatch listening on ['awx_private_queue [direct]', 'onap-awx-0 [direct]', 'tower_broadcast_all_onap-awx-0 [fanout]'] 2022-05-21 03:30:12,450 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(daa6d394-2df8-4dfd-a53b-d9b512bda10e, queue=onap-awx-0) [2022-05-21 03:30:12,450: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(daa6d394-2df8-4dfd-a53b-d9b512bda10e, queue=onap-awx-0) 2022-05-21 03:30:12,800 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(464d0ccb-9c30-4f5b-8e2b-4fab2ef0e717, queue=awx_private_queue) [2022-05-21 03:30:12,800: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(464d0ccb-9c30-4f5b-8e2b-4fab2ef0e717, queue=awx_private_queue) 2022-05-21 03:30:12,817 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(1cc59857-e2ba-4349-a22e-18442dbb3d78, queue=onap-awx-0) [2022-05-21 03:30:12,817: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(1cc59857-e2ba-4349-a22e-18442dbb3d78, queue=onap-awx-0) 2022-05-21 03:30:12,833 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d772b66a-070b-491b-b9f9-3109590248ef, queue=awx_private_queue) [2022-05-21 03:30:12,833: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d772b66a-070b-491b-b9f9-3109590248ef, queue=awx_private_queue) 2022-05-21 03:30:32,834 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(248604b9-6f37-44e4-bee2-e3a427b75d25, queue=awx_private_queue) [2022-05-21 03:30:32,834: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(248604b9-6f37-44e4-bee2-e3a427b75d25, queue=awx_private_queue) 2022-05-21 03:30:32,857 DEBUG awx.main.dispatch delivered 248604b9-6f37-44e4-bee2-e3a427b75d25 to worker[192] qsize 0 2022-05-21 03:30:32,861 DEBUG awx.main.dispatch task 248604b9-6f37-44e4-bee2-e3a427b75d25 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:30:32,864 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:30:32,889 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:30:32,938 DEBUG awx.main.dispatch task 248604b9-6f37-44e4-bee2-e3a427b75d25 is finished 2022-05-21 03:30:42,800 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(a4022903-b209-4a70-a4ef-b9166b595a9b, queue=awx_private_queue) [2022-05-21 03:30:42,800: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(a4022903-b209-4a70-a4ef-b9166b595a9b, queue=awx_private_queue) 2022-05-21 03:30:42,817 DEBUG awx.main.dispatch delivered a4022903-b209-4a70-a4ef-b9166b595a9b to worker[177] qsize 0 2022-05-21 03:30:42,820 DEBUG awx.main.dispatch task a4022903-b209-4a70-a4ef-b9166b595a9b starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:30:42,834 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:30:42,838 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:29:40.510319+00:00 2022-05-21 03:30:43,213 DEBUG awx.main.dispatch task a4022903-b209-4a70-a4ef-b9166b595a9b is finished 2022-05-21 03:30:52,834 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(25390a6d-188b-479f-90fc-49e33e95cf93, queue=awx_private_queue) [2022-05-21 03:30:52,834: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(25390a6d-188b-479f-90fc-49e33e95cf93, queue=awx_private_queue) 2022-05-21 03:30:52,853 DEBUG awx.main.dispatch delivered 25390a6d-188b-479f-90fc-49e33e95cf93 to worker[181] qsize 0 2022-05-21 03:30:52,856 DEBUG awx.main.dispatch task 25390a6d-188b-479f-90fc-49e33e95cf93 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:30:52,860 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:30:52,884 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:30:52,921 DEBUG awx.main.dispatch task 25390a6d-188b-479f-90fc-49e33e95cf93 is finished RESULT 2 OKREADY 2022-05-21 03:31:12,726 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(a5fdaefb-a5db-46f0-a5fd-8cb5cc85e3f0, queue=onap-awx-0) [2022-05-21 03:31:12,726: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(a5fdaefb-a5db-46f0-a5fd-8cb5cc85e3f0, queue=onap-awx-0) 2022-05-21 03:31:12,915 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(0a1801eb-63f1-4a3a-bb9d-b8259bab6add, queue=awx_private_queue) [2022-05-21 03:31:12,915: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(0a1801eb-63f1-4a3a-bb9d-b8259bab6add, queue=awx_private_queue) 2022-05-21 03:31:12,927 DEBUG awx.main.dispatch delivered a5fdaefb-a5db-46f0-a5fd-8cb5cc85e3f0 to worker[177] qsize 0 2022-05-21 03:31:12,930 DEBUG awx.main.dispatch delivered 0a1801eb-63f1-4a3a-bb9d-b8259bab6add to worker[192] qsize 0 2022-05-21 03:31:12,930 DEBUG awx.main.dispatch task a5fdaefb-a5db-46f0-a5fd-8cb5cc85e3f0 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:31:12,932 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:31:12,933 DEBUG awx.main.dispatch task 0a1801eb-63f1-4a3a-bb9d-b8259bab6add starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:31:12,934 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(b992f6dc-aa5c-4988-ae06-7820f8d508ad, queue=onap-awx-0) [2022-05-21 03:31:12,934: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(b992f6dc-aa5c-4988-ae06-7820f8d508ad, queue=onap-awx-0) 2022-05-21 03:31:12,947 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:31:12,950 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:30:42.834972+00:00 2022-05-21 03:31:12,952 DEBUG awx.main.dispatch delivered b992f6dc-aa5c-4988-ae06-7820f8d508ad to worker[181] qsize 0 2022-05-21 03:31:12,954 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(72153806-3eea-43dc-a1af-1f337eb8ca29, queue=awx_private_queue) [2022-05-21 03:31:12,954: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(72153806-3eea-43dc-a1af-1f337eb8ca29, queue=awx_private_queue) 2022-05-21 03:31:12,955 DEBUG awx.main.dispatch task b992f6dc-aa5c-4988-ae06-7820f8d508ad starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:31:12,969 DEBUG awx.main.dispatch task b992f6dc-aa5c-4988-ae06-7820f8d508ad is finished 2022-05-21 03:31:12,978 DEBUG awx.main.dispatch delivered 72153806-3eea-43dc-a1af-1f337eb8ca29 to worker[181] qsize 0 2022-05-21 03:31:12,981 DEBUG awx.main.dispatch task 72153806-3eea-43dc-a1af-1f337eb8ca29 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:31:12,983 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:31:13,005 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:31:13,052 DEBUG awx.main.dispatch task 72153806-3eea-43dc-a1af-1f337eb8ca29 is finished 2022-05-21 03:31:13,439 WARNING awx.main.tasks Rejoining the cluster as instance onap-awx-0. 2022-05-21 03:31:13,439 DEBUG awx.main.dispatch task a5fdaefb-a5db-46f0-a5fd-8cb5cc85e3f0 is finished 2022-05-21 03:31:13,451 DEBUG awx.main.dispatch task 0a1801eb-63f1-4a3a-bb9d-b8259bab6add is finished 2022-05-21 03:31:32,954 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5420a7b5-59f4-449c-9453-738b6fb2598a, queue=awx_private_queue) [2022-05-21 03:31:32,954: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5420a7b5-59f4-449c-9453-738b6fb2598a, queue=awx_private_queue) 2022-05-21 03:31:32,973 DEBUG awx.main.dispatch delivered 5420a7b5-59f4-449c-9453-738b6fb2598a to worker[177] qsize 0 2022-05-21 03:31:32,976 DEBUG awx.main.dispatch task 5420a7b5-59f4-449c-9453-738b6fb2598a starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:31:32,978 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:31:33,002 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:31:33,044 DEBUG awx.main.dispatch task 5420a7b5-59f4-449c-9453-738b6fb2598a is finished 2022-05-21 03:31:42,916 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(131c3492-1d06-414a-89a6-3d13965a30ae, queue=awx_private_queue) [2022-05-21 03:31:42,916: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(131c3492-1d06-414a-89a6-3d13965a30ae, queue=awx_private_queue) 2022-05-21 03:31:42,935 DEBUG awx.main.dispatch delivered 131c3492-1d06-414a-89a6-3d13965a30ae to worker[177] qsize 0 2022-05-21 03:31:42,937 DEBUG awx.main.dispatch task 131c3492-1d06-414a-89a6-3d13965a30ae starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:31:42,953 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:31:42,956 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:31:12.947242+00:00 2022-05-21 03:31:43,321 DEBUG awx.main.dispatch task 131c3492-1d06-414a-89a6-3d13965a30ae is finished 2022-05-21 03:31:52,955 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b6fcf8ab-66bd-4fe5-839a-00e4237275ca, queue=awx_private_queue) [2022-05-21 03:31:52,955: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b6fcf8ab-66bd-4fe5-839a-00e4237275ca, queue=awx_private_queue) 2022-05-21 03:31:52,975 DEBUG awx.main.dispatch delivered b6fcf8ab-66bd-4fe5-839a-00e4237275ca to worker[178] qsize 0 2022-05-21 03:31:52,978 DEBUG awx.main.dispatch task b6fcf8ab-66bd-4fe5-839a-00e4237275ca starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:31:52,981 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:31:53,006 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:31:53,048 DEBUG awx.main.dispatch task b6fcf8ab-66bd-4fe5-839a-00e4237275ca is finished RESULT 2 OKREADY 2022-05-21 03:32:12,736 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(784f510b-086b-40fa-9057-3c5156eac2e5, queue=onap-awx-0) [2022-05-21 03:32:12,736: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(784f510b-086b-40fa-9057-3c5156eac2e5, queue=onap-awx-0) 2022-05-21 03:32:12,940 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(2146217e-2eee-446a-896d-fc1892163b80, queue=awx_private_queue) [2022-05-21 03:32:12,940: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(2146217e-2eee-446a-896d-fc1892163b80, queue=awx_private_queue) 2022-05-21 03:32:12,955 DEBUG awx.main.dispatch delivered 784f510b-086b-40fa-9057-3c5156eac2e5 to worker[192] qsize 0 2022-05-21 03:32:12,958 DEBUG awx.main.dispatch delivered 2146217e-2eee-446a-896d-fc1892163b80 to worker[178] qsize 0 2022-05-21 03:32:12,958 DEBUG awx.main.dispatch task 784f510b-086b-40fa-9057-3c5156eac2e5 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:32:12,960 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:32:12,960 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(e75f482b-cebe-4679-89d0-c0e58af2694b, queue=onap-awx-0) [2022-05-21 03:32:12,960: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(e75f482b-cebe-4679-89d0-c0e58af2694b, queue=onap-awx-0) 2022-05-21 03:32:12,959 DEBUG awx.main.dispatch task 2146217e-2eee-446a-896d-fc1892163b80 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:32:12,971 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:32:12,974 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:31:42.953691+00:00 2022-05-21 03:32:12,978 DEBUG awx.main.dispatch delivered e75f482b-cebe-4679-89d0-c0e58af2694b to worker[177] qsize 0 2022-05-21 03:32:12,979 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(61cb5961-df21-4a3f-822f-ca910216f702, queue=awx_private_queue) [2022-05-21 03:32:12,979: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(61cb5961-df21-4a3f-822f-ca910216f702, queue=awx_private_queue) 2022-05-21 03:32:12,980 DEBUG awx.main.dispatch task e75f482b-cebe-4679-89d0-c0e58af2694b starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:32:12,994 DEBUG awx.main.dispatch delivered 61cb5961-df21-4a3f-822f-ca910216f702 to worker[181] qsize 0 2022-05-21 03:32:12,996 DEBUG awx.main.dispatch task 61cb5961-df21-4a3f-822f-ca910216f702 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:32:12,999 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:32:12,999 DEBUG awx.main.dispatch task e75f482b-cebe-4679-89d0-c0e58af2694b is finished 2022-05-21 03:32:13,020 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:32:13,063 DEBUG awx.main.dispatch task 61cb5961-df21-4a3f-822f-ca910216f702 is finished 2022-05-21 03:32:13,836 DEBUG awx.main.dispatch task 784f510b-086b-40fa-9057-3c5156eac2e5 is finished 2022-05-21 03:32:14,019 DEBUG awx.main.dispatch task 2146217e-2eee-446a-896d-fc1892163b80 is finished 2022-05-21 03:32:32,990 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ceadd051-b301-44b2-8c79-e9da710c5735, queue=awx_private_queue) [2022-05-21 03:32:32,990: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ceadd051-b301-44b2-8c79-e9da710c5735, queue=awx_private_queue) 2022-05-21 03:32:33,009 DEBUG awx.main.dispatch delivered ceadd051-b301-44b2-8c79-e9da710c5735 to worker[178] qsize 0 2022-05-21 03:32:33,012 DEBUG awx.main.dispatch task ceadd051-b301-44b2-8c79-e9da710c5735 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:32:33,014 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:32:33,036 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:32:33,073 DEBUG awx.main.dispatch task ceadd051-b301-44b2-8c79-e9da710c5735 is finished 2022-05-21 03:32:42,941 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(4b507249-04f6-4315-9b27-684deb905649, queue=awx_private_queue) [2022-05-21 03:32:42,941: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(4b507249-04f6-4315-9b27-684deb905649, queue=awx_private_queue) 2022-05-21 03:32:42,963 DEBUG awx.main.dispatch delivered 4b507249-04f6-4315-9b27-684deb905649 to worker[177] qsize 0 2022-05-21 03:32:42,966 DEBUG awx.main.dispatch task 4b507249-04f6-4315-9b27-684deb905649 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:32:42,981 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:32:42,985 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:32:12.971848+00:00 2022-05-21 03:32:43,132 DEBUG awx.main.dispatch task 4b507249-04f6-4315-9b27-684deb905649 is finished 2022-05-21 03:32:52,991 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(fa1835f0-3758-4ff1-8e08-f164ca911b11, queue=awx_private_queue) [2022-05-21 03:32:52,991: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(fa1835f0-3758-4ff1-8e08-f164ca911b11, queue=awx_private_queue) 2022-05-21 03:32:53,012 DEBUG awx.main.dispatch delivered fa1835f0-3758-4ff1-8e08-f164ca911b11 to worker[181] qsize 0 2022-05-21 03:32:53,016 DEBUG awx.main.dispatch task fa1835f0-3758-4ff1-8e08-f164ca911b11 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:32:53,018 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:32:53,040 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:32:53,076 DEBUG awx.main.dispatch task fa1835f0-3758-4ff1-8e08-f164ca911b11 is finished RESULT 2 OKREADY 2022-05-21 03:33:12,746 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(86bec778-64fa-4a67-b987-a83c182bb43d, queue=onap-awx-0) [2022-05-21 03:33:12,746: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(86bec778-64fa-4a67-b987-a83c182bb43d, queue=onap-awx-0) 2022-05-21 03:33:12,973 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(b5f51cf1-05b3-46ba-a34e-fcd299ca3d4a, queue=awx_private_queue) [2022-05-21 03:33:12,973: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(b5f51cf1-05b3-46ba-a34e-fcd299ca3d4a, queue=awx_private_queue) 2022-05-21 03:33:12,988 DEBUG awx.main.dispatch delivered 86bec778-64fa-4a67-b987-a83c182bb43d to worker[181] qsize 0 2022-05-21 03:33:12,991 DEBUG awx.main.dispatch task 86bec778-64fa-4a67-b987-a83c182bb43d starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:33:12,993 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:33:12,996 DEBUG awx.main.dispatch delivered b5f51cf1-05b3-46ba-a34e-fcd299ca3d4a to worker[177] qsize 0 2022-05-21 03:33:12,997 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(86e98e37-5cf6-437d-bffe-2e7f9b5cc1cf, queue=onap-awx-0) [2022-05-21 03:33:12,997: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(86e98e37-5cf6-437d-bffe-2e7f9b5cc1cf, queue=onap-awx-0) 2022-05-21 03:33:12,999 DEBUG awx.main.dispatch task b5f51cf1-05b3-46ba-a34e-fcd299ca3d4a starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:33:13,017 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:33:13,018 DEBUG awx.main.dispatch delivered 86e98e37-5cf6-437d-bffe-2e7f9b5cc1cf to worker[192] qsize 0 2022-05-21 03:33:13,021 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:32:42.981455+00:00 2022-05-21 03:33:13,020 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(905496b5-8ad5-4aca-8319-a42883edc276, queue=awx_private_queue) [2022-05-21 03:33:13,020: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(905496b5-8ad5-4aca-8319-a42883edc276, queue=awx_private_queue) 2022-05-21 03:33:13,021 DEBUG awx.main.dispatch task 86e98e37-5cf6-437d-bffe-2e7f9b5cc1cf starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:33:13,036 DEBUG awx.main.dispatch delivered 905496b5-8ad5-4aca-8319-a42883edc276 to worker[178] qsize 0 2022-05-21 03:33:13,036 DEBUG awx.main.dispatch task 86e98e37-5cf6-437d-bffe-2e7f9b5cc1cf is finished 2022-05-21 03:33:13,039 DEBUG awx.main.dispatch task 905496b5-8ad5-4aca-8319-a42883edc276 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:33:13,041 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:33:13,060 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:33:13,097 DEBUG awx.main.dispatch task 905496b5-8ad5-4aca-8319-a42883edc276 is finished 2022-05-21 03:33:13,228 DEBUG awx.main.dispatch task 86bec778-64fa-4a67-b987-a83c182bb43d is finished 2022-05-21 03:33:13,244 DEBUG awx.main.dispatch task b5f51cf1-05b3-46ba-a34e-fcd299ca3d4a is finished 2022-05-21 03:33:33,030 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(4c72e472-15f5-4412-9b24-a65e3213fabe, queue=awx_private_queue) [2022-05-21 03:33:33,030: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(4c72e472-15f5-4412-9b24-a65e3213fabe, queue=awx_private_queue) 2022-05-21 03:33:33,054 DEBUG awx.main.dispatch delivered 4c72e472-15f5-4412-9b24-a65e3213fabe to worker[177] qsize 0 2022-05-21 03:33:33,057 DEBUG awx.main.dispatch task 4c72e472-15f5-4412-9b24-a65e3213fabe starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:33:33,058 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:33:33,080 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:33:33,124 DEBUG awx.main.dispatch task 4c72e472-15f5-4412-9b24-a65e3213fabe is finished 2022-05-21 03:33:42,973 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(14ca9a9b-172c-493b-84d3-5e0c9816f1c8, queue=awx_private_queue) [2022-05-21 03:33:42,973: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(14ca9a9b-172c-493b-84d3-5e0c9816f1c8, queue=awx_private_queue) 2022-05-21 03:33:42,991 DEBUG awx.main.dispatch delivered 14ca9a9b-172c-493b-84d3-5e0c9816f1c8 to worker[177] qsize 0 2022-05-21 03:33:42,996 DEBUG awx.main.dispatch task 14ca9a9b-172c-493b-84d3-5e0c9816f1c8 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:33:43,009 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:33:43,012 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:33:13.017578+00:00 2022-05-21 03:33:43,528 DEBUG awx.main.dispatch task 14ca9a9b-172c-493b-84d3-5e0c9816f1c8 is finished 2022-05-21 03:33:53,031 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(fc3a851a-a44f-4064-9884-455b458b475a, queue=awx_private_queue) [2022-05-21 03:33:53,031: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(fc3a851a-a44f-4064-9884-455b458b475a, queue=awx_private_queue) 2022-05-21 03:33:53,052 DEBUG awx.main.dispatch delivered fc3a851a-a44f-4064-9884-455b458b475a to worker[178] qsize 0 2022-05-21 03:33:53,056 DEBUG awx.main.dispatch task fc3a851a-a44f-4064-9884-455b458b475a starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:33:53,058 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:33:53,080 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:33:53,117 DEBUG awx.main.dispatch task fc3a851a-a44f-4064-9884-455b458b475a is finished RESULT 2 OKREADY 2022-05-21 03:34:13,514 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(b21840a3-1521-4c22-906f-7a9b8b49d911, queue=onap-awx-0) [2022-05-21 03:34:13,514: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(b21840a3-1521-4c22-906f-7a9b8b49d911, queue=onap-awx-0) 2022-05-21 03:34:13,728 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(fd6b6d53-f031-47c7-99d6-a3a4ce5b548c, queue=awx_private_queue) [2022-05-21 03:34:13,728: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(fd6b6d53-f031-47c7-99d6-a3a4ce5b548c, queue=awx_private_queue) 2022-05-21 03:34:13,742 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(3361541e-ca2f-4459-a734-7becc737b9e0, queue=onap-awx-0) [2022-05-21 03:34:13,742: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(3361541e-ca2f-4459-a734-7becc737b9e0, queue=onap-awx-0) 2022-05-21 03:34:13,743 DEBUG awx.main.dispatch delivered b21840a3-1521-4c22-906f-7a9b8b49d911 to worker[181] qsize 0 2022-05-21 03:34:13,747 DEBUG awx.main.dispatch delivered fd6b6d53-f031-47c7-99d6-a3a4ce5b548c to worker[177] qsize 0 2022-05-21 03:34:13,747 DEBUG awx.main.dispatch task b21840a3-1521-4c22-906f-7a9b8b49d911 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:34:13,749 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:34:13,749 DEBUG awx.main.dispatch task fd6b6d53-f031-47c7-99d6-a3a4ce5b548c starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:34:13,757 DEBUG awx.main.dispatch delivered 3361541e-ca2f-4459-a734-7becc737b9e0 to worker[178] qsize 0 2022-05-21 03:34:13,759 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b52704c0-e325-44ea-abf3-2de2307918c5, queue=awx_private_queue) [2022-05-21 03:34:13,759: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b52704c0-e325-44ea-abf3-2de2307918c5, queue=awx_private_queue) 2022-05-21 03:34:13,761 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:34:13,759 DEBUG awx.main.dispatch task 3361541e-ca2f-4459-a734-7becc737b9e0 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:34:13,764 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:33:43.009585+00:00 2022-05-21 03:34:13,772 DEBUG awx.main.dispatch delivered b52704c0-e325-44ea-abf3-2de2307918c5 to worker[192] qsize 0 2022-05-21 03:34:13,773 DEBUG awx.main.dispatch task 3361541e-ca2f-4459-a734-7becc737b9e0 is finished 2022-05-21 03:34:13,774 DEBUG awx.main.dispatch task b52704c0-e325-44ea-abf3-2de2307918c5 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:34:13,777 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:34:13,797 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:34:13,832 DEBUG awx.main.dispatch task b52704c0-e325-44ea-abf3-2de2307918c5 is finished 2022-05-21 03:34:13,845 DEBUG awx.main.dispatch task b21840a3-1521-4c22-906f-7a9b8b49d911 is finished 2022-05-21 03:34:14,141 DEBUG awx.main.dispatch task fd6b6d53-f031-47c7-99d6-a3a4ce5b548c is finished 2022-05-21 03:34:14,996 DEBUG awx.main.dispatch publish awx.main.tasks.awx_isolated_heartbeat(e70e9b85-d515-4896-8168-dd1e83b99354, queue=onap-awx-0) [2022-05-21 03:34:14,996: DEBUG/Process-1] publish awx.main.tasks.awx_isolated_heartbeat(e70e9b85-d515-4896-8168-dd1e83b99354, queue=onap-awx-0) 2022-05-21 03:34:31,577 DEBUG awx.main.dispatch delivered e70e9b85-d515-4896-8168-dd1e83b99354 to worker[192] qsize 0 2022-05-21 03:34:31,581 DEBUG awx.main.dispatch task e70e9b85-d515-4896-8168-dd1e83b99354 starting awx.main.tasks.awx_isolated_heartbeat(*[]) 2022-05-21 03:34:31,584 DEBUG awx.main.tasks Controlling node checking for any isolated management tasks. 2022-05-21 03:34:31,611 DEBUG awx.main.dispatch task e70e9b85-d515-4896-8168-dd1e83b99354 is finished 2022-05-21 03:34:33,759 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(dcbba434-866f-4a70-9e27-ee4910729e5a, queue=awx_private_queue) [2022-05-21 03:34:33,759: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(dcbba434-866f-4a70-9e27-ee4910729e5a, queue=awx_private_queue) 2022-05-21 03:34:33,784 DEBUG awx.main.dispatch delivered dcbba434-866f-4a70-9e27-ee4910729e5a to worker[178] qsize 0 2022-05-21 03:34:33,786 DEBUG awx.main.dispatch task dcbba434-866f-4a70-9e27-ee4910729e5a starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:34:33,788 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:34:33,809 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:34:33,848 DEBUG awx.main.dispatch task dcbba434-866f-4a70-9e27-ee4910729e5a is finished 2022-05-21 03:34:43,729 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(55658267-8f32-4aca-b437-4f118dd6d3e6, queue=awx_private_queue) [2022-05-21 03:34:43,729: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(55658267-8f32-4aca-b437-4f118dd6d3e6, queue=awx_private_queue) 2022-05-21 03:34:53,759 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a45d346a-5272-4761-b87d-633e10b4d11f, queue=awx_private_queue) [2022-05-21 03:34:53,759: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a45d346a-5272-4761-b87d-633e10b4d11f, queue=awx_private_queue) 2022-05-21 03:34:57,253 DEBUG awx.main.dispatch delivered 55658267-8f32-4aca-b437-4f118dd6d3e6 to worker[178] qsize 0 2022-05-21 03:34:57,256 DEBUG awx.main.dispatch delivered a45d346a-5272-4761-b87d-633e10b4d11f to worker[181] qsize 0 2022-05-21 03:34:57,256 DEBUG awx.main.dispatch task 55658267-8f32-4aca-b437-4f118dd6d3e6 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:34:57,258 DEBUG awx.main.dispatch task a45d346a-5272-4761-b87d-633e10b4d11f starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:34:57,260 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:34:57,269 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:34:57,272 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:34:13.761481+00:00 2022-05-21 03:34:57,279 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:34:57,321 DEBUG awx.main.dispatch task a45d346a-5272-4761-b87d-633e10b4d11f is finished 2022-05-21 03:34:57,893 DEBUG awx.main.dispatch task 55658267-8f32-4aca-b437-4f118dd6d3e6 is finished RESULT 2 OKREADY 2022-05-21 03:35:13,525 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(f1aa5f08-fb64-40d4-b042-b354fe1f7a84, queue=onap-awx-0) [2022-05-21 03:35:13,525: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(f1aa5f08-fb64-40d4-b042-b354fe1f7a84, queue=onap-awx-0) 2022-05-21 03:35:13,562 DEBUG awx.main.dispatch delivered f1aa5f08-fb64-40d4-b042-b354fe1f7a84 to worker[178] qsize 0 2022-05-21 03:35:13,567 DEBUG awx.main.dispatch task f1aa5f08-fb64-40d4-b042-b354fe1f7a84 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:35:13,569 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:35:13,728 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(5148df5a-4b12-4e6d-8517-6353db775a56, queue=awx_private_queue) [2022-05-21 03:35:13,728: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(5148df5a-4b12-4e6d-8517-6353db775a56, queue=awx_private_queue) 2022-05-21 03:35:13,748 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(3a9bf688-7288-4d9a-b1a8-da9b21171694, queue=onap-awx-0) [2022-05-21 03:35:13,748: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(3a9bf688-7288-4d9a-b1a8-da9b21171694, queue=onap-awx-0) 2022-05-21 03:35:13,763 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(986e516a-5b1f-4b77-8a46-fa175f23eff5, queue=awx_private_queue) [2022-05-21 03:35:13,763: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(986e516a-5b1f-4b77-8a46-fa175f23eff5, queue=awx_private_queue) 2022-05-21 03:35:13,762 DEBUG awx.main.dispatch delivered 3a9bf688-7288-4d9a-b1a8-da9b21171694 to worker[181] qsize 0 2022-05-21 03:35:13,943 DEBUG awx.main.dispatch task 3a9bf688-7288-4d9a-b1a8-da9b21171694 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:35:13,947 DEBUG awx.main.dispatch task f1aa5f08-fb64-40d4-b042-b354fe1f7a84 is finished 2022-05-21 03:35:13,959 DEBUG awx.main.dispatch task 3a9bf688-7288-4d9a-b1a8-da9b21171694 is finished 2022-05-21 03:35:24,548 DEBUG awx.main.dispatch delivered 5148df5a-4b12-4e6d-8517-6353db775a56 to worker[178] qsize 0 2022-05-21 03:35:24,552 DEBUG awx.main.dispatch delivered 986e516a-5b1f-4b77-8a46-fa175f23eff5 to worker[192] qsize 0 2022-05-21 03:35:24,553 DEBUG awx.main.dispatch task 5148df5a-4b12-4e6d-8517-6353db775a56 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:35:24,556 DEBUG awx.main.dispatch task 986e516a-5b1f-4b77-8a46-fa175f23eff5 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:35:24,560 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:35:24,569 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:35:24,573 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:34:57.269951+00:00 2022-05-21 03:35:24,584 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:35:24,625 DEBUG awx.main.dispatch task 986e516a-5b1f-4b77-8a46-fa175f23eff5 is finished 2022-05-21 03:35:24,905 DEBUG awx.main.dispatch task 5148df5a-4b12-4e6d-8517-6353db775a56 is finished 2022-05-21 03:35:33,773 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(81701686-ef7e-4542-823a-be214014f90d, queue=awx_private_queue) [2022-05-21 03:35:33,773: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(81701686-ef7e-4542-823a-be214014f90d, queue=awx_private_queue) 2022-05-21 03:35:33,794 DEBUG awx.main.dispatch delivered 81701686-ef7e-4542-823a-be214014f90d to worker[192] qsize 0 2022-05-21 03:35:33,798 DEBUG awx.main.dispatch task 81701686-ef7e-4542-823a-be214014f90d starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:35:33,801 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:35:33,826 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:35:33,864 DEBUG awx.main.dispatch task 81701686-ef7e-4542-823a-be214014f90d is finished 2022-05-21 03:35:43,730 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(174960a9-3010-4674-915d-e8b6dc2b82f6, queue=awx_private_queue) [2022-05-21 03:35:43,730: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(174960a9-3010-4674-915d-e8b6dc2b82f6, queue=awx_private_queue) 2022-05-21 03:35:53,772 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3846961d-58de-4fba-8647-025e3da2d753, queue=awx_private_queue) [2022-05-21 03:35:53,772: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3846961d-58de-4fba-8647-025e3da2d753, queue=awx_private_queue) RESULT 2 OKREADY 2022-05-21 03:36:13,535 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(8d7dbf55-3afa-40b8-9ddf-73a7dc6bf2fe, queue=onap-awx-0) [2022-05-21 03:36:13,535: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(8d7dbf55-3afa-40b8-9ddf-73a7dc6bf2fe, queue=onap-awx-0) 2022-05-21 03:36:13,574 DEBUG awx.main.dispatch delivered 8d7dbf55-3afa-40b8-9ddf-73a7dc6bf2fe to worker[178] qsize 0 2022-05-21 03:36:13,577 DEBUG awx.main.dispatch task 8d7dbf55-3afa-40b8-9ddf-73a7dc6bf2fe starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:36:13,578 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:36:13,620 DEBUG awx.main.dispatch task 8d7dbf55-3afa-40b8-9ddf-73a7dc6bf2fe is finished 2022-05-21 03:36:13,729 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(dc2b868c-e158-49f8-bb0f-2e477d3ad7a6, queue=awx_private_queue) [2022-05-21 03:36:13,729: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(dc2b868c-e158-49f8-bb0f-2e477d3ad7a6, queue=awx_private_queue) 2022-05-21 03:36:13,765 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(f04e63a9-aeef-4163-8bdb-938522319f71, queue=onap-awx-0) [2022-05-21 03:36:13,765: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(f04e63a9-aeef-4163-8bdb-938522319f71, queue=onap-awx-0) 2022-05-21 03:36:13,782 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ee601a39-b538-4ac5-b37a-8d4fe687411f, queue=awx_private_queue) [2022-05-21 03:36:13,782: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ee601a39-b538-4ac5-b37a-8d4fe687411f, queue=awx_private_queue) 2022-05-21 03:36:20,424 DEBUG awx.main.dispatch delivered 174960a9-3010-4674-915d-e8b6dc2b82f6 to worker[181] qsize 0 2022-05-21 03:36:20,618 DEBUG awx.main.dispatch delivered 3846961d-58de-4fba-8647-025e3da2d753 to worker[177] qsize 0 2022-05-21 03:36:20,620 DEBUG awx.main.dispatch delivered dc2b868c-e158-49f8-bb0f-2e477d3ad7a6 to worker[178] qsize 0 2022-05-21 03:36:20,618 DEBUG awx.main.dispatch task 174960a9-3010-4674-915d-e8b6dc2b82f6 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:36:20,622 DEBUG awx.main.dispatch delivered ee601a39-b538-4ac5-b37a-8d4fe687411f to worker[192] qsize 0 2022-05-21 03:36:20,620 DEBUG awx.main.dispatch task 3846961d-58de-4fba-8647-025e3da2d753 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:36:20,624 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:36:20,624 DEBUG awx.main.dispatch task ee601a39-b538-4ac5-b37a-8d4fe687411f starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:36:20,625 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:36:20,623 DEBUG awx.main.dispatch task dc2b868c-e158-49f8-bb0f-2e477d3ad7a6 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:36:20,634 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:36:20,636 DEBUG awx.main.tasks Not running periodic scheduler, another task holds lock 2022-05-21 03:36:20,636 DEBUG awx.main.dispatch task dc2b868c-e158-49f8-bb0f-2e477d3ad7a6 is finished 2022-05-21 03:36:20,639 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:35:24.569388+00:00 2022-05-21 03:36:20,644 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:36:20,648 DEBUG awx.main.scheduler Not running scheduler, another task holds lock 2022-05-21 03:36:20,648 DEBUG awx.main.dispatch task 3846961d-58de-4fba-8647-025e3da2d753 is finished 2022-05-21 03:36:20,679 DEBUG awx.main.dispatch delivered f04e63a9-aeef-4163-8bdb-938522319f71 to worker[178] qsize 0 2022-05-21 03:36:20,685 DEBUG awx.main.dispatch task ee601a39-b538-4ac5-b37a-8d4fe687411f is finished 2022-05-21 03:36:20,688 DEBUG awx.main.dispatch task f04e63a9-aeef-4163-8bdb-938522319f71 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:36:20,689 DEBUG awx.main.dispatch task 174960a9-3010-4674-915d-e8b6dc2b82f6 is finished 2022-05-21 03:36:20,702 DEBUG awx.main.dispatch task f04e63a9-aeef-4163-8bdb-938522319f71 is finished 2022-05-21 03:36:33,792 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d494ee34-5cac-4b22-abb7-f85004a712cd, queue=awx_private_queue) [2022-05-21 03:36:33,792: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d494ee34-5cac-4b22-abb7-f85004a712cd, queue=awx_private_queue) 2022-05-21 03:36:43,730 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(12841616-426f-4fea-99a0-25b5feadf83d, queue=awx_private_queue) [2022-05-21 03:36:43,730: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(12841616-426f-4fea-99a0-25b5feadf83d, queue=awx_private_queue) 2022-05-21 03:36:53,792 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5ffb4746-8159-45dc-b69c-b709af16706b, queue=awx_private_queue) [2022-05-21 03:36:53,792: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5ffb4746-8159-45dc-b69c-b709af16706b, queue=awx_private_queue) 2022-05-21 03:36:56,287 DEBUG awx.main.dispatch delivered d494ee34-5cac-4b22-abb7-f85004a712cd to worker[178] qsize 0 2022-05-21 03:36:56,296 DEBUG awx.main.dispatch delivered 12841616-426f-4fea-99a0-25b5feadf83d to worker[192] qsize 0 2022-05-21 03:36:56,296 DEBUG awx.main.dispatch task d494ee34-5cac-4b22-abb7-f85004a712cd starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:36:56,297 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:36:56,299 DEBUG awx.main.dispatch delivered 5ffb4746-8159-45dc-b69c-b709af16706b to worker[177] qsize 0 2022-05-21 03:36:56,299 DEBUG awx.main.dispatch task 12841616-426f-4fea-99a0-25b5feadf83d starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:36:56,301 DEBUG awx.main.dispatch task 5ffb4746-8159-45dc-b69c-b709af16706b starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:36:56,302 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:36:56,311 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:36:56,315 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:36:20.635145+00:00 2022-05-21 03:36:56,317 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:36:56,322 DEBUG awx.main.scheduler Not running scheduler, another task holds lock 2022-05-21 03:36:56,323 DEBUG awx.main.dispatch task 5ffb4746-8159-45dc-b69c-b709af16706b is finished 2022-05-21 03:36:56,352 DEBUG awx.main.dispatch task d494ee34-5cac-4b22-abb7-f85004a712cd is finished 2022-05-21 03:36:56,906 DEBUG awx.main.dispatch task 12841616-426f-4fea-99a0-25b5feadf83d is finished RESULT 2 OKREADY 2022-05-21 03:37:14,921 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(4b963bb6-53b6-41fe-9834-de6e8ef7a5e4, queue=onap-awx-0) [2022-05-21 03:37:14,921: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(4b963bb6-53b6-41fe-9834-de6e8ef7a5e4, queue=onap-awx-0) 2022-05-21 03:37:14,942 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(395571d8-516a-4f78-9b60-549e4eb3c461, queue=awx_private_queue) [2022-05-21 03:37:14,942: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(395571d8-516a-4f78-9b60-549e4eb3c461, queue=awx_private_queue) 2022-05-21 03:37:14,955 DEBUG awx.main.dispatch delivered 4b963bb6-53b6-41fe-9834-de6e8ef7a5e4 to worker[177] qsize 0 2022-05-21 03:37:14,958 DEBUG awx.main.dispatch delivered 395571d8-516a-4f78-9b60-549e4eb3c461 to worker[178] qsize 0 2022-05-21 03:37:14,958 DEBUG awx.main.dispatch task 4b963bb6-53b6-41fe-9834-de6e8ef7a5e4 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:37:14,959 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:37:14,959 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(32bb0c4c-d004-49f7-a6b2-9d933863f457, queue=onap-awx-0) [2022-05-21 03:37:14,959: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(32bb0c4c-d004-49f7-a6b2-9d933863f457, queue=onap-awx-0) 2022-05-21 03:37:14,960 DEBUG awx.main.dispatch task 395571d8-516a-4f78-9b60-549e4eb3c461 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:37:14,974 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:37:14,978 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:36:56.312166+00:00 2022-05-21 03:37:14,983 DEBUG awx.main.dispatch delivered 32bb0c4c-d004-49f7-a6b2-9d933863f457 to worker[181] qsize 0 2022-05-21 03:37:14,984 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(181fea95-f824-4139-8b88-66e51a1d8efb, queue=awx_private_queue) [2022-05-21 03:37:14,984: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(181fea95-f824-4139-8b88-66e51a1d8efb, queue=awx_private_queue) 2022-05-21 03:37:14,986 DEBUG awx.main.dispatch task 32bb0c4c-d004-49f7-a6b2-9d933863f457 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:37:15,000 DEBUG awx.main.dispatch task 32bb0c4c-d004-49f7-a6b2-9d933863f457 is finished 2022-05-21 03:37:15,003 DEBUG awx.main.dispatch delivered 181fea95-f824-4139-8b88-66e51a1d8efb to worker[192] qsize 0 2022-05-21 03:37:15,006 DEBUG awx.main.dispatch task 181fea95-f824-4139-8b88-66e51a1d8efb starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:37:15,008 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:37:15,029 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:37:15,063 DEBUG awx.main.dispatch task 181fea95-f824-4139-8b88-66e51a1d8efb is finished 2022-05-21 03:37:15,111 DEBUG awx.main.dispatch task 4b963bb6-53b6-41fe-9834-de6e8ef7a5e4 is finished 2022-05-21 03:37:15,121 DEBUG awx.main.dispatch task 395571d8-516a-4f78-9b60-549e4eb3c461 is finished 2022-05-21 03:37:34,996 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(870a43ca-eba3-42f7-b5e4-f19b48a33196, queue=awx_private_queue) [2022-05-21 03:37:34,996: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(870a43ca-eba3-42f7-b5e4-f19b48a33196, queue=awx_private_queue) 2022-05-21 03:37:35,039 DEBUG awx.main.dispatch delivered 870a43ca-eba3-42f7-b5e4-f19b48a33196 to worker[181] qsize 0 2022-05-21 03:37:35,239 DEBUG awx.main.dispatch task 870a43ca-eba3-42f7-b5e4-f19b48a33196 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:37:35,241 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:37:35,264 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:37:35,303 DEBUG awx.main.dispatch task 870a43ca-eba3-42f7-b5e4-f19b48a33196 is finished 2022-05-21 03:37:44,943 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(f5a2cb8b-f3dd-417d-a59a-f69aeb138a75, queue=awx_private_queue) [2022-05-21 03:37:44,943: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(f5a2cb8b-f3dd-417d-a59a-f69aeb138a75, queue=awx_private_queue) 2022-05-21 03:37:44,966 DEBUG awx.main.dispatch delivered f5a2cb8b-f3dd-417d-a59a-f69aeb138a75 to worker[177] qsize 0 2022-05-21 03:37:44,970 DEBUG awx.main.dispatch task f5a2cb8b-f3dd-417d-a59a-f69aeb138a75 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:37:44,984 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:37:44,987 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:37:14.975131+00:00 2022-05-21 03:37:45,584 DEBUG awx.main.dispatch task f5a2cb8b-f3dd-417d-a59a-f69aeb138a75 is finished 2022-05-21 03:37:54,995 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0cfcf948-d4f8-4574-836d-95d20524575a, queue=awx_private_queue) [2022-05-21 03:37:54,995: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0cfcf948-d4f8-4574-836d-95d20524575a, queue=awx_private_queue) 2022-05-21 03:37:55,013 DEBUG awx.main.dispatch delivered 0cfcf948-d4f8-4574-836d-95d20524575a to worker[181] qsize 0 2022-05-21 03:37:55,015 DEBUG awx.main.dispatch task 0cfcf948-d4f8-4574-836d-95d20524575a starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:37:55,017 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:37:55,039 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:37:55,083 DEBUG awx.main.dispatch task 0cfcf948-d4f8-4574-836d-95d20524575a is finished RESULT 2 OKREADY 2022-05-21 03:38:14,921 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(2c1e2d3e-fe3c-4d33-9990-7fcc71cc3332, queue=onap-awx-0) [2022-05-21 03:38:14,921: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(2c1e2d3e-fe3c-4d33-9990-7fcc71cc3332, queue=onap-awx-0) 2022-05-21 03:38:14,960 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(65a84e18-fedd-42a8-b0ab-67d464ca05bf, queue=awx_private_queue) [2022-05-21 03:38:14,960: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(65a84e18-fedd-42a8-b0ab-67d464ca05bf, queue=awx_private_queue) 2022-05-21 03:38:14,971 DEBUG awx.main.dispatch delivered 2c1e2d3e-fe3c-4d33-9990-7fcc71cc3332 to worker[181] qsize 0 2022-05-21 03:38:14,973 DEBUG awx.main.dispatch task 2c1e2d3e-fe3c-4d33-9990-7fcc71cc3332 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:38:14,974 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:38:14,982 DEBUG awx.main.dispatch delivered 65a84e18-fedd-42a8-b0ab-67d464ca05bf to worker[178] qsize 0 2022-05-21 03:38:14,984 DEBUG awx.main.dispatch task 65a84e18-fedd-42a8-b0ab-67d464ca05bf starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:38:14,985 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(fbd1927b-4117-4ec9-a90a-57ce9c9034f7, queue=onap-awx-0) [2022-05-21 03:38:14,985: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(fbd1927b-4117-4ec9-a90a-57ce9c9034f7, queue=onap-awx-0) 2022-05-21 03:38:14,997 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:38:15,000 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:37:44.984849+00:00 2022-05-21 03:38:15,002 DEBUG awx.main.dispatch delivered fbd1927b-4117-4ec9-a90a-57ce9c9034f7 to worker[177] qsize 0 2022-05-21 03:38:15,004 DEBUG awx.main.dispatch task fbd1927b-4117-4ec9-a90a-57ce9c9034f7 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:38:15,005 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ac266226-e5fc-43ad-812f-884a92cf4266, queue=awx_private_queue) [2022-05-21 03:38:15,005: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ac266226-e5fc-43ad-812f-884a92cf4266, queue=awx_private_queue) 2022-05-21 03:38:15,020 DEBUG awx.main.dispatch task fbd1927b-4117-4ec9-a90a-57ce9c9034f7 is finished 2022-05-21 03:38:15,023 DEBUG awx.main.dispatch delivered ac266226-e5fc-43ad-812f-884a92cf4266 to worker[177] qsize 0 2022-05-21 03:38:15,026 DEBUG awx.main.dispatch task ac266226-e5fc-43ad-812f-884a92cf4266 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:38:15,027 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:38:15,049 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:38:15,086 DEBUG awx.main.dispatch task ac266226-e5fc-43ad-812f-884a92cf4266 is finished 2022-05-21 03:38:15,174 DEBUG awx.main.dispatch task 2c1e2d3e-fe3c-4d33-9990-7fcc71cc3332 is finished 2022-05-21 03:38:15,587 DEBUG awx.main.dispatch task 65a84e18-fedd-42a8-b0ab-67d464ca05bf is finished 2022-05-21 03:38:35,017 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6e654272-03f7-4a96-a17d-a9b0a51875de, queue=awx_private_queue) [2022-05-21 03:38:35,017: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6e654272-03f7-4a96-a17d-a9b0a51875de, queue=awx_private_queue) 2022-05-21 03:38:35,059 DEBUG awx.main.dispatch delivered 6e654272-03f7-4a96-a17d-a9b0a51875de to worker[181] qsize 0 2022-05-21 03:38:35,264 DEBUG awx.main.dispatch task 6e654272-03f7-4a96-a17d-a9b0a51875de starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:38:35,268 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:38:35,289 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:38:35,328 DEBUG awx.main.dispatch task 6e654272-03f7-4a96-a17d-a9b0a51875de is finished 2022-05-21 03:38:44,962 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(48027541-69ee-400b-9796-d9e708474b1e, queue=awx_private_queue) [2022-05-21 03:38:44,962: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(48027541-69ee-400b-9796-d9e708474b1e, queue=awx_private_queue) 2022-05-21 03:38:44,986 DEBUG awx.main.dispatch delivered 48027541-69ee-400b-9796-d9e708474b1e to worker[192] qsize 0 2022-05-21 03:38:44,988 DEBUG awx.main.dispatch task 48027541-69ee-400b-9796-d9e708474b1e starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:38:45,001 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:38:45,006 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:38:14.997157+00:00 2022-05-21 03:38:45,116 DEBUG awx.main.dispatch task 48027541-69ee-400b-9796-d9e708474b1e is finished 2022-05-21 03:38:55,017 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(31d61e3d-f234-4619-8e02-7d90d76416c7, queue=awx_private_queue) [2022-05-21 03:38:55,017: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(31d61e3d-f234-4619-8e02-7d90d76416c7, queue=awx_private_queue) 2022-05-21 03:38:55,038 DEBUG awx.main.dispatch delivered 31d61e3d-f234-4619-8e02-7d90d76416c7 to worker[192] qsize 0 2022-05-21 03:38:55,040 DEBUG awx.main.dispatch task 31d61e3d-f234-4619-8e02-7d90d76416c7 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:38:55,042 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:38:55,068 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:38:55,110 DEBUG awx.main.dispatch task 31d61e3d-f234-4619-8e02-7d90d76416c7 is finished RESULT 2 OKREADY 2022-05-21 03:39:14,932 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(e705b911-e87a-4c37-8482-cdf8b5322532, queue=onap-awx-0) [2022-05-21 03:39:14,932: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(e705b911-e87a-4c37-8482-cdf8b5322532, queue=onap-awx-0) 2022-05-21 03:39:14,961 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(1de4b7ef-aa2b-47d5-8770-eed546cbd922, queue=awx_private_queue) [2022-05-21 03:39:14,961: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(1de4b7ef-aa2b-47d5-8770-eed546cbd922, queue=awx_private_queue) 2022-05-21 03:39:14,966 DEBUG awx.main.dispatch delivered e705b911-e87a-4c37-8482-cdf8b5322532 to worker[181] qsize 0 2022-05-21 03:39:14,968 DEBUG awx.main.dispatch task e705b911-e87a-4c37-8482-cdf8b5322532 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:39:14,970 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:39:14,976 DEBUG awx.main.dispatch delivered 1de4b7ef-aa2b-47d5-8770-eed546cbd922 to worker[192] qsize 0 2022-05-21 03:39:14,978 DEBUG awx.main.dispatch task 1de4b7ef-aa2b-47d5-8770-eed546cbd922 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:39:14,985 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(a60a2f7f-2847-4532-9295-897a733c8df3, queue=onap-awx-0) [2022-05-21 03:39:14,985: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(a60a2f7f-2847-4532-9295-897a733c8df3, queue=onap-awx-0) 2022-05-21 03:39:14,989 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:39:14,993 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:38:45.002183+00:00 2022-05-21 03:39:15,001 DEBUG awx.main.dispatch delivered a60a2f7f-2847-4532-9295-897a733c8df3 to worker[178] qsize 0 2022-05-21 03:39:15,001 DEBUG awx.main.dispatch task e705b911-e87a-4c37-8482-cdf8b5322532 is finished 2022-05-21 03:39:15,003 DEBUG awx.main.dispatch task a60a2f7f-2847-4532-9295-897a733c8df3 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:39:15,013 DEBUG awx.main.dispatch task 1de4b7ef-aa2b-47d5-8770-eed546cbd922 is finished 2022-05-21 03:39:15,017 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(24ca8db5-046a-455a-bb3b-541eb793cd49, queue=awx_private_queue) [2022-05-21 03:39:15,017: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(24ca8db5-046a-455a-bb3b-541eb793cd49, queue=awx_private_queue) 2022-05-21 03:39:15,018 DEBUG awx.main.dispatch task a60a2f7f-2847-4532-9295-897a733c8df3 is finished 2022-05-21 03:39:15,033 DEBUG awx.main.dispatch delivered 24ca8db5-046a-455a-bb3b-541eb793cd49 to worker[177] qsize 0 2022-05-21 03:39:15,036 DEBUG awx.main.dispatch task 24ca8db5-046a-455a-bb3b-541eb793cd49 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:39:15,038 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:39:15,061 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:39:15,098 DEBUG awx.main.dispatch task 24ca8db5-046a-455a-bb3b-541eb793cd49 is finished 2022-05-21 03:39:35,028 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d1e3b310-41b9-4658-882a-05b86c8294fb, queue=awx_private_queue) [2022-05-21 03:39:35,028: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d1e3b310-41b9-4658-882a-05b86c8294fb, queue=awx_private_queue) 2022-05-21 03:39:35,065 DEBUG awx.main.dispatch delivered d1e3b310-41b9-4658-882a-05b86c8294fb to worker[192] qsize 0 2022-05-21 03:39:35,247 DEBUG awx.main.dispatch task d1e3b310-41b9-4658-882a-05b86c8294fb starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:39:35,249 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:39:35,272 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:39:35,317 DEBUG awx.main.dispatch task d1e3b310-41b9-4658-882a-05b86c8294fb is finished 2022-05-21 03:39:44,962 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(8d599d37-6be2-461f-a057-d68557ea02b8, queue=awx_private_queue) [2022-05-21 03:39:44,962: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(8d599d37-6be2-461f-a057-d68557ea02b8, queue=awx_private_queue) 2022-05-21 03:39:44,980 DEBUG awx.main.dispatch delivered 8d599d37-6be2-461f-a057-d68557ea02b8 to worker[177] qsize 0 2022-05-21 03:39:44,983 DEBUG awx.main.dispatch task 8d599d37-6be2-461f-a057-d68557ea02b8 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:39:44,998 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:39:45,002 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:39:14.989773+00:00 2022-05-21 03:39:45,685 DEBUG awx.main.dispatch task 8d599d37-6be2-461f-a057-d68557ea02b8 is finished 2022-05-21 03:39:55,028 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ec67aa13-0b3e-4287-971b-d421be903569, queue=awx_private_queue) [2022-05-21 03:39:55,028: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ec67aa13-0b3e-4287-971b-d421be903569, queue=awx_private_queue) 2022-05-21 03:39:55,053 DEBUG awx.main.dispatch delivered ec67aa13-0b3e-4287-971b-d421be903569 to worker[177] qsize 0 2022-05-21 03:39:55,056 DEBUG awx.main.dispatch task ec67aa13-0b3e-4287-971b-d421be903569 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:39:55,058 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:39:55,078 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:39:55,116 DEBUG awx.main.dispatch task ec67aa13-0b3e-4287-971b-d421be903569 is finished RESULT 2 OKREADY 2022-05-21 03:40:15,092 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(d77689ae-5deb-4494-aefe-9a034a11173b, queue=onap-awx-0) [2022-05-21 03:40:15,092: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(d77689ae-5deb-4494-aefe-9a034a11173b, queue=onap-awx-0) 2022-05-21 03:40:15,129 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d6b319ce-4543-4ab4-b4a9-0e28baa74ca1, queue=awx_private_queue) [2022-05-21 03:40:15,129: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d6b319ce-4543-4ab4-b4a9-0e28baa74ca1, queue=awx_private_queue) 2022-05-21 03:40:15,143 DEBUG awx.main.dispatch delivered d77689ae-5deb-4494-aefe-9a034a11173b to worker[181] qsize 0 2022-05-21 03:40:15,146 DEBUG awx.main.dispatch task d77689ae-5deb-4494-aefe-9a034a11173b starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:40:15,148 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:40:15,163 DEBUG awx.main.dispatch delivered d6b319ce-4543-4ab4-b4a9-0e28baa74ca1 to worker[178] qsize 0 2022-05-21 03:40:15,166 DEBUG awx.main.dispatch task d6b319ce-4543-4ab4-b4a9-0e28baa74ca1 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:40:15,165 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(e620e0d5-0a9a-4062-8d84-d182a47fc9a9, queue=onap-awx-0) [2022-05-21 03:40:15,165: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(e620e0d5-0a9a-4062-8d84-d182a47fc9a9, queue=onap-awx-0) 2022-05-21 03:40:15,176 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:40:15,179 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:39:44.999214+00:00 2022-05-21 03:40:15,190 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(79f7f702-1ef6-4c67-9249-a971297defc7, queue=awx_private_queue) [2022-05-21 03:40:15,190: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(79f7f702-1ef6-4c67-9249-a971297defc7, queue=awx_private_queue) 2022-05-21 03:40:15,189 DEBUG awx.main.dispatch delivered e620e0d5-0a9a-4062-8d84-d182a47fc9a9 to worker[177] qsize 0 2022-05-21 03:40:15,192 DEBUG awx.main.dispatch task e620e0d5-0a9a-4062-8d84-d182a47fc9a9 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:40:15,204 DEBUG awx.main.dispatch delivered 79f7f702-1ef6-4c67-9249-a971297defc7 to worker[192] qsize 0 2022-05-21 03:40:15,207 DEBUG awx.main.dispatch task 79f7f702-1ef6-4c67-9249-a971297defc7 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:40:15,210 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:40:15,212 DEBUG awx.main.dispatch task e620e0d5-0a9a-4062-8d84-d182a47fc9a9 is finished 2022-05-21 03:40:15,230 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:40:15,268 DEBUG awx.main.dispatch task 79f7f702-1ef6-4c67-9249-a971297defc7 is finished 2022-05-21 03:40:15,340 DEBUG awx.main.dispatch task d77689ae-5deb-4494-aefe-9a034a11173b is finished 2022-05-21 03:40:15,978 DEBUG awx.main.dispatch task d6b319ce-4543-4ab4-b4a9-0e28baa74ca1 is finished 2022-05-21 03:40:35,196 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(07888d75-c276-45a0-b636-1e6a83df02ad, queue=awx_private_queue) [2022-05-21 03:40:35,196: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(07888d75-c276-45a0-b636-1e6a83df02ad, queue=awx_private_queue) 2022-05-21 03:40:35,234 DEBUG awx.main.dispatch delivered 07888d75-c276-45a0-b636-1e6a83df02ad to worker[178] qsize 0 2022-05-21 03:40:35,430 DEBUG awx.main.dispatch task 07888d75-c276-45a0-b636-1e6a83df02ad starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:40:35,431 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:40:35,455 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:40:35,492 DEBUG awx.main.dispatch task 07888d75-c276-45a0-b636-1e6a83df02ad is finished 2022-05-21 03:40:45,130 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(1a7d16a2-ad1e-4d41-986f-c07a7c36b29e, queue=awx_private_queue) [2022-05-21 03:40:45,130: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(1a7d16a2-ad1e-4d41-986f-c07a7c36b29e, queue=awx_private_queue) 2022-05-21 03:40:45,149 DEBUG awx.main.dispatch delivered 1a7d16a2-ad1e-4d41-986f-c07a7c36b29e to worker[192] qsize 0 2022-05-21 03:40:45,151 DEBUG awx.main.dispatch task 1a7d16a2-ad1e-4d41-986f-c07a7c36b29e starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:40:45,162 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:40:45,166 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:40:15.176157+00:00 2022-05-21 03:40:45,836 DEBUG awx.main.dispatch task 1a7d16a2-ad1e-4d41-986f-c07a7c36b29e is finished 2022-05-21 03:40:55,196 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(20acb641-a864-4f55-b73f-538eda89d38a, queue=awx_private_queue) [2022-05-21 03:40:55,196: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(20acb641-a864-4f55-b73f-538eda89d38a, queue=awx_private_queue) 2022-05-21 03:40:55,218 DEBUG awx.main.dispatch delivered 20acb641-a864-4f55-b73f-538eda89d38a to worker[192] qsize 0 2022-05-21 03:40:55,220 DEBUG awx.main.dispatch task 20acb641-a864-4f55-b73f-538eda89d38a starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:40:55,223 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:40:55,245 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:40:55,282 DEBUG awx.main.dispatch task 20acb641-a864-4f55-b73f-538eda89d38a is finished RESULT 2 OKREADY 2022-05-21 03:41:15,098 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(c77af0a3-6f26-4698-b1d5-db70f04cde1a, queue=onap-awx-0) [2022-05-21 03:41:15,098: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(c77af0a3-6f26-4698-b1d5-db70f04cde1a, queue=onap-awx-0) 2022-05-21 03:41:15,129 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(cec6b2fd-2e6b-41cf-a506-84aef9b7c2a5, queue=awx_private_queue) [2022-05-21 03:41:15,129: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(cec6b2fd-2e6b-41cf-a506-84aef9b7c2a5, queue=awx_private_queue) 2022-05-21 03:41:15,132 DEBUG awx.main.dispatch delivered c77af0a3-6f26-4698-b1d5-db70f04cde1a to worker[181] qsize 0 2022-05-21 03:41:15,134 DEBUG awx.main.dispatch task c77af0a3-6f26-4698-b1d5-db70f04cde1a starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:41:15,135 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:41:15,145 DEBUG awx.main.dispatch delivered cec6b2fd-2e6b-41cf-a506-84aef9b7c2a5 to worker[192] qsize 0 2022-05-21 03:41:15,148 DEBUG awx.main.dispatch task cec6b2fd-2e6b-41cf-a506-84aef9b7c2a5 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:41:15,159 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:41:15,163 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:40:45.163134+00:00 2022-05-21 03:41:15,164 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(67086ea8-6cbb-44df-8fb5-3780d3571c4b, queue=onap-awx-0) [2022-05-21 03:41:15,164: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(67086ea8-6cbb-44df-8fb5-3780d3571c4b, queue=onap-awx-0) 2022-05-21 03:41:15,182 DEBUG awx.main.dispatch delivered 67086ea8-6cbb-44df-8fb5-3780d3571c4b to worker[177] qsize 0 2022-05-21 03:41:15,185 DEBUG awx.main.dispatch task 67086ea8-6cbb-44df-8fb5-3780d3571c4b starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:41:15,196 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(71e83f8b-d0f2-4ffa-a661-0475c6951871, queue=awx_private_queue) [2022-05-21 03:41:15,196: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(71e83f8b-d0f2-4ffa-a661-0475c6951871, queue=awx_private_queue) 2022-05-21 03:41:15,200 DEBUG awx.main.dispatch task 67086ea8-6cbb-44df-8fb5-3780d3571c4b is finished 2022-05-21 03:41:15,211 DEBUG awx.main.dispatch delivered 71e83f8b-d0f2-4ffa-a661-0475c6951871 to worker[178] qsize 0 2022-05-21 03:41:15,214 DEBUG awx.main.dispatch task 71e83f8b-d0f2-4ffa-a661-0475c6951871 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:41:15,216 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:41:15,237 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:41:15,276 DEBUG awx.main.dispatch task 71e83f8b-d0f2-4ffa-a661-0475c6951871 is finished 2022-05-21 03:41:15,794 DEBUG awx.main.dispatch task c77af0a3-6f26-4698-b1d5-db70f04cde1a is finished 2022-05-21 03:41:15,982 DEBUG awx.main.dispatch task cec6b2fd-2e6b-41cf-a506-84aef9b7c2a5 is finished 2022-05-21 03:41:35,206 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d7b345d0-767f-4cb8-b2f8-cacec954dad4, queue=awx_private_queue) [2022-05-21 03:41:35,206: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d7b345d0-767f-4cb8-b2f8-cacec954dad4, queue=awx_private_queue) 2022-05-21 03:41:35,249 DEBUG awx.main.dispatch delivered d7b345d0-767f-4cb8-b2f8-cacec954dad4 to worker[192] qsize 0 2022-05-21 03:41:35,429 DEBUG awx.main.dispatch task d7b345d0-767f-4cb8-b2f8-cacec954dad4 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:41:35,431 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:41:35,453 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:41:35,491 DEBUG awx.main.dispatch task d7b345d0-767f-4cb8-b2f8-cacec954dad4 is finished 2022-05-21 03:41:45,129 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(4aeb5606-8f4f-4cbe-9a7c-e7b2f4348f19, queue=awx_private_queue) [2022-05-21 03:41:45,129: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(4aeb5606-8f4f-4cbe-9a7c-e7b2f4348f19, queue=awx_private_queue) 2022-05-21 03:41:45,146 DEBUG awx.main.dispatch delivered 4aeb5606-8f4f-4cbe-9a7c-e7b2f4348f19 to worker[192] qsize 0 2022-05-21 03:41:45,149 DEBUG awx.main.dispatch task 4aeb5606-8f4f-4cbe-9a7c-e7b2f4348f19 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:41:45,161 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:41:45,164 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:41:15.160039+00:00 2022-05-21 03:41:45,594 DEBUG awx.main.dispatch task 4aeb5606-8f4f-4cbe-9a7c-e7b2f4348f19 is finished 2022-05-21 03:41:55,206 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f5a33956-9a80-4d5b-a1eb-3911079a6a74, queue=awx_private_queue) [2022-05-21 03:41:55,206: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f5a33956-9a80-4d5b-a1eb-3911079a6a74, queue=awx_private_queue) 2022-05-21 03:41:55,222 DEBUG awx.main.dispatch delivered f5a33956-9a80-4d5b-a1eb-3911079a6a74 to worker[192] qsize 0 2022-05-21 03:41:55,225 DEBUG awx.main.dispatch task f5a33956-9a80-4d5b-a1eb-3911079a6a74 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:41:55,227 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:41:55,249 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:41:55,284 DEBUG awx.main.dispatch task f5a33956-9a80-4d5b-a1eb-3911079a6a74 is finished RESULT 2 OKREADY 2022-05-21 03:42:15,109 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(32d1cdae-cc6b-415a-b914-25e360654706, queue=onap-awx-0) [2022-05-21 03:42:15,109: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(32d1cdae-cc6b-415a-b914-25e360654706, queue=onap-awx-0) 2022-05-21 03:42:15,129 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(072ccbd5-e359-4038-8b46-965fb9186e46, queue=awx_private_queue) [2022-05-21 03:42:15,129: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(072ccbd5-e359-4038-8b46-965fb9186e46, queue=awx_private_queue) 2022-05-21 03:42:15,146 DEBUG awx.main.dispatch delivered 32d1cdae-cc6b-415a-b914-25e360654706 to worker[181] qsize 0 2022-05-21 03:42:15,149 DEBUG awx.main.dispatch task 32d1cdae-cc6b-415a-b914-25e360654706 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:42:15,150 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:42:15,165 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(61aecd0c-33d1-4133-8d48-f3a73bd3f23a, queue=onap-awx-0) [2022-05-21 03:42:15,165: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(61aecd0c-33d1-4133-8d48-f3a73bd3f23a, queue=onap-awx-0) 2022-05-21 03:42:15,186 DEBUG awx.main.dispatch delivered 61aecd0c-33d1-4133-8d48-f3a73bd3f23a to worker[177] qsize 0 2022-05-21 03:42:15,189 DEBUG awx.main.dispatch task 61aecd0c-33d1-4133-8d48-f3a73bd3f23a starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:42:15,205 DEBUG awx.main.dispatch task 61aecd0c-33d1-4133-8d48-f3a73bd3f23a is finished 2022-05-21 03:42:15,207 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f6bdfeeb-ee10-4965-9282-6257f999d815, queue=awx_private_queue) [2022-05-21 03:42:15,207: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f6bdfeeb-ee10-4965-9282-6257f999d815, queue=awx_private_queue) 2022-05-21 03:42:15,445 DEBUG awx.main.dispatch task 32d1cdae-cc6b-415a-b914-25e360654706 is finished 2022-05-21 03:42:35,215 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ba3e4c8f-c263-4d91-8aab-69309be6fa0c, queue=awx_private_queue) [2022-05-21 03:42:35,215: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ba3e4c8f-c263-4d91-8aab-69309be6fa0c, queue=awx_private_queue) 2022-05-21 03:42:35,962 DEBUG awx.main.dispatch delivered 072ccbd5-e359-4038-8b46-965fb9186e46 to worker[178] qsize 0 2022-05-21 03:42:36,155 DEBUG awx.main.dispatch delivered f6bdfeeb-ee10-4965-9282-6257f999d815 to worker[177] qsize 0 2022-05-21 03:42:36,155 DEBUG awx.main.dispatch task 072ccbd5-e359-4038-8b46-965fb9186e46 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:42:36,157 DEBUG awx.main.dispatch task f6bdfeeb-ee10-4965-9282-6257f999d815 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:42:36,159 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:42:36,158 DEBUG awx.main.dispatch delivered ba3e4c8f-c263-4d91-8aab-69309be6fa0c to worker[181] qsize 0 2022-05-21 03:42:36,160 DEBUG awx.main.dispatch task ba3e4c8f-c263-4d91-8aab-69309be6fa0c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:42:36,163 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:42:36,168 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:42:36,171 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:41:45.161735+00:00 2022-05-21 03:42:36,177 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:42:36,180 DEBUG awx.main.scheduler Not running scheduler, another task holds lock 2022-05-21 03:42:36,180 DEBUG awx.main.dispatch task ba3e4c8f-c263-4d91-8aab-69309be6fa0c is finished 2022-05-21 03:42:36,215 DEBUG awx.main.dispatch task f6bdfeeb-ee10-4965-9282-6257f999d815 is finished 2022-05-21 03:42:36,855 DEBUG awx.main.dispatch task 072ccbd5-e359-4038-8b46-965fb9186e46 is finished 2022-05-21 03:42:45,130 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(ab1a7055-8ed3-4e56-85c7-e104bd0fb764, queue=awx_private_queue) [2022-05-21 03:42:45,130: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(ab1a7055-8ed3-4e56-85c7-e104bd0fb764, queue=awx_private_queue) 2022-05-21 03:42:55,216 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(33715984-6eee-43be-879f-9bfc4a9b7e1b, queue=awx_private_queue) [2022-05-21 03:42:55,216: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(33715984-6eee-43be-879f-9bfc4a9b7e1b, queue=awx_private_queue) 2022-05-21 03:42:59,667 DEBUG awx.main.dispatch delivered ab1a7055-8ed3-4e56-85c7-e104bd0fb764 to worker[181] qsize 0 2022-05-21 03:42:59,671 DEBUG awx.main.dispatch delivered 33715984-6eee-43be-879f-9bfc4a9b7e1b to worker[177] qsize 0 2022-05-21 03:42:59,671 DEBUG awx.main.dispatch task ab1a7055-8ed3-4e56-85c7-e104bd0fb764 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:42:59,673 DEBUG awx.main.dispatch task 33715984-6eee-43be-879f-9bfc4a9b7e1b starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:42:59,676 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:42:59,686 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:42:59,689 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:42:36.168355+00:00 2022-05-21 03:42:59,698 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:42:59,741 DEBUG awx.main.dispatch task 33715984-6eee-43be-879f-9bfc4a9b7e1b is finished 2022-05-21 03:43:00,325 DEBUG awx.main.dispatch task ab1a7055-8ed3-4e56-85c7-e104bd0fb764 is finished RESULT 2 OKREADY 2022-05-21 03:43:16,520 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(8e411246-16f6-43f1-a6e7-3e7defc01ccd, queue=onap-awx-0) [2022-05-21 03:43:16,520: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(8e411246-16f6-43f1-a6e7-3e7defc01ccd, queue=onap-awx-0) 2022-05-21 03:43:16,546 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(ab7cea95-07da-4bb5-9804-dc0364bc06dd, queue=awx_private_queue) [2022-05-21 03:43:16,546: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(ab7cea95-07da-4bb5-9804-dc0364bc06dd, queue=awx_private_queue) 2022-05-21 03:43:16,559 DEBUG awx.main.dispatch delivered 8e411246-16f6-43f1-a6e7-3e7defc01ccd to worker[192] qsize 0 2022-05-21 03:43:16,561 DEBUG awx.main.dispatch delivered ab7cea95-07da-4bb5-9804-dc0364bc06dd to worker[178] qsize 0 2022-05-21 03:43:16,561 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(49e802d5-e04c-4096-ad03-c9a6f4ffc116, queue=onap-awx-0) [2022-05-21 03:43:16,561: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(49e802d5-e04c-4096-ad03-c9a6f4ffc116, queue=onap-awx-0) 2022-05-21 03:43:16,562 DEBUG awx.main.dispatch task ab7cea95-07da-4bb5-9804-dc0364bc06dd starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:43:16,561 DEBUG awx.main.dispatch task 8e411246-16f6-43f1-a6e7-3e7defc01ccd starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:43:16,564 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:43:16,574 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:43:16,577 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:42:59.686795+00:00 2022-05-21 03:43:16,577 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(dbe57046-7eb9-439e-95e9-96873f44f5a0, queue=awx_private_queue) [2022-05-21 03:43:16,577: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(dbe57046-7eb9-439e-95e9-96873f44f5a0, queue=awx_private_queue) 2022-05-21 03:43:16,576 DEBUG awx.main.dispatch delivered 49e802d5-e04c-4096-ad03-c9a6f4ffc116 to worker[177] qsize 0 2022-05-21 03:43:16,579 DEBUG awx.main.dispatch task 49e802d5-e04c-4096-ad03-c9a6f4ffc116 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:43:16,593 DEBUG awx.main.dispatch delivered dbe57046-7eb9-439e-95e9-96873f44f5a0 to worker[181] qsize 0 2022-05-21 03:43:16,595 DEBUG awx.main.dispatch task dbe57046-7eb9-439e-95e9-96873f44f5a0 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:43:16,597 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:43:16,595 DEBUG awx.main.dispatch task 49e802d5-e04c-4096-ad03-c9a6f4ffc116 is finished 2022-05-21 03:43:16,619 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:43:16,656 DEBUG awx.main.dispatch task dbe57046-7eb9-439e-95e9-96873f44f5a0 is finished 2022-05-21 03:43:17,060 DEBUG awx.main.dispatch task 8e411246-16f6-43f1-a6e7-3e7defc01ccd is finished 2022-05-21 03:43:17,065 DEBUG awx.main.dispatch task ab7cea95-07da-4bb5-9804-dc0364bc06dd is finished 2022-05-21 03:43:36,588 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c5bba2f2-07e9-404e-8868-361c43de2bf2, queue=awx_private_queue) [2022-05-21 03:43:36,588: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c5bba2f2-07e9-404e-8868-361c43de2bf2, queue=awx_private_queue) 2022-05-21 03:43:46,547 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(907ca466-2f1d-4639-b990-df294b8ad862, queue=awx_private_queue) [2022-05-21 03:43:46,547: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(907ca466-2f1d-4639-b990-df294b8ad862, queue=awx_private_queue) 2022-05-21 03:43:46,514 DEBUG awx.main.dispatch delivered c5bba2f2-07e9-404e-8868-361c43de2bf2 to worker[177] qsize 0 2022-05-21 03:43:46,685 DEBUG awx.main.dispatch delivered 907ca466-2f1d-4639-b990-df294b8ad862 to worker[181] qsize 0 2022-05-21 03:43:46,685 DEBUG awx.main.dispatch task c5bba2f2-07e9-404e-8868-361c43de2bf2 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:43:46,686 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:43:46,687 DEBUG awx.main.dispatch task 907ca466-2f1d-4639-b990-df294b8ad862 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:43:46,699 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:43:46,702 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:43:16.574857+00:00 2022-05-21 03:43:46,708 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:43:46,744 DEBUG awx.main.dispatch task c5bba2f2-07e9-404e-8868-361c43de2bf2 is finished 2022-05-21 03:43:47,237 DEBUG awx.main.dispatch task 907ca466-2f1d-4639-b990-df294b8ad862 is finished 2022-05-21 03:43:56,589 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e11cd668-5168-44eb-89d1-f099cf36e7e6, queue=awx_private_queue) [2022-05-21 03:43:56,589: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e11cd668-5168-44eb-89d1-f099cf36e7e6, queue=awx_private_queue) 2022-05-21 03:43:59,801 DEBUG awx.main.dispatch delivered e11cd668-5168-44eb-89d1-f099cf36e7e6 to worker[181] qsize 0 RESULT 2 OKREADY 2022-05-21 03:43:59,804 DEBUG awx.main.dispatch task e11cd668-5168-44eb-89d1-f099cf36e7e6 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:43:59,806 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:43:59,828 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:43:59,862 DEBUG awx.main.dispatch task e11cd668-5168-44eb-89d1-f099cf36e7e6 is finished 2022-05-21 03:44:15,005 DEBUG awx.main.dispatch publish awx.main.tasks.awx_isolated_heartbeat(037a4b79-6905-4864-b9c2-a64911ef6495, queue=onap-awx-0) [2022-05-21 03:44:15,005: DEBUG/Process-1] publish awx.main.tasks.awx_isolated_heartbeat(037a4b79-6905-4864-b9c2-a64911ef6495, queue=onap-awx-0) 2022-05-21 03:44:15,026 DEBUG awx.main.dispatch delivered 037a4b79-6905-4864-b9c2-a64911ef6495 to worker[177] qsize 0 2022-05-21 03:44:15,029 DEBUG awx.main.dispatch task 037a4b79-6905-4864-b9c2-a64911ef6495 starting awx.main.tasks.awx_isolated_heartbeat(*[]) 2022-05-21 03:44:15,031 DEBUG awx.main.tasks Controlling node checking for any isolated management tasks. 2022-05-21 03:44:15,057 DEBUG awx.main.dispatch task 037a4b79-6905-4864-b9c2-a64911ef6495 is finished 2022-05-21 03:44:16,520 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(ec4d1ba7-f869-4e69-9dff-fcf328256cf6, queue=onap-awx-0) [2022-05-21 03:44:16,520: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(ec4d1ba7-f869-4e69-9dff-fcf328256cf6, queue=onap-awx-0) 2022-05-21 03:44:16,546 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(09eb42fe-c1ef-4dea-831a-4398fbf53384, queue=awx_private_queue) [2022-05-21 03:44:16,546: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(09eb42fe-c1ef-4dea-831a-4398fbf53384, queue=awx_private_queue) 2022-05-21 03:44:16,562 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(159a54cd-c263-423b-bb21-9549e43b4480, queue=onap-awx-0) [2022-05-21 03:44:16,562: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(159a54cd-c263-423b-bb21-9549e43b4480, queue=onap-awx-0) 2022-05-21 03:44:16,588 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(abcaa18b-0e67-4eff-b6ab-c69fc2e3c7ef, queue=awx_private_queue) [2022-05-21 03:44:16,588: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(abcaa18b-0e67-4eff-b6ab-c69fc2e3c7ef, queue=awx_private_queue) 2022-05-21 03:44:25,018 DEBUG awx.main.dispatch delivered 09eb42fe-c1ef-4dea-831a-4398fbf53384 to worker[177] qsize 0 2022-05-21 03:44:25,020 DEBUG awx.main.dispatch delivered abcaa18b-0e67-4eff-b6ab-c69fc2e3c7ef to worker[178] qsize 0 2022-05-21 03:44:25,022 DEBUG awx.main.dispatch task abcaa18b-0e67-4eff-b6ab-c69fc2e3c7ef starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:44:25,025 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:44:25,022 DEBUG awx.main.dispatch task 09eb42fe-c1ef-4dea-831a-4398fbf53384 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:44:25,039 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:44:25,043 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:43:46.699792+00:00 2022-05-21 03:44:25,051 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:44:25,091 DEBUG awx.main.dispatch task abcaa18b-0e67-4eff-b6ab-c69fc2e3c7ef is finished 2022-05-21 03:44:25,237 DEBUG awx.main.dispatch task 09eb42fe-c1ef-4dea-831a-4398fbf53384 is finished 2022-05-21 03:44:25,398 DEBUG awx.main.dispatch delivered ec4d1ba7-f869-4e69-9dff-fcf328256cf6 to worker[181] qsize 0 2022-05-21 03:44:25,402 DEBUG awx.main.dispatch delivered 159a54cd-c263-423b-bb21-9549e43b4480 to worker[178] qsize 0 2022-05-21 03:44:25,402 DEBUG awx.main.dispatch task ec4d1ba7-f869-4e69-9dff-fcf328256cf6 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:44:25,404 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:44:25,404 DEBUG awx.main.dispatch task 159a54cd-c263-423b-bb21-9549e43b4480 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:44:25,418 DEBUG awx.main.dispatch task 159a54cd-c263-423b-bb21-9549e43b4480 is finished 2022-05-21 03:44:25,728 DEBUG awx.main.dispatch task ec4d1ba7-f869-4e69-9dff-fcf328256cf6 is finished 2022-05-21 03:44:36,599 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(4a9cb088-63ca-4fbb-a3c7-6ea35ca0e9f8, queue=awx_private_queue) [2022-05-21 03:44:36,599: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(4a9cb088-63ca-4fbb-a3c7-6ea35ca0e9f8, queue=awx_private_queue) 2022-05-21 03:44:43,482 DEBUG awx.main.dispatch delivered 4a9cb088-63ca-4fbb-a3c7-6ea35ca0e9f8 to worker[177] qsize 0 2022-05-21 03:44:43,484 DEBUG awx.main.dispatch task 4a9cb088-63ca-4fbb-a3c7-6ea35ca0e9f8 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:44:43,486 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:44:43,506 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:44:43,547 DEBUG awx.main.dispatch task 4a9cb088-63ca-4fbb-a3c7-6ea35ca0e9f8 is finished 2022-05-21 03:44:46,548 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(5be5c849-1645-4b5e-aae9-7a38d5b15408, queue=awx_private_queue) [2022-05-21 03:44:46,548: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(5be5c849-1645-4b5e-aae9-7a38d5b15408, queue=awx_private_queue) 2022-05-21 03:44:46,586 DEBUG awx.main.dispatch delivered 5be5c849-1645-4b5e-aae9-7a38d5b15408 to worker[181] qsize 0 2022-05-21 03:44:46,761 DEBUG awx.main.dispatch task 5be5c849-1645-4b5e-aae9-7a38d5b15408 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:44:46,775 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:44:46,779 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:44:25.040131+00:00 2022-05-21 03:44:46,958 DEBUG awx.main.dispatch task 5be5c849-1645-4b5e-aae9-7a38d5b15408 is finished 2022-05-21 03:44:56,601 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(2d55ba88-4bed-44e3-a5c3-6757df60320f, queue=awx_private_queue) [2022-05-21 03:44:56,601: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(2d55ba88-4bed-44e3-a5c3-6757df60320f, queue=awx_private_queue) 2022-05-21 03:44:56,622 DEBUG awx.main.dispatch delivered 2d55ba88-4bed-44e3-a5c3-6757df60320f to worker[192] qsize 0 2022-05-21 03:44:56,626 DEBUG awx.main.dispatch task 2d55ba88-4bed-44e3-a5c3-6757df60320f starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:44:56,628 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:44:56,650 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:44:56,690 DEBUG awx.main.dispatch task 2d55ba88-4bed-44e3-a5c3-6757df60320f is finished RESULT 2 OKREADY 2022-05-21 03:45:16,531 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(edc93a80-4576-43c1-8a96-42ca63e9559e, queue=onap-awx-0) [2022-05-21 03:45:16,531: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(edc93a80-4576-43c1-8a96-42ca63e9559e, queue=onap-awx-0) 2022-05-21 03:45:16,566 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(0d5234a9-f9b3-4214-8475-ec25cfb00443, queue=onap-awx-0) [2022-05-21 03:45:16,566: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(0d5234a9-f9b3-4214-8475-ec25cfb00443, queue=onap-awx-0) 2022-05-21 03:45:16,579 DEBUG awx.main.dispatch delivered edc93a80-4576-43c1-8a96-42ca63e9559e to worker[178] qsize 0 2022-05-21 03:45:16,582 DEBUG awx.main.dispatch task edc93a80-4576-43c1-8a96-42ca63e9559e starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:45:16,585 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:45:16,589 DEBUG awx.main.dispatch delivered 0d5234a9-f9b3-4214-8475-ec25cfb00443 to worker[177] qsize 0 2022-05-21 03:45:16,592 DEBUG awx.main.dispatch task 0d5234a9-f9b3-4214-8475-ec25cfb00443 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:45:16,591 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(17da0d71-a62d-4fac-9901-e3e64f392ca3, queue=awx_private_queue) [2022-05-21 03:45:16,591: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(17da0d71-a62d-4fac-9901-e3e64f392ca3, queue=awx_private_queue) 2022-05-21 03:45:16,607 DEBUG awx.main.dispatch task 0d5234a9-f9b3-4214-8475-ec25cfb00443 is finished 2022-05-21 03:45:16,609 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(8d8528a5-683d-407a-bcdc-6872f0ef0ced, queue=awx_private_queue) [2022-05-21 03:45:16,609: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(8d8528a5-683d-407a-bcdc-6872f0ef0ced, queue=awx_private_queue) 2022-05-21 03:45:16,608 DEBUG awx.main.dispatch delivered 17da0d71-a62d-4fac-9901-e3e64f392ca3 to worker[192] qsize 0 2022-05-21 03:45:16,611 DEBUG awx.main.dispatch task 17da0d71-a62d-4fac-9901-e3e64f392ca3 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:45:16,619 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:45:16,622 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:44:46.775985+00:00 2022-05-21 03:45:16,628 DEBUG awx.main.dispatch delivered 8d8528a5-683d-407a-bcdc-6872f0ef0ced to worker[181] qsize 0 2022-05-21 03:45:16,630 DEBUG awx.main.dispatch task 8d8528a5-683d-407a-bcdc-6872f0ef0ced starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:45:16,631 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:45:16,650 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:45:16,692 DEBUG awx.main.dispatch task 8d8528a5-683d-407a-bcdc-6872f0ef0ced is finished 2022-05-21 03:45:16,801 DEBUG awx.main.dispatch task edc93a80-4576-43c1-8a96-42ca63e9559e is finished 2022-05-21 03:45:17,224 DEBUG awx.main.dispatch task 17da0d71-a62d-4fac-9901-e3e64f392ca3 is finished 2022-05-21 03:45:36,617 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(8b37df1f-72a6-4037-9452-18b6375b8954, queue=awx_private_queue) [2022-05-21 03:45:36,617: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(8b37df1f-72a6-4037-9452-18b6375b8954, queue=awx_private_queue) 2022-05-21 03:45:36,643 DEBUG awx.main.dispatch delivered 8b37df1f-72a6-4037-9452-18b6375b8954 to worker[177] qsize 0 2022-05-21 03:45:36,645 DEBUG awx.main.dispatch task 8b37df1f-72a6-4037-9452-18b6375b8954 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:45:36,647 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:45:36,668 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:45:36,711 DEBUG awx.main.dispatch task 8b37df1f-72a6-4037-9452-18b6375b8954 is finished 2022-05-21 03:45:46,591 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(a568f374-dd9b-4962-9939-924db26b4dc7, queue=awx_private_queue) [2022-05-21 03:45:46,591: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(a568f374-dd9b-4962-9939-924db26b4dc7, queue=awx_private_queue) 2022-05-21 03:45:46,628 DEBUG awx.main.dispatch delivered a568f374-dd9b-4962-9939-924db26b4dc7 to worker[178] qsize 0 2022-05-21 03:45:46,797 DEBUG awx.main.dispatch task a568f374-dd9b-4962-9939-924db26b4dc7 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:45:46,809 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:45:46,812 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:45:16.620003+00:00 2022-05-21 03:45:47,527 DEBUG awx.main.dispatch task a568f374-dd9b-4962-9939-924db26b4dc7 is finished 2022-05-21 03:45:56,618 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a073dec5-cf76-4b35-ba5b-fc363bd98346, queue=awx_private_queue) [2022-05-21 03:45:56,618: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a073dec5-cf76-4b35-ba5b-fc363bd98346, queue=awx_private_queue) 2022-05-21 03:45:56,638 DEBUG awx.main.dispatch delivered a073dec5-cf76-4b35-ba5b-fc363bd98346 to worker[178] qsize 0 2022-05-21 03:45:56,641 DEBUG awx.main.dispatch task a073dec5-cf76-4b35-ba5b-fc363bd98346 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:45:56,643 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:45:56,663 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:45:56,705 DEBUG awx.main.dispatch task a073dec5-cf76-4b35-ba5b-fc363bd98346 is finished RESULT 2 OKREADY 2022-05-21 03:46:16,544 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(f0ebb0fc-85cf-4a6d-823d-e32d6422bbb3, queue=onap-awx-0) [2022-05-21 03:46:16,544: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(f0ebb0fc-85cf-4a6d-823d-e32d6422bbb3, queue=onap-awx-0) 2022-05-21 03:46:16,565 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(5bba6fca-1a09-4055-8630-6ec33ebcc4d9, queue=onap-awx-0) [2022-05-21 03:46:16,565: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(5bba6fca-1a09-4055-8630-6ec33ebcc4d9, queue=onap-awx-0) 2022-05-21 03:46:16,578 DEBUG awx.main.dispatch delivered f0ebb0fc-85cf-4a6d-823d-e32d6422bbb3 to worker[181] qsize 0 2022-05-21 03:46:16,581 DEBUG awx.main.dispatch delivered 5bba6fca-1a09-4055-8630-6ec33ebcc4d9 to worker[177] qsize 0 2022-05-21 03:46:16,581 DEBUG awx.main.dispatch task f0ebb0fc-85cf-4a6d-823d-e32d6422bbb3 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:46:16,582 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:46:16,582 DEBUG awx.main.dispatch task 5bba6fca-1a09-4055-8630-6ec33ebcc4d9 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:46:16,591 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(1a274a7a-d77c-4734-bb3b-8aa10ef6ba4d, queue=awx_private_queue) [2022-05-21 03:46:16,591: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(1a274a7a-d77c-4734-bb3b-8aa10ef6ba4d, queue=awx_private_queue) 2022-05-21 03:46:16,600 DEBUG awx.main.dispatch task 5bba6fca-1a09-4055-8630-6ec33ebcc4d9 is finished 2022-05-21 03:46:16,617 DEBUG awx.main.dispatch delivered 1a274a7a-d77c-4734-bb3b-8aa10ef6ba4d to worker[177] qsize 0 2022-05-21 03:46:16,620 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(2a1b2947-9211-4f17-8f36-e4cd9286b88c, queue=awx_private_queue) [2022-05-21 03:46:16,620: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(2a1b2947-9211-4f17-8f36-e4cd9286b88c, queue=awx_private_queue) 2022-05-21 03:46:16,620 DEBUG awx.main.dispatch task 1a274a7a-d77c-4734-bb3b-8aa10ef6ba4d starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:46:16,634 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:46:16,636 DEBUG awx.main.dispatch delivered 2a1b2947-9211-4f17-8f36-e4cd9286b88c to worker[178] qsize 0 2022-05-21 03:46:16,638 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:45:46.809600+00:00 2022-05-21 03:46:16,639 DEBUG awx.main.dispatch task 2a1b2947-9211-4f17-8f36-e4cd9286b88c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:46:16,642 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:46:16,667 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:46:16,708 DEBUG awx.main.dispatch task 2a1b2947-9211-4f17-8f36-e4cd9286b88c is finished 2022-05-21 03:46:16,952 DEBUG awx.main.dispatch task f0ebb0fc-85cf-4a6d-823d-e32d6422bbb3 is finished 2022-05-21 03:46:17,739 DEBUG awx.main.dispatch task 1a274a7a-d77c-4734-bb3b-8aa10ef6ba4d is finished 2022-05-21 03:46:36,630 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(261655ae-95d2-4ebf-98d7-433b04ffe1d1, queue=awx_private_queue) [2022-05-21 03:46:36,630: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(261655ae-95d2-4ebf-98d7-433b04ffe1d1, queue=awx_private_queue) 2022-05-21 03:46:36,648 DEBUG awx.main.dispatch delivered 261655ae-95d2-4ebf-98d7-433b04ffe1d1 to worker[192] qsize 0 2022-05-21 03:46:36,651 DEBUG awx.main.dispatch task 261655ae-95d2-4ebf-98d7-433b04ffe1d1 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:46:36,655 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:46:36,678 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:46:36,716 DEBUG awx.main.dispatch task 261655ae-95d2-4ebf-98d7-433b04ffe1d1 is finished 2022-05-21 03:46:46,592 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(4c6b5738-c0e5-474c-829e-8f3af45d7d60, queue=awx_private_queue) [2022-05-21 03:46:46,592: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(4c6b5738-c0e5-474c-829e-8f3af45d7d60, queue=awx_private_queue) 2022-05-21 03:46:46,629 DEBUG awx.main.dispatch delivered 4c6b5738-c0e5-474c-829e-8f3af45d7d60 to worker[178] qsize 0 2022-05-21 03:46:46,815 DEBUG awx.main.dispatch task 4c6b5738-c0e5-474c-829e-8f3af45d7d60 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:46:46,830 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:46:46,834 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:46:16.634752+00:00 2022-05-21 03:46:47,472 DEBUG awx.main.dispatch task 4c6b5738-c0e5-474c-829e-8f3af45d7d60 is finished 2022-05-21 03:46:56,631 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(fdff8014-994b-4897-96cd-ff6ac72d35d7, queue=awx_private_queue) [2022-05-21 03:46:56,631: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(fdff8014-994b-4897-96cd-ff6ac72d35d7, queue=awx_private_queue) 2022-05-21 03:46:56,651 DEBUG awx.main.dispatch delivered fdff8014-994b-4897-96cd-ff6ac72d35d7 to worker[192] qsize 0 2022-05-21 03:46:56,654 DEBUG awx.main.dispatch task fdff8014-994b-4897-96cd-ff6ac72d35d7 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:46:56,655 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:46:56,680 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:46:56,716 DEBUG awx.main.dispatch task fdff8014-994b-4897-96cd-ff6ac72d35d7 is finished RESULT 2 OKREADY 2022-05-21 03:47:16,545 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(0f932834-e058-45f0-9007-70b9d7d9d391, queue=onap-awx-0) [2022-05-21 03:47:16,545: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(0f932834-e058-45f0-9007-70b9d7d9d391, queue=onap-awx-0) 2022-05-21 03:47:16,569 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(65c10288-5578-480f-bd6c-e008d44b70a3, queue=onap-awx-0) [2022-05-21 03:47:16,569: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(65c10288-5578-480f-bd6c-e008d44b70a3, queue=onap-awx-0) 2022-05-21 03:47:16,583 DEBUG awx.main.dispatch delivered 0f932834-e058-45f0-9007-70b9d7d9d391 to worker[181] qsize 0 2022-05-21 03:47:16,585 DEBUG awx.main.dispatch delivered 65c10288-5578-480f-bd6c-e008d44b70a3 to worker[192] qsize 0 2022-05-21 03:47:16,585 DEBUG awx.main.dispatch task 0f932834-e058-45f0-9007-70b9d7d9d391 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:47:16,588 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:47:16,588 DEBUG awx.main.dispatch task 65c10288-5578-480f-bd6c-e008d44b70a3 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:47:16,592 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(52984f74-d540-45a9-8909-fa86824fee03, queue=awx_private_queue) [2022-05-21 03:47:16,592: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(52984f74-d540-45a9-8909-fa86824fee03, queue=awx_private_queue) 2022-05-21 03:47:16,610 DEBUG awx.main.dispatch task 65c10288-5578-480f-bd6c-e008d44b70a3 is finished 2022-05-21 03:47:16,610 DEBUG awx.main.dispatch delivered 52984f74-d540-45a9-8909-fa86824fee03 to worker[177] qsize 0 2022-05-21 03:47:16,613 DEBUG awx.main.dispatch task 52984f74-d540-45a9-8909-fa86824fee03 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:47:16,627 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:47:16,630 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:46:46.830368+00:00 2022-05-21 03:47:16,631 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ce7ab2ef-f63c-47ca-9e9f-3235c873f81a, queue=awx_private_queue) [2022-05-21 03:47:16,631: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ce7ab2ef-f63c-47ca-9e9f-3235c873f81a, queue=awx_private_queue) 2022-05-21 03:47:16,648 DEBUG awx.main.dispatch delivered ce7ab2ef-f63c-47ca-9e9f-3235c873f81a to worker[178] qsize 0 2022-05-21 03:47:16,650 DEBUG awx.main.dispatch task ce7ab2ef-f63c-47ca-9e9f-3235c873f81a starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:47:16,652 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:47:16,675 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:47:16,719 DEBUG awx.main.dispatch task ce7ab2ef-f63c-47ca-9e9f-3235c873f81a is finished 2022-05-21 03:47:16,948 DEBUG awx.main.dispatch task 0f932834-e058-45f0-9007-70b9d7d9d391 is finished 2022-05-21 03:47:17,481 DEBUG awx.main.dispatch task 52984f74-d540-45a9-8909-fa86824fee03 is finished 2022-05-21 03:47:36,642 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a4715110-cae3-4e06-b234-0e7f33f06e7b, queue=awx_private_queue) [2022-05-21 03:47:36,642: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a4715110-cae3-4e06-b234-0e7f33f06e7b, queue=awx_private_queue) 2022-05-21 03:47:36,660 DEBUG awx.main.dispatch delivered a4715110-cae3-4e06-b234-0e7f33f06e7b to worker[192] qsize 0 2022-05-21 03:47:36,662 DEBUG awx.main.dispatch task a4715110-cae3-4e06-b234-0e7f33f06e7b starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:47:36,665 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:47:36,690 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:47:36,727 DEBUG awx.main.dispatch task a4715110-cae3-4e06-b234-0e7f33f06e7b is finished 2022-05-21 03:47:46,593 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(aa162812-0b9e-4246-9906-e22ca77a293b, queue=awx_private_queue) [2022-05-21 03:47:46,593: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(aa162812-0b9e-4246-9906-e22ca77a293b, queue=awx_private_queue) 2022-05-21 03:47:46,629 DEBUG awx.main.dispatch delivered aa162812-0b9e-4246-9906-e22ca77a293b to worker[177] qsize 0 2022-05-21 03:47:46,823 DEBUG awx.main.dispatch task aa162812-0b9e-4246-9906-e22ca77a293b starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:47:46,834 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:47:46,838 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:47:16.627363+00:00 2022-05-21 03:47:47,346 DEBUG awx.main.dispatch task aa162812-0b9e-4246-9906-e22ca77a293b is finished 2022-05-21 03:47:56,643 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(dc781b78-2473-4ec3-adbb-dee3353600f0, queue=awx_private_queue) [2022-05-21 03:47:56,643: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(dc781b78-2473-4ec3-adbb-dee3353600f0, queue=awx_private_queue) 2022-05-21 03:47:56,669 DEBUG awx.main.dispatch delivered dc781b78-2473-4ec3-adbb-dee3353600f0 to worker[181] qsize 0 2022-05-21 03:47:56,672 DEBUG awx.main.dispatch task dc781b78-2473-4ec3-adbb-dee3353600f0 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:47:56,673 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:47:56,696 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:47:56,737 DEBUG awx.main.dispatch task dc781b78-2473-4ec3-adbb-dee3353600f0 is finished RESULT 2 OKREADY 2022-05-21 03:48:16,556 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(b119b6d8-55c3-4d66-ba59-83cb1b0e5ba4, queue=onap-awx-0) [2022-05-21 03:48:16,556: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(b119b6d8-55c3-4d66-ba59-83cb1b0e5ba4, queue=onap-awx-0) 2022-05-21 03:48:16,578 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(043ac829-c41c-46ca-aa2f-b3fb7733306a, queue=onap-awx-0) [2022-05-21 03:48:16,578: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(043ac829-c41c-46ca-aa2f-b3fb7733306a, queue=onap-awx-0) 2022-05-21 03:48:16,592 DEBUG awx.main.dispatch delivered b119b6d8-55c3-4d66-ba59-83cb1b0e5ba4 to worker[177] qsize 0 2022-05-21 03:48:16,595 DEBUG awx.main.dispatch task b119b6d8-55c3-4d66-ba59-83cb1b0e5ba4 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:48:16,596 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:48:16,597 DEBUG awx.main.dispatch delivered 043ac829-c41c-46ca-aa2f-b3fb7733306a to worker[192] qsize 0 2022-05-21 03:48:16,598 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(cb57bee2-9ba7-4d34-837c-52736733407c, queue=awx_private_queue) [2022-05-21 03:48:16,598: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(cb57bee2-9ba7-4d34-837c-52736733407c, queue=awx_private_queue) 2022-05-21 03:48:16,599 DEBUG awx.main.dispatch task 043ac829-c41c-46ca-aa2f-b3fb7733306a starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:48:16,616 DEBUG awx.main.dispatch task 043ac829-c41c-46ca-aa2f-b3fb7733306a is finished 2022-05-21 03:48:16,617 DEBUG awx.main.dispatch delivered cb57bee2-9ba7-4d34-837c-52736733407c to worker[178] qsize 0 2022-05-21 03:48:16,620 DEBUG awx.main.dispatch task cb57bee2-9ba7-4d34-837c-52736733407c starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:48:16,633 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:48:16,636 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:47:46.835100+00:00 2022-05-21 03:48:16,642 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(4b3ebcef-2ca8-4a02-8c24-8d90efdb5b5c, queue=awx_private_queue) [2022-05-21 03:48:16,642: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(4b3ebcef-2ca8-4a02-8c24-8d90efdb5b5c, queue=awx_private_queue) 2022-05-21 03:48:16,662 DEBUG awx.main.dispatch delivered 4b3ebcef-2ca8-4a02-8c24-8d90efdb5b5c to worker[181] qsize 0 2022-05-21 03:48:16,665 DEBUG awx.main.dispatch task 4b3ebcef-2ca8-4a02-8c24-8d90efdb5b5c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:48:16,668 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:48:16,690 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:48:16,725 DEBUG awx.main.dispatch task 4b3ebcef-2ca8-4a02-8c24-8d90efdb5b5c is finished 2022-05-21 03:48:16,950 DEBUG awx.main.dispatch task b119b6d8-55c3-4d66-ba59-83cb1b0e5ba4 is finished 2022-05-21 03:48:17,022 DEBUG awx.main.dispatch task cb57bee2-9ba7-4d34-837c-52736733407c is finished 2022-05-21 03:48:36,654 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ce1fecde-b1b4-4fd3-8b68-71c60167e31d, queue=awx_private_queue) [2022-05-21 03:48:36,654: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ce1fecde-b1b4-4fd3-8b68-71c60167e31d, queue=awx_private_queue) 2022-05-21 03:48:36,676 DEBUG awx.main.dispatch delivered ce1fecde-b1b4-4fd3-8b68-71c60167e31d to worker[178] qsize 0 2022-05-21 03:48:36,679 DEBUG awx.main.dispatch task ce1fecde-b1b4-4fd3-8b68-71c60167e31d starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:48:36,681 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:48:36,706 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:48:36,751 DEBUG awx.main.dispatch task ce1fecde-b1b4-4fd3-8b68-71c60167e31d is finished 2022-05-21 03:48:46,600 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d50ab1a6-d776-4a06-9261-ddaa4852b8fb, queue=awx_private_queue) [2022-05-21 03:48:46,600: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d50ab1a6-d776-4a06-9261-ddaa4852b8fb, queue=awx_private_queue) 2022-05-21 03:48:46,641 DEBUG awx.main.dispatch delivered d50ab1a6-d776-4a06-9261-ddaa4852b8fb to worker[177] qsize 0 2022-05-21 03:48:46,818 DEBUG awx.main.dispatch task d50ab1a6-d776-4a06-9261-ddaa4852b8fb starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:48:46,831 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:48:46,835 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:48:16.633749+00:00 2022-05-21 03:48:47,213 DEBUG awx.main.dispatch task d50ab1a6-d776-4a06-9261-ddaa4852b8fb is finished 2022-05-21 03:48:56,653 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(857392a9-9f9f-44f6-a5bd-46e2df6039d2, queue=awx_private_queue) [2022-05-21 03:48:56,653: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(857392a9-9f9f-44f6-a5bd-46e2df6039d2, queue=awx_private_queue) 2022-05-21 03:48:56,670 DEBUG awx.main.dispatch delivered 857392a9-9f9f-44f6-a5bd-46e2df6039d2 to worker[181] qsize 0 2022-05-21 03:48:56,672 DEBUG awx.main.dispatch task 857392a9-9f9f-44f6-a5bd-46e2df6039d2 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:48:56,673 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:48:56,696 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:48:56,742 DEBUG awx.main.dispatch task 857392a9-9f9f-44f6-a5bd-46e2df6039d2 is finished RESULT 2 OKREADY 2022-05-21 03:49:16,922 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(f5a6c651-3ae0-4cf4-9048-f65f3230fa5b, queue=onap-awx-0) [2022-05-21 03:49:16,922: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(f5a6c651-3ae0-4cf4-9048-f65f3230fa5b, queue=onap-awx-0) 2022-05-21 03:49:16,938 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(2ab8d921-12b2-4ce5-a955-04021632b239, queue=onap-awx-0) [2022-05-21 03:49:16,938: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(2ab8d921-12b2-4ce5-a955-04021632b239, queue=onap-awx-0) 2022-05-21 03:49:16,954 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(596c477f-4c4f-4ee1-9afd-95e818392bc2, queue=awx_private_queue) [2022-05-21 03:49:16,954: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(596c477f-4c4f-4ee1-9afd-95e818392bc2, queue=awx_private_queue) 2022-05-21 03:49:16,958 DEBUG awx.main.dispatch delivered f5a6c651-3ae0-4cf4-9048-f65f3230fa5b to worker[177] qsize 0 2022-05-21 03:49:16,961 DEBUG awx.main.dispatch delivered 2ab8d921-12b2-4ce5-a955-04021632b239 to worker[181] qsize 0 2022-05-21 03:49:16,962 DEBUG awx.main.dispatch task f5a6c651-3ae0-4cf4-9048-f65f3230fa5b starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:49:16,965 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:49:16,964 DEBUG awx.main.dispatch task 2ab8d921-12b2-4ce5-a955-04021632b239 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:49:16,970 DEBUG awx.main.dispatch delivered 596c477f-4c4f-4ee1-9afd-95e818392bc2 to worker[192] qsize 0 2022-05-21 03:49:16,970 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(44552f4e-02cd-433c-9997-b037ff014565, queue=awx_private_queue) [2022-05-21 03:49:16,970: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(44552f4e-02cd-433c-9997-b037ff014565, queue=awx_private_queue) 2022-05-21 03:49:16,972 DEBUG awx.main.dispatch task 596c477f-4c4f-4ee1-9afd-95e818392bc2 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:49:16,984 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:49:16,984 DEBUG awx.main.dispatch task 2ab8d921-12b2-4ce5-a955-04021632b239 is finished 2022-05-21 03:49:16,985 DEBUG awx.main.dispatch delivered 44552f4e-02cd-433c-9997-b037ff014565 to worker[178] qsize 0 2022-05-21 03:49:16,988 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:48:46.832533+00:00 2022-05-21 03:49:16,987 DEBUG awx.main.dispatch task 44552f4e-02cd-433c-9997-b037ff014565 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:49:16,990 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:49:17,007 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:49:17,042 DEBUG awx.main.dispatch task 44552f4e-02cd-433c-9997-b037ff014565 is finished 2022-05-21 03:49:17,439 DEBUG awx.main.dispatch task f5a6c651-3ae0-4cf4-9048-f65f3230fa5b is finished 2022-05-21 03:49:17,718 DEBUG awx.main.dispatch task 596c477f-4c4f-4ee1-9afd-95e818392bc2 is finished 2022-05-21 03:49:36,981 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(21bcfab9-56cc-431e-82d9-2ab15ceb1330, queue=awx_private_queue) [2022-05-21 03:49:36,981: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(21bcfab9-56cc-431e-82d9-2ab15ceb1330, queue=awx_private_queue) 2022-05-21 03:49:46,955 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(84f696cc-124e-414a-a66f-38e0fda127e3, queue=awx_private_queue) [2022-05-21 03:49:46,955: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(84f696cc-124e-414a-a66f-38e0fda127e3, queue=awx_private_queue) 2022-05-21 03:49:50,284 DEBUG awx.main.dispatch delivered 21bcfab9-56cc-431e-82d9-2ab15ceb1330 to worker[177] qsize 0 2022-05-21 03:49:50,479 DEBUG awx.main.dispatch delivered 84f696cc-124e-414a-a66f-38e0fda127e3 to worker[192] qsize 0 2022-05-21 03:49:50,479 DEBUG awx.main.dispatch task 21bcfab9-56cc-431e-82d9-2ab15ceb1330 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:49:50,481 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:49:50,481 DEBUG awx.main.dispatch task 84f696cc-124e-414a-a66f-38e0fda127e3 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:49:50,493 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:49:50,496 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:49:16.984763+00:00 2022-05-21 03:49:50,501 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:49:50,543 DEBUG awx.main.dispatch task 21bcfab9-56cc-431e-82d9-2ab15ceb1330 is finished 2022-05-21 03:49:51,110 DEBUG awx.main.dispatch task 84f696cc-124e-414a-a66f-38e0fda127e3 is finished 2022-05-21 03:49:56,982 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(caf6d079-4a64-40af-ab44-eae10c029d52, queue=awx_private_queue) [2022-05-21 03:49:56,982: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(caf6d079-4a64-40af-ab44-eae10c029d52, queue=awx_private_queue) 2022-05-21 03:49:57,005 DEBUG awx.main.dispatch delivered caf6d079-4a64-40af-ab44-eae10c029d52 to worker[192] qsize 0 2022-05-21 03:49:57,007 DEBUG awx.main.dispatch task caf6d079-4a64-40af-ab44-eae10c029d52 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:49:57,009 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:49:57,045 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:49:57,088 DEBUG awx.main.dispatch task caf6d079-4a64-40af-ab44-eae10c029d52 is finished RESULT 2 OKREADY 2022-05-21 03:50:16,923 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(20f2a8ff-275f-4736-b426-4557aeadb4dd, queue=onap-awx-0) [2022-05-21 03:50:16,923: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(20f2a8ff-275f-4736-b426-4557aeadb4dd, queue=onap-awx-0) 2022-05-21 03:50:16,946 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(43f700d1-a47d-475b-a877-3e42ee09c5c0, queue=onap-awx-0) [2022-05-21 03:50:16,946: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(43f700d1-a47d-475b-a877-3e42ee09c5c0, queue=onap-awx-0) 2022-05-21 03:50:16,959 DEBUG awx.main.dispatch delivered 20f2a8ff-275f-4736-b426-4557aeadb4dd to worker[177] qsize 0 2022-05-21 03:50:16,962 DEBUG awx.main.dispatch task 20f2a8ff-275f-4736-b426-4557aeadb4dd starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:50:16,966 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:50:16,965 DEBUG awx.main.dispatch delivered 43f700d1-a47d-475b-a877-3e42ee09c5c0 to worker[181] qsize 0 2022-05-21 03:50:16,968 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(4df112cc-2cf5-42dc-8be3-bc99db7fc726, queue=awx_private_queue) [2022-05-21 03:50:16,968: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(4df112cc-2cf5-42dc-8be3-bc99db7fc726, queue=awx_private_queue) 2022-05-21 03:50:16,969 DEBUG awx.main.dispatch task 43f700d1-a47d-475b-a877-3e42ee09c5c0 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:50:16,986 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(719d4068-7688-40ed-bfee-21a193a218c3, queue=awx_private_queue) [2022-05-21 03:50:16,986: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(719d4068-7688-40ed-bfee-21a193a218c3, queue=awx_private_queue) 2022-05-21 03:50:16,986 DEBUG awx.main.dispatch task 43f700d1-a47d-475b-a877-3e42ee09c5c0 is finished 2022-05-21 03:50:17,324 DEBUG awx.main.dispatch task 20f2a8ff-275f-4736-b426-4557aeadb4dd is finished 2022-05-21 03:50:36,987 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f908f420-0614-4db1-8f07-e3e6ab7c37d3, queue=awx_private_queue) [2022-05-21 03:50:36,987: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f908f420-0614-4db1-8f07-e3e6ab7c37d3, queue=awx_private_queue) 2022-05-21 03:50:46,967 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(e0d2b123-f0d7-4e54-b8ad-d5dda71ed104, queue=awx_private_queue) [2022-05-21 03:50:46,967: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(e0d2b123-f0d7-4e54-b8ad-d5dda71ed104, queue=awx_private_queue) RESULT 2 2022-05-21 03:50:56,988 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6e6ebdc5-8f7e-43ee-9df5-eae1118ff512, queue=awx_private_queue) [2022-05-21 03:50:56,988: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6e6ebdc5-8f7e-43ee-9df5-eae1118ff512, queue=awx_private_queue) OKREADY 2022-05-21 03:51:07,184 DEBUG awx.main.dispatch delivered 4df112cc-2cf5-42dc-8be3-bc99db7fc726 to worker[192] qsize 0 2022-05-21 03:51:07,382 DEBUG awx.main.dispatch delivered 719d4068-7688-40ed-bfee-21a193a218c3 to worker[178] qsize 0 2022-05-21 03:51:07,383 DEBUG awx.main.dispatch delivered f908f420-0614-4db1-8f07-e3e6ab7c37d3 to worker[181] qsize 0 2022-05-21 03:51:07,385 DEBUG awx.main.dispatch delivered e0d2b123-f0d7-4e54-b8ad-d5dda71ed104 to worker[177] qsize 0 2022-05-21 03:51:07,385 DEBUG awx.main.dispatch task f908f420-0614-4db1-8f07-e3e6ab7c37d3 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:51:07,388 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:51:07,382 DEBUG awx.main.dispatch task 4df112cc-2cf5-42dc-8be3-bc99db7fc726 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:51:07,384 DEBUG awx.main.dispatch task 719d4068-7688-40ed-bfee-21a193a218c3 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:51:07,389 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:51:07,387 DEBUG awx.main.dispatch task e0d2b123-f0d7-4e54-b8ad-d5dda71ed104 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:51:07,392 WARNING awx.main.dispatch scaling up worker pid:195 2022-05-21 03:51:07,398 DEBUG awx.main.dispatch delivered 6e6ebdc5-8f7e-43ee-9df5-eae1118ff512 to worker[195] qsize 0 2022-05-21 03:51:07,402 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:51:07,403 DEBUG awx.main.tasks Not running periodic scheduler, another task holds lock 2022-05-21 03:51:07,403 DEBUG awx.main.dispatch task 4df112cc-2cf5-42dc-8be3-bc99db7fc726 is finished 2022-05-21 03:51:07,405 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:49:50.493356+00:00 2022-05-21 03:51:07,404 DEBUG awx.main.dispatch task 6e6ebdc5-8f7e-43ee-9df5-eae1118ff512 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:51:07,407 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:51:07,409 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:51:07,411 DEBUG awx.main.scheduler Not running scheduler, another task holds lock 2022-05-21 03:51:07,412 DEBUG awx.main.dispatch task 719d4068-7688-40ed-bfee-21a193a218c3 is finished 2022-05-21 03:51:07,432 DEBUG awx.main.scheduler Not running scheduler, another task holds lock 2022-05-21 03:51:07,432 DEBUG awx.main.dispatch task 6e6ebdc5-8f7e-43ee-9df5-eae1118ff512 is finished 2022-05-21 03:51:07,449 DEBUG awx.main.dispatch task f908f420-0614-4db1-8f07-e3e6ab7c37d3 is finished 2022-05-21 03:51:08,086 DEBUG awx.main.dispatch task e0d2b123-f0d7-4e54-b8ad-d5dda71ed104 is finished 2022-05-21 03:51:16,934 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(0037955b-7193-4921-ac89-7b9a4db83e31, queue=onap-awx-0) [2022-05-21 03:51:16,934: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(0037955b-7193-4921-ac89-7b9a4db83e31, queue=onap-awx-0) 2022-05-21 03:51:16,954 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(ae5d3833-3f55-4edf-ba1c-a58d56cb290e, queue=onap-awx-0) [2022-05-21 03:51:16,954: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(ae5d3833-3f55-4edf-ba1c-a58d56cb290e, queue=onap-awx-0) 2022-05-21 03:51:16,954 WARNING awx.main.dispatch scaling down worker pid:177 2022-05-21 03:51:16,956 WARNING awx.main.dispatch worker exiting gracefully pid:177 2022-05-21 03:51:16,972 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(6d222ffb-14e7-4efd-92c7-c2bc557aa772, queue=awx_private_queue) [2022-05-21 03:51:16,972: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(6d222ffb-14e7-4efd-92c7-c2bc557aa772, queue=awx_private_queue) 2022-05-21 03:51:16,989 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f3d25dd5-1c39-4916-94cc-bee6f73445c9, queue=awx_private_queue) [2022-05-21 03:51:16,989: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f3d25dd5-1c39-4916-94cc-bee6f73445c9, queue=awx_private_queue) 2022-05-21 03:51:16,990 DEBUG awx.main.dispatch delivered 0037955b-7193-4921-ac89-7b9a4db83e31 to worker[181] qsize 0 2022-05-21 03:51:16,992 DEBUG awx.main.dispatch delivered ae5d3833-3f55-4edf-ba1c-a58d56cb290e to worker[192] qsize 0 2022-05-21 03:51:16,992 DEBUG awx.main.dispatch task 0037955b-7193-4921-ac89-7b9a4db83e31 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:51:16,994 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:51:16,994 DEBUG awx.main.dispatch delivered 6d222ffb-14e7-4efd-92c7-c2bc557aa772 to worker[195] qsize 0 2022-05-21 03:51:16,996 DEBUG awx.main.dispatch task 6d222ffb-14e7-4efd-92c7-c2bc557aa772 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:51:16,997 DEBUG awx.main.dispatch task ae5d3833-3f55-4edf-ba1c-a58d56cb290e starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:51:17,005 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:51:17,006 DEBUG awx.main.dispatch delivered f3d25dd5-1c39-4916-94cc-bee6f73445c9 to worker[178] qsize 0 2022-05-21 03:51:17,009 DEBUG awx.main.dispatch task f3d25dd5-1c39-4916-94cc-bee6f73445c9 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:51:17,010 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:51:17,008 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:51:07.402605+00:00 2022-05-21 03:51:17,011 DEBUG awx.main.dispatch task ae5d3833-3f55-4edf-ba1c-a58d56cb290e is finished 2022-05-21 03:51:17,029 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:51:17,073 DEBUG awx.main.dispatch task f3d25dd5-1c39-4916-94cc-bee6f73445c9 is finished 2022-05-21 03:51:17,496 DEBUG awx.main.dispatch task 0037955b-7193-4921-ac89-7b9a4db83e31 is finished 2022-05-21 03:51:17,729 DEBUG awx.main.dispatch task 6d222ffb-14e7-4efd-92c7-c2bc557aa772 is finished 2022-05-21 03:51:36,999 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(15e2e7dc-d63f-40e5-a122-0ae40bc8c90c, queue=awx_private_queue) RESULT 2 OKREADY [2022-05-21 03:51:36,999: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(15e2e7dc-d63f-40e5-a122-0ae40bc8c90c, queue=awx_private_queue) 2022-05-21 03:51:46,972 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(ee66aa97-14ff-4fbe-b597-aef283122457, queue=awx_private_queue) [2022-05-21 03:51:46,972: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(ee66aa97-14ff-4fbe-b597-aef283122457, queue=awx_private_queue) 2022-05-21 03:51:57,000 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(687fc244-8820-4315-9fb1-af300604ed20, queue=awx_private_queue) [2022-05-21 03:51:57,000: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(687fc244-8820-4315-9fb1-af300604ed20, queue=awx_private_queue) 2022-05-21 03:52:06,503 DEBUG awx.main.dispatch delivered 15e2e7dc-d63f-40e5-a122-0ae40bc8c90c to worker[192] qsize 0 2022-05-21 03:52:06,506 DEBUG awx.main.dispatch delivered ee66aa97-14ff-4fbe-b597-aef283122457 to worker[178] qsize 0 2022-05-21 03:52:06,506 DEBUG awx.main.dispatch task 15e2e7dc-d63f-40e5-a122-0ae40bc8c90c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:52:06,508 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:52:06,508 DEBUG awx.main.dispatch delivered 687fc244-8820-4315-9fb1-af300604ed20 to worker[195] qsize 0 2022-05-21 03:52:06,510 DEBUG awx.main.dispatch task ee66aa97-14ff-4fbe-b597-aef283122457 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:52:06,510 DEBUG awx.main.dispatch task 687fc244-8820-4315-9fb1-af300604ed20 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:52:06,514 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:52:06,522 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:52:06,525 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:51:17.006008+00:00 2022-05-21 03:52:06,532 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:52:06,533 DEBUG awx.main.scheduler Not running scheduler, another task holds lock 2022-05-21 03:52:06,534 DEBUG awx.main.dispatch task 15e2e7dc-d63f-40e5-a122-0ae40bc8c90c is finished 2022-05-21 03:52:06,590 DEBUG awx.main.dispatch task 687fc244-8820-4315-9fb1-af300604ed20 is finished 2022-05-21 03:52:07,031 DEBUG awx.main.dispatch task ee66aa97-14ff-4fbe-b597-aef283122457 is finished 2022-05-21 03:52:17,090 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(e9f8e808-4544-40c6-b4f2-590d1558afb9, queue=onap-awx-0) [2022-05-21 03:52:17,090: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(e9f8e808-4544-40c6-b4f2-590d1558afb9, queue=onap-awx-0) 2022-05-21 03:52:17,297 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(a43a2f29-4042-4271-82fd-ded4b92a779c, queue=onap-awx-0) [2022-05-21 03:52:17,297: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(a43a2f29-4042-4271-82fd-ded4b92a779c, queue=onap-awx-0) 2022-05-21 03:52:17,313 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(3186b454-9042-4f16-9e23-e7b88a82c9c6, queue=awx_private_queue) [2022-05-21 03:52:17,313: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(3186b454-9042-4f16-9e23-e7b88a82c9c6, queue=awx_private_queue) 2022-05-21 03:52:17,315 DEBUG awx.main.dispatch delivered e9f8e808-4544-40c6-b4f2-590d1558afb9 to worker[195] qsize 0 2022-05-21 03:52:17,320 DEBUG awx.main.dispatch delivered a43a2f29-4042-4271-82fd-ded4b92a779c to worker[178] qsize 0 2022-05-21 03:52:17,321 DEBUG awx.main.dispatch task a43a2f29-4042-4271-82fd-ded4b92a779c starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:52:17,320 DEBUG awx.main.dispatch task e9f8e808-4544-40c6-b4f2-590d1558afb9 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:52:17,324 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:52:17,329 DEBUG awx.main.dispatch delivered 3186b454-9042-4f16-9e23-e7b88a82c9c6 to worker[192] qsize 0 2022-05-21 03:52:17,330 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6f4b2e0a-6c3e-446a-b342-e00d47b65359, queue=awx_private_queue) [2022-05-21 03:52:17,330: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6f4b2e0a-6c3e-446a-b342-e00d47b65359, queue=awx_private_queue) 2022-05-21 03:52:17,331 DEBUG awx.main.dispatch task 3186b454-9042-4f16-9e23-e7b88a82c9c6 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:52:17,338 DEBUG awx.main.dispatch task a43a2f29-4042-4271-82fd-ded4b92a779c is finished 2022-05-21 03:52:17,343 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:52:17,346 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:52:06.522678+00:00 2022-05-21 03:52:17,347 DEBUG awx.main.dispatch delivered 6f4b2e0a-6c3e-446a-b342-e00d47b65359 to worker[178] qsize 0 2022-05-21 03:52:17,349 DEBUG awx.main.dispatch task 6f4b2e0a-6c3e-446a-b342-e00d47b65359 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:52:17,351 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:52:17,366 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:52:17,405 DEBUG awx.main.dispatch task 6f4b2e0a-6c3e-446a-b342-e00d47b65359 is finished 2022-05-21 03:52:17,923 DEBUG awx.main.dispatch task e9f8e808-4544-40c6-b4f2-590d1558afb9 is finished 2022-05-21 03:52:17,938 DEBUG awx.main.dispatch task 3186b454-9042-4f16-9e23-e7b88a82c9c6 is finished 2022-05-21 03:52:37,340 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a9c4350d-2836-407a-a640-672f40bae035, queue=awx_private_queue) [2022-05-21 03:52:37,340: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a9c4350d-2836-407a-a640-672f40bae035, queue=awx_private_queue) 2022-05-21 03:52:37,360 DEBUG awx.main.dispatch delivered a9c4350d-2836-407a-a640-672f40bae035 to worker[178] qsize 0 2022-05-21 03:52:37,364 DEBUG awx.main.dispatch task a9c4350d-2836-407a-a640-672f40bae035 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:52:37,365 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:52:37,387 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:52:37,426 DEBUG awx.main.dispatch task a9c4350d-2836-407a-a640-672f40bae035 is finished 2022-05-21 03:52:47,314 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(0b9cdbed-9007-449c-bdcf-9f08943bd809, queue=awx_private_queue) [2022-05-21 03:52:47,314: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(0b9cdbed-9007-449c-bdcf-9f08943bd809, queue=awx_private_queue) 2022-05-21 03:52:47,333 DEBUG awx.main.dispatch delivered 0b9cdbed-9007-449c-bdcf-9f08943bd809 to worker[192] qsize 0 2022-05-21 03:52:47,336 DEBUG awx.main.dispatch task 0b9cdbed-9007-449c-bdcf-9f08943bd809 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:52:47,348 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:52:47,352 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:52:17.343728+00:00 2022-05-21 03:52:47,771 DEBUG awx.main.dispatch task 0b9cdbed-9007-449c-bdcf-9f08943bd809 is finished 2022-05-21 03:52:57,341 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(300c487c-3ffb-478d-b481-3a4811d906f6, queue=awx_private_queue) [2022-05-21 03:52:57,341: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(300c487c-3ffb-478d-b481-3a4811d906f6, queue=awx_private_queue) 2022-05-21 03:52:57,366 DEBUG awx.main.dispatch delivered 300c487c-3ffb-478d-b481-3a4811d906f6 to worker[192] qsize 0 2022-05-21 03:52:57,370 DEBUG awx.main.dispatch task 300c487c-3ffb-478d-b481-3a4811d906f6 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:52:57,372 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:52:57,396 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:52:57,433 DEBUG awx.main.dispatch task 300c487c-3ffb-478d-b481-3a4811d906f6 is finished RESULT 2 OKREADY 2022-05-21 03:53:17,101 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(48101ad8-3f0e-4cf1-aba2-b9f14c75d710, queue=onap-awx-0) [2022-05-21 03:53:17,101: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(48101ad8-3f0e-4cf1-aba2-b9f14c75d710, queue=onap-awx-0) 2022-05-21 03:53:17,306 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(1f491438-66f3-49e7-a12f-1c2ddae65c57, queue=onap-awx-0) [2022-05-21 03:53:17,306: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(1f491438-66f3-49e7-a12f-1c2ddae65c57, queue=onap-awx-0) 2022-05-21 03:53:17,320 DEBUG awx.main.dispatch delivered 48101ad8-3f0e-4cf1-aba2-b9f14c75d710 to worker[192] qsize 0 2022-05-21 03:53:17,323 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(f523390d-f8c2-4020-84c2-90056ddcd1d0, queue=awx_private_queue) [2022-05-21 03:53:17,323: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(f523390d-f8c2-4020-84c2-90056ddcd1d0, queue=awx_private_queue) 2022-05-21 03:53:17,323 DEBUG awx.main.dispatch delivered 1f491438-66f3-49e7-a12f-1c2ddae65c57 to worker[195] qsize 0 2022-05-21 03:53:17,323 DEBUG awx.main.dispatch task 48101ad8-3f0e-4cf1-aba2-b9f14c75d710 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:53:17,325 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:53:17,325 DEBUG awx.main.dispatch task 1f491438-66f3-49e7-a12f-1c2ddae65c57 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:53:17,338 DEBUG awx.main.dispatch delivered f523390d-f8c2-4020-84c2-90056ddcd1d0 to worker[178] qsize 0 2022-05-21 03:53:17,340 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(42fbdf67-68d2-4dc5-954e-74ca54d41cad, queue=awx_private_queue) [2022-05-21 03:53:17,340: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(42fbdf67-68d2-4dc5-954e-74ca54d41cad, queue=awx_private_queue) 2022-05-21 03:53:17,342 DEBUG awx.main.dispatch task 1f491438-66f3-49e7-a12f-1c2ddae65c57 is finished 2022-05-21 03:53:17,341 DEBUG awx.main.dispatch task f523390d-f8c2-4020-84c2-90056ddcd1d0 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:53:17,353 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:53:17,357 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:52:47.349056+00:00 2022-05-21 03:53:17,362 DEBUG awx.main.dispatch delivered 42fbdf67-68d2-4dc5-954e-74ca54d41cad to worker[195] qsize 0 2022-05-21 03:53:17,365 DEBUG awx.main.dispatch task 42fbdf67-68d2-4dc5-954e-74ca54d41cad starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:53:17,367 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:53:17,384 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:53:17,418 DEBUG awx.main.dispatch task 48101ad8-3f0e-4cf1-aba2-b9f14c75d710 is finished 2022-05-21 03:53:17,425 DEBUG awx.main.dispatch task 42fbdf67-68d2-4dc5-954e-74ca54d41cad is finished 2022-05-21 03:53:17,439 DEBUG awx.main.dispatch task f523390d-f8c2-4020-84c2-90056ddcd1d0 is finished 2022-05-21 03:53:37,353 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(1aeb4690-c031-416e-9be3-8ca93d89f551, queue=awx_private_queue) [2022-05-21 03:53:37,353: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(1aeb4690-c031-416e-9be3-8ca93d89f551, queue=awx_private_queue) 2022-05-21 03:53:37,383 DEBUG awx.main.dispatch delivered 1aeb4690-c031-416e-9be3-8ca93d89f551 to worker[195] qsize 0 2022-05-21 03:53:37,387 DEBUG awx.main.dispatch task 1aeb4690-c031-416e-9be3-8ca93d89f551 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:53:37,388 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:53:37,414 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:53:37,457 DEBUG awx.main.dispatch task 1aeb4690-c031-416e-9be3-8ca93d89f551 is finished 2022-05-21 03:53:47,324 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(672f702d-f283-440c-927d-ec42fce246b1, queue=awx_private_queue) [2022-05-21 03:53:47,324: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(672f702d-f283-440c-927d-ec42fce246b1, queue=awx_private_queue) 2022-05-21 03:53:47,343 DEBUG awx.main.dispatch delivered 672f702d-f283-440c-927d-ec42fce246b1 to worker[195] qsize 0 2022-05-21 03:53:47,345 DEBUG awx.main.dispatch task 672f702d-f283-440c-927d-ec42fce246b1 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:53:47,358 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:53:47,362 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:53:17.353718+00:00 2022-05-21 03:53:48,448 DEBUG awx.main.dispatch task 672f702d-f283-440c-927d-ec42fce246b1 is finished 2022-05-21 03:53:57,352 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(55ff835a-7d03-4f6e-9345-b779b00246c0, queue=awx_private_queue) [2022-05-21 03:53:57,352: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(55ff835a-7d03-4f6e-9345-b779b00246c0, queue=awx_private_queue) 2022-05-21 03:53:57,368 DEBUG awx.main.dispatch delivered 55ff835a-7d03-4f6e-9345-b779b00246c0 to worker[181] qsize 0 2022-05-21 03:53:57,372 DEBUG awx.main.dispatch task 55ff835a-7d03-4f6e-9345-b779b00246c0 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:53:57,375 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:53:57,397 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:53:57,435 DEBUG awx.main.dispatch task 55ff835a-7d03-4f6e-9345-b779b00246c0 is finished RESULT 2 OKREADY 2022-05-21 03:54:15,014 DEBUG awx.main.dispatch publish awx.main.tasks.awx_isolated_heartbeat(804cb047-752a-4778-8bd1-029b3a3ffd53, queue=onap-awx-0) [2022-05-21 03:54:15,014: DEBUG/Process-1] publish awx.main.tasks.awx_isolated_heartbeat(804cb047-752a-4778-8bd1-029b3a3ffd53, queue=onap-awx-0) 2022-05-21 03:54:15,032 DEBUG awx.main.dispatch delivered 804cb047-752a-4778-8bd1-029b3a3ffd53 to worker[195] qsize 0 2022-05-21 03:54:15,036 DEBUG awx.main.dispatch task 804cb047-752a-4778-8bd1-029b3a3ffd53 starting awx.main.tasks.awx_isolated_heartbeat(*[]) 2022-05-21 03:54:15,038 DEBUG awx.main.tasks Controlling node checking for any isolated management tasks. 2022-05-21 03:54:15,063 DEBUG awx.main.dispatch task 804cb047-752a-4778-8bd1-029b3a3ffd53 is finished 2022-05-21 03:54:17,101 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(abfd013a-1350-407b-a6fb-bc6d8e23c8b1, queue=onap-awx-0) [2022-05-21 03:54:17,101: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(abfd013a-1350-407b-a6fb-bc6d8e23c8b1, queue=onap-awx-0) 2022-05-21 03:54:17,148 DEBUG awx.main.dispatch delivered abfd013a-1350-407b-a6fb-bc6d8e23c8b1 to worker[195] qsize 0 2022-05-21 03:54:17,150 DEBUG awx.main.dispatch task abfd013a-1350-407b-a6fb-bc6d8e23c8b1 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:54:17,152 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:54:17,307 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(07c4fbe3-f861-459e-bf46-6ebab9f9bff1, queue=onap-awx-0) [2022-05-21 03:54:17,307: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(07c4fbe3-f861-459e-bf46-6ebab9f9bff1, queue=onap-awx-0) 2022-05-21 03:54:17,508 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(1ceb93e9-685b-4b6e-9015-44ab57eefff6, queue=awx_private_queue) [2022-05-21 03:54:17,508: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(1ceb93e9-685b-4b6e-9015-44ab57eefff6, queue=awx_private_queue) 2022-05-21 03:54:17,528 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ba4e6bb6-6b1f-44a3-be4c-a8fc1e8f22a3, queue=awx_private_queue) 2022-05-21 03:54:17,526 DEBUG awx.main.dispatch delivered 1ceb93e9-685b-4b6e-9015-44ab57eefff6 to worker[181] qsize 0 [2022-05-21 03:54:17,528: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ba4e6bb6-6b1f-44a3-be4c-a8fc1e8f22a3, queue=awx_private_queue) 2022-05-21 03:54:17,531 DEBUG awx.main.dispatch task 1ceb93e9-685b-4b6e-9015-44ab57eefff6 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:54:17,544 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:54:17,548 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:53:47.359091+00:00 2022-05-21 03:54:17,571 DEBUG awx.main.dispatch delivered ba4e6bb6-6b1f-44a3-be4c-a8fc1e8f22a3 to worker[192] qsize 0 2022-05-21 03:54:17,573 DEBUG awx.main.dispatch task ba4e6bb6-6b1f-44a3-be4c-a8fc1e8f22a3 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:54:17,576 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:54:17,598 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:54:17,637 DEBUG awx.main.dispatch task ba4e6bb6-6b1f-44a3-be4c-a8fc1e8f22a3 is finished 2022-05-21 03:54:17,784 DEBUG awx.main.dispatch delivered 07c4fbe3-f861-459e-bf46-6ebab9f9bff1 to worker[192] qsize 0 2022-05-21 03:54:17,787 DEBUG awx.main.dispatch task 07c4fbe3-f861-459e-bf46-6ebab9f9bff1 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:54:17,804 DEBUG awx.main.dispatch task 07c4fbe3-f861-459e-bf46-6ebab9f9bff1 is finished 2022-05-21 03:54:17,852 DEBUG awx.main.dispatch task abfd013a-1350-407b-a6fb-bc6d8e23c8b1 is finished 2022-05-21 03:54:17,891 DEBUG awx.main.dispatch task 1ceb93e9-685b-4b6e-9015-44ab57eefff6 is finished 2022-05-21 03:54:37,531 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6d559bbd-be46-4c6c-9fe2-655d31f7eef8, queue=awx_private_queue) [2022-05-21 03:54:37,531: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6d559bbd-be46-4c6c-9fe2-655d31f7eef8, queue=awx_private_queue) 2022-05-21 03:54:37,553 DEBUG awx.main.dispatch delivered 6d559bbd-be46-4c6c-9fe2-655d31f7eef8 to worker[178] qsize 0 2022-05-21 03:54:37,555 DEBUG awx.main.dispatch task 6d559bbd-be46-4c6c-9fe2-655d31f7eef8 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:54:37,557 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:54:37,579 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:54:37,622 DEBUG awx.main.dispatch task 6d559bbd-be46-4c6c-9fe2-655d31f7eef8 is finished 2022-05-21 03:54:47,508 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(c3d52b55-4529-4903-81c0-c3d80f3400eb, queue=awx_private_queue) [2022-05-21 03:54:47,508: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(c3d52b55-4529-4903-81c0-c3d80f3400eb, queue=awx_private_queue) 2022-05-21 03:54:47,526 DEBUG awx.main.dispatch delivered c3d52b55-4529-4903-81c0-c3d80f3400eb to worker[178] qsize 0 2022-05-21 03:54:47,528 DEBUG awx.main.dispatch task c3d52b55-4529-4903-81c0-c3d80f3400eb starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:54:47,543 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:54:47,548 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:54:17.544772+00:00 2022-05-21 03:54:48,411 DEBUG awx.main.dispatch task c3d52b55-4529-4903-81c0-c3d80f3400eb is finished 2022-05-21 03:54:57,532 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ab207847-7e00-4a15-bd96-d7e95bdd591c, queue=awx_private_queue) [2022-05-21 03:54:57,532: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ab207847-7e00-4a15-bd96-d7e95bdd591c, queue=awx_private_queue) 2022-05-21 03:54:57,574 DEBUG awx.main.dispatch delivered ab207847-7e00-4a15-bd96-d7e95bdd591c to worker[192] qsize 0 2022-05-21 03:54:57,577 DEBUG awx.main.dispatch task ab207847-7e00-4a15-bd96-d7e95bdd591c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:54:57,578 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:54:57,600 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:54:57,638 DEBUG awx.main.dispatch task ab207847-7e00-4a15-bd96-d7e95bdd591c is finished RESULT 2 OKREADY 2022-05-21 03:55:17,226 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(00d5bc59-e933-4b7c-a574-9dc29863cb4a, queue=onap-awx-0) [2022-05-21 03:55:17,226: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(00d5bc59-e933-4b7c-a574-9dc29863cb4a, queue=onap-awx-0) 2022-05-21 03:55:17,277 DEBUG awx.main.dispatch delivered 00d5bc59-e933-4b7c-a574-9dc29863cb4a to worker[178] qsize 0 2022-05-21 03:55:17,279 DEBUG awx.main.dispatch task 00d5bc59-e933-4b7c-a574-9dc29863cb4a starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:55:17,280 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:55:17,306 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(87a42083-ed1d-4bd6-9677-da1b96a844ef, queue=onap-awx-0) [2022-05-21 03:55:17,306: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(87a42083-ed1d-4bd6-9677-da1b96a844ef, queue=onap-awx-0) 2022-05-21 03:55:17,322 DEBUG awx.main.dispatch delivered 87a42083-ed1d-4bd6-9677-da1b96a844ef to worker[181] qsize 0 2022-05-21 03:55:17,325 DEBUG awx.main.dispatch task 87a42083-ed1d-4bd6-9677-da1b96a844ef starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:55:17,532 DEBUG awx.main.dispatch task 87a42083-ed1d-4bd6-9677-da1b96a844ef is finished 2022-05-21 03:55:17,631 DEBUG awx.main.dispatch task 00d5bc59-e933-4b7c-a574-9dc29863cb4a is finished 2022-05-21 03:55:17,508 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(5e5eabe7-d7de-4a30-bfbf-fe6432edff4f, queue=awx_private_queue) [2022-05-21 03:55:17,508: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(5e5eabe7-d7de-4a30-bfbf-fe6432edff4f, queue=awx_private_queue) 2022-05-21 03:55:17,744 DEBUG awx.main.dispatch delivered 5e5eabe7-d7de-4a30-bfbf-fe6432edff4f to worker[181] qsize 0 2022-05-21 03:55:17,746 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a52941b3-0b43-484d-a2db-b387e0aa2342, queue=awx_private_queue) [2022-05-21 03:55:17,746: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a52941b3-0b43-484d-a2db-b387e0aa2342, queue=awx_private_queue) 2022-05-21 03:55:17,748 DEBUG awx.main.dispatch task 5e5eabe7-d7de-4a30-bfbf-fe6432edff4f starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:55:17,760 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:55:17,762 DEBUG awx.main.dispatch delivered a52941b3-0b43-484d-a2db-b387e0aa2342 to worker[195] qsize 0 2022-05-21 03:55:17,764 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:54:47.543401+00:00 2022-05-21 03:55:17,765 DEBUG awx.main.dispatch task a52941b3-0b43-484d-a2db-b387e0aa2342 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:55:17,766 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:55:17,790 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:55:17,830 DEBUG awx.main.dispatch task a52941b3-0b43-484d-a2db-b387e0aa2342 is finished 2022-05-21 03:55:18,182 DEBUG awx.main.dispatch task 5e5eabe7-d7de-4a30-bfbf-fe6432edff4f is finished 2022-05-21 03:55:37,756 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b8c2e5b9-0537-4796-ba3c-ad05497d7804, queue=awx_private_queue) [2022-05-21 03:55:37,756: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b8c2e5b9-0537-4796-ba3c-ad05497d7804, queue=awx_private_queue) 2022-05-21 03:55:37,775 DEBUG awx.main.dispatch delivered b8c2e5b9-0537-4796-ba3c-ad05497d7804 to worker[192] qsize 0 2022-05-21 03:55:37,778 DEBUG awx.main.dispatch task b8c2e5b9-0537-4796-ba3c-ad05497d7804 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:55:37,780 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:55:37,801 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:55:37,842 DEBUG awx.main.dispatch task b8c2e5b9-0537-4796-ba3c-ad05497d7804 is finished 2022-05-21 03:55:47,509 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(4a3812eb-eb79-4e2e-96f9-e9197e09cfa2, queue=awx_private_queue) [2022-05-21 03:55:47,509: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(4a3812eb-eb79-4e2e-96f9-e9197e09cfa2, queue=awx_private_queue) 2022-05-21 03:55:47,531 DEBUG awx.main.dispatch delivered 4a3812eb-eb79-4e2e-96f9-e9197e09cfa2 to worker[195] qsize 0 2022-05-21 03:55:47,536 DEBUG awx.main.dispatch task 4a3812eb-eb79-4e2e-96f9-e9197e09cfa2 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:55:47,551 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:55:47,555 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:55:17.760738+00:00 2022-05-21 03:55:48,145 DEBUG awx.main.dispatch task 4a3812eb-eb79-4e2e-96f9-e9197e09cfa2 is finished 2022-05-21 03:55:57,757 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(065954de-8cb8-4245-b8f0-d7e683badc04, queue=awx_private_queue) [2022-05-21 03:55:57,757: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(065954de-8cb8-4245-b8f0-d7e683badc04, queue=awx_private_queue) 2022-05-21 03:55:57,780 DEBUG awx.main.dispatch delivered 065954de-8cb8-4245-b8f0-d7e683badc04 to worker[195] qsize 0 2022-05-21 03:55:57,783 DEBUG awx.main.dispatch task 065954de-8cb8-4245-b8f0-d7e683badc04 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:55:57,785 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:55:57,810 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:55:57,845 DEBUG awx.main.dispatch task 065954de-8cb8-4245-b8f0-d7e683badc04 is finished RESULT 2 OKREADY 2022-05-21 03:56:17,236 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(53618d64-33d7-4535-9434-43b23b084ba9, queue=onap-awx-0) [2022-05-21 03:56:17,236: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(53618d64-33d7-4535-9434-43b23b084ba9, queue=onap-awx-0) 2022-05-21 03:56:17,306 DEBUG awx.main.dispatch delivered 53618d64-33d7-4535-9434-43b23b084ba9 to worker[192] qsize 0 2022-05-21 03:56:17,306 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(a52d6ac4-e455-4cac-b3f1-9596a4075449, queue=onap-awx-0) [2022-05-21 03:56:17,306: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(a52d6ac4-e455-4cac-b3f1-9596a4075449, queue=onap-awx-0) 2022-05-21 03:56:17,308 DEBUG awx.main.dispatch task 53618d64-33d7-4535-9434-43b23b084ba9 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:56:17,310 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:56:17,322 DEBUG awx.main.dispatch delivered a52d6ac4-e455-4cac-b3f1-9596a4075449 to worker[181] qsize 0 2022-05-21 03:56:17,325 DEBUG awx.main.dispatch task a52d6ac4-e455-4cac-b3f1-9596a4075449 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:56:17,541 DEBUG awx.main.dispatch task a52d6ac4-e455-4cac-b3f1-9596a4075449 is finished 2022-05-21 03:56:17,653 DEBUG awx.main.dispatch task 53618d64-33d7-4535-9434-43b23b084ba9 is finished 2022-05-21 03:56:17,508 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(5a8897cd-4d80-4c5b-ad5b-bf6be4ce680d, queue=awx_private_queue) [2022-05-21 03:56:17,508: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(5a8897cd-4d80-4c5b-ad5b-bf6be4ce680d, queue=awx_private_queue) 2022-05-21 03:56:17,738 DEBUG awx.main.dispatch delivered 5a8897cd-4d80-4c5b-ad5b-bf6be4ce680d to worker[178] qsize 0 2022-05-21 03:56:17,741 DEBUG awx.main.dispatch task 5a8897cd-4d80-4c5b-ad5b-bf6be4ce680d starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:56:17,754 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:56:17,757 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(34bd6993-b99d-4c22-bf33-fd4a2da4a533, queue=awx_private_queue) [2022-05-21 03:56:17,757: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(34bd6993-b99d-4c22-bf33-fd4a2da4a533, queue=awx_private_queue) 2022-05-21 03:56:17,758 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:55:47.551984+00:00 2022-05-21 03:56:17,772 DEBUG awx.main.dispatch delivered 34bd6993-b99d-4c22-bf33-fd4a2da4a533 to worker[195] qsize 0 2022-05-21 03:56:17,776 DEBUG awx.main.dispatch task 34bd6993-b99d-4c22-bf33-fd4a2da4a533 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:56:17,777 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:56:17,778 DEBUG awx.main.dispatch task 5a8897cd-4d80-4c5b-ad5b-bf6be4ce680d is finished 2022-05-21 03:56:17,799 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:56:17,838 DEBUG awx.main.dispatch task 34bd6993-b99d-4c22-bf33-fd4a2da4a533 is finished 2022-05-21 03:56:37,768 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(20b6f399-b576-4930-9204-1cfadcbfcc32, queue=awx_private_queue) [2022-05-21 03:56:37,768: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(20b6f399-b576-4930-9204-1cfadcbfcc32, queue=awx_private_queue) 2022-05-21 03:56:37,785 DEBUG awx.main.dispatch delivered 20b6f399-b576-4930-9204-1cfadcbfcc32 to worker[195] qsize 0 2022-05-21 03:56:37,790 DEBUG awx.main.dispatch task 20b6f399-b576-4930-9204-1cfadcbfcc32 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:56:37,792 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:56:37,813 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:56:37,858 DEBUG awx.main.dispatch task 20b6f399-b576-4930-9204-1cfadcbfcc32 is finished 2022-05-21 03:56:47,509 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(60d95cac-006d-4df6-ab1b-ced8c3fa4ac2, queue=awx_private_queue) [2022-05-21 03:56:47,509: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(60d95cac-006d-4df6-ab1b-ced8c3fa4ac2, queue=awx_private_queue) 2022-05-21 03:56:47,526 DEBUG awx.main.dispatch delivered 60d95cac-006d-4df6-ab1b-ced8c3fa4ac2 to worker[178] qsize 0 2022-05-21 03:56:47,528 DEBUG awx.main.dispatch task 60d95cac-006d-4df6-ab1b-ced8c3fa4ac2 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:56:47,540 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:56:47,543 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:56:17.754739+00:00 2022-05-21 03:56:47,936 DEBUG awx.main.dispatch task 60d95cac-006d-4df6-ab1b-ced8c3fa4ac2 is finished 2022-05-21 03:56:57,768 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e58d2abf-9eaf-4ed5-975c-ecc948e4ea87, queue=awx_private_queue) [2022-05-21 03:56:57,768: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e58d2abf-9eaf-4ed5-975c-ecc948e4ea87, queue=awx_private_queue) RESULT 2 OKREADY 2022-05-21 03:57:17,245 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(3003a3d2-3c0e-4d21-af3e-3c6850249e5d, queue=onap-awx-0) [2022-05-21 03:57:17,245: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(3003a3d2-3c0e-4d21-af3e-3c6850249e5d, queue=onap-awx-0) 2022-05-21 03:57:17,292 DEBUG awx.main.dispatch delivered 3003a3d2-3c0e-4d21-af3e-3c6850249e5d to worker[195] qsize 0 2022-05-21 03:57:17,307 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(29849921-a0b7-4876-b069-d57043bb29b8, queue=onap-awx-0) [2022-05-21 03:57:17,307: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(29849921-a0b7-4876-b069-d57043bb29b8, queue=onap-awx-0) 2022-05-21 03:57:17,322 DEBUG awx.main.dispatch delivered 29849921-a0b7-4876-b069-d57043bb29b8 to worker[178] qsize 0 2022-05-21 03:57:17,325 DEBUG awx.main.dispatch task 29849921-a0b7-4876-b069-d57043bb29b8 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:57:17,343 DEBUG awx.main.dispatch task 29849921-a0b7-4876-b069-d57043bb29b8 is finished 2022-05-21 03:57:17,294 DEBUG awx.main.dispatch task 3003a3d2-3c0e-4d21-af3e-3c6850249e5d starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:57:17,512 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:57:17,617 DEBUG awx.main.dispatch task 3003a3d2-3c0e-4d21-af3e-3c6850249e5d is finished 2022-05-21 03:57:17,508 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(f8ccb667-fb99-4fe8-9975-14940c66d75e, queue=awx_private_queue) [2022-05-21 03:57:17,508: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(f8ccb667-fb99-4fe8-9975-14940c66d75e, queue=awx_private_queue) 2022-05-21 03:57:17,768 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(dd196106-2311-4049-87bc-e40a8aff47bc, queue=awx_private_queue) [2022-05-21 03:57:17,768: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(dd196106-2311-4049-87bc-e40a8aff47bc, queue=awx_private_queue) 2022-05-21 03:57:37,778 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5ba617fd-92ea-4a87-bd55-cd0013cdf42d, queue=awx_private_queue) [2022-05-21 03:57:37,778: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5ba617fd-92ea-4a87-bd55-cd0013cdf42d, queue=awx_private_queue) 2022-05-21 03:57:40,192 DEBUG awx.main.dispatch delivered e58d2abf-9eaf-4ed5-975c-ecc948e4ea87 to worker[195] qsize 0 2022-05-21 03:57:40,197 DEBUG awx.main.dispatch delivered f8ccb667-fb99-4fe8-9975-14940c66d75e to worker[192] qsize 0 2022-05-21 03:57:40,198 DEBUG awx.main.dispatch task e58d2abf-9eaf-4ed5-975c-ecc948e4ea87 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:57:40,201 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:57:40,200 DEBUG awx.main.dispatch delivered dd196106-2311-4049-87bc-e40a8aff47bc to worker[181] qsize 0 2022-05-21 03:57:40,203 DEBUG awx.main.dispatch delivered 5ba617fd-92ea-4a87-bd55-cd0013cdf42d to worker[178] qsize 0 2022-05-21 03:57:40,200 DEBUG awx.main.dispatch task f8ccb667-fb99-4fe8-9975-14940c66d75e starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:57:40,205 DEBUG awx.main.dispatch task dd196106-2311-4049-87bc-e40a8aff47bc starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:57:40,208 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:57:40,207 DEBUG awx.main.dispatch task 5ba617fd-92ea-4a87-bd55-cd0013cdf42d starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:57:40,221 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:57:40,222 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:57:40,224 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:56:47.540741+00:00 2022-05-21 03:57:40,226 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:57:40,229 DEBUG awx.main.scheduler Not running scheduler, another task holds lock 2022-05-21 03:57:40,230 DEBUG awx.main.dispatch task dd196106-2311-4049-87bc-e40a8aff47bc is finished 2022-05-21 03:57:40,245 DEBUG awx.main.scheduler Not running scheduler, another task holds lock 2022-05-21 03:57:40,245 DEBUG awx.main.dispatch task 5ba617fd-92ea-4a87-bd55-cd0013cdf42d is finished 2022-05-21 03:57:40,264 DEBUG awx.main.dispatch task e58d2abf-9eaf-4ed5-975c-ecc948e4ea87 is finished 2022-05-21 03:57:41,283 DEBUG awx.main.dispatch task f8ccb667-fb99-4fe8-9975-14940c66d75e is finished 2022-05-21 03:57:47,510 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(5cc8aeb4-0a64-402f-b67c-9a7049eceafb, queue=awx_private_queue) [2022-05-21 03:57:47,510: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(5cc8aeb4-0a64-402f-b67c-9a7049eceafb, queue=awx_private_queue) 2022-05-21 03:57:47,533 DEBUG awx.main.dispatch delivered 5cc8aeb4-0a64-402f-b67c-9a7049eceafb to worker[181] qsize 0 2022-05-21 03:57:47,537 DEBUG awx.main.dispatch task 5cc8aeb4-0a64-402f-b67c-9a7049eceafb starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:57:47,550 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:57:47,553 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:57:40.222603+00:00 2022-05-21 03:57:48,219 DEBUG awx.main.dispatch task 5cc8aeb4-0a64-402f-b67c-9a7049eceafb is finished 2022-05-21 03:57:57,780 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(9111570d-f391-4c91-ad41-0661ba9e6a0c, queue=awx_private_queue) [2022-05-21 03:57:57,780: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(9111570d-f391-4c91-ad41-0661ba9e6a0c, queue=awx_private_queue) RESULT 2 OKREADY 2022-05-21 03:58:17,759 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(b792f29c-e8bc-4fc1-84ff-efd1295eaffe, queue=onap-awx-0) [2022-05-21 03:58:17,759: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(b792f29c-e8bc-4fc1-84ff-efd1295eaffe, queue=onap-awx-0) 2022-05-21 03:58:18,006 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(fa9eaa48-f064-4f9b-84dc-bb0f37864ec5, queue=onap-awx-0) [2022-05-21 03:58:18,006: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(fa9eaa48-f064-4f9b-84dc-bb0f37864ec5, queue=onap-awx-0) 2022-05-21 03:58:18,022 DEBUG awx.main.dispatch delivered b792f29c-e8bc-4fc1-84ff-efd1295eaffe to worker[178] qsize 0 2022-05-21 03:58:18,023 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(29eec48d-fa0a-4664-b7b0-9d1d9eea7b46, queue=awx_private_queue) [2022-05-21 03:58:18,023: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(29eec48d-fa0a-4664-b7b0-9d1d9eea7b46, queue=awx_private_queue) 2022-05-21 03:58:18,024 DEBUG awx.main.dispatch delivered fa9eaa48-f064-4f9b-84dc-bb0f37864ec5 to worker[181] qsize 0 2022-05-21 03:58:18,025 DEBUG awx.main.dispatch task b792f29c-e8bc-4fc1-84ff-efd1295eaffe starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:58:18,027 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:58:18,026 DEBUG awx.main.dispatch task fa9eaa48-f064-4f9b-84dc-bb0f37864ec5 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:58:18,042 DEBUG awx.main.dispatch task fa9eaa48-f064-4f9b-84dc-bb0f37864ec5 is finished 2022-05-21 03:58:18,049 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f02c7f40-7288-48c1-9161-1e4732ce5814, queue=awx_private_queue) [2022-05-21 03:58:18,049: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f02c7f40-7288-48c1-9161-1e4732ce5814, queue=awx_private_queue) 2022-05-21 03:58:18,341 DEBUG awx.main.dispatch task b792f29c-e8bc-4fc1-84ff-efd1295eaffe is finished 2022-05-21 03:58:25,400 DEBUG awx.main.dispatch delivered 9111570d-f391-4c91-ad41-0661ba9e6a0c to worker[178] qsize 0 2022-05-21 03:58:25,403 DEBUG awx.main.dispatch delivered 29eec48d-fa0a-4664-b7b0-9d1d9eea7b46 to worker[195] qsize 0 2022-05-21 03:58:25,404 DEBUG awx.main.dispatch task 9111570d-f391-4c91-ad41-0661ba9e6a0c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:58:25,406 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:58:25,406 DEBUG awx.main.dispatch delivered f02c7f40-7288-48c1-9161-1e4732ce5814 to worker[181] qsize 0 2022-05-21 03:58:25,408 DEBUG awx.main.dispatch task f02c7f40-7288-48c1-9161-1e4732ce5814 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:58:25,410 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:58:25,407 DEBUG awx.main.dispatch task 29eec48d-fa0a-4664-b7b0-9d1d9eea7b46 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:58:25,421 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:58:25,424 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:57:47.550831+00:00 2022-05-21 03:58:25,429 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:58:25,430 DEBUG awx.main.scheduler Not running scheduler, another task holds lock 2022-05-21 03:58:25,430 DEBUG awx.main.dispatch task 9111570d-f391-4c91-ad41-0661ba9e6a0c is finished 2022-05-21 03:58:25,465 DEBUG awx.main.dispatch task f02c7f40-7288-48c1-9161-1e4732ce5814 is finished 2022-05-21 03:58:26,034 DEBUG awx.main.dispatch task 29eec48d-fa0a-4664-b7b0-9d1d9eea7b46 is finished 2022-05-21 03:58:38,054 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(14a4a7fb-8ddf-464e-88be-70559861864d, queue=awx_private_queue) [2022-05-21 03:58:38,054: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(14a4a7fb-8ddf-464e-88be-70559861864d, queue=awx_private_queue) 2022-05-21 03:58:38,071 DEBUG awx.main.dispatch delivered 14a4a7fb-8ddf-464e-88be-70559861864d to worker[192] qsize 0 2022-05-21 03:58:38,073 DEBUG awx.main.dispatch task 14a4a7fb-8ddf-464e-88be-70559861864d starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:58:38,075 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:58:38,098 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:58:38,137 DEBUG awx.main.dispatch task 14a4a7fb-8ddf-464e-88be-70559861864d is finished 2022-05-21 03:58:48,024 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(da79523a-fd22-4441-af96-83ae216a35fa, queue=awx_private_queue) [2022-05-21 03:58:48,024: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(da79523a-fd22-4441-af96-83ae216a35fa, queue=awx_private_queue) 2022-05-21 03:58:58,054 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(746444c5-9e86-491e-861b-0fee7bba939b, queue=awx_private_queue) [2022-05-21 03:58:58,054: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(746444c5-9e86-491e-861b-0fee7bba939b, queue=awx_private_queue) 2022-05-21 03:59:00,524 DEBUG awx.main.dispatch delivered da79523a-fd22-4441-af96-83ae216a35fa to worker[195] qsize 0 RESULT 2 OKREADY 2022-05-21 03:59:00,528 DEBUG awx.main.dispatch delivered 746444c5-9e86-491e-861b-0fee7bba939b to worker[178] qsize 0 2022-05-21 03:59:00,528 DEBUG awx.main.dispatch task da79523a-fd22-4441-af96-83ae216a35fa starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:59:00,530 DEBUG awx.main.dispatch task 746444c5-9e86-491e-861b-0fee7bba939b starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:59:00,532 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:59:00,542 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:59:00,546 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:58:25.422197+00:00 2022-05-21 03:59:00,557 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:59:00,591 DEBUG awx.main.dispatch task 746444c5-9e86-491e-861b-0fee7bba939b is finished 2022-05-21 03:59:01,697 DEBUG awx.main.dispatch task da79523a-fd22-4441-af96-83ae216a35fa is finished 2022-05-21 03:59:17,759 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(1d543a98-9fe0-4602-9931-0afafcab2211, queue=onap-awx-0) [2022-05-21 03:59:17,759: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(1d543a98-9fe0-4602-9931-0afafcab2211, queue=onap-awx-0) 2022-05-21 03:59:17,811 DEBUG awx.main.dispatch delivered 1d543a98-9fe0-4602-9931-0afafcab2211 to worker[181] qsize 0 2022-05-21 03:59:17,814 DEBUG awx.main.dispatch task 1d543a98-9fe0-4602-9931-0afafcab2211 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 03:59:17,816 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 03:59:18,007 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(dd936fa4-4103-4dbf-a250-52c1e4e2b17e, queue=onap-awx-0) [2022-05-21 03:59:18,007: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(dd936fa4-4103-4dbf-a250-52c1e4e2b17e, queue=onap-awx-0) 2022-05-21 03:59:18,026 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(3f6189bb-7750-42da-8dca-75ee45797c78, queue=awx_private_queue) [2022-05-21 03:59:18,026: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(3f6189bb-7750-42da-8dca-75ee45797c78, queue=awx_private_queue) 2022-05-21 03:59:18,042 DEBUG awx.main.dispatch delivered 3f6189bb-7750-42da-8dca-75ee45797c78 to worker[195] qsize 0 2022-05-21 03:59:18,045 DEBUG awx.main.dispatch task 3f6189bb-7750-42da-8dca-75ee45797c78 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:59:18,055 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b39eb05d-2217-484d-9f6a-6ae54deee035, queue=awx_private_queue) [2022-05-21 03:59:18,055: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b39eb05d-2217-484d-9f6a-6ae54deee035, queue=awx_private_queue) 2022-05-21 03:59:18,058 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:59:18,062 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:59:00.543018+00:00 2022-05-21 03:59:18,070 DEBUG awx.main.dispatch delivered b39eb05d-2217-484d-9f6a-6ae54deee035 to worker[178] qsize 0 2022-05-21 03:59:18,074 DEBUG awx.main.dispatch task b39eb05d-2217-484d-9f6a-6ae54deee035 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:59:18,076 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:59:18,099 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:59:18,145 DEBUG awx.main.dispatch task b39eb05d-2217-484d-9f6a-6ae54deee035 is finished 2022-05-21 03:59:18,270 DEBUG awx.main.dispatch task 1d543a98-9fe0-4602-9931-0afafcab2211 is finished 2022-05-21 03:59:18,798 DEBUG awx.main.dispatch task 3f6189bb-7750-42da-8dca-75ee45797c78 is finished 2022-05-21 03:59:19,047 DEBUG awx.main.dispatch delivered dd936fa4-4103-4dbf-a250-52c1e4e2b17e to worker[192] qsize 0 2022-05-21 03:59:19,049 DEBUG awx.main.dispatch task dd936fa4-4103-4dbf-a250-52c1e4e2b17e starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 03:59:19,279 DEBUG awx.main.dispatch task dd936fa4-4103-4dbf-a250-52c1e4e2b17e is finished 2022-05-21 03:59:38,063 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6cea1bb7-805b-4de3-894a-8ff32535af67, queue=awx_private_queue) [2022-05-21 03:59:38,063: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6cea1bb7-805b-4de3-894a-8ff32535af67, queue=awx_private_queue) 2022-05-21 03:59:38,079 DEBUG awx.main.dispatch delivered 6cea1bb7-805b-4de3-894a-8ff32535af67 to worker[192] qsize 0 2022-05-21 03:59:38,081 DEBUG awx.main.dispatch task 6cea1bb7-805b-4de3-894a-8ff32535af67 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:59:38,083 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:59:38,105 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:59:38,148 DEBUG awx.main.dispatch task 6cea1bb7-805b-4de3-894a-8ff32535af67 is finished 2022-05-21 03:59:48,027 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(42611870-9c15-4413-b289-4b89ee160b90, queue=awx_private_queue) [2022-05-21 03:59:48,027: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(42611870-9c15-4413-b289-4b89ee160b90, queue=awx_private_queue) 2022-05-21 03:59:48,047 DEBUG awx.main.dispatch delivered 42611870-9c15-4413-b289-4b89ee160b90 to worker[192] qsize 0 2022-05-21 03:59:48,049 DEBUG awx.main.dispatch task 42611870-9c15-4413-b289-4b89ee160b90 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 03:59:48,063 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 03:59:48,066 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:59:18.058871+00:00 2022-05-21 03:59:48,793 DEBUG awx.main.dispatch task 42611870-9c15-4413-b289-4b89ee160b90 is finished 2022-05-21 03:59:58,063 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(23d57fd5-d60c-4f23-bafb-c5e492884159, queue=awx_private_queue) [2022-05-21 03:59:58,063: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(23d57fd5-d60c-4f23-bafb-c5e492884159, queue=awx_private_queue) 2022-05-21 03:59:58,089 DEBUG awx.main.dispatch delivered 23d57fd5-d60c-4f23-bafb-c5e492884159 to worker[195] qsize 0 2022-05-21 03:59:58,093 DEBUG awx.main.dispatch task 23d57fd5-d60c-4f23-bafb-c5e492884159 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 03:59:58,095 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 03:59:58,117 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 03:59:58,157 DEBUG awx.main.dispatch task 23d57fd5-d60c-4f23-bafb-c5e492884159 is finished RESULT 2 OKREADY 2022-05-21 04:00:17,770 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(b6c80c43-0c89-4309-b35a-e497d9fcb363, queue=onap-awx-0) [2022-05-21 04:00:17,770: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(b6c80c43-0c89-4309-b35a-e497d9fcb363, queue=onap-awx-0) 2022-05-21 04:00:17,807 DEBUG awx.main.dispatch delivered b6c80c43-0c89-4309-b35a-e497d9fcb363 to worker[181] qsize 0 2022-05-21 04:00:17,810 DEBUG awx.main.dispatch task b6c80c43-0c89-4309-b35a-e497d9fcb363 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 04:00:17,812 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 04:00:18,007 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(20eea034-bdfa-4736-bfc1-81d37f829835, queue=onap-awx-0) [2022-05-21 04:00:18,007: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(20eea034-bdfa-4736-bfc1-81d37f829835, queue=onap-awx-0) 2022-05-21 04:00:18,027 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(392c2a80-9fa5-4c46-afff-658666d4d23f, queue=awx_private_queue) [2022-05-21 04:00:18,027: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(392c2a80-9fa5-4c46-afff-658666d4d23f, queue=awx_private_queue) 2022-05-21 04:00:18,044 DEBUG awx.main.dispatch delivered 392c2a80-9fa5-4c46-afff-658666d4d23f to worker[192] qsize 0 2022-05-21 04:00:18,047 DEBUG awx.main.dispatch task 392c2a80-9fa5-4c46-afff-658666d4d23f starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 04:00:18,060 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 04:00:18,063 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 03:59:48.063434+00:00 2022-05-21 04:00:18,063 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(9ef6b640-3a8e-4a21-8a00-5919a48361c0, queue=awx_private_queue) [2022-05-21 04:00:18,063: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(9ef6b640-3a8e-4a21-8a00-5919a48361c0, queue=awx_private_queue) 2022-05-21 04:00:18,080 DEBUG awx.main.dispatch delivered 9ef6b640-3a8e-4a21-8a00-5919a48361c0 to worker[178] qsize 0 2022-05-21 04:00:18,083 DEBUG awx.main.dispatch task 9ef6b640-3a8e-4a21-8a00-5919a48361c0 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:00:18,085 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:00:18,107 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 04:00:18,147 DEBUG awx.main.dispatch task 9ef6b640-3a8e-4a21-8a00-5919a48361c0 is finished 2022-05-21 04:00:18,185 DEBUG awx.main.dispatch delivered 20eea034-bdfa-4736-bfc1-81d37f829835 to worker[178] qsize 0 2022-05-21 04:00:18,187 DEBUG awx.main.dispatch task 20eea034-bdfa-4736-bfc1-81d37f829835 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 04:00:18,202 DEBUG awx.main.dispatch task 20eea034-bdfa-4736-bfc1-81d37f829835 is finished 2022-05-21 04:00:18,325 DEBUG awx.main.dispatch task b6c80c43-0c89-4309-b35a-e497d9fcb363 is finished 2022-05-21 04:00:18,378 DEBUG awx.main.dispatch task 392c2a80-9fa5-4c46-afff-658666d4d23f is finished 2022-05-21 04:00:38,071 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(50abbb28-12df-4772-b4c1-addeaf3d433f, queue=awx_private_queue) [2022-05-21 04:00:38,071: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(50abbb28-12df-4772-b4c1-addeaf3d433f, queue=awx_private_queue) 2022-05-21 04:00:38,108 DEBUG awx.main.dispatch delivered 50abbb28-12df-4772-b4c1-addeaf3d433f to worker[178] qsize 0 2022-05-21 04:00:38,111 DEBUG awx.main.dispatch task 50abbb28-12df-4772-b4c1-addeaf3d433f starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:00:38,113 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:00:38,137 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 04:00:38,181 DEBUG awx.main.dispatch task 50abbb28-12df-4772-b4c1-addeaf3d433f is finished 2022-05-21 04:00:48,028 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(542999db-377d-43ba-8eab-8f964e3e0028, queue=awx_private_queue) [2022-05-21 04:00:48,028: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(542999db-377d-43ba-8eab-8f964e3e0028, queue=awx_private_queue) 2022-05-21 04:00:48,046 DEBUG awx.main.dispatch delivered 542999db-377d-43ba-8eab-8f964e3e0028 to worker[181] qsize 0 2022-05-21 04:00:48,049 DEBUG awx.main.dispatch task 542999db-377d-43ba-8eab-8f964e3e0028 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 04:00:48,062 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 04:00:48,067 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 04:00:18.060453+00:00 2022-05-21 04:00:49,087 DEBUG awx.main.dispatch task 542999db-377d-43ba-8eab-8f964e3e0028 is finished 2022-05-21 04:00:58,071 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(2fc2b246-95c5-4a62-a25f-52b0cb71f7b2, queue=awx_private_queue) [2022-05-21 04:00:58,071: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(2fc2b246-95c5-4a62-a25f-52b0cb71f7b2, queue=awx_private_queue) 2022-05-21 04:00:58,092 DEBUG awx.main.dispatch delivered 2fc2b246-95c5-4a62-a25f-52b0cb71f7b2 to worker[181] qsize 0 2022-05-21 04:00:58,095 DEBUG awx.main.dispatch task 2fc2b246-95c5-4a62-a25f-52b0cb71f7b2 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:00:58,096 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:00:58,119 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 04:00:58,161 DEBUG awx.main.dispatch task 2fc2b246-95c5-4a62-a25f-52b0cb71f7b2 is finished RESULT 2 OKREADY 2022-05-21 04:01:17,785 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(27f10e42-44b0-4669-aee6-a5eb6c3e4888, queue=onap-awx-0) [2022-05-21 04:01:17,785: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(27f10e42-44b0-4669-aee6-a5eb6c3e4888, queue=onap-awx-0) 2022-05-21 04:01:17,820 DEBUG awx.main.dispatch delivered 27f10e42-44b0-4669-aee6-a5eb6c3e4888 to worker[195] qsize 0 2022-05-21 04:01:18,001 DEBUG awx.main.dispatch task 27f10e42-44b0-4669-aee6-a5eb6c3e4888 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 04:01:18,005 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 04:01:18,006 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(2209456f-2650-4a1b-b0e6-1bfb013e9065, queue=onap-awx-0) [2022-05-21 04:01:18,006: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(2209456f-2650-4a1b-b0e6-1bfb013e9065, queue=onap-awx-0) 2022-05-21 04:01:18,022 DEBUG awx.main.dispatch delivered 2209456f-2650-4a1b-b0e6-1bfb013e9065 to worker[192] qsize 0 2022-05-21 04:01:18,027 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(9db2d870-9025-4333-a897-2aa66bec13e6, queue=awx_private_queue) [2022-05-21 04:01:18,027: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(9db2d870-9025-4333-a897-2aa66bec13e6, queue=awx_private_queue) 2022-05-21 04:01:18,025 DEBUG awx.main.dispatch task 2209456f-2650-4a1b-b0e6-1bfb013e9065 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 04:01:18,046 DEBUG awx.main.dispatch delivered 9db2d870-9025-4333-a897-2aa66bec13e6 to worker[178] qsize 0 2022-05-21 04:01:18,048 DEBUG awx.main.dispatch task 2209456f-2650-4a1b-b0e6-1bfb013e9065 is finished 2022-05-21 04:01:18,051 DEBUG awx.main.dispatch task 9db2d870-9025-4333-a897-2aa66bec13e6 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 04:01:18,064 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 04:01:18,068 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 04:00:48.063228+00:00 2022-05-21 04:01:18,071 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b0410696-7526-4c91-bfdf-24aba436064a, queue=awx_private_queue) [2022-05-21 04:01:18,071: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b0410696-7526-4c91-bfdf-24aba436064a, queue=awx_private_queue) 2022-05-21 04:01:18,086 DEBUG awx.main.dispatch delivered b0410696-7526-4c91-bfdf-24aba436064a to worker[192] qsize 0 2022-05-21 04:01:18,090 DEBUG awx.main.dispatch task b0410696-7526-4c91-bfdf-24aba436064a starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:01:18,092 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:01:18,112 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 04:01:18,152 DEBUG awx.main.dispatch task b0410696-7526-4c91-bfdf-24aba436064a is finished 2022-05-21 04:01:18,786 DEBUG awx.main.dispatch task 27f10e42-44b0-4669-aee6-a5eb6c3e4888 is finished 2022-05-21 04:01:19,257 DEBUG awx.main.dispatch task 9db2d870-9025-4333-a897-2aa66bec13e6 is finished 2022-05-21 04:01:38,079 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6b1d4222-7d49-40a4-ad48-3194f77d3f08, queue=awx_private_queue) [2022-05-21 04:01:38,079: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6b1d4222-7d49-40a4-ad48-3194f77d3f08, queue=awx_private_queue) 2022-05-21 04:01:38,095 DEBUG awx.main.dispatch delivered 6b1d4222-7d49-40a4-ad48-3194f77d3f08 to worker[192] qsize 0 2022-05-21 04:01:38,098 DEBUG awx.main.dispatch task 6b1d4222-7d49-40a4-ad48-3194f77d3f08 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:01:38,099 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:01:38,119 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 04:01:38,159 DEBUG awx.main.dispatch task 6b1d4222-7d49-40a4-ad48-3194f77d3f08 is finished 2022-05-21 04:01:48,028 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(1a9d5d44-588d-4e55-a180-eee9c2e6fd15, queue=awx_private_queue) [2022-05-21 04:01:48,028: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(1a9d5d44-588d-4e55-a180-eee9c2e6fd15, queue=awx_private_queue) 2022-05-21 04:01:48,046 DEBUG awx.main.dispatch delivered 1a9d5d44-588d-4e55-a180-eee9c2e6fd15 to worker[195] qsize 0 2022-05-21 04:01:48,049 DEBUG awx.main.dispatch task 1a9d5d44-588d-4e55-a180-eee9c2e6fd15 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 04:01:48,063 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 04:01:48,067 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 04:01:18.064350+00:00 2022-05-21 04:01:49,119 DEBUG awx.main.dispatch task 1a9d5d44-588d-4e55-a180-eee9c2e6fd15 is finished 2022-05-21 04:01:58,080 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c6178353-b688-4a00-9ceb-a19c86962071, queue=awx_private_queue) [2022-05-21 04:01:58,080: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c6178353-b688-4a00-9ceb-a19c86962071, queue=awx_private_queue) 2022-05-21 04:01:58,099 DEBUG awx.main.dispatch delivered c6178353-b688-4a00-9ceb-a19c86962071 to worker[181] qsize 0 2022-05-21 04:01:58,102 DEBUG awx.main.dispatch task c6178353-b688-4a00-9ceb-a19c86962071 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:01:58,104 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:01:58,130 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 04:01:58,169 DEBUG awx.main.dispatch task c6178353-b688-4a00-9ceb-a19c86962071 is finished RESULT 2 OKREADY 2022-05-21 04:02:17,784 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(9509092c-1e9e-4cab-a59d-5732a6f4abc5, queue=onap-awx-0) [2022-05-21 04:02:17,784: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(9509092c-1e9e-4cab-a59d-5732a6f4abc5, queue=onap-awx-0) 2022-05-21 04:02:18,007 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(6ec95f87-a921-4343-9364-e4db660643f6, queue=onap-awx-0) [2022-05-21 04:02:18,007: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(6ec95f87-a921-4343-9364-e4db660643f6, queue=onap-awx-0) 2022-05-21 04:02:17,845 DEBUG awx.main.dispatch delivered 9509092c-1e9e-4cab-a59d-5732a6f4abc5 to worker[181] qsize 0 2022-05-21 04:02:18,050 DEBUG awx.main.dispatch delivered 6ec95f87-a921-4343-9364-e4db660643f6 to worker[195] qsize 0 2022-05-21 04:02:18,050 DEBUG awx.main.dispatch task 9509092c-1e9e-4cab-a59d-5732a6f4abc5 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 04:02:18,052 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 04:02:18,053 DEBUG awx.main.dispatch task 6ec95f87-a921-4343-9364-e4db660643f6 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 04:02:18,068 DEBUG awx.main.dispatch task 6ec95f87-a921-4343-9364-e4db660643f6 is finished 2022-05-21 04:02:18,028 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(e546ce79-4b0d-4505-9e1a-52a2fe9a8263, queue=awx_private_queue) [2022-05-21 04:02:18,028: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(e546ce79-4b0d-4505-9e1a-52a2fe9a8263, queue=awx_private_queue) 2022-05-21 04:02:18,255 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(92befc62-83a0-49e7-ac38-fd7cc99baae6, queue=awx_private_queue) [2022-05-21 04:02:18,255: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(92befc62-83a0-49e7-ac38-fd7cc99baae6, queue=awx_private_queue) 2022-05-21 04:02:18,254 DEBUG awx.main.dispatch delivered e546ce79-4b0d-4505-9e1a-52a2fe9a8263 to worker[195] qsize 0 2022-05-21 04:02:18,258 DEBUG awx.main.dispatch task e546ce79-4b0d-4505-9e1a-52a2fe9a8263 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 04:02:18,269 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 04:02:18,270 DEBUG awx.main.dispatch delivered 92befc62-83a0-49e7-ac38-fd7cc99baae6 to worker[192] qsize 0 2022-05-21 04:02:18,272 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 04:01:48.063610+00:00 2022-05-21 04:02:18,273 DEBUG awx.main.dispatch task 92befc62-83a0-49e7-ac38-fd7cc99baae6 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:02:18,275 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:02:18,298 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 04:02:18,336 DEBUG awx.main.dispatch task 92befc62-83a0-49e7-ac38-fd7cc99baae6 is finished 2022-05-21 04:02:18,693 DEBUG awx.main.dispatch task 9509092c-1e9e-4cab-a59d-5732a6f4abc5 is finished 2022-05-21 04:02:19,746 DEBUG awx.main.dispatch task e546ce79-4b0d-4505-9e1a-52a2fe9a8263 is finished 2022-05-21 04:02:38,265 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0686c53f-eafa-43f4-86fa-9931b4798872, queue=awx_private_queue) [2022-05-21 04:02:38,265: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0686c53f-eafa-43f4-86fa-9931b4798872, queue=awx_private_queue) 2022-05-21 04:02:38,284 DEBUG awx.main.dispatch delivered 0686c53f-eafa-43f4-86fa-9931b4798872 to worker[181] qsize 0 2022-05-21 04:02:38,288 DEBUG awx.main.dispatch task 0686c53f-eafa-43f4-86fa-9931b4798872 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:02:38,289 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:02:38,309 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 04:02:38,342 DEBUG awx.main.dispatch task 0686c53f-eafa-43f4-86fa-9931b4798872 is finished 2022-05-21 04:02:48,029 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(99c8a9c3-5607-4715-a518-47991f7dadf0, queue=awx_private_queue) [2022-05-21 04:02:48,029: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(99c8a9c3-5607-4715-a518-47991f7dadf0, queue=awx_private_queue) 2022-05-21 04:02:48,051 DEBUG awx.main.dispatch delivered 99c8a9c3-5607-4715-a518-47991f7dadf0 to worker[192] qsize 0 2022-05-21 04:02:48,054 DEBUG awx.main.dispatch task 99c8a9c3-5607-4715-a518-47991f7dadf0 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 04:02:48,068 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 04:02:48,072 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 04:02:18.269801+00:00 2022-05-21 04:02:48,797 DEBUG awx.main.dispatch task 99c8a9c3-5607-4715-a518-47991f7dadf0 is finished 2022-05-21 04:02:58,266 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(cb4ec924-ba98-4f6a-a8d7-4e716ffb6d46, queue=awx_private_queue) [2022-05-21 04:02:58,266: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(cb4ec924-ba98-4f6a-a8d7-4e716ffb6d46, queue=awx_private_queue) 2022-05-21 04:02:58,286 DEBUG awx.main.dispatch delivered cb4ec924-ba98-4f6a-a8d7-4e716ffb6d46 to worker[192] qsize 0 2022-05-21 04:02:58,288 DEBUG awx.main.dispatch task cb4ec924-ba98-4f6a-a8d7-4e716ffb6d46 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:02:58,290 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:02:58,310 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 04:02:58,345 DEBUG awx.main.dispatch task cb4ec924-ba98-4f6a-a8d7-4e716ffb6d46 is finished RESULT 2 OKREADY 2022-05-21 04:03:17,790 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(2ae13298-3908-498f-b610-af22a78deaff, queue=onap-awx-0) [2022-05-21 04:03:17,790: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(2ae13298-3908-498f-b610-af22a78deaff, queue=onap-awx-0) 2022-05-21 04:03:17,844 DEBUG awx.main.dispatch delivered 2ae13298-3908-498f-b610-af22a78deaff to worker[178] qsize 0 2022-05-21 04:03:18,007 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(51f71ba1-3bf2-4be0-9e4d-91c40f322fb3, queue=onap-awx-0) [2022-05-21 04:03:18,007: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(51f71ba1-3bf2-4be0-9e4d-91c40f322fb3, queue=onap-awx-0) 2022-05-21 04:03:17,847 DEBUG awx.main.dispatch task 2ae13298-3908-498f-b610-af22a78deaff starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 04:03:18,059 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 04:03:18,037 DEBUG awx.main.dispatch delivered 51f71ba1-3bf2-4be0-9e4d-91c40f322fb3 to worker[192] qsize 0 2022-05-21 04:03:18,257 DEBUG awx.main.dispatch task 51f71ba1-3bf2-4be0-9e4d-91c40f322fb3 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 04:03:18,037 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(a6a8c651-c994-4003-a7db-09e1152c3f38, queue=awx_private_queue) [2022-05-21 04:03:18,037: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(a6a8c651-c994-4003-a7db-09e1152c3f38, queue=awx_private_queue) 2022-05-21 04:03:18,272 DEBUG awx.main.dispatch task 51f71ba1-3bf2-4be0-9e4d-91c40f322fb3 is finished 2022-05-21 04:03:18,277 DEBUG awx.main.dispatch delivered a6a8c651-c994-4003-a7db-09e1152c3f38 to worker[192] qsize 0 2022-05-21 04:03:18,279 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(29e642c0-98a6-4bac-9c5f-ae059d3efc94, queue=awx_private_queue) [2022-05-21 04:03:18,279: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(29e642c0-98a6-4bac-9c5f-ae059d3efc94, queue=awx_private_queue) 2022-05-21 04:03:18,281 DEBUG awx.main.dispatch task a6a8c651-c994-4003-a7db-09e1152c3f38 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 04:03:18,296 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 04:03:18,300 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 04:02:48.069127+00:00 2022-05-21 04:03:18,303 DEBUG awx.main.dispatch delivered 29e642c0-98a6-4bac-9c5f-ae059d3efc94 to worker[195] qsize 0 2022-05-21 04:03:18,306 DEBUG awx.main.dispatch task 29e642c0-98a6-4bac-9c5f-ae059d3efc94 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:03:18,309 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:03:18,330 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 04:03:18,371 DEBUG awx.main.dispatch task 29e642c0-98a6-4bac-9c5f-ae059d3efc94 is finished 2022-05-21 04:03:18,439 DEBUG awx.main.dispatch task 2ae13298-3908-498f-b610-af22a78deaff is finished 2022-05-21 04:03:19,275 DEBUG awx.main.dispatch task a6a8c651-c994-4003-a7db-09e1152c3f38 is finished 2022-05-21 04:03:38,289 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(046f282e-cd97-4639-abe3-38ae6c080d6f, queue=awx_private_queue) [2022-05-21 04:03:38,289: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(046f282e-cd97-4639-abe3-38ae6c080d6f, queue=awx_private_queue) 2022-05-21 04:03:38,311 DEBUG awx.main.dispatch delivered 046f282e-cd97-4639-abe3-38ae6c080d6f to worker[178] qsize 0 2022-05-21 04:03:38,314 DEBUG awx.main.dispatch task 046f282e-cd97-4639-abe3-38ae6c080d6f starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:03:38,315 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:03:38,335 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 04:03:38,375 DEBUG awx.main.dispatch task 046f282e-cd97-4639-abe3-38ae6c080d6f is finished 2022-05-21 04:03:48,038 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(24598693-acae-4b7b-b93f-671f2679f244, queue=awx_private_queue) [2022-05-21 04:03:48,038: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(24598693-acae-4b7b-b93f-671f2679f244, queue=awx_private_queue) 2022-05-21 04:03:48,057 DEBUG awx.main.dispatch delivered 24598693-acae-4b7b-b93f-671f2679f244 to worker[178] qsize 0 2022-05-21 04:03:48,059 DEBUG awx.main.dispatch task 24598693-acae-4b7b-b93f-671f2679f244 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 04:03:48,074 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 04:03:48,078 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 04:03:18.296903+00:00 2022-05-21 04:03:48,620 DEBUG awx.main.dispatch task 24598693-acae-4b7b-b93f-671f2679f244 is finished 2022-05-21 04:03:58,290 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(41ebfd09-6639-4f5e-b262-adcbaa5455d5, queue=awx_private_queue) [2022-05-21 04:03:58,290: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(41ebfd09-6639-4f5e-b262-adcbaa5455d5, queue=awx_private_queue) 2022-05-21 04:03:58,306 DEBUG awx.main.dispatch delivered 41ebfd09-6639-4f5e-b262-adcbaa5455d5 to worker[195] qsize 0 2022-05-21 04:03:58,309 DEBUG awx.main.dispatch task 41ebfd09-6639-4f5e-b262-adcbaa5455d5 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:03:58,311 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:03:58,331 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 04:03:58,366 DEBUG awx.main.dispatch task 41ebfd09-6639-4f5e-b262-adcbaa5455d5 is finished RESULT 2 OKREADY 2022-05-21 04:04:15,013 DEBUG awx.main.dispatch publish awx.main.tasks.awx_isolated_heartbeat(c2a69704-fd0f-4ca4-a401-c909c69f9ad3, queue=onap-awx-0) [2022-05-21 04:04:15,013: DEBUG/Process-1] publish awx.main.tasks.awx_isolated_heartbeat(c2a69704-fd0f-4ca4-a401-c909c69f9ad3, queue=onap-awx-0) 2022-05-21 04:04:15,032 DEBUG awx.main.dispatch delivered c2a69704-fd0f-4ca4-a401-c909c69f9ad3 to worker[178] qsize 0 2022-05-21 04:04:15,035 DEBUG awx.main.dispatch task c2a69704-fd0f-4ca4-a401-c909c69f9ad3 starting awx.main.tasks.awx_isolated_heartbeat(*[]) 2022-05-21 04:04:15,037 DEBUG awx.main.tasks Controlling node checking for any isolated management tasks. 2022-05-21 04:04:15,058 DEBUG awx.main.dispatch task c2a69704-fd0f-4ca4-a401-c909c69f9ad3 is finished 2022-05-21 04:04:40,513 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(32ffda94-2acf-421b-8546-c4b7ac13d563, queue=onap-awx-0) [2022-05-21 04:04:40,513: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(32ffda94-2acf-421b-8546-c4b7ac13d563, queue=onap-awx-0) 2022-05-21 04:04:40,715 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(ff2be8ec-1257-41de-91e3-689b0d55c5e3, queue=onap-awx-0) [2022-05-21 04:04:40,715: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(ff2be8ec-1257-41de-91e3-689b0d55c5e3, queue=onap-awx-0) 2022-05-21 04:04:40,731 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(c5e72953-cafe-424d-837e-6272f8dfca7f, queue=awx_private_queue) [2022-05-21 04:04:40,731: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(c5e72953-cafe-424d-837e-6272f8dfca7f, queue=awx_private_queue) 2022-05-21 04:04:40,747 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(216eff26-8485-4bc1-9775-508c1d510578, queue=awx_private_queue) [2022-05-21 04:04:40,747: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(216eff26-8485-4bc1-9775-508c1d510578, queue=awx_private_queue) 2022-05-21 04:04:40,942 DEBUG awx.main.dispatch delivered c5e72953-cafe-424d-837e-6272f8dfca7f to worker[181] qsize 0 2022-05-21 04:04:40,947 DEBUG awx.main.dispatch delivered 216eff26-8485-4bc1-9775-508c1d510578 to worker[192] qsize 0 2022-05-21 04:04:40,947 DEBUG awx.main.dispatch task c5e72953-cafe-424d-837e-6272f8dfca7f starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 04:04:40,949 DEBUG awx.main.dispatch task 216eff26-8485-4bc1-9775-508c1d510578 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:04:40,952 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:04:40,959 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 04:04:40,963 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 04:03:48.074972+00:00 2022-05-21 04:04:40,972 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 04:04:41,011 DEBUG awx.main.dispatch task 216eff26-8485-4bc1-9775-508c1d510578 is finished 2022-05-21 04:04:41,845 DEBUG awx.main.dispatch task c5e72953-cafe-424d-837e-6272f8dfca7f is finished 2022-05-21 04:04:42,676 DEBUG awx.main.dispatch delivered 32ffda94-2acf-421b-8546-c4b7ac13d563 to worker[181] qsize 0 2022-05-21 04:04:42,679 DEBUG awx.main.dispatch delivered ff2be8ec-1257-41de-91e3-689b0d55c5e3 to worker[178] qsize 0 2022-05-21 04:04:42,679 DEBUG awx.main.dispatch task 32ffda94-2acf-421b-8546-c4b7ac13d563 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 04:04:42,680 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 04:04:42,681 DEBUG awx.main.dispatch task ff2be8ec-1257-41de-91e3-689b0d55c5e3 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 04:04:42,696 DEBUG awx.main.dispatch task ff2be8ec-1257-41de-91e3-689b0d55c5e3 is finished 2022-05-21 04:04:42,724 DEBUG awx.main.dispatch task 32ffda94-2acf-421b-8546-c4b7ac13d563 is finished 2022-05-21 04:05:00,755 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7acd857e-0a70-4933-99e0-4630650b6b6e, queue=awx_private_queue) [2022-05-21 04:05:00,755: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7acd857e-0a70-4933-99e0-4630650b6b6e, queue=awx_private_queue) 2022-05-21 04:05:02,236 DEBUG awx.main.dispatch delivered 7acd857e-0a70-4933-99e0-4630650b6b6e to worker[178] qsize 0 2022-05-21 04:05:02,239 DEBUG awx.main.dispatch task 7acd857e-0a70-4933-99e0-4630650b6b6e starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:05:02,241 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:05:02,265 DEBUG awx.main.scheduler Starting Scheduler RESULT 2 OKREADY 2022-05-21 04:05:02,308 DEBUG awx.main.dispatch task 7acd857e-0a70-4933-99e0-4630650b6b6e is finished 2022-05-21 04:05:10,732 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(3865406d-9900-4281-b2d2-3610a0be41f1, queue=awx_private_queue) [2022-05-21 04:05:10,732: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(3865406d-9900-4281-b2d2-3610a0be41f1, queue=awx_private_queue) 2022-05-21 04:05:10,754 DEBUG awx.main.dispatch delivered 3865406d-9900-4281-b2d2-3610a0be41f1 to worker[181] qsize 0 2022-05-21 04:05:10,758 DEBUG awx.main.dispatch task 3865406d-9900-4281-b2d2-3610a0be41f1 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 04:05:10,771 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 04:05:10,775 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 04:04:40.959516+00:00 2022-05-21 04:05:11,577 DEBUG awx.main.dispatch task 3865406d-9900-4281-b2d2-3610a0be41f1 is finished 2022-05-21 04:05:20,755 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d29f433b-3601-4468-9745-ee17ec1abd9a, queue=awx_private_queue) [2022-05-21 04:05:20,755: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d29f433b-3601-4468-9745-ee17ec1abd9a, queue=awx_private_queue) 2022-05-21 04:05:40,523 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(3e364fdc-5862-4cf7-b158-475e33d3293f, queue=onap-awx-0) [2022-05-21 04:05:40,523: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(3e364fdc-5862-4cf7-b158-475e33d3293f, queue=onap-awx-0) 2022-05-21 04:05:40,747 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(1d210751-b5b4-4ed6-9288-8f2c96074bab, queue=onap-awx-0) [2022-05-21 04:05:40,747: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(1d210751-b5b4-4ed6-9288-8f2c96074bab, queue=onap-awx-0) 2022-05-21 04:05:40,763 DEBUG awx.main.dispatch delivered 3e364fdc-5862-4cf7-b158-475e33d3293f to worker[181] qsize 0 2022-05-21 04:05:40,765 DEBUG awx.main.dispatch delivered 1d210751-b5b4-4ed6-9288-8f2c96074bab to worker[192] qsize 0 2022-05-21 04:05:40,765 DEBUG awx.main.dispatch task 3e364fdc-5862-4cf7-b158-475e33d3293f starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 04:05:40,767 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 04:05:40,766 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(679fea9b-1232-4e21-9eaf-9d1c2479bed0, queue=awx_private_queue) [2022-05-21 04:05:40,766: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(679fea9b-1232-4e21-9eaf-9d1c2479bed0, queue=awx_private_queue) 2022-05-21 04:05:40,768 DEBUG awx.main.dispatch task 1d210751-b5b4-4ed6-9288-8f2c96074bab starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 04:05:40,787 DEBUG awx.main.dispatch task 1d210751-b5b4-4ed6-9288-8f2c96074bab is finished 2022-05-21 04:05:40,789 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(199b8557-519c-44d8-bc1c-a5f22e9118d1, queue=awx_private_queue) [2022-05-21 04:05:40,789: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(199b8557-519c-44d8-bc1c-a5f22e9118d1, queue=awx_private_queue) 2022-05-21 04:05:40,870 DEBUG awx.main.dispatch task 3e364fdc-5862-4cf7-b158-475e33d3293f is finished 2022-05-21 04:05:53,691 DEBUG awx.main.dispatch delivered d29f433b-3601-4468-9745-ee17ec1abd9a to worker[192] qsize 0 2022-05-21 04:05:53,694 DEBUG awx.main.dispatch delivered 679fea9b-1232-4e21-9eaf-9d1c2479bed0 to worker[195] qsize 0 2022-05-21 04:05:53,694 DEBUG awx.main.dispatch task d29f433b-3601-4468-9745-ee17ec1abd9a starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:05:53,696 DEBUG awx.main.dispatch delivered 199b8557-519c-44d8-bc1c-a5f22e9118d1 to worker[178] qsize 0 2022-05-21 04:05:53,698 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:05:53,697 DEBUG awx.main.dispatch task 679fea9b-1232-4e21-9eaf-9d1c2479bed0 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 04:05:53,699 DEBUG awx.main.dispatch task 199b8557-519c-44d8-bc1c-a5f22e9118d1 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:05:53,701 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:05:53,711 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 04:05:53,714 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 04:05:10.771413+00:00 2022-05-21 04:05:53,718 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 04:05:53,721 DEBUG awx.main.scheduler Not running scheduler, another task holds lock 2022-05-21 04:05:53,721 DEBUG awx.main.dispatch task d29f433b-3601-4468-9745-ee17ec1abd9a is finished 2022-05-21 04:05:53,751 DEBUG awx.main.dispatch task 199b8557-519c-44d8-bc1c-a5f22e9118d1 is finished 2022-05-21 04:05:54,711 DEBUG awx.main.dispatch task 679fea9b-1232-4e21-9eaf-9d1c2479bed0 is finished 2022-05-21 04:06:00,799 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(443375bd-9fad-45ab-8b63-0921077aa02e, queue=awx_private_queue) [2022-05-21 04:06:00,799: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(443375bd-9fad-45ab-8b63-0921077aa02e, queue=awx_private_queue) 2022-05-21 04:06:00,818 DEBUG awx.main.dispatch delivered 443375bd-9fad-45ab-8b63-0921077aa02e to worker[192] qsize 0 RESULT 2 2022-05-21 04:06:00,820 DEBUG awx.main.dispatch task 443375bd-9fad-45ab-8b63-0921077aa02e starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:06:00,822 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:06:00,846 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 04:06:00,880 DEBUG awx.main.dispatch task 443375bd-9fad-45ab-8b63-0921077aa02e is finished 2022-05-21 04:06:10,767 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(4d190cef-bb23-40a1-a7b7-5edc26375eb8, queue=awx_private_queue) [2022-05-21 04:06:10,767: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(4d190cef-bb23-40a1-a7b7-5edc26375eb8, queue=awx_private_queue) OKREADY 2022-05-21 04:06:15,521 DEBUG awx.main.dispatch delivered 4d190cef-bb23-40a1-a7b7-5edc26375eb8 to worker[178] qsize 0 2022-05-21 04:06:15,525 DEBUG awx.main.dispatch task 4d190cef-bb23-40a1-a7b7-5edc26375eb8 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 04:06:15,540 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 04:06:15,543 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 04:05:53.711329+00:00 2022-05-21 04:06:16,223 DEBUG awx.main.dispatch task 4d190cef-bb23-40a1-a7b7-5edc26375eb8 is finished 2022-05-21 04:06:20,799 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(24539fc6-f97f-4068-a69b-0d9af5338726, queue=awx_private_queue) [2022-05-21 04:06:20,799: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(24539fc6-f97f-4068-a69b-0d9af5338726, queue=awx_private_queue) 2022-05-21 04:06:33,794 DEBUG awx.main.dispatch delivered 24539fc6-f97f-4068-a69b-0d9af5338726 to worker[178] qsize 0 2022-05-21 04:06:33,797 DEBUG awx.main.dispatch task 24539fc6-f97f-4068-a69b-0d9af5338726 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:06:33,799 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:06:33,822 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 04:06:33,860 DEBUG awx.main.dispatch task 24539fc6-f97f-4068-a69b-0d9af5338726 is finished 2022-05-21 04:06:40,525 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(5fee96a4-b907-4af8-b99b-66c7b375e485, queue=onap-awx-0) [2022-05-21 04:06:40,525: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(5fee96a4-b907-4af8-b99b-66c7b375e485, queue=onap-awx-0) 2022-05-21 04:06:40,747 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(b1f40048-8664-4078-9555-24910779d218, queue=onap-awx-0) [2022-05-21 04:06:40,747: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(b1f40048-8664-4078-9555-24910779d218, queue=onap-awx-0) 2022-05-21 04:06:40,760 DEBUG awx.main.dispatch delivered 5fee96a4-b907-4af8-b99b-66c7b375e485 to worker[178] qsize 0 2022-05-21 04:06:40,762 DEBUG awx.main.dispatch delivered b1f40048-8664-4078-9555-24910779d218 to worker[192] qsize 0 2022-05-21 04:06:40,762 DEBUG awx.main.dispatch task 5fee96a4-b907-4af8-b99b-66c7b375e485 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 04:06:40,764 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 04:06:40,764 DEBUG awx.main.dispatch task b1f40048-8664-4078-9555-24910779d218 starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 04:06:40,766 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(375ca230-c126-4d57-94da-77f7726d325c, queue=awx_private_queue) [2022-05-21 04:06:40,766: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(375ca230-c126-4d57-94da-77f7726d325c, queue=awx_private_queue) 2022-05-21 04:06:40,779 DEBUG awx.main.dispatch task b1f40048-8664-4078-9555-24910779d218 is finished 2022-05-21 04:06:40,781 DEBUG awx.main.dispatch delivered 375ca230-c126-4d57-94da-77f7726d325c to worker[181] qsize 0 2022-05-21 04:06:40,784 DEBUG awx.main.dispatch task 375ca230-c126-4d57-94da-77f7726d325c starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 04:06:40,796 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 04:06:40,800 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 04:06:15.540661+00:00 2022-05-21 04:06:40,799 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a90f526e-435d-42d1-b573-7e26286e6943, queue=awx_private_queue) [2022-05-21 04:06:40,799: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a90f526e-435d-42d1-b573-7e26286e6943, queue=awx_private_queue) 2022-05-21 04:06:40,815 DEBUG awx.main.dispatch delivered a90f526e-435d-42d1-b573-7e26286e6943 to worker[192] qsize 0 2022-05-21 04:06:40,818 DEBUG awx.main.dispatch task a90f526e-435d-42d1-b573-7e26286e6943 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:06:40,820 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:06:40,842 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 04:06:40,878 DEBUG awx.main.dispatch task a90f526e-435d-42d1-b573-7e26286e6943 is finished 2022-05-21 04:06:41,564 DEBUG awx.main.dispatch task 5fee96a4-b907-4af8-b99b-66c7b375e485 is finished 2022-05-21 04:06:42,313 DEBUG awx.main.dispatch task 375ca230-c126-4d57-94da-77f7726d325c is finished 2022-05-21 04:07:00,806 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(68df11de-964c-4f5d-b619-34c432aea33f, queue=awx_private_queue) [2022-05-21 04:07:00,806: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(68df11de-964c-4f5d-b619-34c432aea33f, queue=awx_private_queue) RESULT 2 OKREADY 2022-05-21 04:07:00,824 DEBUG awx.main.dispatch delivered 68df11de-964c-4f5d-b619-34c432aea33f to worker[181] qsize 0 2022-05-21 04:07:00,827 DEBUG awx.main.dispatch task 68df11de-964c-4f5d-b619-34c432aea33f starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:07:00,828 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:07:00,853 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 04:07:00,892 DEBUG awx.main.dispatch task 68df11de-964c-4f5d-b619-34c432aea33f is finished 2022-05-21 04:07:10,767 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(b5ed5db6-1b00-40ac-b559-41d4bd397c91, queue=awx_private_queue) [2022-05-21 04:07:10,767: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(b5ed5db6-1b00-40ac-b559-41d4bd397c91, queue=awx_private_queue) 2022-05-21 04:07:10,787 DEBUG awx.main.dispatch delivered b5ed5db6-1b00-40ac-b559-41d4bd397c91 to worker[192] qsize 0 2022-05-21 04:07:10,789 DEBUG awx.main.dispatch task b5ed5db6-1b00-40ac-b559-41d4bd397c91 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 04:07:10,806 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 04:07:10,809 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 04:06:40.796795+00:00 2022-05-21 04:07:11,672 DEBUG awx.main.dispatch task b5ed5db6-1b00-40ac-b559-41d4bd397c91 is finished 2022-05-21 04:07:20,807 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b55f1f7c-2e2b-46c7-aeaa-d09e93ac3483, queue=awx_private_queue) [2022-05-21 04:07:20,807: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b55f1f7c-2e2b-46c7-aeaa-d09e93ac3483, queue=awx_private_queue) 2022-05-21 04:07:20,828 DEBUG awx.main.dispatch delivered b55f1f7c-2e2b-46c7-aeaa-d09e93ac3483 to worker[192] qsize 0 2022-05-21 04:07:20,831 DEBUG awx.main.dispatch task b55f1f7c-2e2b-46c7-aeaa-d09e93ac3483 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:07:20,833 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:07:20,855 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 04:07:20,900 DEBUG awx.main.dispatch task b55f1f7c-2e2b-46c7-aeaa-d09e93ac3483 is finished 2022-05-21 04:07:40,895 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(8ae55de7-2138-40dd-be46-04efda8e0445, queue=onap-awx-0) [2022-05-21 04:07:40,895: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(8ae55de7-2138-40dd-be46-04efda8e0445, queue=onap-awx-0) 2022-05-21 04:07:41,096 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(533eb343-49f8-44e0-8372-de4ab0af079a, queue=onap-awx-0) [2022-05-21 04:07:41,096: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(533eb343-49f8-44e0-8372-de4ab0af079a, queue=onap-awx-0) 2022-05-21 04:07:41,109 DEBUG awx.main.dispatch delivered 8ae55de7-2138-40dd-be46-04efda8e0445 to worker[192] qsize 0 2022-05-21 04:07:41,112 DEBUG awx.main.dispatch task 8ae55de7-2138-40dd-be46-04efda8e0445 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 04:07:41,113 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 04:07:41,116 DEBUG awx.main.dispatch delivered 533eb343-49f8-44e0-8372-de4ab0af079a to worker[178] qsize 0 2022-05-21 04:07:41,117 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(03198489-b5ea-4049-8c88-fbf7d595ccd6, queue=awx_private_queue) [2022-05-21 04:07:41,117: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(03198489-b5ea-4049-8c88-fbf7d595ccd6, queue=awx_private_queue) 2022-05-21 04:07:41,119 DEBUG awx.main.dispatch task 533eb343-49f8-44e0-8372-de4ab0af079a starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 04:07:41,133 DEBUG awx.main.dispatch delivered 03198489-b5ea-4049-8c88-fbf7d595ccd6 to worker[195] qsize 0 2022-05-21 04:07:41,134 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(23c7f6d0-527a-44e6-b542-2f3576a60340, queue=awx_private_queue) [2022-05-21 04:07:41,134: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(23c7f6d0-527a-44e6-b542-2f3576a60340, queue=awx_private_queue) 2022-05-21 04:07:41,137 DEBUG awx.main.dispatch task 533eb343-49f8-44e0-8372-de4ab0af079a is finished 2022-05-21 04:07:41,136 DEBUG awx.main.dispatch task 03198489-b5ea-4049-8c88-fbf7d595ccd6 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 04:07:41,153 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 04:07:41,151 DEBUG awx.main.dispatch delivered 23c7f6d0-527a-44e6-b542-2f3576a60340 to worker[178] qsize 0 2022-05-21 04:07:41,156 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 04:07:10.806506+00:00 2022-05-21 04:07:41,155 DEBUG awx.main.dispatch task 23c7f6d0-527a-44e6-b542-2f3576a60340 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:07:41,157 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:07:41,179 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 04:07:41,218 DEBUG awx.main.dispatch task 23c7f6d0-527a-44e6-b542-2f3576a60340 is finished 2022-05-21 04:07:41,622 DEBUG awx.main.dispatch task 8ae55de7-2138-40dd-be46-04efda8e0445 is finished 2022-05-21 04:07:41,649 DEBUG awx.main.dispatch task 03198489-b5ea-4049-8c88-fbf7d595ccd6 is finished 2022-05-21 04:08:01,145 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(8fb03f17-ddcb-4e19-8b5e-89e2f41d0268, queue=awx_private_queue) [2022-05-21 04:08:01,145: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(8fb03f17-ddcb-4e19-8b5e-89e2f41d0268, queue=awx_private_queue) RESULT 2 OKREADY 2022-05-21 04:08:01,165 DEBUG awx.main.dispatch delivered 8fb03f17-ddcb-4e19-8b5e-89e2f41d0268 to worker[195] qsize 0 2022-05-21 04:08:01,170 DEBUG awx.main.dispatch task 8fb03f17-ddcb-4e19-8b5e-89e2f41d0268 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:08:01,171 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:08:01,197 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 04:08:01,234 DEBUG awx.main.dispatch task 8fb03f17-ddcb-4e19-8b5e-89e2f41d0268 is finished 2022-05-21 04:08:11,119 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(9495a06f-5cbe-4751-b75d-cac366153a10, queue=awx_private_queue) [2022-05-21 04:08:11,119: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(9495a06f-5cbe-4751-b75d-cac366153a10, queue=awx_private_queue) 2022-05-21 04:08:11,140 DEBUG awx.main.dispatch delivered 9495a06f-5cbe-4751-b75d-cac366153a10 to worker[178] qsize 0 2022-05-21 04:08:11,143 DEBUG awx.main.dispatch task 9495a06f-5cbe-4751-b75d-cac366153a10 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 04:08:11,159 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 04:08:11,162 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 04:07:41.153547+00:00 2022-05-21 04:08:11,899 DEBUG awx.main.dispatch task 9495a06f-5cbe-4751-b75d-cac366153a10 is finished 2022-05-21 04:08:21,145 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e63f32a3-efa7-40cb-bc00-a186b7308ec2, queue=awx_private_queue) [2022-05-21 04:08:21,145: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e63f32a3-efa7-40cb-bc00-a186b7308ec2, queue=awx_private_queue) 2022-05-21 04:08:21,170 DEBUG awx.main.dispatch delivered e63f32a3-efa7-40cb-bc00-a186b7308ec2 to worker[181] qsize 0 2022-05-21 04:08:21,173 DEBUG awx.main.dispatch task e63f32a3-efa7-40cb-bc00-a186b7308ec2 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:08:21,177 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:08:21,202 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 04:08:21,241 DEBUG awx.main.dispatch task e63f32a3-efa7-40cb-bc00-a186b7308ec2 is finished 2022-05-21 04:08:40,906 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(c63f13ee-a66d-4a76-addd-9551796afaea, queue=onap-awx-0) [2022-05-21 04:08:40,906: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(c63f13ee-a66d-4a76-addd-9551796afaea, queue=onap-awx-0) 2022-05-21 04:08:41,140 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(c494c63a-07f0-4ac3-81f2-6d2375cb1d0f, queue=onap-awx-0) [2022-05-21 04:08:41,140: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(c494c63a-07f0-4ac3-81f2-6d2375cb1d0f, queue=onap-awx-0) 2022-05-21 04:08:41,154 DEBUG awx.main.dispatch delivered c63f13ee-a66d-4a76-addd-9551796afaea to worker[192] qsize 0 2022-05-21 04:08:41,157 DEBUG awx.main.dispatch delivered c494c63a-07f0-4ac3-81f2-6d2375cb1d0f to worker[181] qsize 0 2022-05-21 04:08:41,158 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(56a3c326-4276-485f-b8d0-1d7ff650a9bc, queue=awx_private_queue) [2022-05-21 04:08:41,158: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(56a3c326-4276-485f-b8d0-1d7ff650a9bc, queue=awx_private_queue) 2022-05-21 04:08:41,158 DEBUG awx.main.dispatch task c494c63a-07f0-4ac3-81f2-6d2375cb1d0f starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 04:08:41,157 DEBUG awx.main.dispatch task c63f13ee-a66d-4a76-addd-9551796afaea starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 04:08:41,160 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 04:08:41,177 DEBUG awx.main.dispatch task c494c63a-07f0-4ac3-81f2-6d2375cb1d0f is finished 2022-05-21 04:08:41,179 DEBUG awx.main.dispatch delivered 56a3c326-4276-485f-b8d0-1d7ff650a9bc to worker[178] qsize 0 2022-05-21 04:08:41,180 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5204dc8b-d6f4-4df6-9ea4-31323fceb1ec, queue=awx_private_queue) [2022-05-21 04:08:41,180: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5204dc8b-d6f4-4df6-9ea4-31323fceb1ec, queue=awx_private_queue) 2022-05-21 04:08:41,181 DEBUG awx.main.dispatch task 56a3c326-4276-485f-b8d0-1d7ff650a9bc starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 04:08:41,193 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 04:08:41,197 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 04:08:11.159353+00:00 2022-05-21 04:08:41,199 DEBUG awx.main.dispatch delivered 5204dc8b-d6f4-4df6-9ea4-31323fceb1ec to worker[195] qsize 0 2022-05-21 04:08:41,202 DEBUG awx.main.dispatch task 5204dc8b-d6f4-4df6-9ea4-31323fceb1ec starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:08:41,206 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:08:41,229 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 04:08:41,265 DEBUG awx.main.dispatch task 5204dc8b-d6f4-4df6-9ea4-31323fceb1ec is finished 2022-05-21 04:08:41,914 DEBUG awx.main.dispatch task c63f13ee-a66d-4a76-addd-9551796afaea is finished 2022-05-21 04:08:42,178 DEBUG awx.main.dispatch task 56a3c326-4276-485f-b8d0-1d7ff650a9bc is finished 2022-05-21 04:09:01,183 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(8703666f-654a-44aa-9403-84f68cbcff24, queue=awx_private_queue) [2022-05-21 04:09:01,183: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(8703666f-654a-44aa-9403-84f68cbcff24, queue=awx_private_queue) RESULT 2 OKREADY 2022-05-21 04:09:01,207 DEBUG awx.main.dispatch delivered 8703666f-654a-44aa-9403-84f68cbcff24 to worker[178] qsize 0 2022-05-21 04:09:01,212 DEBUG awx.main.dispatch task 8703666f-654a-44aa-9403-84f68cbcff24 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:09:01,215 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:09:01,239 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 04:09:01,277 DEBUG awx.main.dispatch task 8703666f-654a-44aa-9403-84f68cbcff24 is finished 2022-05-21 04:09:11,158 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(ff3178bb-fd67-47ff-a9a5-54bec9b3fd06, queue=awx_private_queue) [2022-05-21 04:09:11,158: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(ff3178bb-fd67-47ff-a9a5-54bec9b3fd06, queue=awx_private_queue) 2022-05-21 04:09:11,179 DEBUG awx.main.dispatch delivered ff3178bb-fd67-47ff-a9a5-54bec9b3fd06 to worker[195] qsize 0 2022-05-21 04:09:11,182 DEBUG awx.main.dispatch task ff3178bb-fd67-47ff-a9a5-54bec9b3fd06 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 04:09:11,196 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 04:09:11,199 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 04:08:41.193884+00:00 2022-05-21 04:09:12,320 DEBUG awx.main.dispatch task ff3178bb-fd67-47ff-a9a5-54bec9b3fd06 is finished 2022-05-21 04:09:21,184 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(1db7e5c7-b4fe-43c8-aa7c-4bdb128d2334, queue=awx_private_queue) [2022-05-21 04:09:21,184: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(1db7e5c7-b4fe-43c8-aa7c-4bdb128d2334, queue=awx_private_queue) 2022-05-21 04:09:21,206 DEBUG awx.main.dispatch delivered 1db7e5c7-b4fe-43c8-aa7c-4bdb128d2334 to worker[195] qsize 0 2022-05-21 04:09:21,209 DEBUG awx.main.dispatch task 1db7e5c7-b4fe-43c8-aa7c-4bdb128d2334 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:09:21,210 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:09:21,233 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 04:09:21,274 DEBUG awx.main.dispatch task 1db7e5c7-b4fe-43c8-aa7c-4bdb128d2334 is finished 2022-05-21 04:09:40,906 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(a915d4d1-3ff5-4a1c-b85c-3dc41d492692, queue=onap-awx-0) [2022-05-21 04:09:40,906: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(a915d4d1-3ff5-4a1c-b85c-3dc41d492692, queue=onap-awx-0) 2022-05-21 04:09:41,140 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(69e9973e-96eb-4d93-9489-32c817e1bf9d, queue=onap-awx-0) [2022-05-21 04:09:41,140: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(69e9973e-96eb-4d93-9489-32c817e1bf9d, queue=onap-awx-0) 2022-05-21 04:09:41,146 DEBUG awx.main.dispatch delivered a915d4d1-3ff5-4a1c-b85c-3dc41d492692 to worker[195] qsize 0 2022-05-21 04:09:41,148 DEBUG awx.main.dispatch task a915d4d1-3ff5-4a1c-b85c-3dc41d492692 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 04:09:41,149 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 04:09:41,157 DEBUG awx.main.dispatch delivered 69e9973e-96eb-4d93-9489-32c817e1bf9d to worker[192] qsize 0 2022-05-21 04:09:41,158 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(3a7fde21-c383-4941-8e33-4053ea5ac598, queue=awx_private_queue) [2022-05-21 04:09:41,158: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(3a7fde21-c383-4941-8e33-4053ea5ac598, queue=awx_private_queue) 2022-05-21 04:09:41,159 DEBUG awx.main.dispatch task 69e9973e-96eb-4d93-9489-32c817e1bf9d starting awx.main.tasks.awx_k8s_reaper(*[]) 2022-05-21 04:09:41,174 DEBUG awx.main.dispatch task 69e9973e-96eb-4d93-9489-32c817e1bf9d is finished 2022-05-21 04:09:41,176 DEBUG awx.main.dispatch delivered 3a7fde21-c383-4941-8e33-4053ea5ac598 to worker[192] qsize 0 2022-05-21 04:09:41,178 DEBUG awx.main.dispatch task 3a7fde21-c383-4941-8e33-4053ea5ac598 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 04:09:41,184 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(1d7244ec-f71e-43a6-af56-f95deca45ea3, queue=awx_private_queue) [2022-05-21 04:09:41,184: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(1d7244ec-f71e-43a6-af56-f95deca45ea3, queue=awx_private_queue) 2022-05-21 04:09:41,189 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 04:09:41,192 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 04:09:11.196437+00:00 2022-05-21 04:09:41,201 DEBUG awx.main.dispatch delivered 1d7244ec-f71e-43a6-af56-f95deca45ea3 to worker[181] qsize 0 2022-05-21 04:09:41,203 DEBUG awx.main.dispatch task 1d7244ec-f71e-43a6-af56-f95deca45ea3 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:09:41,205 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:09:41,225 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 04:09:41,244 DEBUG awx.main.dispatch task a915d4d1-3ff5-4a1c-b85c-3dc41d492692 is finished 2022-05-21 04:09:41,261 DEBUG awx.main.dispatch task 1d7244ec-f71e-43a6-af56-f95deca45ea3 is finished 2022-05-21 04:09:41,684 DEBUG awx.main.dispatch task 3a7fde21-c383-4941-8e33-4053ea5ac598 is finished 2022-05-21 04:10:01,194 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(8ab2b52f-0ba2-4b46-a1bb-79f6b614d10e, queue=awx_private_queue) [2022-05-21 04:10:01,194: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(8ab2b52f-0ba2-4b46-a1bb-79f6b614d10e, queue=awx_private_queue) RESULT 2 OKREADY 2022-05-21 04:10:01,217 DEBUG awx.main.dispatch delivered 8ab2b52f-0ba2-4b46-a1bb-79f6b614d10e to worker[181] qsize 0 2022-05-21 04:10:01,221 DEBUG awx.main.dispatch task 8ab2b52f-0ba2-4b46-a1bb-79f6b614d10e starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:10:01,223 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:10:01,246 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 04:10:01,286 DEBUG awx.main.dispatch task 8ab2b52f-0ba2-4b46-a1bb-79f6b614d10e is finished 2022-05-21 04:10:11,158 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(e2e10ea0-08dd-4e47-b47a-94a505f1c74b, queue=awx_private_queue) [2022-05-21 04:10:11,158: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(e2e10ea0-08dd-4e47-b47a-94a505f1c74b, queue=awx_private_queue) 2022-05-21 04:10:11,179 DEBUG awx.main.dispatch delivered e2e10ea0-08dd-4e47-b47a-94a505f1c74b to worker[178] qsize 0 2022-05-21 04:10:11,181 DEBUG awx.main.dispatch task e2e10ea0-08dd-4e47-b47a-94a505f1c74b starting awx.main.tasks.awx_periodic_scheduler(*[]) 2022-05-21 04:10:11,196 DEBUG awx.main.tasks Starting periodic scheduler 2022-05-21 04:10:11,199 DEBUG awx.main.tasks Last scheduler run was: 2022-05-21 04:09:41.189433+00:00 2022-05-21 04:10:12,360 DEBUG awx.main.dispatch task e2e10ea0-08dd-4e47-b47a-94a505f1c74b is finished 2022-05-21 04:10:21,195 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ba3563b7-16bd-41dd-aaa2-a595f6c5bcea, queue=awx_private_queue) [2022-05-21 04:10:21,195: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ba3563b7-16bd-41dd-aaa2-a595f6c5bcea, queue=awx_private_queue) 2022-05-21 04:10:21,215 DEBUG awx.main.dispatch delivered ba3563b7-16bd-41dd-aaa2-a595f6c5bcea to worker[181] qsize 0 2022-05-21 04:10:21,219 DEBUG awx.main.dispatch task ba3563b7-16bd-41dd-aaa2-a595f6c5bcea starting awx.main.scheduler.tasks.run_task_manager(*[]) 2022-05-21 04:10:21,220 DEBUG awx.main.scheduler Running Tower task manager. 2022-05-21 04:10:21,243 DEBUG awx.main.scheduler Starting Scheduler 2022-05-21 04:10:21,280 DEBUG awx.main.dispatch task ba3563b7-16bd-41dd-aaa2-a595f6c5bcea is finished 2022-05-21 04:10:41,238 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(f411949e-dff5-40c6-ba90-7726b339f4b7, queue=onap-awx-0) [2022-05-21 04:10:41,238: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(f411949e-dff5-40c6-ba90-7726b339f4b7, queue=onap-awx-0) 2022-05-21 04:10:41,466 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(6995bc45-87fd-4e22-ae90-2c9e43381bfb, queue=onap-awx-0) [2022-05-21 04:10:41,466: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(6995bc45-87fd-4e22-ae90-2c9e43381bfb, queue=onap-awx-0) 2022-05-21 04:10:41,481 DEBUG awx.main.dispatch delivered f411949e-dff5-40c6-ba90-7726b339f4b7 to worker[195] qsize 0 2022-05-21 04:10:41,485 DEBUG awx.main.dispatch delivered 6995bc45-87fd-4e22-ae90-2c9e43381bfb to worker[192] qsize 0 2022-05-21 04:10:41,484 DEBUG awx.main.dispatch task f411949e-dff5-40c6-ba90-7726b339f4b7 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2022-05-21 04:10:41,487 DEBUG awx.main.tasks Cluster node heartbeat task. 2022-05-21 04:10:41,487 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(9b37d56e-b812-4734-9e79-4210d7e4d8df, queue=awx_private_queue) [2022-05-21 04:10:41,487: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(9b37d56e-b812-4734-9e79-4210d7e4d8df, queue=awx_private_queue) 2022-05-21 04:10:41,487 DEBUG awx.main.dispatch task 6995bc45-87fd-4e