By type
Using /etc/ansible/ansible.cfg as config file 127.0.0.1 | SUCCESS => { "ansible_facts": { "discovered_interpreter_python": "/usr/libexec/platform-python" }, "changed": false, "elapsed": 0, "match_groupdict": {}, "match_groups": [], "path": null, "port": 5432, "search_regex": null, "state": "started" } Using /etc/ansible/ansible.cfg as config file 127.0.0.1 | FAILED! => { "ansible_facts": { "discovered_interpreter_python": "/usr/libexec/platform-python" }, "changed": false, "msg": "argument port is of type
and we were unable to convert to int: cannot be converted to an int" } Using /etc/ansible/ansible.cfg as config file 127.0.0.1 | FAILED! => { "ansible_facts": { "discovered_interpreter_python": "/usr/libexec/platform-python" }, "changed": false, "msg": "argument port is of type and we were unable to convert to int: cannot be converted to an int" } Using /etc/ansible/ansible.cfg as config file 127.0.0.1 | SUCCESS => { "ansible_facts": { "discovered_interpreter_python": "/usr/libexec/platform-python" }, "changed": false, "db": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER" } Default organization added. Demo Credential, Inventory, and Job Template added. (changed: True) 2021-11-02 09:48:05,171 DEBUG awx.main.dispatch publish awx.main.tasks.apply_cluster_membership_policies(72231a2d-9aad-442c-be52-c2d48a8bb68b, queue=awx_private_queue) Successfully registered instance dev-awx-0 (changed: True) 2021-11-02 09:48:08,755 DEBUG awx.main.dispatch publish awx.main.tasks.apply_cluster_membership_policies(643d460e-c591-4d96-b624-20919f479d08, queue=awx_private_queue) 2021-11-02 09:48:08,791 DEBUG awx.main.dispatch publish awx.main.tasks.apply_cluster_membership_policies(de2b1526-1116-4ae4-9036-c3aebcc41cbf, queue=awx_private_queue) Creating instance group tower (changed: True) /usr/bin/launch_awx_task.sh: line 27: unset: `#!/bin/sh': not a valid identifier 2021-11-02 09:48:09,595 INFO RPC interface 'supervisor' initialized 2021-11-02 09:48:09,596 CRIT Server 'unix_http_server' running without any HTTP authentication checking 2021-11-02 09:48:09,596 INFO supervisord started with pid 150 2021-11-02 09:48:10,601 INFO spawned: 'awx-config-watcher' with pid 153 2021-11-02 09:48:10,606 INFO spawned: 'dispatcher' with pid 154 2021-11-02 09:48:10,617 INFO spawned: 'callback-receiver' with pid 155 2021-11-02 09:48:10,621 INFO spawned: 'channels-worker' with pid 156 READY 2021-11-02 09:48:11,744 INFO success: awx-config-watcher entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-02 09:48:11,744 INFO success: dispatcher entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-02 09:48:11,744 INFO success: callback-receiver entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-02 09:48:11,745 INFO success: channels-worker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-02 09:48:13,817 - INFO - runworker - Using single-threaded worker. 2021-11-02 09:48:13,811 WARNING awx.main.dispatch scaling up worker pid:176 2021-11-02 09:48:13,817 - INFO - runworker - Running worker against channel layer default (asgi_amqp.core.AMQPChannelLayer) 2021-11-02 09:48:13,818 - INFO - worker - Listening on channels websocket.connect, websocket.disconnect, websocket.receive 2021-11-02 09:48:13,817 ERROR celery.beat Removing corrupted schedule file '/var/lib/awx/beat.db': error(11, 'Resource temporarily unavailable') Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/celery/beat.py", line 485, in setup_schedule self._store = self._open_schedule() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/celery/beat.py", line 475, in _open_schedule return self.persistence.open(self.schedule_filename, writeback=True) File "/usr/lib64/python3.6/shelve.py", line 243, in open return DbfilenameShelf(filename, flag, protocol, writeback) File "/usr/lib64/python3.6/shelve.py", line 227, in __init__ Shelf.__init__(self, dbm.open(filename, flag), protocol, writeback) File "/usr/lib64/python3.6/dbm/__init__.py", line 94, in open return mod.open(file, flag, mode) _gdbm.error: [Errno 11] Resource temporarily unavailable 2021-11-02 09:48:13,819 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:177 2021-11-02 09:48:13,819 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:177 2021-11-02 09:48:13,827 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:179 2021-11-02 09:48:13,827 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:179 2021-11-02 09:48:13,823 WARNING awx.main.dispatch scaling up worker pid:178 2021-11-02 09:48:13,835 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:180 2021-11-02 09:48:13,835 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:180 2021-11-02 09:48:13,837 WARNING awx.main.dispatch scaling up worker pid:181 2021-11-02 09:48:13,844 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:182 2021-11-02 09:48:13,844 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:182 2021-11-02 09:48:13,849 WARNING awx.main.dispatch scaling up worker pid:183 2021-11-02 09:48:13,855 DEBUG awx.main.tasks Syncing Schedules 2021-11-02 09:48:14,144 DEBUG awx.main.tasks Waited 0.0012009143829345703 seconds to obtain lock name: cluster_policy_lock 2021-11-02 09:48:14,157 DEBUG awx.main.tasks Total non-isolated instances:1 available for policy: 1 2021-11-02 09:48:14,157 DEBUG awx.main.tasks Policy percentage, adding Instances [1] to Group tower 2021-11-02 09:48:14,158 DEBUG awx.main.tasks Adding instances [1] to group tower 2021-11-02 09:48:14,165 DEBUG awx.main.tasks Cluster policy computation finished in 0.021402835845947266 seconds 2021-11-02 09:48:14,166 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 09:48:14,203 DEBUG awx.main.dispatch listening on ['awx_private_queue [direct]', 'dev-awx-0 [direct]', 'tower_broadcast_all_dev-awx-0 [fanout]'] 2021-11-02 09:48:33,992 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3e5dab5a-e5ac-4126-87cf-bd53be43ef54, queue=awx_private_queue) [2021-11-02 09:48:33,992: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3e5dab5a-e5ac-4126-87cf-bd53be43ef54, queue=awx_private_queue) 2021-11-02 09:48:34,039 DEBUG awx.main.dispatch delivered 3e5dab5a-e5ac-4126-87cf-bd53be43ef54 to worker[181] qsize 0 2021-11-02 09:48:34,051 DEBUG awx.main.dispatch task 3e5dab5a-e5ac-4126-87cf-bd53be43ef54 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:48:34,055 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:48:34,086 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:48:34,130 DEBUG awx.main.dispatch task 3e5dab5a-e5ac-4126-87cf-bd53be43ef54 is finished 2021-11-02 09:48:43,951 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d6546900-17ee-4b50-a238-6ed1e77ace15, queue=awx_private_queue) [2021-11-02 09:48:43,951: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d6546900-17ee-4b50-a238-6ed1e77ace15, queue=awx_private_queue) 2021-11-02 09:48:43,971 DEBUG awx.main.dispatch delivered d6546900-17ee-4b50-a238-6ed1e77ace15 to worker[178] qsize 0 2021-11-02 09:48:43,977 DEBUG awx.main.dispatch task d6546900-17ee-4b50-a238-6ed1e77ace15 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 09:48:44,003 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 09:48:44,052 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 09:48:44.015487+00:00 2021-11-02 09:48:44,090 DEBUG awx.main.dispatch task d6546900-17ee-4b50-a238-6ed1e77ace15 is finished 2021-11-02 09:48:53,968 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(69ed65d7-0efc-4d8b-be6f-6a07e643620f, queue=awx_private_queue) [2021-11-02 09:48:53,968: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(69ed65d7-0efc-4d8b-be6f-6a07e643620f, queue=awx_private_queue) 2021-11-02 09:48:53,994 DEBUG awx.main.dispatch delivered 69ed65d7-0efc-4d8b-be6f-6a07e643620f to worker[178] qsize 0 2021-11-02 09:48:54,000 DEBUG awx.main.dispatch task 69ed65d7-0efc-4d8b-be6f-6a07e643620f starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:48:54,002 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:48:54,026 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:48:54,078 DEBUG awx.main.dispatch task 69ed65d7-0efc-4d8b-be6f-6a07e643620f is finished RESULT 2 OKREADY 2021-11-02 09:49:13,961 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(261ce830-36ae-412b-8006-55eac4cee500, queue=dev-awx-0) [2021-11-02 09:49:13,961: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(261ce830-36ae-412b-8006-55eac4cee500, queue=dev-awx-0) 2021-11-02 09:49:14,204 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(5c485a4e-9625-44ae-9e6e-b90e4a1d8a02, queue=dev-awx-0) [2021-11-02 09:49:14,204: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(5c485a4e-9625-44ae-9e6e-b90e4a1d8a02, queue=dev-awx-0) 2021-11-02 09:49:14,221 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d137b295-864d-4f53-a6f9-6715256c2a9a, queue=awx_private_queue) [2021-11-02 09:49:14,221: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d137b295-864d-4f53-a6f9-6715256c2a9a, queue=awx_private_queue) 2021-11-02 09:49:14,221 DEBUG awx.main.dispatch delivered 261ce830-36ae-412b-8006-55eac4cee500 to worker[176] qsize 0 2021-11-02 09:49:14,225 DEBUG awx.main.dispatch delivered 5c485a4e-9625-44ae-9e6e-b90e4a1d8a02 to worker[178] qsize 0 2021-11-02 09:49:14,227 DEBUG awx.main.dispatch task 5c485a4e-9625-44ae-9e6e-b90e4a1d8a02 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 09:49:14,226 DEBUG awx.main.dispatch task 261ce830-36ae-412b-8006-55eac4cee500 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 09:49:14,235 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 09:49:14,245 DEBUG awx.main.dispatch delivered d137b295-864d-4f53-a6f9-6715256c2a9a to worker[181] qsize 0 2021-11-02 09:49:14,247 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3dc25356-581f-4a94-a0c2-7295c2eab8dd, queue=awx_private_queue) [2021-11-02 09:49:14,247: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3dc25356-581f-4a94-a0c2-7295c2eab8dd, queue=awx_private_queue) 2021-11-02 09:49:14,248 DEBUG awx.main.dispatch task 5c485a4e-9625-44ae-9e6e-b90e4a1d8a02 is finished 2021-11-02 09:49:14,248 DEBUG awx.main.dispatch task d137b295-864d-4f53-a6f9-6715256c2a9a starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 09:49:14,259 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 09:49:14,262 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 09:48:44.003969+00:00 2021-11-02 09:49:14,265 DEBUG awx.main.dispatch delivered 3dc25356-581f-4a94-a0c2-7295c2eab8dd to worker[183] qsize 0 2021-11-02 09:49:14,270 DEBUG awx.main.dispatch task 3dc25356-581f-4a94-a0c2-7295c2eab8dd starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:49:14,275 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:49:14,281 DEBUG awx.main.dispatch task 261ce830-36ae-412b-8006-55eac4cee500 is finished 2021-11-02 09:49:14,296 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:49:14,304 DEBUG awx.main.dispatch task d137b295-864d-4f53-a6f9-6715256c2a9a is finished 2021-11-02 09:49:14,333 DEBUG awx.main.dispatch task 3dc25356-581f-4a94-a0c2-7295c2eab8dd is finished 2021-11-02 09:49:34,257 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(109a78da-738b-44c1-92bd-d1158f37cab5, queue=awx_private_queue) [2021-11-02 09:49:34,257: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(109a78da-738b-44c1-92bd-d1158f37cab5, queue=awx_private_queue) 2021-11-02 09:49:34,279 DEBUG awx.main.dispatch delivered 109a78da-738b-44c1-92bd-d1158f37cab5 to worker[176] qsize 0 2021-11-02 09:49:34,283 DEBUG awx.main.dispatch task 109a78da-738b-44c1-92bd-d1158f37cab5 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:49:34,284 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:49:34,303 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:49:34,346 DEBUG awx.main.dispatch task 109a78da-738b-44c1-92bd-d1158f37cab5 is finished 2021-11-02 09:49:44,223 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(7cc0e7c5-7d0a-4e5a-beae-191d7f9ab5a7, queue=awx_private_queue) [2021-11-02 09:49:44,223: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(7cc0e7c5-7d0a-4e5a-beae-191d7f9ab5a7, queue=awx_private_queue) 2021-11-02 09:49:44,246 DEBUG awx.main.dispatch delivered 7cc0e7c5-7d0a-4e5a-beae-191d7f9ab5a7 to worker[181] qsize 0 2021-11-02 09:49:44,249 DEBUG awx.main.dispatch task 7cc0e7c5-7d0a-4e5a-beae-191d7f9ab5a7 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 09:49:44,259 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 09:49:44,262 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 09:49:14.260054+00:00 2021-11-02 09:49:46,663 DEBUG awx.main.dispatch task 7cc0e7c5-7d0a-4e5a-beae-191d7f9ab5a7 is finished 2021-11-02 09:49:54,259 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a29f3aa2-0537-450b-aa5c-a6012518fb03, queue=awx_private_queue) [2021-11-02 09:49:54,259: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a29f3aa2-0537-450b-aa5c-a6012518fb03, queue=awx_private_queue) 2021-11-02 09:49:54,284 DEBUG awx.main.dispatch delivered a29f3aa2-0537-450b-aa5c-a6012518fb03 to worker[176] qsize 0 2021-11-02 09:49:54,287 DEBUG awx.main.dispatch task a29f3aa2-0537-450b-aa5c-a6012518fb03 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:49:54,289 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:49:54,311 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:49:54,345 DEBUG awx.main.dispatch task a29f3aa2-0537-450b-aa5c-a6012518fb03 is finished RESULT 2 OKREADY 2021-11-02 09:50:13,980 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(1bc80f99-56e0-4b76-9507-83bd55c038d4, queue=dev-awx-0) [2021-11-02 09:50:13,980: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(1bc80f99-56e0-4b76-9507-83bd55c038d4, queue=dev-awx-0) 2021-11-02 09:50:14,255 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(6c60313c-3b1a-476c-afb4-9822f47eca25, queue=dev-awx-0) [2021-11-02 09:50:14,255: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(6c60313c-3b1a-476c-afb4-9822f47eca25, queue=dev-awx-0) 2021-11-02 09:50:14,272 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(06f73180-49fc-46d5-995a-defad4ed5f99, queue=awx_private_queue) [2021-11-02 09:50:14,272: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(06f73180-49fc-46d5-995a-defad4ed5f99, queue=awx_private_queue) 2021-11-02 09:50:14,284 DEBUG awx.main.dispatch delivered 1bc80f99-56e0-4b76-9507-83bd55c038d4 to worker[181] qsize 0 2021-11-02 09:50:14,288 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ab8f07b5-aa04-4b83-ae8b-fcff51a68668, queue=awx_private_queue) [2021-11-02 09:50:14,288: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ab8f07b5-aa04-4b83-ae8b-fcff51a68668, queue=awx_private_queue) 2021-11-02 09:50:14,289 DEBUG awx.main.dispatch delivered 6c60313c-3b1a-476c-afb4-9822f47eca25 to worker[183] qsize 0 2021-11-02 09:50:14,291 DEBUG awx.main.dispatch task 1bc80f99-56e0-4b76-9507-83bd55c038d4 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 09:50:14,295 DEBUG awx.main.dispatch delivered 06f73180-49fc-46d5-995a-defad4ed5f99 to worker[176] qsize 0 2021-11-02 09:50:14,297 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 09:50:14,297 DEBUG awx.main.dispatch task 6c60313c-3b1a-476c-afb4-9822f47eca25 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 09:50:14,299 DEBUG awx.main.dispatch task 06f73180-49fc-46d5-995a-defad4ed5f99 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 09:50:14,305 DEBUG awx.main.dispatch delivered ab8f07b5-aa04-4b83-ae8b-fcff51a68668 to worker[178] qsize 0 2021-11-02 09:50:14,309 DEBUG awx.main.dispatch task ab8f07b5-aa04-4b83-ae8b-fcff51a68668 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:50:14,314 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:50:14,316 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 09:50:14,318 DEBUG awx.main.dispatch task 6c60313c-3b1a-476c-afb4-9822f47eca25 is finished 2021-11-02 09:50:14,321 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 09:49:44.259744+00:00 2021-11-02 09:50:14,333 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:50:14,365 DEBUG awx.main.dispatch task ab8f07b5-aa04-4b83-ae8b-fcff51a68668 is finished 2021-11-02 09:50:17,276 DEBUG awx.main.dispatch task 1bc80f99-56e0-4b76-9507-83bd55c038d4 is finished 2021-11-02 09:50:17,371 DEBUG awx.main.dispatch task 06f73180-49fc-46d5-995a-defad4ed5f99 is finished 2021-11-02 09:50:34,298 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(557ea193-8692-4823-9f4c-c64eb15593af, queue=awx_private_queue) [2021-11-02 09:50:34,298: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(557ea193-8692-4823-9f4c-c64eb15593af, queue=awx_private_queue) 2021-11-02 09:50:34,314 DEBUG awx.main.dispatch delivered 557ea193-8692-4823-9f4c-c64eb15593af to worker[178] qsize 0 2021-11-02 09:50:34,317 DEBUG awx.main.dispatch task 557ea193-8692-4823-9f4c-c64eb15593af starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:50:34,319 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:50:34,342 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:50:34,375 DEBUG awx.main.dispatch task 557ea193-8692-4823-9f4c-c64eb15593af is finished 2021-11-02 09:50:44,273 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(734596df-7be0-49d4-9a61-0b9c34f0b7b7, queue=awx_private_queue) [2021-11-02 09:50:44,273: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(734596df-7be0-49d4-9a61-0b9c34f0b7b7, queue=awx_private_queue) 2021-11-02 09:50:44,294 DEBUG awx.main.dispatch delivered 734596df-7be0-49d4-9a61-0b9c34f0b7b7 to worker[176] qsize 0 2021-11-02 09:50:44,297 DEBUG awx.main.dispatch task 734596df-7be0-49d4-9a61-0b9c34f0b7b7 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 09:50:44,308 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 09:50:44,311 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 09:50:14.317233+00:00 2021-11-02 09:50:44,371 DEBUG awx.main.dispatch task 734596df-7be0-49d4-9a61-0b9c34f0b7b7 is finished 2021-11-02 09:50:54,298 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0fed86c6-f241-4094-b3fb-b3b62f58cbe2, queue=awx_private_queue) [2021-11-02 09:50:54,298: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0fed86c6-f241-4094-b3fb-b3b62f58cbe2, queue=awx_private_queue) 2021-11-02 09:50:54,315 DEBUG awx.main.dispatch delivered 0fed86c6-f241-4094-b3fb-b3b62f58cbe2 to worker[183] qsize 0 2021-11-02 09:50:54,321 DEBUG awx.main.dispatch task 0fed86c6-f241-4094-b3fb-b3b62f58cbe2 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:50:54,323 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:50:54,351 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:50:54,392 DEBUG awx.main.dispatch task 0fed86c6-f241-4094-b3fb-b3b62f58cbe2 is finished RESULT 2 OKREADY 2021-11-02 09:51:13,983 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(4a2beb77-726f-400b-b575-0a0c6881f3ed, queue=dev-awx-0) [2021-11-02 09:51:13,983: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(4a2beb77-726f-400b-b575-0a0c6881f3ed, queue=dev-awx-0) 2021-11-02 09:51:14,256 DEBUG awx.main.dispatch delivered 4a2beb77-726f-400b-b575-0a0c6881f3ed to worker[181] qsize 0 2021-11-02 09:51:14,255 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(0fcc3db1-056b-4626-824e-18a292f5178a, queue=dev-awx-0) [2021-11-02 09:51:14,255: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(0fcc3db1-056b-4626-824e-18a292f5178a, queue=dev-awx-0) 2021-11-02 09:51:14,259 DEBUG awx.main.dispatch task 4a2beb77-726f-400b-b575-0a0c6881f3ed starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 09:51:14,261 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 09:51:14,277 DEBUG awx.main.dispatch delivered 0fcc3db1-056b-4626-824e-18a292f5178a to worker[183] qsize 0 2021-11-02 09:51:14,279 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(ce6e4f5f-0c2d-47a8-9399-82011eae2165, queue=awx_private_queue) [2021-11-02 09:51:14,279: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(ce6e4f5f-0c2d-47a8-9399-82011eae2165, queue=awx_private_queue) 2021-11-02 09:51:14,279 DEBUG awx.main.dispatch task 0fcc3db1-056b-4626-824e-18a292f5178a starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 09:51:14,295 DEBUG awx.main.dispatch task 0fcc3db1-056b-4626-824e-18a292f5178a is finished 2021-11-02 09:51:14,301 DEBUG awx.main.dispatch delivered ce6e4f5f-0c2d-47a8-9399-82011eae2165 to worker[183] qsize 0 2021-11-02 09:51:14,303 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d476038c-5e30-49d0-a411-9d603a5dc7ae, queue=awx_private_queue) [2021-11-02 09:51:14,303: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d476038c-5e30-49d0-a411-9d603a5dc7ae, queue=awx_private_queue) 2021-11-02 09:51:14,304 DEBUG awx.main.dispatch task ce6e4f5f-0c2d-47a8-9399-82011eae2165 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 09:51:14,314 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 09:51:14,318 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 09:50:44.308675+00:00 2021-11-02 09:51:14,326 DEBUG awx.main.dispatch delivered d476038c-5e30-49d0-a411-9d603a5dc7ae to worker[178] qsize 0 2021-11-02 09:51:14,328 DEBUG awx.main.dispatch task d476038c-5e30-49d0-a411-9d603a5dc7ae starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:51:14,330 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:51:14,344 DEBUG awx.main.dispatch task 4a2beb77-726f-400b-b575-0a0c6881f3ed is finished 2021-11-02 09:51:14,351 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:51:14,360 DEBUG awx.main.dispatch task ce6e4f5f-0c2d-47a8-9399-82011eae2165 is finished 2021-11-02 09:51:14,381 DEBUG awx.main.dispatch task d476038c-5e30-49d0-a411-9d603a5dc7ae is finished 2021-11-02 09:51:34,315 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(28ef3dc8-f2e5-42f7-8e21-c9facf6343b5, queue=awx_private_queue) [2021-11-02 09:51:34,315: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(28ef3dc8-f2e5-42f7-8e21-c9facf6343b5, queue=awx_private_queue) 2021-11-02 09:51:34,343 DEBUG awx.main.dispatch delivered 28ef3dc8-f2e5-42f7-8e21-c9facf6343b5 to worker[181] qsize 0 2021-11-02 09:51:34,352 DEBUG awx.main.dispatch task 28ef3dc8-f2e5-42f7-8e21-c9facf6343b5 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:51:34,357 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:51:34,389 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:51:34,432 DEBUG awx.main.dispatch task 28ef3dc8-f2e5-42f7-8e21-c9facf6343b5 is finished 2021-11-02 09:51:44,279 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(567ab688-c928-4863-9e38-b8a73b0455f9, queue=awx_private_queue) [2021-11-02 09:51:44,279: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(567ab688-c928-4863-9e38-b8a73b0455f9, queue=awx_private_queue) 2021-11-02 09:51:44,302 DEBUG awx.main.dispatch delivered 567ab688-c928-4863-9e38-b8a73b0455f9 to worker[181] qsize 0 2021-11-02 09:51:44,305 DEBUG awx.main.dispatch task 567ab688-c928-4863-9e38-b8a73b0455f9 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 09:51:44,315 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 09:51:44,320 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 09:51:14.314405+00:00 2021-11-02 09:51:44,347 DEBUG awx.main.dispatch task 567ab688-c928-4863-9e38-b8a73b0455f9 is finished 2021-11-02 09:51:54,311 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b2a0c685-05c0-425a-9a8a-5f4ecc585bdc, queue=awx_private_queue) [2021-11-02 09:51:54,311: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b2a0c685-05c0-425a-9a8a-5f4ecc585bdc, queue=awx_private_queue) 2021-11-02 09:51:54,331 DEBUG awx.main.dispatch delivered b2a0c685-05c0-425a-9a8a-5f4ecc585bdc to worker[176] qsize 0 2021-11-02 09:51:54,340 DEBUG awx.main.dispatch task b2a0c685-05c0-425a-9a8a-5f4ecc585bdc starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:51:54,349 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:51:54,379 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:51:54,417 DEBUG awx.main.dispatch task b2a0c685-05c0-425a-9a8a-5f4ecc585bdc is finished RESULT 2 OKREADY 2021-11-02 09:52:13,993 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(f263766c-10f9-4510-8753-e1a0a19865e4, queue=dev-awx-0) [2021-11-02 09:52:13,993: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(f263766c-10f9-4510-8753-e1a0a19865e4, queue=dev-awx-0) 2021-11-02 09:52:14,252 DEBUG awx.main.dispatch delivered f263766c-10f9-4510-8753-e1a0a19865e4 to worker[181] qsize 0 2021-11-02 09:52:14,255 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(b11537b1-20b1-4f3f-b2e8-b93cefed03c0, queue=dev-awx-0) [2021-11-02 09:52:14,255: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(b11537b1-20b1-4f3f-b2e8-b93cefed03c0, queue=dev-awx-0) 2021-11-02 09:52:14,255 DEBUG awx.main.dispatch task f263766c-10f9-4510-8753-e1a0a19865e4 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 09:52:14,257 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 09:52:14,273 DEBUG awx.main.dispatch delivered b11537b1-20b1-4f3f-b2e8-b93cefed03c0 to worker[176] qsize 0 2021-11-02 09:52:14,276 DEBUG awx.main.dispatch task b11537b1-20b1-4f3f-b2e8-b93cefed03c0 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 09:52:14,278 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(f0f436c6-9d02-485a-913d-9fc5603c3905, queue=awx_private_queue) [2021-11-02 09:52:14,278: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(f0f436c6-9d02-485a-913d-9fc5603c3905, queue=awx_private_queue) 2021-11-02 09:52:14,292 DEBUG awx.main.dispatch task b11537b1-20b1-4f3f-b2e8-b93cefed03c0 is finished 2021-11-02 09:52:14,295 DEBUG awx.main.dispatch delivered f0f436c6-9d02-485a-913d-9fc5603c3905 to worker[183] qsize 0 2021-11-02 09:52:14,299 DEBUG awx.main.dispatch task f0f436c6-9d02-485a-913d-9fc5603c3905 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 09:52:14,311 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(71e97fca-53cb-4429-a5aa-06bfca523406, queue=awx_private_queue) [2021-11-02 09:52:14,311: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(71e97fca-53cb-4429-a5aa-06bfca523406, queue=awx_private_queue) 2021-11-02 09:52:14,315 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 09:52:14,321 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 09:51:44.316248+00:00 2021-11-02 09:52:14,329 DEBUG awx.main.dispatch delivered 71e97fca-53cb-4429-a5aa-06bfca523406 to worker[176] qsize 0 2021-11-02 09:52:14,332 DEBUG awx.main.dispatch task 71e97fca-53cb-4429-a5aa-06bfca523406 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:52:14,333 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:52:14,349 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:52:14,380 DEBUG awx.main.dispatch task 71e97fca-53cb-4429-a5aa-06bfca523406 is finished 2021-11-02 09:52:16,840 DEBUG awx.main.dispatch task f263766c-10f9-4510-8753-e1a0a19865e4 is finished 2021-11-02 09:52:19,194 DEBUG awx.main.dispatch task f0f436c6-9d02-485a-913d-9fc5603c3905 is finished 2021-11-02 09:52:34,311 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c462da3f-e21e-4d25-8d00-291f59f84819, queue=awx_private_queue) [2021-11-02 09:52:34,311: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c462da3f-e21e-4d25-8d00-291f59f84819, queue=awx_private_queue) 2021-11-02 09:52:34,327 DEBUG awx.main.dispatch delivered c462da3f-e21e-4d25-8d00-291f59f84819 to worker[176] qsize 0 2021-11-02 09:52:34,330 DEBUG awx.main.dispatch task c462da3f-e21e-4d25-8d00-291f59f84819 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:52:34,331 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:52:34,352 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:52:34,380 DEBUG awx.main.dispatch task c462da3f-e21e-4d25-8d00-291f59f84819 is finished 2021-11-02 09:52:44,286 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(fa75a39b-cb3d-4a95-9dbc-a155232fc856, queue=awx_private_queue) [2021-11-02 09:52:44,286: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(fa75a39b-cb3d-4a95-9dbc-a155232fc856, queue=awx_private_queue) 2021-11-02 09:52:44,321 DEBUG awx.main.dispatch delivered fa75a39b-cb3d-4a95-9dbc-a155232fc856 to worker[178] qsize 0 2021-11-02 09:52:44,329 DEBUG awx.main.dispatch task fa75a39b-cb3d-4a95-9dbc-a155232fc856 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 09:52:44,346 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 09:52:44,351 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 09:52:14.315907+00:00 2021-11-02 09:52:47,239 DEBUG awx.main.dispatch task fa75a39b-cb3d-4a95-9dbc-a155232fc856 is finished 2021-11-02 09:52:54,312 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(df367e88-bc13-4442-b4bf-16625a54d9f8, queue=awx_private_queue) [2021-11-02 09:52:54,312: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(df367e88-bc13-4442-b4bf-16625a54d9f8, queue=awx_private_queue) 2021-11-02 09:52:54,331 DEBUG awx.main.dispatch delivered df367e88-bc13-4442-b4bf-16625a54d9f8 to worker[176] qsize 0 2021-11-02 09:52:54,337 DEBUG awx.main.dispatch task df367e88-bc13-4442-b4bf-16625a54d9f8 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:52:54,342 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:52:54,365 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:52:54,393 DEBUG awx.main.dispatch task df367e88-bc13-4442-b4bf-16625a54d9f8 is finished RESULT 2 OKREADY 2021-11-02 09:53:14,002 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(5e8d5351-35fd-4ebf-bc65-77f7da99c379, queue=dev-awx-0) [2021-11-02 09:53:14,002: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(5e8d5351-35fd-4ebf-bc65-77f7da99c379, queue=dev-awx-0) 2021-11-02 09:53:14,223 DEBUG awx.main.dispatch delivered 5e8d5351-35fd-4ebf-bc65-77f7da99c379 to worker[178] qsize 0 2021-11-02 09:53:14,226 DEBUG awx.main.dispatch task 5e8d5351-35fd-4ebf-bc65-77f7da99c379 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 09:53:14,227 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 09:53:14,255 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(d2a3fae9-dfd3-4161-8644-70c674591b4c, queue=dev-awx-0) [2021-11-02 09:53:14,255: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(d2a3fae9-dfd3-4161-8644-70c674591b4c, queue=dev-awx-0) 2021-11-02 09:53:14,270 DEBUG awx.main.dispatch delivered d2a3fae9-dfd3-4161-8644-70c674591b4c to worker[181] qsize 0 2021-11-02 09:53:14,274 DEBUG awx.main.dispatch task d2a3fae9-dfd3-4161-8644-70c674591b4c starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 09:53:14,278 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(a5834c97-ab86-495d-b1d6-892e9f5e7e41, queue=awx_private_queue) [2021-11-02 09:53:14,278: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(a5834c97-ab86-495d-b1d6-892e9f5e7e41, queue=awx_private_queue) 2021-11-02 09:53:14,293 DEBUG awx.main.dispatch task d2a3fae9-dfd3-4161-8644-70c674591b4c is finished 2021-11-02 09:53:14,298 DEBUG awx.main.dispatch delivered a5834c97-ab86-495d-b1d6-892e9f5e7e41 to worker[176] qsize 0 2021-11-02 09:53:14,301 DEBUG awx.main.dispatch task a5834c97-ab86-495d-b1d6-892e9f5e7e41 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 09:53:14,311 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3bf47065-6e09-45d8-a286-508599fdd720, queue=awx_private_queue) [2021-11-02 09:53:14,311: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3bf47065-6e09-45d8-a286-508599fdd720, queue=awx_private_queue) 2021-11-02 09:53:14,314 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 09:53:14,317 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 09:52:44.346220+00:00 2021-11-02 09:53:14,340 DEBUG awx.main.dispatch delivered 3bf47065-6e09-45d8-a286-508599fdd720 to worker[183] qsize 0 2021-11-02 09:53:14,344 DEBUG awx.main.dispatch task 3bf47065-6e09-45d8-a286-508599fdd720 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:53:14,347 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:53:14,376 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:53:14,404 DEBUG awx.main.dispatch task 3bf47065-6e09-45d8-a286-508599fdd720 is finished 2021-11-02 09:53:15,697 DEBUG awx.main.dispatch task 5e8d5351-35fd-4ebf-bc65-77f7da99c379 is finished 2021-11-02 09:53:18,469 DEBUG awx.main.dispatch task a5834c97-ab86-495d-b1d6-892e9f5e7e41 is finished 2021-11-02 09:53:34,312 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(4cfbc9ac-b72f-4de4-bec8-48815559d049, queue=awx_private_queue) [2021-11-02 09:53:34,312: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(4cfbc9ac-b72f-4de4-bec8-48815559d049, queue=awx_private_queue) 2021-11-02 09:53:34,332 DEBUG awx.main.dispatch delivered 4cfbc9ac-b72f-4de4-bec8-48815559d049 to worker[178] qsize 0 2021-11-02 09:53:34,335 DEBUG awx.main.dispatch task 4cfbc9ac-b72f-4de4-bec8-48815559d049 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:53:34,336 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:53:35,357 ERROR awx.main.dispatch Worker failed to run task awx.main.scheduler.tasks.run_task_manager(*[], **{} Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection self.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect self.connection = self.get_new_connection(conn_params) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection connection = Database.connect(**conn_params) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect conn = _connect(dsn, connection_factory=connection_factory, **kwasync) psycopg2.OperationalError: could not connect to server: Connection refused Is the server running on host "awx-postgresql" (10.96.101.160) and accepting TCP/IP connections on port 5432? The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work result = self.run_callable(body) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable return _call(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/tasks.py", line 15, in run_task_manager TaskManager().schedule() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/task_manager.py", line 45, in __init__ for rampart_group in InstanceGroup.objects.prefetch_related('instances'): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 274, in __iter__ self._fetch_all() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 1242, in _fetch_all self._result_cache = list(self._iterable_class(self)) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 55, in __iter__ results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1098, in execute_sql cursor = self.connection.cursor() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor return self._cursor() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor self.ensure_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection self.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__ raise dj_exc_value.with_traceback(traceback) from exc_value File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection self.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect self.connection = self.get_new_connection(conn_params) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection connection = Database.connect(**conn_params) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect conn = _connect(dsn, connection_factory=connection_factory, **kwasync) django.db.utils.OperationalError: could not connect to server: Connection refused Is the server running on host "awx-postgresql" (10.96.101.160) and accepting TCP/IP connections on port 5432? 2021-11-02 09:53:35,371 DEBUG awx.main.dispatch task 4cfbc9ac-b72f-4de4-bec8-48815559d049 is finished 2021-11-02 09:53:44,279 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(a1fdeaac-05d5-4152-87c0-cc070da5a6f5, queue=awx_private_queue) [2021-11-02 09:53:44,279: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(a1fdeaac-05d5-4152-87c0-cc070da5a6f5, queue=awx_private_queue) 2021-11-02 09:53:44,301 DEBUG awx.main.dispatch delivered a1fdeaac-05d5-4152-87c0-cc070da5a6f5 to worker[176] qsize 0 2021-11-02 09:53:44,304 DEBUG awx.main.dispatch task a1fdeaac-05d5-4152-87c0-cc070da5a6f5 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 09:53:45,309 ERROR awx.main.dispatch Worker failed to run task awx.main.tasks.awx_periodic_scheduler(*[], **{} Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection self.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect self.connection = self.get_new_connection(conn_params) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection connection = Database.connect(**conn_params) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect conn = _connect(dsn, connection_factory=connection_factory, **kwasync) psycopg2.OperationalError: could not connect to server: Connection refused Is the server running on host "awx-postgresql" (10.96.101.160) and accepting TCP/IP connections on port 5432? The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work result = self.run_callable(body) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable return _call(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/tasks.py", line 482, in awx_periodic_scheduler with advisory_lock('awx_periodic_scheduler_lock', wait=False) as acquired: File "/usr/lib64/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/utils/pglock.py", line 13, in advisory_lock with django_pglocks_advisory_lock(*args, **kwargs) as internal_lock: File "/usr/lib64/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django_pglocks/__init__.py", line 64, in advisory_lock cursor = connections[using].cursor() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor return self._cursor() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor self.ensure_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection self.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__ raise dj_exc_value.with_traceback(traceback) from exc_value File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection self.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect self.connection = self.get_new_connection(conn_params) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection connection = Database.connect(**conn_params) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect conn = _connect(dsn, connection_factory=connection_factory, **kwasync) django.db.utils.OperationalError: could not connect to server: Connection refused Is the server running on host "awx-postgresql" (10.96.101.160) and accepting TCP/IP connections on port 5432? 2021-11-02 09:53:45,317 DEBUG awx.main.dispatch task a1fdeaac-05d5-4152-87c0-cc070da5a6f5 is finished 2021-11-02 09:53:54,315 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3669139c-237f-41dd-887f-44c2558c54cb, queue=awx_private_queue) [2021-11-02 09:53:54,315: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3669139c-237f-41dd-887f-44c2558c54cb, queue=awx_private_queue) 2021-11-02 09:53:54,341 DEBUG awx.main.dispatch delivered 3669139c-237f-41dd-887f-44c2558c54cb to worker[178] qsize 0 2021-11-02 09:53:54,347 DEBUG awx.main.dispatch task 3669139c-237f-41dd-887f-44c2558c54cb starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:53:54,351 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:53:54,379 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:53:54,420 DEBUG awx.main.dispatch task 3669139c-237f-41dd-887f-44c2558c54cb is finished RESULT 2 OKREADY 2021-11-02 09:54:14,004 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(3ffe8efc-ede0-4721-a136-2333e5ef7a45, queue=dev-awx-0) [2021-11-02 09:54:14,004: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(3ffe8efc-ede0-4721-a136-2333e5ef7a45, queue=dev-awx-0) 2021-11-02 09:54:14,244 DEBUG awx.main.dispatch delivered 3ffe8efc-ede0-4721-a136-2333e5ef7a45 to worker[178] qsize 0 2021-11-02 09:54:14,248 DEBUG awx.main.dispatch task 3ffe8efc-ede0-4721-a136-2333e5ef7a45 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 09:54:14,250 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 09:54:14,255 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(7bb7ec68-6efe-4c47-bef9-55066957cc61, queue=dev-awx-0) [2021-11-02 09:54:14,255: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(7bb7ec68-6efe-4c47-bef9-55066957cc61, queue=dev-awx-0) 2021-11-02 09:54:14,273 DEBUG awx.main.dispatch task 3ffe8efc-ede0-4721-a136-2333e5ef7a45 is finished 2021-11-02 09:54:14,290 DEBUG awx.main.dispatch delivered 7bb7ec68-6efe-4c47-bef9-55066957cc61 to worker[183] qsize 0 2021-11-02 09:54:14,292 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(354d0f83-715a-4792-9e91-56e4abfd93b8, queue=awx_private_queue) [2021-11-02 09:54:14,292: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(354d0f83-715a-4792-9e91-56e4abfd93b8, queue=awx_private_queue) 2021-11-02 09:54:14,294 DEBUG awx.main.dispatch task 7bb7ec68-6efe-4c47-bef9-55066957cc61 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 09:54:14,308 DEBUG awx.main.dispatch delivered 354d0f83-715a-4792-9e91-56e4abfd93b8 to worker[178] qsize 0 2021-11-02 09:54:14,311 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6fced313-d1d6-4d83-86cb-33cbb2c4750e, queue=awx_private_queue) [2021-11-02 09:54:14,311: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6fced313-d1d6-4d83-86cb-33cbb2c4750e, queue=awx_private_queue) 2021-11-02 09:54:14,311 DEBUG awx.main.dispatch task 7bb7ec68-6efe-4c47-bef9-55066957cc61 is finished 2021-11-02 09:54:14,311 DEBUG awx.main.dispatch task 354d0f83-715a-4792-9e91-56e4abfd93b8 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 09:54:14,326 DEBUG awx.main.dispatch delivered 6fced313-d1d6-4d83-86cb-33cbb2c4750e to worker[176] qsize 0 2021-11-02 09:54:14,329 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 09:54:14,332 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 09:53:14.314332+00:00 2021-11-02 09:54:14,330 DEBUG awx.main.dispatch task 6fced313-d1d6-4d83-86cb-33cbb2c4750e starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:54:14,337 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:54:14,368 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:54:14,380 DEBUG awx.main.dispatch task 354d0f83-715a-4792-9e91-56e4abfd93b8 is finished 2021-11-02 09:54:14,413 DEBUG awx.main.dispatch task 6fced313-d1d6-4d83-86cb-33cbb2c4750e is finished 2021-11-02 09:54:34,325 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(29a24838-bb37-46ca-b615-4f082e6527a5, queue=awx_private_queue) [2021-11-02 09:54:34,325: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(29a24838-bb37-46ca-b615-4f082e6527a5, queue=awx_private_queue) 2021-11-02 09:54:34,343 DEBUG awx.main.dispatch delivered 29a24838-bb37-46ca-b615-4f082e6527a5 to worker[183] qsize 0 2021-11-02 09:54:34,347 DEBUG awx.main.dispatch task 29a24838-bb37-46ca-b615-4f082e6527a5 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:54:34,349 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:54:34,375 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:54:34,413 DEBUG awx.main.dispatch task 29a24838-bb37-46ca-b615-4f082e6527a5 is finished 2021-11-02 09:54:44,292 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(a1588fec-bc1c-42ab-a572-d6e8822b42d8, queue=awx_private_queue) [2021-11-02 09:54:44,292: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(a1588fec-bc1c-42ab-a572-d6e8822b42d8, queue=awx_private_queue) 2021-11-02 09:54:44,309 DEBUG awx.main.dispatch delivered a1588fec-bc1c-42ab-a572-d6e8822b42d8 to worker[181] qsize 0 2021-11-02 09:54:44,314 DEBUG awx.main.dispatch task a1588fec-bc1c-42ab-a572-d6e8822b42d8 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 09:54:44,331 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 09:54:44,337 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 09:54:14.329531+00:00 2021-11-02 09:54:44,375 DEBUG awx.main.dispatch task a1588fec-bc1c-42ab-a572-d6e8822b42d8 is finished 2021-11-02 09:54:54,325 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c5a8a2d2-dbf4-459d-a7a8-4ff1860f0a7f, queue=awx_private_queue) [2021-11-02 09:54:54,325: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c5a8a2d2-dbf4-459d-a7a8-4ff1860f0a7f, queue=awx_private_queue) 2021-11-02 09:54:54,344 DEBUG awx.main.dispatch delivered c5a8a2d2-dbf4-459d-a7a8-4ff1860f0a7f to worker[181] qsize 0 2021-11-02 09:54:54,348 DEBUG awx.main.dispatch task c5a8a2d2-dbf4-459d-a7a8-4ff1860f0a7f starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:54:54,350 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:54:54,371 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:54:54,408 DEBUG awx.main.dispatch task c5a8a2d2-dbf4-459d-a7a8-4ff1860f0a7f is finished RESULT 2 OKREADY 2021-11-02 09:55:14,012 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(05da4e66-8b28-49bf-82cc-abe5eb3f6f70, queue=dev-awx-0) [2021-11-02 09:55:14,012: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(05da4e66-8b28-49bf-82cc-abe5eb3f6f70, queue=dev-awx-0) 2021-11-02 09:55:14,241 DEBUG awx.main.dispatch delivered 05da4e66-8b28-49bf-82cc-abe5eb3f6f70 to worker[183] qsize 0 2021-11-02 09:55:14,244 DEBUG awx.main.dispatch task 05da4e66-8b28-49bf-82cc-abe5eb3f6f70 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 09:55:14,245 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 09:55:14,256 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(d656d796-5321-440f-95d3-1b1de0d7266a, queue=dev-awx-0) [2021-11-02 09:55:14,256: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(d656d796-5321-440f-95d3-1b1de0d7266a, queue=dev-awx-0) 2021-11-02 09:55:14,281 DEBUG awx.main.dispatch delivered d656d796-5321-440f-95d3-1b1de0d7266a to worker[178] qsize 0 2021-11-02 09:55:14,284 DEBUG awx.main.dispatch task 05da4e66-8b28-49bf-82cc-abe5eb3f6f70 is finished 2021-11-02 09:55:14,283 DEBUG awx.main.dispatch task d656d796-5321-440f-95d3-1b1de0d7266a starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 09:55:14,292 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(e6bc56c8-d0e0-4314-9d2f-dbe9208056ad, queue=awx_private_queue) [2021-11-02 09:55:14,292: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(e6bc56c8-d0e0-4314-9d2f-dbe9208056ad, queue=awx_private_queue) 2021-11-02 09:55:14,298 DEBUG awx.main.dispatch task d656d796-5321-440f-95d3-1b1de0d7266a is finished 2021-11-02 09:55:14,306 DEBUG awx.main.dispatch delivered e6bc56c8-d0e0-4314-9d2f-dbe9208056ad to worker[183] qsize 0 2021-11-02 09:55:14,308 DEBUG awx.main.dispatch task e6bc56c8-d0e0-4314-9d2f-dbe9208056ad starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 09:55:14,320 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 09:55:14,323 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 09:54:44.331772+00:00 2021-11-02 09:55:14,324 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(1efcd599-7a5e-412a-86c9-c378767809f2, queue=awx_private_queue) [2021-11-02 09:55:14,324: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(1efcd599-7a5e-412a-86c9-c378767809f2, queue=awx_private_queue) 2021-11-02 09:55:14,338 DEBUG awx.main.dispatch delivered 1efcd599-7a5e-412a-86c9-c378767809f2 to worker[176] qsize 0 2021-11-02 09:55:14,340 DEBUG awx.main.dispatch task 1efcd599-7a5e-412a-86c9-c378767809f2 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:55:14,342 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:55:14,347 DEBUG awx.main.dispatch task e6bc56c8-d0e0-4314-9d2f-dbe9208056ad is finished 2021-11-02 09:55:14,357 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:55:14,383 DEBUG awx.main.dispatch task 1efcd599-7a5e-412a-86c9-c378767809f2 is finished 2021-11-02 09:55:34,332 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(fadb3e1c-d746-40f2-9425-e64472059a7f, queue=awx_private_queue) [2021-11-02 09:55:34,332: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(fadb3e1c-d746-40f2-9425-e64472059a7f, queue=awx_private_queue) 2021-11-02 09:55:34,361 DEBUG awx.main.dispatch delivered fadb3e1c-d746-40f2-9425-e64472059a7f to worker[181] qsize 0 2021-11-02 09:55:34,368 DEBUG awx.main.dispatch task fadb3e1c-d746-40f2-9425-e64472059a7f starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:55:34,372 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:55:34,400 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:55:34,429 DEBUG awx.main.dispatch task fadb3e1c-d746-40f2-9425-e64472059a7f is finished 2021-11-02 09:55:44,294 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(1ff2ee04-8985-43c7-b579-38b52d79bacf, queue=awx_private_queue) [2021-11-02 09:55:44,294: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(1ff2ee04-8985-43c7-b579-38b52d79bacf, queue=awx_private_queue) 2021-11-02 09:55:44,322 DEBUG awx.main.dispatch delivered 1ff2ee04-8985-43c7-b579-38b52d79bacf to worker[176] qsize 0 2021-11-02 09:55:44,330 DEBUG awx.main.dispatch task 1ff2ee04-8985-43c7-b579-38b52d79bacf starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 09:55:44,348 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 09:55:44,354 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 09:55:14.320886+00:00 2021-11-02 09:55:44,914 DEBUG awx.main.dispatch task 1ff2ee04-8985-43c7-b579-38b52d79bacf is finished 2021-11-02 09:55:54,326 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0f51db93-8f8a-463a-9394-993286365112, queue=awx_private_queue) [2021-11-02 09:55:54,326: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0f51db93-8f8a-463a-9394-993286365112, queue=awx_private_queue) 2021-11-02 09:55:54,351 DEBUG awx.main.dispatch delivered 0f51db93-8f8a-463a-9394-993286365112 to worker[178] qsize 0 2021-11-02 09:55:54,359 DEBUG awx.main.dispatch task 0f51db93-8f8a-463a-9394-993286365112 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:55:54,364 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:55:54,406 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:55:54,443 DEBUG awx.main.dispatch task 0f51db93-8f8a-463a-9394-993286365112 is finished RESULT 2 OKREADY 2021-11-02 09:56:14,022 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(8fd1926b-5594-4063-b1f2-06532a4ee775, queue=dev-awx-0) [2021-11-02 09:56:14,022: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(8fd1926b-5594-4063-b1f2-06532a4ee775, queue=dev-awx-0) 2021-11-02 09:56:14,062 DEBUG awx.main.dispatch delivered 8fd1926b-5594-4063-b1f2-06532a4ee775 to worker[181] qsize 0 2021-11-02 09:56:14,256 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(d4eed368-9535-4c67-a9f7-dadba47f55e0, queue=dev-awx-0) [2021-11-02 09:56:14,256: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(d4eed368-9535-4c67-a9f7-dadba47f55e0, queue=dev-awx-0) 2021-11-02 09:56:14,070 DEBUG awx.main.dispatch task 8fd1926b-5594-4063-b1f2-06532a4ee775 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 09:56:14,262 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 09:56:14,281 DEBUG awx.main.dispatch delivered d4eed368-9535-4c67-a9f7-dadba47f55e0 to worker[183] qsize 0 2021-11-02 09:56:14,285 DEBUG awx.main.dispatch task d4eed368-9535-4c67-a9f7-dadba47f55e0 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 09:56:14,292 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(e97e56f2-58a7-4225-8665-d671d1c24686, queue=awx_private_queue) [2021-11-02 09:56:14,292: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(e97e56f2-58a7-4225-8665-d671d1c24686, queue=awx_private_queue) 2021-11-02 09:56:14,297 DEBUG awx.main.dispatch task 8fd1926b-5594-4063-b1f2-06532a4ee775 is finished 2021-11-02 09:56:14,305 DEBUG awx.main.dispatch task d4eed368-9535-4c67-a9f7-dadba47f55e0 is finished 2021-11-02 09:56:14,310 DEBUG awx.main.dispatch delivered e97e56f2-58a7-4225-8665-d671d1c24686 to worker[176] qsize 0 2021-11-02 09:56:14,312 DEBUG awx.main.dispatch task e97e56f2-58a7-4225-8665-d671d1c24686 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 09:56:14,322 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 09:56:14,324 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 09:55:44.348572+00:00 2021-11-02 09:56:14,326 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(4018f427-4476-44f1-b191-8d6296411d71, queue=awx_private_queue) [2021-11-02 09:56:14,326: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(4018f427-4476-44f1-b191-8d6296411d71, queue=awx_private_queue) 2021-11-02 09:56:14,337 DEBUG awx.main.dispatch task e97e56f2-58a7-4225-8665-d671d1c24686 is finished 2021-11-02 09:56:14,340 DEBUG awx.main.dispatch delivered 4018f427-4476-44f1-b191-8d6296411d71 to worker[178] qsize 0 2021-11-02 09:56:14,342 DEBUG awx.main.dispatch task 4018f427-4476-44f1-b191-8d6296411d71 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:56:14,346 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:56:14,362 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:56:14,388 DEBUG awx.main.dispatch task 4018f427-4476-44f1-b191-8d6296411d71 is finished 2021-11-02 09:56:34,332 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3ab825ce-323d-482e-90e0-a64adedf8795, queue=awx_private_queue) [2021-11-02 09:56:34,332: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3ab825ce-323d-482e-90e0-a64adedf8795, queue=awx_private_queue) 2021-11-02 09:56:34,349 DEBUG awx.main.dispatch delivered 3ab825ce-323d-482e-90e0-a64adedf8795 to worker[181] qsize 0 2021-11-02 09:56:34,351 DEBUG awx.main.dispatch task 3ab825ce-323d-482e-90e0-a64adedf8795 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:56:34,352 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:56:34,368 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:56:34,395 DEBUG awx.main.dispatch task 3ab825ce-323d-482e-90e0-a64adedf8795 is finished 2021-11-02 09:56:44,301 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(2d9e226a-08a5-4f9e-a202-386037b90e26, queue=awx_private_queue) [2021-11-02 09:56:44,301: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(2d9e226a-08a5-4f9e-a202-386037b90e26, queue=awx_private_queue) 2021-11-02 09:56:44,334 DEBUG awx.main.dispatch delivered 2d9e226a-08a5-4f9e-a202-386037b90e26 to worker[178] qsize 0 2021-11-02 09:56:44,343 DEBUG awx.main.dispatch task 2d9e226a-08a5-4f9e-a202-386037b90e26 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 09:56:44,366 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 09:56:44,374 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 09:56:14.322406+00:00 2021-11-02 09:56:44,409 DEBUG awx.main.dispatch task 2d9e226a-08a5-4f9e-a202-386037b90e26 is finished 2021-11-02 09:56:54,333 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f6560004-4050-41de-b9e6-27cc11cc2efc, queue=awx_private_queue) [2021-11-02 09:56:54,333: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f6560004-4050-41de-b9e6-27cc11cc2efc, queue=awx_private_queue) 2021-11-02 09:56:54,351 DEBUG awx.main.dispatch delivered f6560004-4050-41de-b9e6-27cc11cc2efc to worker[181] qsize 0 2021-11-02 09:56:54,356 DEBUG awx.main.dispatch task f6560004-4050-41de-b9e6-27cc11cc2efc starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:56:54,361 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:56:54,385 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:56:54,418 DEBUG awx.main.dispatch task f6560004-4050-41de-b9e6-27cc11cc2efc is finished RESULT 2 OKREADY 2021-11-02 09:57:14,022 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(1be18366-c40c-49f1-8391-5d2f310e6960, queue=dev-awx-0) [2021-11-02 09:57:14,022: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(1be18366-c40c-49f1-8391-5d2f310e6960, queue=dev-awx-0) 2021-11-02 09:57:14,065 DEBUG awx.main.dispatch delivered 1be18366-c40c-49f1-8391-5d2f310e6960 to worker[181] qsize 0 2021-11-02 09:57:14,067 DEBUG awx.main.dispatch task 1be18366-c40c-49f1-8391-5d2f310e6960 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 09:57:14,069 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 09:57:14,255 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(3dbba9e8-e6b7-4190-98d2-34d93488c0a6, queue=dev-awx-0) [2021-11-02 09:57:14,255: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(3dbba9e8-e6b7-4190-98d2-34d93488c0a6, queue=dev-awx-0) 2021-11-02 09:57:14,276 DEBUG awx.main.dispatch delivered 3dbba9e8-e6b7-4190-98d2-34d93488c0a6 to worker[183] qsize 0 2021-11-02 09:57:14,293 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(30557de5-f164-4ab3-96e6-7ae5a82eb670, queue=awx_private_queue) [2021-11-02 09:57:14,293: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(30557de5-f164-4ab3-96e6-7ae5a82eb670, queue=awx_private_queue) 2021-11-02 09:57:14,114 DEBUG awx.main.dispatch task 1be18366-c40c-49f1-8391-5d2f310e6960 is finished 2021-11-02 09:57:14,309 DEBUG awx.main.dispatch delivered 30557de5-f164-4ab3-96e6-7ae5a82eb670 to worker[181] qsize 0 2021-11-02 09:57:14,311 DEBUG awx.main.dispatch task 30557de5-f164-4ab3-96e6-7ae5a82eb670 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 09:57:14,319 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 09:57:14,321 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 09:56:44.367542+00:00 2021-11-02 09:57:14,331 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(14d34c5a-9b63-484e-9ab5-66042cb18c32, queue=awx_private_queue) [2021-11-02 09:57:14,331: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(14d34c5a-9b63-484e-9ab5-66042cb18c32, queue=awx_private_queue) 2021-11-02 09:57:14,334 DEBUG awx.main.dispatch task 30557de5-f164-4ab3-96e6-7ae5a82eb670 is finished 2021-11-02 09:57:14,345 DEBUG awx.main.dispatch delivered 14d34c5a-9b63-484e-9ab5-66042cb18c32 to worker[176] qsize 0 2021-11-02 09:57:14,350 DEBUG awx.main.dispatch task 14d34c5a-9b63-484e-9ab5-66042cb18c32 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:57:14,358 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:57:14,385 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:57:14,426 DEBUG awx.main.dispatch task 14d34c5a-9b63-484e-9ab5-66042cb18c32 is finished 2021-11-02 09:57:14,282 DEBUG awx.main.dispatch task 3dbba9e8-e6b7-4190-98d2-34d93488c0a6 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 09:57:14,523 DEBUG awx.main.dispatch task 3dbba9e8-e6b7-4190-98d2-34d93488c0a6 is finished 2021-11-02 09:57:34,332 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c9c6747d-840d-42eb-b1a6-0b3b2d09e4cb, queue=awx_private_queue) [2021-11-02 09:57:34,332: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c9c6747d-840d-42eb-b1a6-0b3b2d09e4cb, queue=awx_private_queue) 2021-11-02 09:57:34,383 DEBUG awx.main.dispatch delivered c9c6747d-840d-42eb-b1a6-0b3b2d09e4cb to worker[176] qsize 0 2021-11-02 09:57:34,387 DEBUG awx.main.dispatch task c9c6747d-840d-42eb-b1a6-0b3b2d09e4cb starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:57:34,389 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:57:34,411 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:57:34,448 DEBUG awx.main.dispatch task c9c6747d-840d-42eb-b1a6-0b3b2d09e4cb is finished 2021-11-02 09:57:44,299 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(91662f3b-bf96-4b6e-a2d3-54520b4c0e9f, queue=awx_private_queue) [2021-11-02 09:57:44,299: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(91662f3b-bf96-4b6e-a2d3-54520b4c0e9f, queue=awx_private_queue) 2021-11-02 09:57:44,322 DEBUG awx.main.dispatch delivered 91662f3b-bf96-4b6e-a2d3-54520b4c0e9f to worker[181] qsize 0 2021-11-02 09:57:44,325 DEBUG awx.main.dispatch task 91662f3b-bf96-4b6e-a2d3-54520b4c0e9f starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 09:57:44,336 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 09:57:44,339 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 09:57:14.319431+00:00 2021-11-02 09:57:44,421 DEBUG awx.main.dispatch task 91662f3b-bf96-4b6e-a2d3-54520b4c0e9f is finished 2021-11-02 09:57:54,332 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(049759a3-91ad-4cb1-b264-0d42956f218e, queue=awx_private_queue) [2021-11-02 09:57:54,332: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(049759a3-91ad-4cb1-b264-0d42956f218e, queue=awx_private_queue) 2021-11-02 09:57:54,357 DEBUG awx.main.dispatch delivered 049759a3-91ad-4cb1-b264-0d42956f218e to worker[183] qsize 0 2021-11-02 09:57:54,362 DEBUG awx.main.dispatch task 049759a3-91ad-4cb1-b264-0d42956f218e starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:57:54,363 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:57:54,381 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:57:54,414 DEBUG awx.main.dispatch task 049759a3-91ad-4cb1-b264-0d42956f218e is finished RESULT 2 OKREADY 2021-11-02 09:58:13,966 DEBUG awx.main.dispatch publish awx.main.tasks.awx_isolated_heartbeat(71518f1b-7082-4741-a7c0-b14c87de6c66, queue=dev-awx-0) [2021-11-02 09:58:13,966: DEBUG/Process-1] publish awx.main.tasks.awx_isolated_heartbeat(71518f1b-7082-4741-a7c0-b14c87de6c66, queue=dev-awx-0) 2021-11-02 09:58:13,993 DEBUG awx.main.dispatch delivered 71518f1b-7082-4741-a7c0-b14c87de6c66 to worker[183] qsize 0 2021-11-02 09:58:13,999 DEBUG awx.main.dispatch task 71518f1b-7082-4741-a7c0-b14c87de6c66 starting awx.main.tasks.awx_isolated_heartbeat(*[]) 2021-11-02 09:58:14,003 DEBUG awx.main.tasks Controlling node checking for any isolated management tasks. 2021-11-02 09:58:14,022 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(13fca2f5-faaa-4804-abfe-cc48d708e2ca, queue=dev-awx-0) [2021-11-02 09:58:14,022: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(13fca2f5-faaa-4804-abfe-cc48d708e2ca, queue=dev-awx-0) 2021-11-02 09:58:14,028 DEBUG awx.main.dispatch task 71518f1b-7082-4741-a7c0-b14c87de6c66 is finished 2021-11-02 09:58:14,058 DEBUG awx.main.dispatch delivered 13fca2f5-faaa-4804-abfe-cc48d708e2ca to worker[178] qsize 0 2021-11-02 09:58:14,061 DEBUG awx.main.dispatch task 13fca2f5-faaa-4804-abfe-cc48d708e2ca starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 09:58:14,065 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 09:58:14,143 DEBUG awx.main.dispatch task 13fca2f5-faaa-4804-abfe-cc48d708e2ca is finished 2021-11-02 09:58:14,256 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(a950ec88-3a75-4be0-8d41-d7b6071d194d, queue=dev-awx-0) [2021-11-02 09:58:14,256: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(a950ec88-3a75-4be0-8d41-d7b6071d194d, queue=dev-awx-0) 2021-11-02 09:58:14,469 DEBUG awx.main.dispatch delivered a950ec88-3a75-4be0-8d41-d7b6071d194d to worker[183] qsize 0 2021-11-02 09:58:14,471 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(397441b1-107a-4e49-af08-934a9d861bf1, queue=awx_private_queue) [2021-11-02 09:58:14,471: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(397441b1-107a-4e49-af08-934a9d861bf1, queue=awx_private_queue) 2021-11-02 09:58:14,472 DEBUG awx.main.dispatch task a950ec88-3a75-4be0-8d41-d7b6071d194d starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 09:58:14,484 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(58b1f75b-10cf-4231-adfb-4e1d17fea42c, queue=awx_private_queue) [2021-11-02 09:58:14,484: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(58b1f75b-10cf-4231-adfb-4e1d17fea42c, queue=awx_private_queue) 2021-11-02 09:58:14,483 DEBUG awx.main.dispatch delivered 397441b1-107a-4e49-af08-934a9d861bf1 to worker[176] qsize 0 2021-11-02 09:58:14,488 DEBUG awx.main.dispatch task a950ec88-3a75-4be0-8d41-d7b6071d194d is finished 2021-11-02 09:58:14,489 DEBUG awx.main.dispatch task 397441b1-107a-4e49-af08-934a9d861bf1 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 09:58:14,497 DEBUG awx.main.dispatch delivered 58b1f75b-10cf-4231-adfb-4e1d17fea42c to worker[181] qsize 0 2021-11-02 09:58:14,501 DEBUG awx.main.dispatch task 58b1f75b-10cf-4231-adfb-4e1d17fea42c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:58:14,505 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:58:14,509 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 09:58:14,516 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 09:57:44.336613+00:00 2021-11-02 09:58:14,526 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:58:14,536 DEBUG awx.main.dispatch task 397441b1-107a-4e49-af08-934a9d861bf1 is finished 2021-11-02 09:58:14,563 DEBUG awx.main.dispatch task 58b1f75b-10cf-4231-adfb-4e1d17fea42c is finished 2021-11-02 09:58:34,491 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(015d974e-5197-4f4a-a654-ec84d5889a23, queue=awx_private_queue) [2021-11-02 09:58:34,491: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(015d974e-5197-4f4a-a654-ec84d5889a23, queue=awx_private_queue) 2021-11-02 09:58:34,511 DEBUG awx.main.dispatch delivered 015d974e-5197-4f4a-a654-ec84d5889a23 to worker[183] qsize 0 2021-11-02 09:58:34,513 DEBUG awx.main.dispatch task 015d974e-5197-4f4a-a654-ec84d5889a23 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:58:34,515 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:58:34,539 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:58:34,583 DEBUG awx.main.dispatch task 015d974e-5197-4f4a-a654-ec84d5889a23 is finished 2021-11-02 09:58:44,473 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d5f1482b-ab4a-49fe-92f2-cbd0c9b0dd9f, queue=awx_private_queue) [2021-11-02 09:58:44,473: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d5f1482b-ab4a-49fe-92f2-cbd0c9b0dd9f, queue=awx_private_queue) 2021-11-02 09:58:44,500 DEBUG awx.main.dispatch delivered d5f1482b-ab4a-49fe-92f2-cbd0c9b0dd9f to worker[176] qsize 0 2021-11-02 09:58:44,504 DEBUG awx.main.dispatch task d5f1482b-ab4a-49fe-92f2-cbd0c9b0dd9f starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 09:58:44,541 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 09:58:44,548 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 09:58:14.509847+00:00 2021-11-02 09:58:44,678 DEBUG awx.main.dispatch task d5f1482b-ab4a-49fe-92f2-cbd0c9b0dd9f is finished 2021-11-02 09:58:54,491 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f8f4999e-1332-4cc6-b531-d9474b5f5596, queue=awx_private_queue) [2021-11-02 09:58:54,491: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f8f4999e-1332-4cc6-b531-d9474b5f5596, queue=awx_private_queue) 2021-11-02 09:58:54,513 DEBUG awx.main.dispatch delivered f8f4999e-1332-4cc6-b531-d9474b5f5596 to worker[183] qsize 0 2021-11-02 09:58:54,517 DEBUG awx.main.dispatch task f8f4999e-1332-4cc6-b531-d9474b5f5596 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:58:54,519 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:58:54,570 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:58:54,619 DEBUG awx.main.dispatch task f8f4999e-1332-4cc6-b531-d9474b5f5596 is finished RESULT 2 OKREADY 2021-11-02 09:59:14,022 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(37413168-4486-4145-b99b-13e3965ac617, queue=dev-awx-0) [2021-11-02 09:59:14,022: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(37413168-4486-4145-b99b-13e3965ac617, queue=dev-awx-0) 2021-11-02 09:59:14,060 DEBUG awx.main.dispatch delivered 37413168-4486-4145-b99b-13e3965ac617 to worker[178] qsize 0 2021-11-02 09:59:14,063 DEBUG awx.main.dispatch task 37413168-4486-4145-b99b-13e3965ac617 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 09:59:14,066 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 09:59:14,093 DEBUG awx.main.dispatch task 37413168-4486-4145-b99b-13e3965ac617 is finished 2021-11-02 09:59:14,256 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(e64c7251-caff-4d0b-a3d3-cff2bfb8556a, queue=dev-awx-0) [2021-11-02 09:59:14,256: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(e64c7251-caff-4d0b-a3d3-cff2bfb8556a, queue=dev-awx-0) 2021-11-02 09:59:14,474 DEBUG awx.main.dispatch delivered e64c7251-caff-4d0b-a3d3-cff2bfb8556a to worker[181] qsize 0 2021-11-02 09:59:14,477 DEBUG awx.main.dispatch task e64c7251-caff-4d0b-a3d3-cff2bfb8556a starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 09:59:14,477 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(0b47dd50-ace8-4776-b907-1b800b8bf49d, queue=awx_private_queue) [2021-11-02 09:59:14,477: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(0b47dd50-ace8-4776-b907-1b800b8bf49d, queue=awx_private_queue) 2021-11-02 09:59:14,492 DEBUG awx.main.dispatch task e64c7251-caff-4d0b-a3d3-cff2bfb8556a is finished 2021-11-02 09:59:14,500 DEBUG awx.main.dispatch delivered 0b47dd50-ace8-4776-b907-1b800b8bf49d to worker[181] qsize 0 2021-11-02 09:59:14,502 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d8dfb347-432f-4259-96c8-627919ee0906, queue=awx_private_queue) [2021-11-02 09:59:14,502: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d8dfb347-432f-4259-96c8-627919ee0906, queue=awx_private_queue) 2021-11-02 09:59:14,502 DEBUG awx.main.dispatch task 0b47dd50-ace8-4776-b907-1b800b8bf49d starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 09:59:14,512 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 09:59:14,515 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 09:58:44.541628+00:00 2021-11-02 09:59:14,520 DEBUG awx.main.dispatch delivered d8dfb347-432f-4259-96c8-627919ee0906 to worker[183] qsize 0 2021-11-02 09:59:14,523 DEBUG awx.main.dispatch task d8dfb347-432f-4259-96c8-627919ee0906 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:59:14,525 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:59:14,529 DEBUG awx.main.dispatch task 0b47dd50-ace8-4776-b907-1b800b8bf49d is finished 2021-11-02 09:59:14,541 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:59:14,572 DEBUG awx.main.dispatch task d8dfb347-432f-4259-96c8-627919ee0906 is finished 2021-11-02 09:59:34,505 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(aeeeb3a0-98a5-4658-8bc3-40378be8132e, queue=awx_private_queue) [2021-11-02 09:59:34,505: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(aeeeb3a0-98a5-4658-8bc3-40378be8132e, queue=awx_private_queue) 2021-11-02 09:59:34,532 DEBUG awx.main.dispatch delivered aeeeb3a0-98a5-4658-8bc3-40378be8132e to worker[178] qsize 0 2021-11-02 09:59:34,542 DEBUG awx.main.dispatch task aeeeb3a0-98a5-4658-8bc3-40378be8132e starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:59:34,547 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:59:34,577 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:59:34,616 DEBUG awx.main.dispatch task aeeeb3a0-98a5-4658-8bc3-40378be8132e is finished 2021-11-02 09:59:44,479 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(e2af19f8-ce5d-4bd4-861b-3c97f94670ab, queue=awx_private_queue) [2021-11-02 09:59:44,479: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(e2af19f8-ce5d-4bd4-861b-3c97f94670ab, queue=awx_private_queue) 2021-11-02 09:59:44,500 DEBUG awx.main.dispatch delivered e2af19f8-ce5d-4bd4-861b-3c97f94670ab to worker[183] qsize 0 2021-11-02 09:59:44,506 DEBUG awx.main.dispatch task e2af19f8-ce5d-4bd4-861b-3c97f94670ab starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 09:59:44,520 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 09:59:44,528 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 09:59:14.512698+00:00 2021-11-02 09:59:44,566 DEBUG awx.main.dispatch task e2af19f8-ce5d-4bd4-861b-3c97f94670ab is finished 2021-11-02 09:59:54,504 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(acbd0645-7e86-49c4-9b39-387ffcd5ecb4, queue=awx_private_queue) [2021-11-02 09:59:54,504: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(acbd0645-7e86-49c4-9b39-387ffcd5ecb4, queue=awx_private_queue) 2021-11-02 09:59:54,534 DEBUG awx.main.dispatch delivered acbd0645-7e86-49c4-9b39-387ffcd5ecb4 to worker[176] qsize 0 2021-11-02 09:59:54,539 DEBUG awx.main.dispatch task acbd0645-7e86-49c4-9b39-387ffcd5ecb4 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 09:59:54,544 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 09:59:54,588 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 09:59:54,632 DEBUG awx.main.dispatch task acbd0645-7e86-49c4-9b39-387ffcd5ecb4 is finished RESULT 2 OKREADY 2021-11-02 10:00:14,028 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(d1a9614c-0ca7-4c0e-b11d-7a1763b8e383, queue=dev-awx-0) [2021-11-02 10:00:14,028: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(d1a9614c-0ca7-4c0e-b11d-7a1763b8e383, queue=dev-awx-0) 2021-11-02 10:00:14,100 DEBUG awx.main.dispatch delivered d1a9614c-0ca7-4c0e-b11d-7a1763b8e383 to worker[178] qsize 0 2021-11-02 10:00:14,255 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(b6a332a8-96bb-4752-85fb-b21bc6b62115, queue=dev-awx-0) [2021-11-02 10:00:14,255: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(b6a332a8-96bb-4752-85fb-b21bc6b62115, queue=dev-awx-0) 2021-11-02 10:00:14,267 DEBUG awx.main.dispatch delivered b6a332a8-96bb-4752-85fb-b21bc6b62115 to worker[183] qsize 0 2021-11-02 10:00:14,269 DEBUG awx.main.dispatch task b6a332a8-96bb-4752-85fb-b21bc6b62115 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:00:14,281 DEBUG awx.main.dispatch task b6a332a8-96bb-4752-85fb-b21bc6b62115 is finished 2021-11-02 10:00:14,103 DEBUG awx.main.dispatch task d1a9614c-0ca7-4c0e-b11d-7a1763b8e383 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:00:14,286 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:00:14,315 DEBUG awx.main.dispatch task d1a9614c-0ca7-4c0e-b11d-7a1763b8e383 is finished 2021-11-02 10:00:14,477 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(9f8776f0-b0d4-406e-8046-c2df2ded1dea, queue=awx_private_queue) [2021-11-02 10:00:14,477: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(9f8776f0-b0d4-406e-8046-c2df2ded1dea, queue=awx_private_queue) 2021-11-02 10:00:14,495 DEBUG awx.main.dispatch delivered 9f8776f0-b0d4-406e-8046-c2df2ded1dea to worker[176] qsize 0 2021-11-02 10:00:14,497 DEBUG awx.main.dispatch task 9f8776f0-b0d4-406e-8046-c2df2ded1dea starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:00:14,502 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(19b89c5e-a06c-46dd-b5d3-543d29036895, queue=awx_private_queue) [2021-11-02 10:00:14,502: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(19b89c5e-a06c-46dd-b5d3-543d29036895, queue=awx_private_queue) 2021-11-02 10:00:14,506 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:00:14,509 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 09:59:44.521065+00:00 2021-11-02 10:00:14,515 DEBUG awx.main.dispatch delivered 19b89c5e-a06c-46dd-b5d3-543d29036895 to worker[178] qsize 0 2021-11-02 10:00:14,518 DEBUG awx.main.dispatch task 19b89c5e-a06c-46dd-b5d3-543d29036895 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:00:14,519 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:00:14,523 DEBUG awx.main.dispatch task 9f8776f0-b0d4-406e-8046-c2df2ded1dea is finished 2021-11-02 10:00:14,536 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:00:14,563 DEBUG awx.main.dispatch task 19b89c5e-a06c-46dd-b5d3-543d29036895 is finished 2021-11-02 10:00:34,514 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c55393ea-8962-4573-b7d9-4ef14ef85d1b, queue=awx_private_queue) [2021-11-02 10:00:34,514: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c55393ea-8962-4573-b7d9-4ef14ef85d1b, queue=awx_private_queue) 2021-11-02 10:00:34,535 DEBUG awx.main.dispatch delivered c55393ea-8962-4573-b7d9-4ef14ef85d1b to worker[181] qsize 0 2021-11-02 10:00:34,539 DEBUG awx.main.dispatch task c55393ea-8962-4573-b7d9-4ef14ef85d1b starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:00:34,544 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:00:34,569 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:00:34,597 DEBUG awx.main.dispatch task c55393ea-8962-4573-b7d9-4ef14ef85d1b is finished 2021-11-02 10:00:44,488 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(80b2112d-9de0-4677-8406-052e360711f6, queue=awx_private_queue) [2021-11-02 10:00:44,488: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(80b2112d-9de0-4677-8406-052e360711f6, queue=awx_private_queue) 2021-11-02 10:00:44,524 DEBUG awx.main.dispatch delivered 80b2112d-9de0-4677-8406-052e360711f6 to worker[176] qsize 0 2021-11-02 10:00:44,533 DEBUG awx.main.dispatch task 80b2112d-9de0-4677-8406-052e360711f6 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:00:44,547 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:00:44,552 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:00:14.507028+00:00 2021-11-02 10:00:44,814 DEBUG awx.main.dispatch task 80b2112d-9de0-4677-8406-052e360711f6 is finished 2021-11-02 10:00:54,518 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(434cdd3c-4e5f-4bf9-8467-45a002b9e28b, queue=awx_private_queue) [2021-11-02 10:00:54,518: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(434cdd3c-4e5f-4bf9-8467-45a002b9e28b, queue=awx_private_queue) 2021-11-02 10:00:54,563 DEBUG awx.main.dispatch delivered 434cdd3c-4e5f-4bf9-8467-45a002b9e28b to worker[178] qsize 0 2021-11-02 10:00:54,570 DEBUG awx.main.dispatch task 434cdd3c-4e5f-4bf9-8467-45a002b9e28b starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:00:54,574 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:00:54,599 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:00:54,638 DEBUG awx.main.dispatch task 434cdd3c-4e5f-4bf9-8467-45a002b9e28b is finished RESULT 2 OKREADY 2021-11-02 10:01:14,035 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(bd0b507f-67cc-4136-9094-f765989b9976, queue=dev-awx-0) [2021-11-02 10:01:14,035: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(bd0b507f-67cc-4136-9094-f765989b9976, queue=dev-awx-0) 2021-11-02 10:01:14,110 DEBUG awx.main.dispatch delivered bd0b507f-67cc-4136-9094-f765989b9976 to worker[181] qsize 0 2021-11-02 10:01:14,114 DEBUG awx.main.dispatch task bd0b507f-67cc-4136-9094-f765989b9976 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:01:14,119 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:01:14,179 DEBUG awx.main.dispatch task bd0b507f-67cc-4136-9094-f765989b9976 is finished 2021-11-02 10:01:14,256 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(d420e870-10f8-4905-accf-d93fee2b7bea, queue=dev-awx-0) [2021-11-02 10:01:14,256: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(d420e870-10f8-4905-accf-d93fee2b7bea, queue=dev-awx-0) 2021-11-02 10:01:14,276 DEBUG awx.main.dispatch delivered d420e870-10f8-4905-accf-d93fee2b7bea to worker[183] qsize 0 2021-11-02 10:01:14,281 DEBUG awx.main.dispatch task d420e870-10f8-4905-accf-d93fee2b7bea starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:01:14,575 DEBUG awx.main.dispatch task d420e870-10f8-4905-accf-d93fee2b7bea is finished 2021-11-02 10:01:14,485 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(44730d30-9994-4ccc-80d6-a70eaf10597a, queue=awx_private_queue) [2021-11-02 10:01:14,485: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(44730d30-9994-4ccc-80d6-a70eaf10597a, queue=awx_private_queue) 2021-11-02 10:01:14,726 DEBUG awx.main.dispatch delivered 44730d30-9994-4ccc-80d6-a70eaf10597a to worker[181] qsize 0 2021-11-02 10:01:14,728 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6c5112a5-6963-4b2c-b0ee-425d1e15a19e, queue=awx_private_queue) [2021-11-02 10:01:14,728: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6c5112a5-6963-4b2c-b0ee-425d1e15a19e, queue=awx_private_queue) 2021-11-02 10:01:14,728 DEBUG awx.main.dispatch task 44730d30-9994-4ccc-80d6-a70eaf10597a starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:01:14,740 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:01:14,741 DEBUG awx.main.dispatch delivered 6c5112a5-6963-4b2c-b0ee-425d1e15a19e to worker[178] qsize 0 2021-11-02 10:01:14,743 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:00:44.547366+00:00 2021-11-02 10:01:14,743 DEBUG awx.main.dispatch task 6c5112a5-6963-4b2c-b0ee-425d1e15a19e starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:01:14,746 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:01:14,765 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:01:14,798 DEBUG awx.main.dispatch task 6c5112a5-6963-4b2c-b0ee-425d1e15a19e is finished 2021-11-02 10:01:14,819 DEBUG awx.main.dispatch task 44730d30-9994-4ccc-80d6-a70eaf10597a is finished 2021-11-02 10:01:34,738 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(fdf7a3b5-7dce-4db9-851d-a009931d1796, queue=awx_private_queue) [2021-11-02 10:01:34,738: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(fdf7a3b5-7dce-4db9-851d-a009931d1796, queue=awx_private_queue) 2021-11-02 10:01:34,758 DEBUG awx.main.dispatch delivered fdf7a3b5-7dce-4db9-851d-a009931d1796 to worker[181] qsize 0 2021-11-02 10:01:34,760 DEBUG awx.main.dispatch task fdf7a3b5-7dce-4db9-851d-a009931d1796 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:01:34,762 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:01:34,778 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:01:34,805 DEBUG awx.main.dispatch task fdf7a3b5-7dce-4db9-851d-a009931d1796 is finished 2021-11-02 10:01:44,485 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(564c2a70-41bb-443f-99b8-a9ac8170f40f, queue=awx_private_queue) [2021-11-02 10:01:44,485: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(564c2a70-41bb-443f-99b8-a9ac8170f40f, queue=awx_private_queue) 2021-11-02 10:01:44,509 DEBUG awx.main.dispatch delivered 564c2a70-41bb-443f-99b8-a9ac8170f40f to worker[181] qsize 0 2021-11-02 10:01:44,511 DEBUG awx.main.dispatch task 564c2a70-41bb-443f-99b8-a9ac8170f40f starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:01:44,521 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:01:44,524 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:01:14.740693+00:00 2021-11-02 10:01:44,569 DEBUG awx.main.dispatch task 564c2a70-41bb-443f-99b8-a9ac8170f40f is finished 2021-11-02 10:01:54,738 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ab6620c2-a8d9-4cee-906b-8c26b6eb2def, queue=awx_private_queue) [2021-11-02 10:01:54,738: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ab6620c2-a8d9-4cee-906b-8c26b6eb2def, queue=awx_private_queue) 2021-11-02 10:01:54,754 DEBUG awx.main.dispatch delivered ab6620c2-a8d9-4cee-906b-8c26b6eb2def to worker[183] qsize 0 2021-11-02 10:01:54,758 DEBUG awx.main.dispatch task ab6620c2-a8d9-4cee-906b-8c26b6eb2def starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:01:54,759 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:01:54,781 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:01:54,813 DEBUG awx.main.dispatch task ab6620c2-a8d9-4cee-906b-8c26b6eb2def is finished RESULT 2 OKREADY 2021-11-02 10:02:14,039 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(cba3cc3f-08e5-41b0-812d-79700ae6ea8e, queue=dev-awx-0) [2021-11-02 10:02:14,039: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(cba3cc3f-08e5-41b0-812d-79700ae6ea8e, queue=dev-awx-0) 2021-11-02 10:02:14,116 DEBUG awx.main.dispatch delivered cba3cc3f-08e5-41b0-812d-79700ae6ea8e to worker[178] qsize 0 2021-11-02 10:02:14,123 DEBUG awx.main.dispatch task cba3cc3f-08e5-41b0-812d-79700ae6ea8e starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:02:14,127 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:02:14,212 DEBUG awx.main.dispatch task cba3cc3f-08e5-41b0-812d-79700ae6ea8e is finished 2021-11-02 10:02:14,255 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(54b5e6d8-d91e-4092-8df3-22ab9b7d6501, queue=dev-awx-0) [2021-11-02 10:02:14,255: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(54b5e6d8-d91e-4092-8df3-22ab9b7d6501, queue=dev-awx-0) 2021-11-02 10:02:14,275 DEBUG awx.main.dispatch delivered 54b5e6d8-d91e-4092-8df3-22ab9b7d6501 to worker[176] qsize 0 2021-11-02 10:02:14,281 DEBUG awx.main.dispatch task 54b5e6d8-d91e-4092-8df3-22ab9b7d6501 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:02:14,310 DEBUG awx.main.dispatch task 54b5e6d8-d91e-4092-8df3-22ab9b7d6501 is finished 2021-11-02 10:02:14,485 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(85ff7b35-f1ec-4f02-a06e-1aaf4ebaa041, queue=awx_private_queue) [2021-11-02 10:02:14,485: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(85ff7b35-f1ec-4f02-a06e-1aaf4ebaa041, queue=awx_private_queue) 2021-11-02 10:02:14,534 DEBUG awx.main.dispatch delivered 85ff7b35-f1ec-4f02-a06e-1aaf4ebaa041 to worker[176] qsize 0 2021-11-02 10:02:14,536 DEBUG awx.main.dispatch task 85ff7b35-f1ec-4f02-a06e-1aaf4ebaa041 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:02:14,546 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:02:14,550 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:01:44.521855+00:00 2021-11-02 10:02:14,566 DEBUG awx.main.dispatch task 85ff7b35-f1ec-4f02-a06e-1aaf4ebaa041 is finished 2021-11-02 10:02:14,739 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(46d02e2d-b2a2-49e9-b41b-a6a3d40f2036, queue=awx_private_queue) [2021-11-02 10:02:14,739: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(46d02e2d-b2a2-49e9-b41b-a6a3d40f2036, queue=awx_private_queue) 2021-11-02 10:02:15,008 DEBUG awx.main.dispatch delivered 46d02e2d-b2a2-49e9-b41b-a6a3d40f2036 to worker[183] qsize 0 2021-11-02 10:02:15,020 DEBUG awx.main.dispatch task 46d02e2d-b2a2-49e9-b41b-a6a3d40f2036 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:02:15,027 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:02:15,056 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:02:15,087 DEBUG awx.main.dispatch task 46d02e2d-b2a2-49e9-b41b-a6a3d40f2036 is finished 2021-11-02 10:02:34,756 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7a5cc883-46cc-4fdf-b87e-ae107546973c, queue=awx_private_queue) [2021-11-02 10:02:34,756: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7a5cc883-46cc-4fdf-b87e-ae107546973c, queue=awx_private_queue) 2021-11-02 10:02:34,779 DEBUG awx.main.dispatch delivered 7a5cc883-46cc-4fdf-b87e-ae107546973c to worker[176] qsize 0 2021-11-02 10:02:34,783 DEBUG awx.main.dispatch task 7a5cc883-46cc-4fdf-b87e-ae107546973c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:02:34,785 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:02:34,806 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:02:34,845 DEBUG awx.main.dispatch task 7a5cc883-46cc-4fdf-b87e-ae107546973c is finished 2021-11-02 10:02:44,485 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(6ce3d0b7-abf4-468d-a867-b8a9ff0cd9ba, queue=awx_private_queue) [2021-11-02 10:02:44,485: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(6ce3d0b7-abf4-468d-a867-b8a9ff0cd9ba, queue=awx_private_queue) 2021-11-02 10:02:44,501 DEBUG awx.main.dispatch delivered 6ce3d0b7-abf4-468d-a867-b8a9ff0cd9ba to worker[183] qsize 0 2021-11-02 10:02:44,505 DEBUG awx.main.dispatch task 6ce3d0b7-abf4-468d-a867-b8a9ff0cd9ba starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:02:44,517 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:02:44,520 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:02:14.546848+00:00 2021-11-02 10:02:44,560 DEBUG awx.main.dispatch task 6ce3d0b7-abf4-468d-a867-b8a9ff0cd9ba is finished 2021-11-02 10:02:54,756 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(403255a0-01d2-4a06-8649-ca6dfe0032a1, queue=awx_private_queue) [2021-11-02 10:02:54,756: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(403255a0-01d2-4a06-8649-ca6dfe0032a1, queue=awx_private_queue) 2021-11-02 10:02:54,772 DEBUG awx.main.dispatch delivered 403255a0-01d2-4a06-8649-ca6dfe0032a1 to worker[176] qsize 0 2021-11-02 10:02:54,776 DEBUG awx.main.dispatch task 403255a0-01d2-4a06-8649-ca6dfe0032a1 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:02:54,778 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:02:54,797 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:02:54,830 DEBUG awx.main.dispatch task 403255a0-01d2-4a06-8649-ca6dfe0032a1 is finished RESULT 2 OKREADY 2021-11-02 10:03:14,034 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(4f47b6f4-1fb2-4e14-97b7-b01643c6a322, queue=dev-awx-0) [2021-11-02 10:03:14,034: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(4f47b6f4-1fb2-4e14-97b7-b01643c6a322, queue=dev-awx-0) 2021-11-02 10:03:14,070 DEBUG awx.main.dispatch delivered 4f47b6f4-1fb2-4e14-97b7-b01643c6a322 to worker[178] qsize 0 2021-11-02 10:03:14,072 DEBUG awx.main.dispatch task 4f47b6f4-1fb2-4e14-97b7-b01643c6a322 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:03:14,075 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:03:14,117 DEBUG awx.main.dispatch task 4f47b6f4-1fb2-4e14-97b7-b01643c6a322 is finished 2021-11-02 10:03:14,256 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(0f2e1592-a3e4-4687-af66-d39b1f0b9e77, queue=dev-awx-0) [2021-11-02 10:03:14,256: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(0f2e1592-a3e4-4687-af66-d39b1f0b9e77, queue=dev-awx-0) 2021-11-02 10:03:14,277 DEBUG awx.main.dispatch delivered 0f2e1592-a3e4-4687-af66-d39b1f0b9e77 to worker[178] qsize 0 2021-11-02 10:03:14,280 DEBUG awx.main.dispatch task 0f2e1592-a3e4-4687-af66-d39b1f0b9e77 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:03:14,294 DEBUG awx.main.dispatch task 0f2e1592-a3e4-4687-af66-d39b1f0b9e77 is finished 2021-11-02 10:03:14,485 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(21ccc5d7-ac54-4189-b8c7-37dcf9787a3f, queue=awx_private_queue) [2021-11-02 10:03:14,485: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(21ccc5d7-ac54-4189-b8c7-37dcf9787a3f, queue=awx_private_queue) 2021-11-02 10:03:14,505 DEBUG awx.main.dispatch delivered 21ccc5d7-ac54-4189-b8c7-37dcf9787a3f to worker[176] qsize 0 2021-11-02 10:03:14,507 DEBUG awx.main.dispatch task 21ccc5d7-ac54-4189-b8c7-37dcf9787a3f starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:03:14,518 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:03:14,520 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:02:44.517274+00:00 2021-11-02 10:03:14,534 DEBUG awx.main.dispatch task 21ccc5d7-ac54-4189-b8c7-37dcf9787a3f is finished 2021-11-02 10:03:14,756 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f2199fa3-61c9-464e-b3b8-d943e26457d6, queue=awx_private_queue) [2021-11-02 10:03:14,756: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f2199fa3-61c9-464e-b3b8-d943e26457d6, queue=awx_private_queue) 2021-11-02 10:03:14,981 DEBUG awx.main.dispatch delivered f2199fa3-61c9-464e-b3b8-d943e26457d6 to worker[176] qsize 0 2021-11-02 10:03:14,983 DEBUG awx.main.dispatch task f2199fa3-61c9-464e-b3b8-d943e26457d6 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:03:14,984 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:03:14,999 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:03:15,040 DEBUG awx.main.dispatch task f2199fa3-61c9-464e-b3b8-d943e26457d6 is finished 2021-11-02 10:03:34,760 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3630e88c-c029-445a-95f1-9ee63acac276, queue=awx_private_queue) [2021-11-02 10:03:34,760: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3630e88c-c029-445a-95f1-9ee63acac276, queue=awx_private_queue) 2021-11-02 10:03:34,787 DEBUG awx.main.dispatch delivered 3630e88c-c029-445a-95f1-9ee63acac276 to worker[178] qsize 0 2021-11-02 10:03:34,795 DEBUG awx.main.dispatch task 3630e88c-c029-445a-95f1-9ee63acac276 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:03:34,801 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:03:34,830 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:03:34,868 DEBUG awx.main.dispatch task 3630e88c-c029-445a-95f1-9ee63acac276 is finished 2021-11-02 10:03:44,493 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(5236fd76-ceb1-48d0-bef1-7bd5a55f3a93, queue=awx_private_queue) [2021-11-02 10:03:44,493: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(5236fd76-ceb1-48d0-bef1-7bd5a55f3a93, queue=awx_private_queue) 2021-11-02 10:03:44,519 DEBUG awx.main.dispatch delivered 5236fd76-ceb1-48d0-bef1-7bd5a55f3a93 to worker[178] qsize 0 2021-11-02 10:03:44,522 DEBUG awx.main.dispatch task 5236fd76-ceb1-48d0-bef1-7bd5a55f3a93 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:03:44,533 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:03:44,536 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:03:14.518226+00:00 2021-11-02 10:03:44,621 DEBUG awx.main.dispatch task 5236fd76-ceb1-48d0-bef1-7bd5a55f3a93 is finished 2021-11-02 10:03:54,757 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(541022e5-33b3-46bc-b16f-1e7d985ae51d, queue=awx_private_queue) [2021-11-02 10:03:54,757: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(541022e5-33b3-46bc-b16f-1e7d985ae51d, queue=awx_private_queue) 2021-11-02 10:03:54,781 DEBUG awx.main.dispatch delivered 541022e5-33b3-46bc-b16f-1e7d985ae51d to worker[178] qsize 0 2021-11-02 10:03:54,785 DEBUG awx.main.dispatch task 541022e5-33b3-46bc-b16f-1e7d985ae51d starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:03:54,786 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:03:54,804 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:03:54,835 DEBUG awx.main.dispatch task 541022e5-33b3-46bc-b16f-1e7d985ae51d is finished RESULT 2 OKREADY 2021-11-02 10:04:14,045 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(721a5c7f-17b0-4630-844a-37ef7b57ebf9, queue=dev-awx-0) [2021-11-02 10:04:14,045: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(721a5c7f-17b0-4630-844a-37ef7b57ebf9, queue=dev-awx-0) 2021-11-02 10:04:14,096 DEBUG awx.main.dispatch delivered 721a5c7f-17b0-4630-844a-37ef7b57ebf9 to worker[181] qsize 0 2021-11-02 10:04:14,102 DEBUG awx.main.dispatch task 721a5c7f-17b0-4630-844a-37ef7b57ebf9 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:04:14,111 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:04:14,147 DEBUG awx.main.dispatch task 721a5c7f-17b0-4630-844a-37ef7b57ebf9 is finished 2021-11-02 10:04:14,256 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(779d624e-ad46-4072-8af3-f43d3ff1ff00, queue=dev-awx-0) [2021-11-02 10:04:14,256: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(779d624e-ad46-4072-8af3-f43d3ff1ff00, queue=dev-awx-0) 2021-11-02 10:04:14,285 DEBUG awx.main.dispatch delivered 779d624e-ad46-4072-8af3-f43d3ff1ff00 to worker[178] qsize 0 2021-11-02 10:04:14,288 DEBUG awx.main.dispatch task 779d624e-ad46-4072-8af3-f43d3ff1ff00 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:04:14,304 DEBUG awx.main.dispatch task 779d624e-ad46-4072-8af3-f43d3ff1ff00 is finished 2021-11-02 10:04:14,492 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(928396b6-5c30-47a1-85b0-08c853b3956f, queue=awx_private_queue) [2021-11-02 10:04:14,492: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(928396b6-5c30-47a1-85b0-08c853b3956f, queue=awx_private_queue) 2021-11-02 10:04:14,509 DEBUG awx.main.dispatch delivered 928396b6-5c30-47a1-85b0-08c853b3956f to worker[181] qsize 0 2021-11-02 10:04:14,512 DEBUG awx.main.dispatch task 928396b6-5c30-47a1-85b0-08c853b3956f starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:04:14,522 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:04:14,526 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:03:44.533372+00:00 2021-11-02 10:04:14,542 DEBUG awx.main.dispatch task 928396b6-5c30-47a1-85b0-08c853b3956f is finished 2021-11-02 10:04:14,757 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ef245a58-67d1-410e-84cb-2394a58dcac5, queue=awx_private_queue) [2021-11-02 10:04:14,757: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ef245a58-67d1-410e-84cb-2394a58dcac5, queue=awx_private_queue) 2021-11-02 10:04:14,982 DEBUG awx.main.dispatch delivered ef245a58-67d1-410e-84cb-2394a58dcac5 to worker[176] qsize 0 2021-11-02 10:04:14,988 DEBUG awx.main.dispatch task ef245a58-67d1-410e-84cb-2394a58dcac5 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:04:14,996 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:04:15,026 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:04:15,059 DEBUG awx.main.dispatch task ef245a58-67d1-410e-84cb-2394a58dcac5 is finished 2021-11-02 10:04:34,767 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(1e9ef415-38ca-4721-a981-a7c4e194be93, queue=awx_private_queue) [2021-11-02 10:04:34,767: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(1e9ef415-38ca-4721-a981-a7c4e194be93, queue=awx_private_queue) 2021-11-02 10:04:34,801 DEBUG awx.main.dispatch delivered 1e9ef415-38ca-4721-a981-a7c4e194be93 to worker[181] qsize 0 2021-11-02 10:04:34,804 DEBUG awx.main.dispatch task 1e9ef415-38ca-4721-a981-a7c4e194be93 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:04:34,805 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:04:34,824 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:04:34,853 DEBUG awx.main.dispatch task 1e9ef415-38ca-4721-a981-a7c4e194be93 is finished 2021-11-02 10:04:44,493 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(91061f97-6be9-4953-8949-e518d26a07e2, queue=awx_private_queue) [2021-11-02 10:04:44,493: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(91061f97-6be9-4953-8949-e518d26a07e2, queue=awx_private_queue) 2021-11-02 10:04:44,516 DEBUG awx.main.dispatch delivered 91061f97-6be9-4953-8949-e518d26a07e2 to worker[183] qsize 0 2021-11-02 10:04:44,521 DEBUG awx.main.dispatch task 91061f97-6be9-4953-8949-e518d26a07e2 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:04:44,542 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:04:44,549 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:04:14.522618+00:00 2021-11-02 10:04:44,596 DEBUG awx.main.dispatch task 91061f97-6be9-4953-8949-e518d26a07e2 is finished 2021-11-02 10:04:54,773 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(90dcc869-274c-4968-9c73-fa63ed86d316, queue=awx_private_queue) [2021-11-02 10:04:54,773: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(90dcc869-274c-4968-9c73-fa63ed86d316, queue=awx_private_queue) 2021-11-02 10:04:54,805 DEBUG awx.main.dispatch delivered 90dcc869-274c-4968-9c73-fa63ed86d316 to worker[178] qsize 0 2021-11-02 10:04:54,816 DEBUG awx.main.dispatch task 90dcc869-274c-4968-9c73-fa63ed86d316 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:04:54,821 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:04:54,846 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:04:54,880 DEBUG awx.main.dispatch task 90dcc869-274c-4968-9c73-fa63ed86d316 is finished RESULT 2 OKREADY 2021-11-02 10:05:14,057 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(2f0b1a92-b775-497a-a410-614e5a22c994, queue=dev-awx-0) [2021-11-02 10:05:14,057: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(2f0b1a92-b775-497a-a410-614e5a22c994, queue=dev-awx-0) 2021-11-02 10:05:14,116 DEBUG awx.main.dispatch delivered 2f0b1a92-b775-497a-a410-614e5a22c994 to worker[178] qsize 0 2021-11-02 10:05:14,120 DEBUG awx.main.dispatch task 2f0b1a92-b775-497a-a410-614e5a22c994 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:05:14,124 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:05:14,174 DEBUG awx.main.dispatch task 2f0b1a92-b775-497a-a410-614e5a22c994 is finished 2021-11-02 10:05:14,257 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(3cca0d26-45ee-499e-9e1b-4ecd6d8c82b8, queue=dev-awx-0) [2021-11-02 10:05:14,257: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(3cca0d26-45ee-499e-9e1b-4ecd6d8c82b8, queue=dev-awx-0) 2021-11-02 10:05:14,303 DEBUG awx.main.dispatch delivered 3cca0d26-45ee-499e-9e1b-4ecd6d8c82b8 to worker[183] qsize 0 2021-11-02 10:05:14,309 DEBUG awx.main.dispatch task 3cca0d26-45ee-499e-9e1b-4ecd6d8c82b8 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:05:14,333 DEBUG awx.main.dispatch task 3cca0d26-45ee-499e-9e1b-4ecd6d8c82b8 is finished 2021-11-02 10:05:14,492 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(e11aad50-64d8-4a9c-989b-613cd9e7d7bc, queue=awx_private_queue) [2021-11-02 10:05:14,492: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(e11aad50-64d8-4a9c-989b-613cd9e7d7bc, queue=awx_private_queue) 2021-11-02 10:05:14,511 DEBUG awx.main.dispatch delivered e11aad50-64d8-4a9c-989b-613cd9e7d7bc to worker[183] qsize 0 2021-11-02 10:05:14,514 DEBUG awx.main.dispatch task e11aad50-64d8-4a9c-989b-613cd9e7d7bc starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:05:14,523 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:05:14,527 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:04:44.542364+00:00 2021-11-02 10:05:14,543 DEBUG awx.main.dispatch task e11aad50-64d8-4a9c-989b-613cd9e7d7bc is finished 2021-11-02 10:05:14,768 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5aebf0db-c6ab-4894-8c16-b6fbc75c6cad, queue=awx_private_queue) [2021-11-02 10:05:14,768: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5aebf0db-c6ab-4894-8c16-b6fbc75c6cad, queue=awx_private_queue) 2021-11-02 10:05:14,982 DEBUG awx.main.dispatch delivered 5aebf0db-c6ab-4894-8c16-b6fbc75c6cad to worker[181] qsize 0 2021-11-02 10:05:14,987 DEBUG awx.main.dispatch task 5aebf0db-c6ab-4894-8c16-b6fbc75c6cad starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:05:14,995 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:05:15,024 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:05:15,062 DEBUG awx.main.dispatch task 5aebf0db-c6ab-4894-8c16-b6fbc75c6cad is finished 2021-11-02 10:05:34,767 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f7728ac9-130e-4cec-aa70-5a10760ba527, queue=awx_private_queue) [2021-11-02 10:05:34,767: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f7728ac9-130e-4cec-aa70-5a10760ba527, queue=awx_private_queue) 2021-11-02 10:05:34,784 DEBUG awx.main.dispatch delivered f7728ac9-130e-4cec-aa70-5a10760ba527 to worker[181] qsize 0 2021-11-02 10:05:34,787 DEBUG awx.main.dispatch task f7728ac9-130e-4cec-aa70-5a10760ba527 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:05:34,788 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:05:34,804 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:05:34,837 DEBUG awx.main.dispatch task f7728ac9-130e-4cec-aa70-5a10760ba527 is finished 2021-11-02 10:05:44,493 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d6fecfe3-d491-4b91-9f1c-d66b020bf890, queue=awx_private_queue) [2021-11-02 10:05:44,493: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d6fecfe3-d491-4b91-9f1c-d66b020bf890, queue=awx_private_queue) 2021-11-02 10:05:44,509 DEBUG awx.main.dispatch delivered d6fecfe3-d491-4b91-9f1c-d66b020bf890 to worker[183] qsize 0 2021-11-02 10:05:44,512 DEBUG awx.main.dispatch task d6fecfe3-d491-4b91-9f1c-d66b020bf890 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:05:44,523 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:05:44,526 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:05:14.524050+00:00 2021-11-02 10:05:44,594 DEBUG awx.main.dispatch task d6fecfe3-d491-4b91-9f1c-d66b020bf890 is finished 2021-11-02 10:05:54,768 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(34a0f90d-02ee-4850-af5a-e3e754d7f807, queue=awx_private_queue) [2021-11-02 10:05:54,768: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(34a0f90d-02ee-4850-af5a-e3e754d7f807, queue=awx_private_queue) 2021-11-02 10:05:54,783 DEBUG awx.main.dispatch delivered 34a0f90d-02ee-4850-af5a-e3e754d7f807 to worker[183] qsize 0 2021-11-02 10:05:54,786 DEBUG awx.main.dispatch task 34a0f90d-02ee-4850-af5a-e3e754d7f807 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:05:54,787 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:05:54,803 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:05:54,834 DEBUG awx.main.dispatch task 34a0f90d-02ee-4850-af5a-e3e754d7f807 is finished RESULT 2 OKREADY 2021-11-02 10:06:14,059 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(a1445263-bcf0-42be-8f08-0e63704c1f2b, queue=dev-awx-0) [2021-11-02 10:06:14,059: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(a1445263-bcf0-42be-8f08-0e63704c1f2b, queue=dev-awx-0) 2021-11-02 10:06:14,122 DEBUG awx.main.dispatch delivered a1445263-bcf0-42be-8f08-0e63704c1f2b to worker[181] qsize 0 2021-11-02 10:06:14,128 DEBUG awx.main.dispatch task a1445263-bcf0-42be-8f08-0e63704c1f2b starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:06:14,137 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:06:14,206 DEBUG awx.main.dispatch task a1445263-bcf0-42be-8f08-0e63704c1f2b is finished 2021-11-02 10:06:14,256 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(37846436-1775-44b0-97bb-4610d92819e0, queue=dev-awx-0) [2021-11-02 10:06:14,256: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(37846436-1775-44b0-97bb-4610d92819e0, queue=dev-awx-0) 2021-11-02 10:06:14,276 DEBUG awx.main.dispatch delivered 37846436-1775-44b0-97bb-4610d92819e0 to worker[178] qsize 0 2021-11-02 10:06:14,282 DEBUG awx.main.dispatch task 37846436-1775-44b0-97bb-4610d92819e0 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:06:14,309 DEBUG awx.main.dispatch task 37846436-1775-44b0-97bb-4610d92819e0 is finished 2021-11-02 10:06:14,493 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(22674d52-fa34-48bf-acc5-9dbeace3e12a, queue=awx_private_queue) [2021-11-02 10:06:14,493: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(22674d52-fa34-48bf-acc5-9dbeace3e12a, queue=awx_private_queue) 2021-11-02 10:06:14,510 DEBUG awx.main.dispatch delivered 22674d52-fa34-48bf-acc5-9dbeace3e12a to worker[176] qsize 0 2021-11-02 10:06:14,513 DEBUG awx.main.dispatch task 22674d52-fa34-48bf-acc5-9dbeace3e12a starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:06:14,532 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:06:14,538 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:05:44.523298+00:00 2021-11-02 10:06:14,730 DEBUG awx.main.dispatch task 22674d52-fa34-48bf-acc5-9dbeace3e12a is finished 2021-11-02 10:06:14,767 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b0c73730-a40c-4d1f-be5f-5c914222f50c, queue=awx_private_queue) [2021-11-02 10:06:14,767: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b0c73730-a40c-4d1f-be5f-5c914222f50c, queue=awx_private_queue) 2021-11-02 10:06:14,781 DEBUG awx.main.dispatch delivered b0c73730-a40c-4d1f-be5f-5c914222f50c to worker[178] qsize 0 2021-11-02 10:06:14,783 DEBUG awx.main.dispatch task b0c73730-a40c-4d1f-be5f-5c914222f50c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:06:14,784 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:06:14,802 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:06:14,845 DEBUG awx.main.dispatch task b0c73730-a40c-4d1f-be5f-5c914222f50c is finished 2021-11-02 10:06:34,779 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e761e9ba-2257-47a6-bb6c-39f546acad1b, queue=awx_private_queue) [2021-11-02 10:06:34,779: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e761e9ba-2257-47a6-bb6c-39f546acad1b, queue=awx_private_queue) 2021-11-02 10:06:35,052 DEBUG awx.main.dispatch delivered e761e9ba-2257-47a6-bb6c-39f546acad1b to worker[181] qsize 0 2021-11-02 10:06:35,054 DEBUG awx.main.dispatch task e761e9ba-2257-47a6-bb6c-39f546acad1b starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:06:35,056 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:06:35,075 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:06:35,114 DEBUG awx.main.dispatch task e761e9ba-2257-47a6-bb6c-39f546acad1b is finished 2021-11-02 10:06:44,496 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(024e7800-91d6-421c-9b9e-ad8455549424, queue=awx_private_queue) [2021-11-02 10:06:44,496: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(024e7800-91d6-421c-9b9e-ad8455549424, queue=awx_private_queue) 2021-11-02 10:06:44,527 DEBUG awx.main.dispatch delivered 024e7800-91d6-421c-9b9e-ad8455549424 to worker[183] qsize 0 2021-11-02 10:06:44,533 DEBUG awx.main.dispatch task 024e7800-91d6-421c-9b9e-ad8455549424 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:06:44,548 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:06:44,554 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:06:14.532623+00:00 2021-11-02 10:06:45,558 DEBUG awx.main.dispatch task 024e7800-91d6-421c-9b9e-ad8455549424 is finished 2021-11-02 10:06:54,778 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(06d06f31-089b-4b31-a498-ad37655d5318, queue=awx_private_queue) [2021-11-02 10:06:54,778: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(06d06f31-089b-4b31-a498-ad37655d5318, queue=awx_private_queue) 2021-11-02 10:06:54,791 DEBUG awx.main.dispatch delivered 06d06f31-089b-4b31-a498-ad37655d5318 to worker[176] qsize 0 2021-11-02 10:06:54,794 DEBUG awx.main.dispatch task 06d06f31-089b-4b31-a498-ad37655d5318 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:06:54,795 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:06:54,810 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:06:54,835 DEBUG awx.main.dispatch task 06d06f31-089b-4b31-a498-ad37655d5318 is finished RESULT 2 OKREADY 2021-11-02 10:07:14,064 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(be87ef67-48b9-4223-a38d-4f0a7b1fb2af, queue=dev-awx-0) [2021-11-02 10:07:14,064: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(be87ef67-48b9-4223-a38d-4f0a7b1fb2af, queue=dev-awx-0) 2021-11-02 10:07:14,091 DEBUG awx.main.dispatch delivered be87ef67-48b9-4223-a38d-4f0a7b1fb2af to worker[181] qsize 0 2021-11-02 10:07:14,094 DEBUG awx.main.dispatch task be87ef67-48b9-4223-a38d-4f0a7b1fb2af starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:07:14,095 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:07:14,169 DEBUG awx.main.dispatch task be87ef67-48b9-4223-a38d-4f0a7b1fb2af is finished 2021-11-02 10:07:14,256 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(c95fc708-c5a9-44ff-b6c6-3eb9129f0d78, queue=dev-awx-0) [2021-11-02 10:07:14,256: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(c95fc708-c5a9-44ff-b6c6-3eb9129f0d78, queue=dev-awx-0) 2021-11-02 10:07:14,271 DEBUG awx.main.dispatch delivered c95fc708-c5a9-44ff-b6c6-3eb9129f0d78 to worker[181] qsize 0 2021-11-02 10:07:14,274 DEBUG awx.main.dispatch task c95fc708-c5a9-44ff-b6c6-3eb9129f0d78 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:07:14,288 DEBUG awx.main.dispatch task c95fc708-c5a9-44ff-b6c6-3eb9129f0d78 is finished 2021-11-02 10:07:14,496 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(c885304a-0c89-4435-ab03-3ac345f487c6, queue=awx_private_queue) [2021-11-02 10:07:14,496: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(c885304a-0c89-4435-ab03-3ac345f487c6, queue=awx_private_queue) 2021-11-02 10:07:14,510 DEBUG awx.main.dispatch delivered c885304a-0c89-4435-ab03-3ac345f487c6 to worker[178] qsize 0 2021-11-02 10:07:14,512 DEBUG awx.main.dispatch task c885304a-0c89-4435-ab03-3ac345f487c6 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:07:14,522 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:07:14,525 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:06:44.548959+00:00 2021-11-02 10:07:14,538 DEBUG awx.main.dispatch task c885304a-0c89-4435-ab03-3ac345f487c6 is finished 2021-11-02 10:07:14,779 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(99ce2471-0ad6-492a-b810-d912bf479209, queue=awx_private_queue) [2021-11-02 10:07:14,779: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(99ce2471-0ad6-492a-b810-d912bf479209, queue=awx_private_queue) 2021-11-02 10:07:14,796 DEBUG awx.main.dispatch delivered 99ce2471-0ad6-492a-b810-d912bf479209 to worker[181] qsize 0 2021-11-02 10:07:14,798 DEBUG awx.main.dispatch task 99ce2471-0ad6-492a-b810-d912bf479209 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:07:14,799 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:07:14,814 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:07:14,870 DEBUG awx.main.dispatch task 99ce2471-0ad6-492a-b810-d912bf479209 is finished 2021-11-02 10:07:34,801 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(446e4dd5-b7ed-4b32-9ead-a08c73e6bfd7, queue=awx_private_queue) [2021-11-02 10:07:34,801: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(446e4dd5-b7ed-4b32-9ead-a08c73e6bfd7, queue=awx_private_queue) 2021-11-02 10:07:34,831 DEBUG awx.main.dispatch delivered 446e4dd5-b7ed-4b32-9ead-a08c73e6bfd7 to worker[178] qsize 0 2021-11-02 10:07:34,847 DEBUG awx.main.dispatch task 446e4dd5-b7ed-4b32-9ead-a08c73e6bfd7 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:07:34,851 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:07:34,892 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:07:34,922 DEBUG awx.main.dispatch task 446e4dd5-b7ed-4b32-9ead-a08c73e6bfd7 is finished 2021-11-02 10:07:44,497 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(ba853159-fe7a-403d-a03e-1b0e39d6bbbe, queue=awx_private_queue) [2021-11-02 10:07:44,497: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(ba853159-fe7a-403d-a03e-1b0e39d6bbbe, queue=awx_private_queue) 2021-11-02 10:07:44,522 DEBUG awx.main.dispatch delivered ba853159-fe7a-403d-a03e-1b0e39d6bbbe to worker[176] qsize 0 2021-11-02 10:07:44,525 DEBUG awx.main.dispatch task ba853159-fe7a-403d-a03e-1b0e39d6bbbe starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:07:44,741 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:07:44,744 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:07:14.522616+00:00 2021-11-02 10:07:44,800 DEBUG awx.main.dispatch task ba853159-fe7a-403d-a03e-1b0e39d6bbbe is finished 2021-11-02 10:07:54,794 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(dc2a4848-5c3f-4dd0-bbd4-7c44662ce9f8, queue=awx_private_queue) [2021-11-02 10:07:54,794: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(dc2a4848-5c3f-4dd0-bbd4-7c44662ce9f8, queue=awx_private_queue) 2021-11-02 10:07:54,813 DEBUG awx.main.dispatch delivered dc2a4848-5c3f-4dd0-bbd4-7c44662ce9f8 to worker[181] qsize 0 2021-11-02 10:07:54,818 DEBUG awx.main.dispatch task dc2a4848-5c3f-4dd0-bbd4-7c44662ce9f8 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:07:54,824 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:07:54,846 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:07:54,881 DEBUG awx.main.dispatch task dc2a4848-5c3f-4dd0-bbd4-7c44662ce9f8 is finished RESULT 2 OKREADY 2021-11-02 10:08:13,973 DEBUG awx.main.dispatch publish awx.main.tasks.awx_isolated_heartbeat(d70a07b9-d21e-496b-977d-c1185736b808, queue=dev-awx-0) [2021-11-02 10:08:13,973: DEBUG/Process-1] publish awx.main.tasks.awx_isolated_heartbeat(d70a07b9-d21e-496b-977d-c1185736b808, queue=dev-awx-0) 2021-11-02 10:08:13,999 DEBUG awx.main.dispatch delivered d70a07b9-d21e-496b-977d-c1185736b808 to worker[176] qsize 0 2021-11-02 10:08:14,003 DEBUG awx.main.dispatch task d70a07b9-d21e-496b-977d-c1185736b808 starting awx.main.tasks.awx_isolated_heartbeat(*[]) 2021-11-02 10:08:14,005 DEBUG awx.main.tasks Controlling node checking for any isolated management tasks. 2021-11-02 10:08:14,028 DEBUG awx.main.dispatch task d70a07b9-d21e-496b-977d-c1185736b808 is finished 2021-11-02 10:08:14,065 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(300f6b26-5da9-457d-a376-c01cde04f24b, queue=dev-awx-0) [2021-11-02 10:08:14,065: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(300f6b26-5da9-457d-a376-c01cde04f24b, queue=dev-awx-0) 2021-11-02 10:08:14,108 DEBUG awx.main.dispatch delivered 300f6b26-5da9-457d-a376-c01cde04f24b to worker[178] qsize 0 2021-11-02 10:08:14,111 DEBUG awx.main.dispatch task 300f6b26-5da9-457d-a376-c01cde04f24b starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:08:14,113 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:08:14,151 DEBUG awx.main.dispatch task 300f6b26-5da9-457d-a376-c01cde04f24b is finished 2021-11-02 10:08:14,256 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(6b039249-8054-415c-8742-9fa6f400b86f, queue=dev-awx-0) [2021-11-02 10:08:14,256: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(6b039249-8054-415c-8742-9fa6f400b86f, queue=dev-awx-0) 2021-11-02 10:08:14,290 DEBUG awx.main.dispatch delivered 6b039249-8054-415c-8742-9fa6f400b86f to worker[176] qsize 0 2021-11-02 10:08:14,294 DEBUG awx.main.dispatch task 6b039249-8054-415c-8742-9fa6f400b86f starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:08:14,311 DEBUG awx.main.dispatch task 6b039249-8054-415c-8742-9fa6f400b86f is finished 2021-11-02 10:08:14,497 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(ab7436d6-4c7d-44ae-ba66-8b8871b9ab56, queue=awx_private_queue) [2021-11-02 10:08:14,497: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(ab7436d6-4c7d-44ae-ba66-8b8871b9ab56, queue=awx_private_queue) 2021-11-02 10:08:14,518 DEBUG awx.main.dispatch delivered ab7436d6-4c7d-44ae-ba66-8b8871b9ab56 to worker[178] qsize 0 2021-11-02 10:08:14,521 DEBUG awx.main.dispatch task ab7436d6-4c7d-44ae-ba66-8b8871b9ab56 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:08:14,533 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:08:14,536 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:07:44.741961+00:00 2021-11-02 10:08:14,554 DEBUG awx.main.dispatch task ab7436d6-4c7d-44ae-ba66-8b8871b9ab56 is finished 2021-11-02 10:08:14,797 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(288bc23b-5fa5-4d34-829f-7818d53c278b, queue=awx_private_queue) [2021-11-02 10:08:14,797: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(288bc23b-5fa5-4d34-829f-7818d53c278b, queue=awx_private_queue) 2021-11-02 10:08:14,824 DEBUG awx.main.dispatch delivered 288bc23b-5fa5-4d34-829f-7818d53c278b to worker[183] qsize 0 2021-11-02 10:08:14,829 DEBUG awx.main.dispatch task 288bc23b-5fa5-4d34-829f-7818d53c278b starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:08:14,834 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:08:14,862 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:08:14,892 DEBUG awx.main.dispatch task 288bc23b-5fa5-4d34-829f-7818d53c278b is finished 2021-11-02 10:08:34,798 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c1828804-f2a9-4960-919d-7f87e7918108, queue=awx_private_queue) [2021-11-02 10:08:34,798: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c1828804-f2a9-4960-919d-7f87e7918108, queue=awx_private_queue) 2021-11-02 10:08:34,824 DEBUG awx.main.dispatch delivered c1828804-f2a9-4960-919d-7f87e7918108 to worker[181] qsize 0 2021-11-02 10:08:34,830 DEBUG awx.main.dispatch task c1828804-f2a9-4960-919d-7f87e7918108 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:08:34,833 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:08:34,857 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:08:34,897 DEBUG awx.main.dispatch task c1828804-f2a9-4960-919d-7f87e7918108 is finished 2021-11-02 10:08:44,497 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(618af291-ef40-4e4e-9090-84b1bfd73419, queue=awx_private_queue) [2021-11-02 10:08:44,497: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(618af291-ef40-4e4e-9090-84b1bfd73419, queue=awx_private_queue) 2021-11-02 10:08:44,696 DEBUG awx.main.dispatch delivered 618af291-ef40-4e4e-9090-84b1bfd73419 to worker[176] qsize 0 2021-11-02 10:08:44,707 DEBUG awx.main.dispatch task 618af291-ef40-4e4e-9090-84b1bfd73419 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:08:44,723 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:08:44,727 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:08:14.533734+00:00 2021-11-02 10:08:45,106 DEBUG awx.main.dispatch task 618af291-ef40-4e4e-9090-84b1bfd73419 is finished 2021-11-02 10:08:54,795 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d1f2e352-0af3-4566-8089-c876b5540082, queue=awx_private_queue) [2021-11-02 10:08:54,795: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d1f2e352-0af3-4566-8089-c876b5540082, queue=awx_private_queue) 2021-11-02 10:08:54,814 DEBUG awx.main.dispatch delivered d1f2e352-0af3-4566-8089-c876b5540082 to worker[178] qsize 0 2021-11-02 10:08:54,819 DEBUG awx.main.dispatch task d1f2e352-0af3-4566-8089-c876b5540082 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:08:54,823 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:08:54,844 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:08:54,875 DEBUG awx.main.dispatch task d1f2e352-0af3-4566-8089-c876b5540082 is finished RESULT 2 OKREADY 2021-11-02 10:09:14,086 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(f4327926-8598-43a9-976f-22dfcd048a53, queue=dev-awx-0) [2021-11-02 10:09:14,086: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(f4327926-8598-43a9-976f-22dfcd048a53, queue=dev-awx-0) 2021-11-02 10:09:14,148 DEBUG awx.main.dispatch delivered f4327926-8598-43a9-976f-22dfcd048a53 to worker[183] qsize 0 2021-11-02 10:09:14,156 DEBUG awx.main.dispatch task f4327926-8598-43a9-976f-22dfcd048a53 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:09:14,163 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:09:14,199 DEBUG awx.main.dispatch task f4327926-8598-43a9-976f-22dfcd048a53 is finished 2021-11-02 10:09:14,256 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(9c13cd5b-fdb5-4470-92e2-16f020adc1aa, queue=dev-awx-0) [2021-11-02 10:09:14,256: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(9c13cd5b-fdb5-4470-92e2-16f020adc1aa, queue=dev-awx-0) 2021-11-02 10:09:14,291 DEBUG awx.main.dispatch delivered 9c13cd5b-fdb5-4470-92e2-16f020adc1aa to worker[183] qsize 0 2021-11-02 10:09:14,295 DEBUG awx.main.dispatch task 9c13cd5b-fdb5-4470-92e2-16f020adc1aa starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:09:14,311 DEBUG awx.main.dispatch task 9c13cd5b-fdb5-4470-92e2-16f020adc1aa is finished 2021-11-02 10:09:14,498 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(2705a08a-6e6b-4993-87dc-ad3724417a7c, queue=awx_private_queue) [2021-11-02 10:09:14,498: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(2705a08a-6e6b-4993-87dc-ad3724417a7c, queue=awx_private_queue) 2021-11-02 10:09:14,525 DEBUG awx.main.dispatch delivered 2705a08a-6e6b-4993-87dc-ad3724417a7c to worker[178] qsize 0 2021-11-02 10:09:14,532 DEBUG awx.main.dispatch task 2705a08a-6e6b-4993-87dc-ad3724417a7c starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:09:14,551 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:09:14,557 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:08:44.723610+00:00 2021-11-02 10:09:14,590 DEBUG awx.main.dispatch task 2705a08a-6e6b-4993-87dc-ad3724417a7c is finished 2021-11-02 10:09:14,794 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(62d1bc19-b107-49d4-b313-2bfdb9e891df, queue=awx_private_queue) [2021-11-02 10:09:14,794: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(62d1bc19-b107-49d4-b313-2bfdb9e891df, queue=awx_private_queue) 2021-11-02 10:09:14,811 DEBUG awx.main.dispatch delivered 62d1bc19-b107-49d4-b313-2bfdb9e891df to worker[176] qsize 0 2021-11-02 10:09:14,815 DEBUG awx.main.dispatch task 62d1bc19-b107-49d4-b313-2bfdb9e891df starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:09:14,820 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:09:14,847 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:09:14,884 DEBUG awx.main.dispatch task 62d1bc19-b107-49d4-b313-2bfdb9e891df is finished 2021-11-02 10:09:34,806 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c63ff209-408e-4b3f-b76d-11650b6951e7, queue=awx_private_queue) [2021-11-02 10:09:34,806: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c63ff209-408e-4b3f-b76d-11650b6951e7, queue=awx_private_queue) 2021-11-02 10:09:34,826 DEBUG awx.main.dispatch delivered c63ff209-408e-4b3f-b76d-11650b6951e7 to worker[183] qsize 0 2021-11-02 10:09:34,828 DEBUG awx.main.dispatch task c63ff209-408e-4b3f-b76d-11650b6951e7 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:09:34,830 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:09:34,850 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:09:34,892 DEBUG awx.main.dispatch task c63ff209-408e-4b3f-b76d-11650b6951e7 is finished 2021-11-02 10:09:44,499 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(c0b70cff-3302-4772-ba0b-66094ddd07ea, queue=awx_private_queue) [2021-11-02 10:09:44,499: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(c0b70cff-3302-4772-ba0b-66094ddd07ea, queue=awx_private_queue) 2021-11-02 10:09:44,744 DEBUG awx.main.dispatch delivered c0b70cff-3302-4772-ba0b-66094ddd07ea to worker[181] qsize 0 2021-11-02 10:09:44,752 DEBUG awx.main.dispatch task c0b70cff-3302-4772-ba0b-66094ddd07ea starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:09:44,770 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:09:44,775 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:09:14.551741+00:00 2021-11-02 10:09:44,815 DEBUG awx.main.dispatch task c0b70cff-3302-4772-ba0b-66094ddd07ea is finished 2021-11-02 10:09:54,805 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0141a255-24a1-4a40-af8c-a9b254a2c157, queue=awx_private_queue) [2021-11-02 10:09:54,805: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0141a255-24a1-4a40-af8c-a9b254a2c157, queue=awx_private_queue) 2021-11-02 10:09:54,823 DEBUG awx.main.dispatch delivered 0141a255-24a1-4a40-af8c-a9b254a2c157 to worker[181] qsize 0 2021-11-02 10:09:54,826 DEBUG awx.main.dispatch task 0141a255-24a1-4a40-af8c-a9b254a2c157 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:09:54,827 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:09:54,845 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:09:54,880 DEBUG awx.main.dispatch task 0141a255-24a1-4a40-af8c-a9b254a2c157 is finished RESULT 2 OKREADY 2021-11-02 10:10:14,088 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(6a183ae0-88f4-4124-b003-f2bf8bb9bef3, queue=dev-awx-0) [2021-11-02 10:10:14,088: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(6a183ae0-88f4-4124-b003-f2bf8bb9bef3, queue=dev-awx-0) 2021-11-02 10:10:14,133 DEBUG awx.main.dispatch delivered 6a183ae0-88f4-4124-b003-f2bf8bb9bef3 to worker[181] qsize 0 2021-11-02 10:10:14,137 DEBUG awx.main.dispatch task 6a183ae0-88f4-4124-b003-f2bf8bb9bef3 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:10:14,139 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:10:14,218 DEBUG awx.main.dispatch task 6a183ae0-88f4-4124-b003-f2bf8bb9bef3 is finished 2021-11-02 10:10:14,257 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(35d4199b-b7d9-47e6-816e-314861c33c7c, queue=dev-awx-0) [2021-11-02 10:10:14,257: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(35d4199b-b7d9-47e6-816e-314861c33c7c, queue=dev-awx-0) 2021-11-02 10:10:14,278 DEBUG awx.main.dispatch delivered 35d4199b-b7d9-47e6-816e-314861c33c7c to worker[181] qsize 0 2021-11-02 10:10:14,281 DEBUG awx.main.dispatch task 35d4199b-b7d9-47e6-816e-314861c33c7c starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:10:14,297 DEBUG awx.main.dispatch task 35d4199b-b7d9-47e6-816e-314861c33c7c is finished 2021-11-02 10:10:14,500 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(6d9d795e-6623-4987-b3fa-3e1fcd49e4ac, queue=awx_private_queue) [2021-11-02 10:10:14,500: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(6d9d795e-6623-4987-b3fa-3e1fcd49e4ac, queue=awx_private_queue) 2021-11-02 10:10:14,526 DEBUG awx.main.dispatch delivered 6d9d795e-6623-4987-b3fa-3e1fcd49e4ac to worker[181] qsize 0 2021-11-02 10:10:14,531 DEBUG awx.main.dispatch task 6d9d795e-6623-4987-b3fa-3e1fcd49e4ac starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:10:14,542 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:10:14,545 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:09:44.770574+00:00 2021-11-02 10:10:14,563 DEBUG awx.main.dispatch task 6d9d795e-6623-4987-b3fa-3e1fcd49e4ac is finished 2021-11-02 10:10:14,806 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ab561245-da34-4202-84d0-47f4f3e3f2c9, queue=awx_private_queue) [2021-11-02 10:10:14,806: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ab561245-da34-4202-84d0-47f4f3e3f2c9, queue=awx_private_queue) 2021-11-02 10:10:14,843 DEBUG awx.main.dispatch delivered ab561245-da34-4202-84d0-47f4f3e3f2c9 to worker[178] qsize 0 2021-11-02 10:10:14,845 DEBUG awx.main.dispatch task ab561245-da34-4202-84d0-47f4f3e3f2c9 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:10:14,848 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:10:14,865 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:10:14,901 DEBUG awx.main.dispatch task ab561245-da34-4202-84d0-47f4f3e3f2c9 is finished 2021-11-02 10:10:34,814 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a64c8cb8-36c2-43fa-973b-ea2535b271e9, queue=awx_private_queue) [2021-11-02 10:10:34,814: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a64c8cb8-36c2-43fa-973b-ea2535b271e9, queue=awx_private_queue) 2021-11-02 10:10:34,836 DEBUG awx.main.dispatch delivered a64c8cb8-36c2-43fa-973b-ea2535b271e9 to worker[181] qsize 0 2021-11-02 10:10:34,838 DEBUG awx.main.dispatch task a64c8cb8-36c2-43fa-973b-ea2535b271e9 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:10:34,839 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:10:34,857 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:10:34,884 DEBUG awx.main.dispatch task a64c8cb8-36c2-43fa-973b-ea2535b271e9 is finished 2021-11-02 10:10:44,500 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(fab60b81-a9a5-41b0-943d-0e6ec5b03945, queue=awx_private_queue) [2021-11-02 10:10:44,500: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(fab60b81-a9a5-41b0-943d-0e6ec5b03945, queue=awx_private_queue) 2021-11-02 10:10:44,717 DEBUG awx.main.dispatch delivered fab60b81-a9a5-41b0-943d-0e6ec5b03945 to worker[183] qsize 0 2021-11-02 10:10:44,720 DEBUG awx.main.dispatch task fab60b81-a9a5-41b0-943d-0e6ec5b03945 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:10:44,734 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:10:44,737 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:10:14.542364+00:00 2021-11-02 10:10:44,810 DEBUG awx.main.dispatch task fab60b81-a9a5-41b0-943d-0e6ec5b03945 is finished 2021-11-02 10:10:54,827 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b872fe89-958e-4580-986e-031dabef99e1, queue=awx_private_queue) [2021-11-02 10:10:54,827: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b872fe89-958e-4580-986e-031dabef99e1, queue=awx_private_queue) 2021-11-02 10:10:54,871 DEBUG awx.main.dispatch delivered b872fe89-958e-4580-986e-031dabef99e1 to worker[176] qsize 0 2021-11-02 10:10:54,891 DEBUG awx.main.dispatch task b872fe89-958e-4580-986e-031dabef99e1 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:10:54,902 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:10:54,934 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:10:54,973 DEBUG awx.main.dispatch task b872fe89-958e-4580-986e-031dabef99e1 is finished RESULT 2 OKREADY 2021-11-02 10:11:14,100 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(82f57359-0503-4c78-9d4a-f5ca8610a407, queue=dev-awx-0) [2021-11-02 10:11:14,100: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(82f57359-0503-4c78-9d4a-f5ca8610a407, queue=dev-awx-0) 2021-11-02 10:11:14,167 DEBUG awx.main.dispatch delivered 82f57359-0503-4c78-9d4a-f5ca8610a407 to worker[178] qsize 0 2021-11-02 10:11:14,173 DEBUG awx.main.dispatch task 82f57359-0503-4c78-9d4a-f5ca8610a407 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:11:14,179 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:11:14,232 DEBUG awx.main.dispatch task 82f57359-0503-4c78-9d4a-f5ca8610a407 is finished 2021-11-02 10:11:14,256 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(18514930-4276-46e4-ad7c-0ca4b77e5591, queue=dev-awx-0) [2021-11-02 10:11:14,256: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(18514930-4276-46e4-ad7c-0ca4b77e5591, queue=dev-awx-0) 2021-11-02 10:11:14,274 DEBUG awx.main.dispatch delivered 18514930-4276-46e4-ad7c-0ca4b77e5591 to worker[176] qsize 0 2021-11-02 10:11:14,279 DEBUG awx.main.dispatch task 18514930-4276-46e4-ad7c-0ca4b77e5591 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:11:14,296 DEBUG awx.main.dispatch task 18514930-4276-46e4-ad7c-0ca4b77e5591 is finished 2021-11-02 10:11:14,500 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(8817f1ca-3b8a-4e04-b337-0562d56621e4, queue=awx_private_queue) [2021-11-02 10:11:14,500: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(8817f1ca-3b8a-4e04-b337-0562d56621e4, queue=awx_private_queue) 2021-11-02 10:11:14,535 DEBUG awx.main.dispatch delivered 8817f1ca-3b8a-4e04-b337-0562d56621e4 to worker[181] qsize 0 2021-11-02 10:11:14,542 DEBUG awx.main.dispatch task 8817f1ca-3b8a-4e04-b337-0562d56621e4 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:11:14,569 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:11:14,580 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:10:44.734220+00:00 2021-11-02 10:11:14,600 DEBUG awx.main.dispatch task 8817f1ca-3b8a-4e04-b337-0562d56621e4 is finished 2021-11-02 10:11:14,817 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(8e7ac9b8-2b6d-46c5-81f3-c00209e3c6cd, queue=awx_private_queue) [2021-11-02 10:11:14,817: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(8e7ac9b8-2b6d-46c5-81f3-c00209e3c6cd, queue=awx_private_queue) 2021-11-02 10:11:14,834 DEBUG awx.main.dispatch delivered 8e7ac9b8-2b6d-46c5-81f3-c00209e3c6cd to worker[183] qsize 0 2021-11-02 10:11:14,838 DEBUG awx.main.dispatch task 8e7ac9b8-2b6d-46c5-81f3-c00209e3c6cd starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:11:14,842 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:11:14,864 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:11:14,900 DEBUG awx.main.dispatch task 8e7ac9b8-2b6d-46c5-81f3-c00209e3c6cd is finished 2021-11-02 10:11:34,829 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(9bd5531d-e939-4c7f-a52b-3a3df970caa3, queue=awx_private_queue) [2021-11-02 10:11:34,829: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(9bd5531d-e939-4c7f-a52b-3a3df970caa3, queue=awx_private_queue) 2021-11-02 10:11:34,856 DEBUG awx.main.dispatch delivered 9bd5531d-e939-4c7f-a52b-3a3df970caa3 to worker[176] qsize 0 2021-11-02 10:11:34,859 DEBUG awx.main.dispatch task 9bd5531d-e939-4c7f-a52b-3a3df970caa3 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:11:34,860 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:11:34,878 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:11:34,914 DEBUG awx.main.dispatch task 9bd5531d-e939-4c7f-a52b-3a3df970caa3 is finished 2021-11-02 10:11:44,501 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(7bfdb1c8-b27b-4ec8-b085-247346e22a70, queue=awx_private_queue) [2021-11-02 10:11:44,501: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(7bfdb1c8-b27b-4ec8-b085-247346e22a70, queue=awx_private_queue) 2021-11-02 10:11:44,743 DEBUG awx.main.dispatch delivered 7bfdb1c8-b27b-4ec8-b085-247346e22a70 to worker[178] qsize 0 2021-11-02 10:11:44,745 DEBUG awx.main.dispatch task 7bfdb1c8-b27b-4ec8-b085-247346e22a70 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:11:44,758 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:11:44,761 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:11:14.569605+00:00 2021-11-02 10:11:44,847 DEBUG awx.main.dispatch task 7bfdb1c8-b27b-4ec8-b085-247346e22a70 is finished 2021-11-02 10:11:54,829 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(767592f5-e2e1-4498-9d4e-4d898d92c3be, queue=awx_private_queue) [2021-11-02 10:11:54,829: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(767592f5-e2e1-4498-9d4e-4d898d92c3be, queue=awx_private_queue) 2021-11-02 10:11:54,851 DEBUG awx.main.dispatch delivered 767592f5-e2e1-4498-9d4e-4d898d92c3be to worker[181] qsize 0 2021-11-02 10:11:54,853 DEBUG awx.main.dispatch task 767592f5-e2e1-4498-9d4e-4d898d92c3be starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:11:54,855 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:11:54,882 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:11:54,922 DEBUG awx.main.dispatch task 767592f5-e2e1-4498-9d4e-4d898d92c3be is finished RESULT 2 OKREADY 2021-11-02 10:12:14,108 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(eaa2b776-e088-48f5-8444-b0ef94aa289a, queue=dev-awx-0) [2021-11-02 10:12:14,108: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(eaa2b776-e088-48f5-8444-b0ef94aa289a, queue=dev-awx-0) 2021-11-02 10:12:14,159 DEBUG awx.main.dispatch delivered eaa2b776-e088-48f5-8444-b0ef94aa289a to worker[178] qsize 0 2021-11-02 10:12:14,162 DEBUG awx.main.dispatch task eaa2b776-e088-48f5-8444-b0ef94aa289a starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:12:14,164 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:12:14,256 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(f026355a-0bdc-40a6-bd7e-6bfdc3035805, queue=dev-awx-0) [2021-11-02 10:12:14,256: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(f026355a-0bdc-40a6-bd7e-6bfdc3035805, queue=dev-awx-0) 2021-11-02 10:12:14,259 DEBUG awx.main.dispatch task eaa2b776-e088-48f5-8444-b0ef94aa289a is finished 2021-11-02 10:12:14,272 DEBUG awx.main.dispatch delivered f026355a-0bdc-40a6-bd7e-6bfdc3035805 to worker[183] qsize 0 2021-11-02 10:12:14,275 DEBUG awx.main.dispatch task f026355a-0bdc-40a6-bd7e-6bfdc3035805 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:12:14,291 DEBUG awx.main.dispatch task f026355a-0bdc-40a6-bd7e-6bfdc3035805 is finished 2021-11-02 10:12:14,500 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(cfd03148-6c1b-4339-b808-addc43f02e24, queue=awx_private_queue) [2021-11-02 10:12:14,500: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(cfd03148-6c1b-4339-b808-addc43f02e24, queue=awx_private_queue) 2021-11-02 10:12:14,522 DEBUG awx.main.dispatch delivered cfd03148-6c1b-4339-b808-addc43f02e24 to worker[176] qsize 0 2021-11-02 10:12:14,525 DEBUG awx.main.dispatch task cfd03148-6c1b-4339-b808-addc43f02e24 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:12:14,538 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:12:14,542 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:11:44.758287+00:00 2021-11-02 10:12:14,562 DEBUG awx.main.dispatch task cfd03148-6c1b-4339-b808-addc43f02e24 is finished 2021-11-02 10:12:14,828 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(716a263f-3216-44b4-8537-5da1d748fc44, queue=awx_private_queue) [2021-11-02 10:12:14,828: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(716a263f-3216-44b4-8537-5da1d748fc44, queue=awx_private_queue) 2021-11-02 10:12:14,853 DEBUG awx.main.dispatch delivered 716a263f-3216-44b4-8537-5da1d748fc44 to worker[183] qsize 0 2021-11-02 10:12:14,858 DEBUG awx.main.dispatch task 716a263f-3216-44b4-8537-5da1d748fc44 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:12:14,861 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:12:14,881 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:12:14,913 DEBUG awx.main.dispatch task 716a263f-3216-44b4-8537-5da1d748fc44 is finished 2021-11-02 10:12:34,840 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(4ce272f6-53d1-463c-8a76-aa6db98f04b4, queue=awx_private_queue) [2021-11-02 10:12:34,840: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(4ce272f6-53d1-463c-8a76-aa6db98f04b4, queue=awx_private_queue) 2021-11-02 10:12:34,862 DEBUG awx.main.dispatch delivered 4ce272f6-53d1-463c-8a76-aa6db98f04b4 to worker[181] qsize 0 2021-11-02 10:12:34,865 DEBUG awx.main.dispatch task 4ce272f6-53d1-463c-8a76-aa6db98f04b4 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:12:34,868 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:12:34,887 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:12:34,918 DEBUG awx.main.dispatch task 4ce272f6-53d1-463c-8a76-aa6db98f04b4 is finished 2021-11-02 10:12:44,529 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(83396028-073b-4d17-9b7d-382b01d39eee, queue=awx_private_queue) [2021-11-02 10:12:44,529: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(83396028-073b-4d17-9b7d-382b01d39eee, queue=awx_private_queue) 2021-11-02 10:12:44,823 DEBUG awx.main.dispatch delivered 83396028-073b-4d17-9b7d-382b01d39eee to worker[178] qsize 0 2021-11-02 10:12:44,831 DEBUG awx.main.dispatch task 83396028-073b-4d17-9b7d-382b01d39eee starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:12:44,851 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:12:44,857 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:12:14.539088+00:00 2021-11-02 10:12:44,900 DEBUG awx.main.dispatch task 83396028-073b-4d17-9b7d-382b01d39eee is finished 2021-11-02 10:12:54,841 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(687826c1-1c75-47cb-a21a-30af9aa5bb7b, queue=awx_private_queue) [2021-11-02 10:12:54,841: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(687826c1-1c75-47cb-a21a-30af9aa5bb7b, queue=awx_private_queue) 2021-11-02 10:12:54,859 DEBUG awx.main.dispatch delivered 687826c1-1c75-47cb-a21a-30af9aa5bb7b to worker[183] qsize 0 2021-11-02 10:12:54,865 DEBUG awx.main.dispatch task 687826c1-1c75-47cb-a21a-30af9aa5bb7b starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:12:54,871 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:12:54,909 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:12:54,956 DEBUG awx.main.dispatch task 687826c1-1c75-47cb-a21a-30af9aa5bb7b is finished RESULT 2 OKREADY 2021-11-02 10:13:14,118 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(f8cc1a6d-2d75-4237-994a-44d12462b02f, queue=dev-awx-0) [2021-11-02 10:13:14,118: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(f8cc1a6d-2d75-4237-994a-44d12462b02f, queue=dev-awx-0) 2021-11-02 10:13:14,161 DEBUG awx.main.dispatch delivered f8cc1a6d-2d75-4237-994a-44d12462b02f to worker[181] qsize 0 2021-11-02 10:13:14,169 DEBUG awx.main.dispatch task f8cc1a6d-2d75-4237-994a-44d12462b02f starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:13:14,176 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:13:14,257 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(ecba71e9-dd4e-463c-8bf8-0a9259bdb3e6, queue=dev-awx-0) [2021-11-02 10:13:14,257: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(ecba71e9-dd4e-463c-8bf8-0a9259bdb3e6, queue=dev-awx-0) 2021-11-02 10:13:14,281 DEBUG awx.main.dispatch delivered ecba71e9-dd4e-463c-8bf8-0a9259bdb3e6 to worker[176] qsize 0 2021-11-02 10:13:14,287 DEBUG awx.main.dispatch task ecba71e9-dd4e-463c-8bf8-0a9259bdb3e6 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:13:14,311 DEBUG awx.main.dispatch task ecba71e9-dd4e-463c-8bf8-0a9259bdb3e6 is finished 2021-11-02 10:13:14,516 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(28177210-f6c6-4494-bee1-9184293d9fbb, queue=awx_private_queue) [2021-11-02 10:13:14,516: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(28177210-f6c6-4494-bee1-9184293d9fbb, queue=awx_private_queue) 2021-11-02 10:13:14,540 DEBUG awx.main.dispatch delivered 28177210-f6c6-4494-bee1-9184293d9fbb to worker[176] qsize 0 2021-11-02 10:13:14,542 DEBUG awx.main.dispatch task 28177210-f6c6-4494-bee1-9184293d9fbb starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:13:14,557 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:13:14,561 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:12:44.851886+00:00 2021-11-02 10:13:14,840 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(deb08e53-1bb6-4010-9d4b-97e81d089977, queue=awx_private_queue) [2021-11-02 10:13:14,840: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(deb08e53-1bb6-4010-9d4b-97e81d089977, queue=awx_private_queue) 2021-11-02 10:13:14,860 DEBUG awx.main.dispatch delivered deb08e53-1bb6-4010-9d4b-97e81d089977 to worker[178] qsize 0 2021-11-02 10:13:14,864 DEBUG awx.main.dispatch task deb08e53-1bb6-4010-9d4b-97e81d089977 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:13:14,865 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:13:14,900 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:13:14,928 DEBUG awx.main.dispatch task deb08e53-1bb6-4010-9d4b-97e81d089977 is finished 2021-11-02 10:13:15,486 DEBUG awx.main.dispatch task f8cc1a6d-2d75-4237-994a-44d12462b02f is finished 2021-11-02 10:13:16,801 DEBUG awx.main.dispatch task 28177210-f6c6-4494-bee1-9184293d9fbb is finished 2021-11-02 10:13:34,851 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ce42c600-96cb-47f0-8ec5-ffea7af6847f, queue=awx_private_queue) [2021-11-02 10:13:34,851: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ce42c600-96cb-47f0-8ec5-ffea7af6847f, queue=awx_private_queue) 2021-11-02 10:13:34,873 DEBUG awx.main.dispatch delivered ce42c600-96cb-47f0-8ec5-ffea7af6847f to worker[181] qsize 0 2021-11-02 10:13:34,876 DEBUG awx.main.dispatch task ce42c600-96cb-47f0-8ec5-ffea7af6847f starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:13:34,880 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:13:34,901 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:13:34,932 DEBUG awx.main.dispatch task ce42c600-96cb-47f0-8ec5-ffea7af6847f is finished 2021-11-02 10:13:44,516 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(4bb588c7-d48e-4ee8-b6c2-82751e68040a, queue=awx_private_queue) [2021-11-02 10:13:44,516: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(4bb588c7-d48e-4ee8-b6c2-82751e68040a, queue=awx_private_queue) 2021-11-02 10:13:44,562 DEBUG awx.main.dispatch delivered 4bb588c7-d48e-4ee8-b6c2-82751e68040a to worker[181] qsize 0 2021-11-02 10:13:44,565 DEBUG awx.main.dispatch task 4bb588c7-d48e-4ee8-b6c2-82751e68040a starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:13:44,576 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:13:44,579 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:13:14.557731+00:00 2021-11-02 10:13:44,946 DEBUG awx.main.dispatch task 4bb588c7-d48e-4ee8-b6c2-82751e68040a is finished 2021-11-02 10:13:54,851 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(75dc756e-5197-4be0-8951-6a801c355c3b, queue=awx_private_queue) [2021-11-02 10:13:54,851: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(75dc756e-5197-4be0-8951-6a801c355c3b, queue=awx_private_queue) 2021-11-02 10:13:55,042 DEBUG awx.main.dispatch delivered 75dc756e-5197-4be0-8951-6a801c355c3b to worker[178] qsize 0 2021-11-02 10:13:55,044 DEBUG awx.main.dispatch task 75dc756e-5197-4be0-8951-6a801c355c3b starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:13:55,046 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:13:55,063 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:13:55,089 DEBUG awx.main.dispatch task 75dc756e-5197-4be0-8951-6a801c355c3b is finished RESULT 2 OKREADY 2021-11-02 10:14:14,135 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(7e406576-8a51-44e5-bdd1-f08c80f88240, queue=dev-awx-0) [2021-11-02 10:14:14,135: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(7e406576-8a51-44e5-bdd1-f08c80f88240, queue=dev-awx-0) 2021-11-02 10:14:14,202 DEBUG awx.main.dispatch delivered 7e406576-8a51-44e5-bdd1-f08c80f88240 to worker[183] qsize 0 2021-11-02 10:14:14,212 DEBUG awx.main.dispatch task 7e406576-8a51-44e5-bdd1-f08c80f88240 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:14:14,220 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:14:14,257 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(a2c7e74a-5bda-4ad7-828c-5eacee0d836e, queue=dev-awx-0) [2021-11-02 10:14:14,257: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(a2c7e74a-5bda-4ad7-828c-5eacee0d836e, queue=dev-awx-0) 2021-11-02 10:14:14,280 DEBUG awx.main.dispatch delivered a2c7e74a-5bda-4ad7-828c-5eacee0d836e to worker[178] qsize 0 2021-11-02 10:14:14,284 DEBUG awx.main.dispatch task 7e406576-8a51-44e5-bdd1-f08c80f88240 is finished 2021-11-02 10:14:14,286 DEBUG awx.main.dispatch task a2c7e74a-5bda-4ad7-828c-5eacee0d836e starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:14:14,314 DEBUG awx.main.dispatch task a2c7e74a-5bda-4ad7-828c-5eacee0d836e is finished 2021-11-02 10:14:14,517 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(51c350c7-25cd-45d2-abc6-622fe1314e0b, queue=awx_private_queue) [2021-11-02 10:14:14,517: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(51c350c7-25cd-45d2-abc6-622fe1314e0b, queue=awx_private_queue) 2021-11-02 10:14:14,540 DEBUG awx.main.dispatch delivered 51c350c7-25cd-45d2-abc6-622fe1314e0b to worker[183] qsize 0 2021-11-02 10:14:14,542 DEBUG awx.main.dispatch task 51c350c7-25cd-45d2-abc6-622fe1314e0b starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:14:14,553 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:14:14,556 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:13:44.576207+00:00 2021-11-02 10:14:14,639 DEBUG awx.main.dispatch task 51c350c7-25cd-45d2-abc6-622fe1314e0b is finished 2021-11-02 10:14:14,852 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5fa7b186-45c2-423d-851a-5513783dba8d, queue=awx_private_queue) [2021-11-02 10:14:14,852: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5fa7b186-45c2-423d-851a-5513783dba8d, queue=awx_private_queue) 2021-11-02 10:14:14,874 DEBUG awx.main.dispatch delivered 5fa7b186-45c2-423d-851a-5513783dba8d to worker[176] qsize 0 2021-11-02 10:14:14,878 DEBUG awx.main.dispatch task 5fa7b186-45c2-423d-851a-5513783dba8d starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:14:14,885 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:14:14,907 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:14:14,937 DEBUG awx.main.dispatch task 5fa7b186-45c2-423d-851a-5513783dba8d is finished 2021-11-02 10:14:34,864 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(1795ad20-a390-4a99-bddd-fdc7445ecdab, queue=awx_private_queue) [2021-11-02 10:14:34,864: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(1795ad20-a390-4a99-bddd-fdc7445ecdab, queue=awx_private_queue) 2021-11-02 10:14:34,886 DEBUG awx.main.dispatch delivered 1795ad20-a390-4a99-bddd-fdc7445ecdab to worker[176] qsize 0 2021-11-02 10:14:34,889 DEBUG awx.main.dispatch task 1795ad20-a390-4a99-bddd-fdc7445ecdab starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:14:34,890 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:14:34,906 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:14:34,934 DEBUG awx.main.dispatch task 1795ad20-a390-4a99-bddd-fdc7445ecdab is finished 2021-11-02 10:14:44,517 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(9a69c33d-d86b-4e45-b89f-2502c0ec2230, queue=awx_private_queue) [2021-11-02 10:14:44,517: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(9a69c33d-d86b-4e45-b89f-2502c0ec2230, queue=awx_private_queue) 2021-11-02 10:14:44,535 DEBUG awx.main.dispatch delivered 9a69c33d-d86b-4e45-b89f-2502c0ec2230 to worker[176] qsize 0 2021-11-02 10:14:44,538 DEBUG awx.main.dispatch task 9a69c33d-d86b-4e45-b89f-2502c0ec2230 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:14:44,550 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:14:44,553 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:14:14.553233+00:00 2021-11-02 10:14:44,624 DEBUG awx.main.dispatch task 9a69c33d-d86b-4e45-b89f-2502c0ec2230 is finished 2021-11-02 10:14:54,864 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a835ab79-5ce9-471c-ad65-f7a68ec64fb9, queue=awx_private_queue) [2021-11-02 10:14:54,864: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a835ab79-5ce9-471c-ad65-f7a68ec64fb9, queue=awx_private_queue) 2021-11-02 10:14:55,091 DEBUG awx.main.dispatch delivered a835ab79-5ce9-471c-ad65-f7a68ec64fb9 to worker[181] qsize 0 2021-11-02 10:14:55,096 DEBUG awx.main.dispatch task a835ab79-5ce9-471c-ad65-f7a68ec64fb9 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:14:55,102 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:14:55,125 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:14:55,155 DEBUG awx.main.dispatch task a835ab79-5ce9-471c-ad65-f7a68ec64fb9 is finished RESULT 2 OKREADY 2021-11-02 10:15:14,127 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(9bb9ab60-0cd3-42e8-9795-7ed48c4416c9, queue=dev-awx-0) [2021-11-02 10:15:14,127: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(9bb9ab60-0cd3-42e8-9795-7ed48c4416c9, queue=dev-awx-0) 2021-11-02 10:15:14,166 DEBUG awx.main.dispatch delivered 9bb9ab60-0cd3-42e8-9795-7ed48c4416c9 to worker[181] qsize 0 2021-11-02 10:15:14,169 DEBUG awx.main.dispatch task 9bb9ab60-0cd3-42e8-9795-7ed48c4416c9 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:15:14,172 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:15:14,228 DEBUG awx.main.dispatch task 9bb9ab60-0cd3-42e8-9795-7ed48c4416c9 is finished 2021-11-02 10:15:14,257 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(2ce0d5bf-0a6b-49dc-86cc-15fba33d6f98, queue=dev-awx-0) [2021-11-02 10:15:14,257: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(2ce0d5bf-0a6b-49dc-86cc-15fba33d6f98, queue=dev-awx-0) 2021-11-02 10:15:14,281 DEBUG awx.main.dispatch delivered 2ce0d5bf-0a6b-49dc-86cc-15fba33d6f98 to worker[178] qsize 0 2021-11-02 10:15:14,284 DEBUG awx.main.dispatch task 2ce0d5bf-0a6b-49dc-86cc-15fba33d6f98 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:15:14,299 DEBUG awx.main.dispatch task 2ce0d5bf-0a6b-49dc-86cc-15fba33d6f98 is finished 2021-11-02 10:15:14,517 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(951620f9-3698-40e4-8f78-d39c4bffa597, queue=awx_private_queue) [2021-11-02 10:15:14,517: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(951620f9-3698-40e4-8f78-d39c4bffa597, queue=awx_private_queue) 2021-11-02 10:15:14,541 DEBUG awx.main.dispatch delivered 951620f9-3698-40e4-8f78-d39c4bffa597 to worker[181] qsize 0 2021-11-02 10:15:14,545 DEBUG awx.main.dispatch task 951620f9-3698-40e4-8f78-d39c4bffa597 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:15:14,555 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:15:14,559 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:14:44.550464+00:00 2021-11-02 10:15:14,589 DEBUG awx.main.dispatch task 951620f9-3698-40e4-8f78-d39c4bffa597 is finished 2021-11-02 10:15:14,864 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(00706aaf-2224-42a9-b80f-b5fd6fb26edc, queue=awx_private_queue) [2021-11-02 10:15:14,864: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(00706aaf-2224-42a9-b80f-b5fd6fb26edc, queue=awx_private_queue) 2021-11-02 10:15:14,884 DEBUG awx.main.dispatch delivered 00706aaf-2224-42a9-b80f-b5fd6fb26edc to worker[176] qsize 0 2021-11-02 10:15:14,887 DEBUG awx.main.dispatch task 00706aaf-2224-42a9-b80f-b5fd6fb26edc starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:15:14,889 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:15:14,907 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:15:14,942 DEBUG awx.main.dispatch task 00706aaf-2224-42a9-b80f-b5fd6fb26edc is finished 2021-11-02 10:15:34,874 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6486375e-fd96-4d20-b773-7079b7ccc0ff, queue=awx_private_queue) [2021-11-02 10:15:34,874: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6486375e-fd96-4d20-b773-7079b7ccc0ff, queue=awx_private_queue) 2021-11-02 10:15:34,899 DEBUG awx.main.dispatch delivered 6486375e-fd96-4d20-b773-7079b7ccc0ff to worker[178] qsize 0 2021-11-02 10:15:34,902 DEBUG awx.main.dispatch task 6486375e-fd96-4d20-b773-7079b7ccc0ff starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:15:34,904 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:15:34,925 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:15:34,956 DEBUG awx.main.dispatch task 6486375e-fd96-4d20-b773-7079b7ccc0ff is finished 2021-11-02 10:15:44,522 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(9335195e-4a01-48d8-b07c-32a81f0ce596, queue=awx_private_queue) [2021-11-02 10:15:44,522: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(9335195e-4a01-48d8-b07c-32a81f0ce596, queue=awx_private_queue) 2021-11-02 10:15:44,549 DEBUG awx.main.dispatch delivered 9335195e-4a01-48d8-b07c-32a81f0ce596 to worker[181] qsize 0 2021-11-02 10:15:44,552 DEBUG awx.main.dispatch task 9335195e-4a01-48d8-b07c-32a81f0ce596 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:15:44,565 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:15:44,568 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:15:14.556350+00:00 2021-11-02 10:15:44,605 DEBUG awx.main.dispatch task 9335195e-4a01-48d8-b07c-32a81f0ce596 is finished 2021-11-02 10:15:54,879 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(07406baa-6a1f-4b46-9693-887264c0d460, queue=awx_private_queue) [2021-11-02 10:15:54,879: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(07406baa-6a1f-4b46-9693-887264c0d460, queue=awx_private_queue) 2021-11-02 10:15:55,110 DEBUG awx.main.dispatch delivered 07406baa-6a1f-4b46-9693-887264c0d460 to worker[176] qsize 0 2021-11-02 10:15:55,119 DEBUG awx.main.dispatch task 07406baa-6a1f-4b46-9693-887264c0d460 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:15:55,124 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:15:55,147 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:15:55,178 DEBUG awx.main.dispatch task 07406baa-6a1f-4b46-9693-887264c0d460 is finished RESULT 2 OKREADY 2021-11-02 10:16:14,137 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(a3be455b-6a2e-4325-9830-302b5fd7d7a5, queue=dev-awx-0) [2021-11-02 10:16:14,137: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(a3be455b-6a2e-4325-9830-302b5fd7d7a5, queue=dev-awx-0) 2021-11-02 10:16:14,191 DEBUG awx.main.dispatch delivered a3be455b-6a2e-4325-9830-302b5fd7d7a5 to worker[176] qsize 0 2021-11-02 10:16:14,194 DEBUG awx.main.dispatch task a3be455b-6a2e-4325-9830-302b5fd7d7a5 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:16:14,196 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:16:14,219 DEBUG awx.main.dispatch task a3be455b-6a2e-4325-9830-302b5fd7d7a5 is finished 2021-11-02 10:16:14,257 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(a9ef4c26-bdcd-4f2b-ab48-077a98d272d6, queue=dev-awx-0) [2021-11-02 10:16:14,257: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(a9ef4c26-bdcd-4f2b-ab48-077a98d272d6, queue=dev-awx-0) 2021-11-02 10:16:14,279 DEBUG awx.main.dispatch delivered a9ef4c26-bdcd-4f2b-ab48-077a98d272d6 to worker[176] qsize 0 2021-11-02 10:16:14,282 DEBUG awx.main.dispatch task a9ef4c26-bdcd-4f2b-ab48-077a98d272d6 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:16:14,296 DEBUG awx.main.dispatch task a9ef4c26-bdcd-4f2b-ab48-077a98d272d6 is finished 2021-11-02 10:16:14,522 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(df586bf6-4f16-4aa9-a63c-f7a86d716250, queue=awx_private_queue) [2021-11-02 10:16:14,522: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(df586bf6-4f16-4aa9-a63c-f7a86d716250, queue=awx_private_queue) 2021-11-02 10:16:14,544 DEBUG awx.main.dispatch delivered df586bf6-4f16-4aa9-a63c-f7a86d716250 to worker[176] qsize 0 2021-11-02 10:16:14,547 DEBUG awx.main.dispatch task df586bf6-4f16-4aa9-a63c-f7a86d716250 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:16:14,559 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:16:14,562 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:15:44.565857+00:00 2021-11-02 10:16:14,582 DEBUG awx.main.dispatch task df586bf6-4f16-4aa9-a63c-f7a86d716250 is finished 2021-11-02 10:16:14,876 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c80450fa-366c-4b21-b826-2e62e328f248, queue=awx_private_queue) [2021-11-02 10:16:14,876: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c80450fa-366c-4b21-b826-2e62e328f248, queue=awx_private_queue) 2021-11-02 10:16:14,894 DEBUG awx.main.dispatch delivered c80450fa-366c-4b21-b826-2e62e328f248 to worker[176] qsize 0 2021-11-02 10:16:14,899 DEBUG awx.main.dispatch task c80450fa-366c-4b21-b826-2e62e328f248 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:16:14,902 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:16:14,920 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:16:14,952 DEBUG awx.main.dispatch task c80450fa-366c-4b21-b826-2e62e328f248 is finished 2021-11-02 10:16:34,876 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(cedd2f20-0ea0-484a-9ff6-7e4044b5b050, queue=awx_private_queue) [2021-11-02 10:16:34,876: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(cedd2f20-0ea0-484a-9ff6-7e4044b5b050, queue=awx_private_queue) 2021-11-02 10:16:34,898 DEBUG awx.main.dispatch delivered cedd2f20-0ea0-484a-9ff6-7e4044b5b050 to worker[178] qsize 0 2021-11-02 10:16:34,903 DEBUG awx.main.dispatch task cedd2f20-0ea0-484a-9ff6-7e4044b5b050 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:16:34,910 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:16:34,941 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:16:34,972 DEBUG awx.main.dispatch task cedd2f20-0ea0-484a-9ff6-7e4044b5b050 is finished 2021-11-02 10:16:44,523 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(3ae372e3-f031-4b52-9e86-a4dcb085821d, queue=awx_private_queue) [2021-11-02 10:16:44,523: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(3ae372e3-f031-4b52-9e86-a4dcb085821d, queue=awx_private_queue) 2021-11-02 10:16:44,549 DEBUG awx.main.dispatch delivered 3ae372e3-f031-4b52-9e86-a4dcb085821d to worker[181] qsize 0 2021-11-02 10:16:44,555 DEBUG awx.main.dispatch task 3ae372e3-f031-4b52-9e86-a4dcb085821d starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:16:44,572 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:16:44,577 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:16:14.559757+00:00 2021-11-02 10:16:44,625 DEBUG awx.main.dispatch task 3ae372e3-f031-4b52-9e86-a4dcb085821d is finished 2021-11-02 10:16:54,878 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(2964fe3e-8a47-46d0-ba15-5bf4c8a50cae, queue=awx_private_queue) [2021-11-02 10:16:54,878: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(2964fe3e-8a47-46d0-ba15-5bf4c8a50cae, queue=awx_private_queue) 2021-11-02 10:16:54,907 DEBUG awx.main.dispatch delivered 2964fe3e-8a47-46d0-ba15-5bf4c8a50cae to worker[176] qsize 0 2021-11-02 10:16:54,910 DEBUG awx.main.dispatch task 2964fe3e-8a47-46d0-ba15-5bf4c8a50cae starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:16:54,916 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:16:54,937 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:16:54,975 DEBUG awx.main.dispatch task 2964fe3e-8a47-46d0-ba15-5bf4c8a50cae is finished RESULT 2 OKREADY 2021-11-02 10:17:14,141 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(e1e2b21f-6042-4573-8ca8-059989875ec8, queue=dev-awx-0) [2021-11-02 10:17:14,141: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(e1e2b21f-6042-4573-8ca8-059989875ec8, queue=dev-awx-0) 2021-11-02 10:17:14,373 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(8a35249c-1dc5-4858-98d6-dd7cfa2f477f, queue=dev-awx-0) [2021-11-02 10:17:14,373: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(8a35249c-1dc5-4858-98d6-dd7cfa2f477f, queue=dev-awx-0) 2021-11-02 10:17:14,403 DEBUG awx.main.dispatch delivered e1e2b21f-6042-4573-8ca8-059989875ec8 to worker[178] qsize 0 2021-11-02 10:17:14,408 DEBUG awx.main.dispatch delivered 8a35249c-1dc5-4858-98d6-dd7cfa2f477f to worker[183] qsize 0 2021-11-02 10:17:14,409 DEBUG awx.main.dispatch task e1e2b21f-6042-4573-8ca8-059989875ec8 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:17:14,413 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:17:14,411 DEBUG awx.main.dispatch task 8a35249c-1dc5-4858-98d6-dd7cfa2f477f starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:17:14,430 DEBUG awx.main.dispatch task 8a35249c-1dc5-4858-98d6-dd7cfa2f477f is finished 2021-11-02 10:17:14,452 DEBUG awx.main.dispatch task e1e2b21f-6042-4573-8ca8-059989875ec8 is finished 2021-11-02 10:17:14,522 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(620f8cd5-4122-4d09-860c-fd402a4bdfea, queue=awx_private_queue) [2021-11-02 10:17:14,522: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(620f8cd5-4122-4d09-860c-fd402a4bdfea, queue=awx_private_queue) 2021-11-02 10:17:14,546 DEBUG awx.main.dispatch delivered 620f8cd5-4122-4d09-860c-fd402a4bdfea to worker[181] qsize 0 2021-11-02 10:17:14,550 DEBUG awx.main.dispatch task 620f8cd5-4122-4d09-860c-fd402a4bdfea starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:17:14,563 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:17:14,568 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:16:44.572827+00:00 2021-11-02 10:17:14,583 DEBUG awx.main.dispatch task 620f8cd5-4122-4d09-860c-fd402a4bdfea is finished 2021-11-02 10:17:14,877 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(57540cfa-bbd8-4c3b-a5a6-a0ebb2659f60, queue=awx_private_queue) [2021-11-02 10:17:14,877: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(57540cfa-bbd8-4c3b-a5a6-a0ebb2659f60, queue=awx_private_queue) 2021-11-02 10:17:14,899 DEBUG awx.main.dispatch delivered 57540cfa-bbd8-4c3b-a5a6-a0ebb2659f60 to worker[183] qsize 0 2021-11-02 10:17:14,903 DEBUG awx.main.dispatch task 57540cfa-bbd8-4c3b-a5a6-a0ebb2659f60 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:17:14,905 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:17:14,924 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:17:14,961 DEBUG awx.main.dispatch task 57540cfa-bbd8-4c3b-a5a6-a0ebb2659f60 is finished 2021-11-02 10:17:34,881 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(8b1ae6af-0bc8-471c-bec4-12d6fa360e06, queue=awx_private_queue) [2021-11-02 10:17:34,881: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(8b1ae6af-0bc8-471c-bec4-12d6fa360e06, queue=awx_private_queue) 2021-11-02 10:17:34,913 DEBUG awx.main.dispatch delivered 8b1ae6af-0bc8-471c-bec4-12d6fa360e06 to worker[176] qsize 0 2021-11-02 10:17:34,919 DEBUG awx.main.dispatch task 8b1ae6af-0bc8-471c-bec4-12d6fa360e06 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:17:34,930 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:17:34,958 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:17:34,987 DEBUG awx.main.dispatch task 8b1ae6af-0bc8-471c-bec4-12d6fa360e06 is finished 2021-11-02 10:17:44,523 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(820851e2-7f44-4795-b9a7-4cbccfb0d5bc, queue=awx_private_queue) [2021-11-02 10:17:44,523: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(820851e2-7f44-4795-b9a7-4cbccfb0d5bc, queue=awx_private_queue) 2021-11-02 10:17:44,548 DEBUG awx.main.dispatch delivered 820851e2-7f44-4795-b9a7-4cbccfb0d5bc to worker[176] qsize 0 2021-11-02 10:17:44,552 DEBUG awx.main.dispatch task 820851e2-7f44-4795-b9a7-4cbccfb0d5bc starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:17:44,564 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:17:44,568 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:17:14.563815+00:00 2021-11-02 10:17:44,643 DEBUG awx.main.dispatch task 820851e2-7f44-4795-b9a7-4cbccfb0d5bc is finished 2021-11-02 10:17:54,878 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ec396584-e348-4b77-abcf-7b8f1ce5c2af, queue=awx_private_queue) [2021-11-02 10:17:54,878: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ec396584-e348-4b77-abcf-7b8f1ce5c2af, queue=awx_private_queue) 2021-11-02 10:17:54,894 DEBUG awx.main.dispatch delivered ec396584-e348-4b77-abcf-7b8f1ce5c2af to worker[181] qsize 0 2021-11-02 10:17:54,896 DEBUG awx.main.dispatch task ec396584-e348-4b77-abcf-7b8f1ce5c2af starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:17:54,898 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:17:54,915 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:17:54,943 DEBUG awx.main.dispatch task ec396584-e348-4b77-abcf-7b8f1ce5c2af is finished RESULT 2 OKREADY 2021-11-02 10:18:13,982 DEBUG awx.main.dispatch publish awx.main.tasks.awx_isolated_heartbeat(2417919f-0cf1-4703-ae3a-895cf62e6b5c, queue=dev-awx-0) [2021-11-02 10:18:13,982: DEBUG/Process-1] publish awx.main.tasks.awx_isolated_heartbeat(2417919f-0cf1-4703-ae3a-895cf62e6b5c, queue=dev-awx-0) 2021-11-02 10:18:14,026 DEBUG awx.main.dispatch delivered 2417919f-0cf1-4703-ae3a-895cf62e6b5c to worker[178] qsize 0 2021-11-02 10:18:14,135 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(14dcdd0a-311e-4e51-8193-4fca87812fa7, queue=dev-awx-0) [2021-11-02 10:18:14,135: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(14dcdd0a-311e-4e51-8193-4fca87812fa7, queue=dev-awx-0) 2021-11-02 10:18:14,176 DEBUG awx.main.dispatch delivered 14dcdd0a-311e-4e51-8193-4fca87812fa7 to worker[176] qsize 0 2021-11-02 10:18:14,178 DEBUG awx.main.dispatch task 14dcdd0a-311e-4e51-8193-4fca87812fa7 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:18:14,180 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:18:14,249 DEBUG awx.main.dispatch task 14dcdd0a-311e-4e51-8193-4fca87812fa7 is finished 2021-11-02 10:18:14,030 DEBUG awx.main.dispatch task 2417919f-0cf1-4703-ae3a-895cf62e6b5c starting awx.main.tasks.awx_isolated_heartbeat(*[]) 2021-11-02 10:18:14,285 DEBUG awx.main.tasks Controlling node checking for any isolated management tasks. 2021-11-02 10:18:14,295 DEBUG awx.main.dispatch task 2417919f-0cf1-4703-ae3a-895cf62e6b5c is finished 2021-11-02 10:18:14,373 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(5ba8ca9f-f506-4f44-beff-1bf898568d33, queue=dev-awx-0) [2021-11-02 10:18:14,373: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(5ba8ca9f-f506-4f44-beff-1bf898568d33, queue=dev-awx-0) 2021-11-02 10:18:14,397 DEBUG awx.main.dispatch delivered 5ba8ca9f-f506-4f44-beff-1bf898568d33 to worker[178] qsize 0 2021-11-02 10:18:14,399 DEBUG awx.main.dispatch task 5ba8ca9f-f506-4f44-beff-1bf898568d33 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:18:14,414 DEBUG awx.main.dispatch task 5ba8ca9f-f506-4f44-beff-1bf898568d33 is finished 2021-11-02 10:18:14,523 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(bd3ee5a6-78f1-430e-a977-8e3769be5f11, queue=awx_private_queue) [2021-11-02 10:18:14,523: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(bd3ee5a6-78f1-430e-a977-8e3769be5f11, queue=awx_private_queue) 2021-11-02 10:18:14,548 DEBUG awx.main.dispatch delivered bd3ee5a6-78f1-430e-a977-8e3769be5f11 to worker[181] qsize 0 2021-11-02 10:18:14,551 DEBUG awx.main.dispatch task bd3ee5a6-78f1-430e-a977-8e3769be5f11 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:18:14,562 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:18:14,565 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:17:44.565042+00:00 2021-11-02 10:18:14,580 DEBUG awx.main.dispatch task bd3ee5a6-78f1-430e-a977-8e3769be5f11 is finished 2021-11-02 10:18:14,878 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(196e685f-926c-43b3-aab5-b0dc375238b6, queue=awx_private_queue) [2021-11-02 10:18:14,878: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(196e685f-926c-43b3-aab5-b0dc375238b6, queue=awx_private_queue) 2021-11-02 10:18:14,900 DEBUG awx.main.dispatch delivered 196e685f-926c-43b3-aab5-b0dc375238b6 to worker[181] qsize 0 2021-11-02 10:18:14,904 DEBUG awx.main.dispatch task 196e685f-926c-43b3-aab5-b0dc375238b6 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:18:14,906 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:18:14,926 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:18:14,957 DEBUG awx.main.dispatch task 196e685f-926c-43b3-aab5-b0dc375238b6 is finished 2021-11-02 10:18:34,886 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b81122f4-2d36-41a2-ae24-7f56b8d31efd, queue=awx_private_queue) [2021-11-02 10:18:34,886: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b81122f4-2d36-41a2-ae24-7f56b8d31efd, queue=awx_private_queue) 2021-11-02 10:18:34,903 DEBUG awx.main.dispatch delivered b81122f4-2d36-41a2-ae24-7f56b8d31efd to worker[181] qsize 0 2021-11-02 10:18:34,910 DEBUG awx.main.dispatch task b81122f4-2d36-41a2-ae24-7f56b8d31efd starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:18:34,911 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:18:34,933 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:18:34,962 DEBUG awx.main.dispatch task b81122f4-2d36-41a2-ae24-7f56b8d31efd is finished 2021-11-02 10:18:44,523 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(93658866-6700-4f62-b5a1-0a02eb9bd991, queue=awx_private_queue) [2021-11-02 10:18:44,523: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(93658866-6700-4f62-b5a1-0a02eb9bd991, queue=awx_private_queue) 2021-11-02 10:18:44,547 DEBUG awx.main.dispatch delivered 93658866-6700-4f62-b5a1-0a02eb9bd991 to worker[181] qsize 0 2021-11-02 10:18:44,550 DEBUG awx.main.dispatch task 93658866-6700-4f62-b5a1-0a02eb9bd991 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:18:44,559 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:18:44,561 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:18:14.562850+00:00 2021-11-02 10:18:44,606 DEBUG awx.main.dispatch task 93658866-6700-4f62-b5a1-0a02eb9bd991 is finished 2021-11-02 10:18:54,894 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(de0b65e2-fb5c-465a-a302-1ae9bfc70c1e, queue=awx_private_queue) [2021-11-02 10:18:54,894: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(de0b65e2-fb5c-465a-a302-1ae9bfc70c1e, queue=awx_private_queue) 2021-11-02 10:18:54,923 DEBUG awx.main.dispatch delivered de0b65e2-fb5c-465a-a302-1ae9bfc70c1e to worker[183] qsize 0 2021-11-02 10:18:54,931 DEBUG awx.main.dispatch task de0b65e2-fb5c-465a-a302-1ae9bfc70c1e starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:18:54,937 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:18:54,963 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:18:54,993 DEBUG awx.main.dispatch task de0b65e2-fb5c-465a-a302-1ae9bfc70c1e is finished RESULT 2 OKREADY 2021-11-02 10:19:14,148 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(a4856e3a-9e02-4633-8b5d-beb22f6e1ced, queue=dev-awx-0) [2021-11-02 10:19:14,148: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(a4856e3a-9e02-4633-8b5d-beb22f6e1ced, queue=dev-awx-0) 2021-11-02 10:19:14,215 DEBUG awx.main.dispatch delivered a4856e3a-9e02-4633-8b5d-beb22f6e1ced to worker[178] qsize 0 2021-11-02 10:19:14,220 DEBUG awx.main.dispatch task a4856e3a-9e02-4633-8b5d-beb22f6e1ced starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:19:14,440 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:19:14,457 DEBUG awx.main.dispatch task a4856e3a-9e02-4633-8b5d-beb22f6e1ced is finished 2021-11-02 10:19:14,373 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(f92ff03f-db0a-445f-a365-f0f0afdacb7b, queue=dev-awx-0) [2021-11-02 10:19:14,373: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(f92ff03f-db0a-445f-a365-f0f0afdacb7b, queue=dev-awx-0) 2021-11-02 10:19:14,597 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(f59896cc-a035-4ef1-abd9-2b6989e72656, queue=awx_private_queue) [2021-11-02 10:19:14,597: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(f59896cc-a035-4ef1-abd9-2b6989e72656, queue=awx_private_queue) 2021-11-02 10:19:14,597 DEBUG awx.main.dispatch delivered f92ff03f-db0a-445f-a365-f0f0afdacb7b to worker[178] qsize 0 2021-11-02 10:19:14,600 DEBUG awx.main.dispatch task f92ff03f-db0a-445f-a365-f0f0afdacb7b starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:19:14,612 DEBUG awx.main.dispatch delivered f59896cc-a035-4ef1-abd9-2b6989e72656 to worker[176] qsize 0 2021-11-02 10:19:14,614 DEBUG awx.main.dispatch task f92ff03f-db0a-445f-a365-f0f0afdacb7b is finished 2021-11-02 10:19:14,616 DEBUG awx.main.dispatch task f59896cc-a035-4ef1-abd9-2b6989e72656 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:19:14,632 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:19:14,639 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:18:44.559233+00:00 2021-11-02 10:19:14,677 DEBUG awx.main.dispatch task f59896cc-a035-4ef1-abd9-2b6989e72656 is finished 2021-11-02 10:19:14,891 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(13bb0be3-fa32-4d2c-bd29-be7732d5afbd, queue=awx_private_queue) [2021-11-02 10:19:14,891: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(13bb0be3-fa32-4d2c-bd29-be7732d5afbd, queue=awx_private_queue) 2021-11-02 10:19:14,912 DEBUG awx.main.dispatch delivered 13bb0be3-fa32-4d2c-bd29-be7732d5afbd to worker[176] qsize 0 2021-11-02 10:19:14,916 DEBUG awx.main.dispatch task 13bb0be3-fa32-4d2c-bd29-be7732d5afbd starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:19:14,918 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:19:14,936 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:19:14,967 DEBUG awx.main.dispatch task 13bb0be3-fa32-4d2c-bd29-be7732d5afbd is finished 2021-11-02 10:19:34,891 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(870301c2-3cca-47c0-a541-d8382cc0e9d6, queue=awx_private_queue) [2021-11-02 10:19:34,891: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(870301c2-3cca-47c0-a541-d8382cc0e9d6, queue=awx_private_queue) 2021-11-02 10:19:34,913 DEBUG awx.main.dispatch delivered 870301c2-3cca-47c0-a541-d8382cc0e9d6 to worker[178] qsize 0 2021-11-02 10:19:34,915 DEBUG awx.main.dispatch task 870301c2-3cca-47c0-a541-d8382cc0e9d6 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:19:34,916 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:19:34,932 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:19:34,960 DEBUG awx.main.dispatch task 870301c2-3cca-47c0-a541-d8382cc0e9d6 is finished 2021-11-02 10:19:44,598 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(84a69352-862b-4529-9700-53c70192f72d, queue=awx_private_queue) [2021-11-02 10:19:44,598: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(84a69352-862b-4529-9700-53c70192f72d, queue=awx_private_queue) 2021-11-02 10:19:44,622 DEBUG awx.main.dispatch delivered 84a69352-862b-4529-9700-53c70192f72d to worker[183] qsize 0 2021-11-02 10:19:44,625 DEBUG awx.main.dispatch task 84a69352-862b-4529-9700-53c70192f72d starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:19:44,635 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:19:44,639 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:19:14.632545+00:00 2021-11-02 10:19:44,727 DEBUG awx.main.dispatch task 84a69352-862b-4529-9700-53c70192f72d is finished 2021-11-02 10:19:54,891 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c8913a76-6dfa-42ad-8ca6-a93e4ef17c6b, queue=awx_private_queue) [2021-11-02 10:19:54,891: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c8913a76-6dfa-42ad-8ca6-a93e4ef17c6b, queue=awx_private_queue) 2021-11-02 10:19:54,907 DEBUG awx.main.dispatch delivered c8913a76-6dfa-42ad-8ca6-a93e4ef17c6b to worker[178] qsize 0 2021-11-02 10:19:54,910 DEBUG awx.main.dispatch task c8913a76-6dfa-42ad-8ca6-a93e4ef17c6b starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:19:54,911 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:19:54,934 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:19:54,969 DEBUG awx.main.dispatch task c8913a76-6dfa-42ad-8ca6-a93e4ef17c6b is finished RESULT 2 OKREADY 2021-11-02 10:20:14,145 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(5463b61f-03c8-4187-a0e5-162ec1cd9785, queue=dev-awx-0) [2021-11-02 10:20:14,145: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(5463b61f-03c8-4187-a0e5-162ec1cd9785, queue=dev-awx-0) 2021-11-02 10:20:14,203 DEBUG awx.main.dispatch delivered 5463b61f-03c8-4187-a0e5-162ec1cd9785 to worker[176] qsize 0 2021-11-02 10:20:14,206 DEBUG awx.main.dispatch task 5463b61f-03c8-4187-a0e5-162ec1cd9785 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:20:14,208 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:20:14,527 DEBUG awx.main.dispatch task 5463b61f-03c8-4187-a0e5-162ec1cd9785 is finished 2021-11-02 10:20:14,375 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(9d6d970b-61dd-4e67-8fd0-346e026e0d9b, queue=dev-awx-0) [2021-11-02 10:20:14,375: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(9d6d970b-61dd-4e67-8fd0-346e026e0d9b, queue=dev-awx-0) 2021-11-02 10:20:14,626 DEBUG awx.main.dispatch delivered 9d6d970b-61dd-4e67-8fd0-346e026e0d9b to worker[176] qsize 0 2021-11-02 10:20:14,628 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(187d340d-2aa5-43f6-9336-eeff0bbee6f3, queue=awx_private_queue) [2021-11-02 10:20:14,628: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(187d340d-2aa5-43f6-9336-eeff0bbee6f3, queue=awx_private_queue) 2021-11-02 10:20:14,629 DEBUG awx.main.dispatch task 9d6d970b-61dd-4e67-8fd0-346e026e0d9b starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:20:14,645 DEBUG awx.main.dispatch task 9d6d970b-61dd-4e67-8fd0-346e026e0d9b is finished 2021-11-02 10:20:14,647 DEBUG awx.main.dispatch delivered 187d340d-2aa5-43f6-9336-eeff0bbee6f3 to worker[183] qsize 0 2021-11-02 10:20:14,649 DEBUG awx.main.dispatch task 187d340d-2aa5-43f6-9336-eeff0bbee6f3 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:20:14,661 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:20:14,665 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:19:44.635905+00:00 2021-11-02 10:20:14,891 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f6def514-c563-4e9f-8f0c-6bfe438af76e, queue=awx_private_queue) [2021-11-02 10:20:14,891: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f6def514-c563-4e9f-8f0c-6bfe438af76e, queue=awx_private_queue) 2021-11-02 10:20:14,910 DEBUG awx.main.dispatch delivered f6def514-c563-4e9f-8f0c-6bfe438af76e to worker[181] qsize 0 2021-11-02 10:20:14,916 DEBUG awx.main.dispatch task f6def514-c563-4e9f-8f0c-6bfe438af76e starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:20:14,922 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:20:14,943 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:20:14,974 DEBUG awx.main.dispatch task f6def514-c563-4e9f-8f0c-6bfe438af76e is finished 2021-11-02 10:20:17,428 DEBUG awx.main.dispatch task 187d340d-2aa5-43f6-9336-eeff0bbee6f3 is finished 2021-11-02 10:20:34,909 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0d0f9603-76c9-4c14-afaa-d9e7fea0f684, queue=awx_private_queue) [2021-11-02 10:20:34,909: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0d0f9603-76c9-4c14-afaa-d9e7fea0f684, queue=awx_private_queue) 2021-11-02 10:20:34,933 DEBUG awx.main.dispatch delivered 0d0f9603-76c9-4c14-afaa-d9e7fea0f684 to worker[183] qsize 0 2021-11-02 10:20:34,940 DEBUG awx.main.dispatch task 0d0f9603-76c9-4c14-afaa-d9e7fea0f684 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:20:34,943 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:20:35,966 ERROR awx.main.dispatch Worker failed to run task awx.main.scheduler.tasks.run_task_manager(*[], **{} Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection self.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect self.connection = self.get_new_connection(conn_params) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection connection = Database.connect(**conn_params) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect conn = _connect(dsn, connection_factory=connection_factory, **kwasync) psycopg2.OperationalError: could not connect to server: Connection refused Is the server running on host "awx-postgresql" (10.96.101.160) and accepting TCP/IP connections on port 5432? The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work result = self.run_callable(body) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable return _call(*args, **kwargs) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/tasks.py", line 15, in run_task_manager TaskManager().schedule() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/task_manager.py", line 45, in __init__ for rampart_group in InstanceGroup.objects.prefetch_related('instances'): File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 274, in __iter__ self._fetch_all() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 1242, in _fetch_all self._result_cache = list(self._iterable_class(self)) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 55, in __iter__ results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1098, in execute_sql cursor = self.connection.cursor() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor return self._cursor() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor self.ensure_connection() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection self.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__ raise dj_exc_value.with_traceback(traceback) from exc_value File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection self.connect() File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect self.connection = self.get_new_connection(conn_params) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection connection = Database.connect(**conn_params) File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect conn = _connect(dsn, connection_factory=connection_factory, **kwasync) django.db.utils.OperationalError: could not connect to server: Connection refused Is the server running on host "awx-postgresql" (10.96.101.160) and accepting TCP/IP connections on port 5432? 2021-11-02 10:20:35,981 DEBUG awx.main.dispatch task 0d0f9603-76c9-4c14-afaa-d9e7fea0f684 is finished 2021-11-02 10:20:44,633 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(4071c8bb-669b-4919-8208-9f71ab579c11, queue=awx_private_queue) [2021-11-02 10:20:44,633: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(4071c8bb-669b-4919-8208-9f71ab579c11, queue=awx_private_queue) 2021-11-02 10:20:44,659 DEBUG awx.main.dispatch delivered 4071c8bb-669b-4919-8208-9f71ab579c11 to worker[181] qsize 0 2021-11-02 10:20:44,664 DEBUG awx.main.dispatch task 4071c8bb-669b-4919-8208-9f71ab579c11 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:20:44,677 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:20:44,682 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:20:14.662332+00:00 2021-11-02 10:20:44,737 DEBUG awx.main.dispatch task 4071c8bb-669b-4919-8208-9f71ab579c11 is finished 2021-11-02 10:20:54,902 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d4c1b5b0-e29b-4eae-8ffa-ad704f89b90c, queue=awx_private_queue) [2021-11-02 10:20:54,902: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d4c1b5b0-e29b-4eae-8ffa-ad704f89b90c, queue=awx_private_queue) 2021-11-02 10:20:54,923 DEBUG awx.main.dispatch delivered d4c1b5b0-e29b-4eae-8ffa-ad704f89b90c to worker[181] qsize 0 2021-11-02 10:20:54,926 DEBUG awx.main.dispatch task d4c1b5b0-e29b-4eae-8ffa-ad704f89b90c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:20:54,927 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:20:54,951 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:20:54,984 DEBUG awx.main.dispatch task d4c1b5b0-e29b-4eae-8ffa-ad704f89b90c is finished RESULT 2 OKREADY 2021-11-02 10:21:14,155 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(a600575b-8f72-4b15-8863-f67bb1dccd98, queue=dev-awx-0) [2021-11-02 10:21:14,155: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(a600575b-8f72-4b15-8863-f67bb1dccd98, queue=dev-awx-0) 2021-11-02 10:21:14,234 DEBUG awx.main.dispatch delivered a600575b-8f72-4b15-8863-f67bb1dccd98 to worker[176] qsize 0 2021-11-02 10:21:14,246 DEBUG awx.main.dispatch task a600575b-8f72-4b15-8863-f67bb1dccd98 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:21:14,262 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:21:14,328 DEBUG awx.main.dispatch task a600575b-8f72-4b15-8863-f67bb1dccd98 is finished 2021-11-02 10:21:14,374 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(a64fb63f-5b82-498a-9e65-636828422be5, queue=dev-awx-0) [2021-11-02 10:21:14,374: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(a64fb63f-5b82-498a-9e65-636828422be5, queue=dev-awx-0) 2021-11-02 10:21:14,407 DEBUG awx.main.dispatch delivered a64fb63f-5b82-498a-9e65-636828422be5 to worker[178] qsize 0 2021-11-02 10:21:14,414 DEBUG awx.main.dispatch task a64fb63f-5b82-498a-9e65-636828422be5 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:21:14,676 DEBUG awx.main.dispatch task a64fb63f-5b82-498a-9e65-636828422be5 is finished 2021-11-02 10:21:14,629 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(f7951727-53b7-426f-954a-a6d0099a9ed3, queue=awx_private_queue) [2021-11-02 10:21:14,629: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(f7951727-53b7-426f-954a-a6d0099a9ed3, queue=awx_private_queue) 2021-11-02 10:21:14,863 DEBUG awx.main.dispatch delivered f7951727-53b7-426f-954a-a6d0099a9ed3 to worker[183] qsize 0 2021-11-02 10:21:14,865 DEBUG awx.main.dispatch task f7951727-53b7-426f-954a-a6d0099a9ed3 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:21:14,878 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:21:14,882 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:20:44.678276+00:00 2021-11-02 10:21:14,898 DEBUG awx.main.dispatch task f7951727-53b7-426f-954a-a6d0099a9ed3 is finished 2021-11-02 10:21:14,902 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(172233cb-7ad0-4876-9fce-36a86c2e0462, queue=awx_private_queue) [2021-11-02 10:21:14,902: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(172233cb-7ad0-4876-9fce-36a86c2e0462, queue=awx_private_queue) 2021-11-02 10:21:14,926 DEBUG awx.main.dispatch delivered 172233cb-7ad0-4876-9fce-36a86c2e0462 to worker[176] qsize 0 2021-11-02 10:21:14,928 DEBUG awx.main.dispatch task 172233cb-7ad0-4876-9fce-36a86c2e0462 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:21:14,930 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:21:14,950 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:21:14,993 DEBUG awx.main.dispatch task 172233cb-7ad0-4876-9fce-36a86c2e0462 is finished 2021-11-02 10:21:34,910 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(dcfe2a3c-3f9d-4786-8701-41590b06a77e, queue=awx_private_queue) [2021-11-02 10:21:34,910: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(dcfe2a3c-3f9d-4786-8701-41590b06a77e, queue=awx_private_queue) 2021-11-02 10:21:34,929 DEBUG awx.main.dispatch delivered dcfe2a3c-3f9d-4786-8701-41590b06a77e to worker[176] qsize 0 2021-11-02 10:21:34,931 DEBUG awx.main.dispatch task dcfe2a3c-3f9d-4786-8701-41590b06a77e starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:21:34,932 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:21:34,951 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:21:34,982 DEBUG awx.main.dispatch task dcfe2a3c-3f9d-4786-8701-41590b06a77e is finished 2021-11-02 10:21:44,629 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(41fa9019-9b23-4b95-a8bf-fd1c1e17f293, queue=awx_private_queue) [2021-11-02 10:21:44,629: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(41fa9019-9b23-4b95-a8bf-fd1c1e17f293, queue=awx_private_queue) 2021-11-02 10:21:44,652 DEBUG awx.main.dispatch delivered 41fa9019-9b23-4b95-a8bf-fd1c1e17f293 to worker[178] qsize 0 2021-11-02 10:21:44,655 DEBUG awx.main.dispatch task 41fa9019-9b23-4b95-a8bf-fd1c1e17f293 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:21:44,667 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:21:44,670 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:21:14.878717+00:00 2021-11-02 10:21:44,719 DEBUG awx.main.dispatch task 41fa9019-9b23-4b95-a8bf-fd1c1e17f293 is finished 2021-11-02 10:21:54,914 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(faaafbe0-7431-4d17-a412-38489f3a961c, queue=awx_private_queue) [2021-11-02 10:21:54,914: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(faaafbe0-7431-4d17-a412-38489f3a961c, queue=awx_private_queue) 2021-11-02 10:21:54,933 DEBUG awx.main.dispatch delivered faaafbe0-7431-4d17-a412-38489f3a961c to worker[178] qsize 0 2021-11-02 10:21:54,935 DEBUG awx.main.dispatch task faaafbe0-7431-4d17-a412-38489f3a961c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:21:54,937 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:21:54,958 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:21:54,994 DEBUG awx.main.dispatch task faaafbe0-7431-4d17-a412-38489f3a961c is finished RESULT 2 OKREADY 2021-11-02 10:22:14,172 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(d382f004-8a0b-4487-bfbe-5c5b6c249796, queue=dev-awx-0) [2021-11-02 10:22:14,172: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(d382f004-8a0b-4487-bfbe-5c5b6c249796, queue=dev-awx-0) 2021-11-02 10:22:14,258 DEBUG awx.main.dispatch delivered d382f004-8a0b-4487-bfbe-5c5b6c249796 to worker[178] qsize 0 2021-11-02 10:22:14,267 DEBUG awx.main.dispatch task d382f004-8a0b-4487-bfbe-5c5b6c249796 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:22:14,273 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:22:14,374 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(60a96e7c-8970-40a3-861c-1bf412d75e2e, queue=dev-awx-0) [2021-11-02 10:22:14,374: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(60a96e7c-8970-40a3-861c-1bf412d75e2e, queue=dev-awx-0) 2021-11-02 10:22:14,401 DEBUG awx.main.dispatch delivered 60a96e7c-8970-40a3-861c-1bf412d75e2e to worker[183] qsize 0 2021-11-02 10:22:14,407 DEBUG awx.main.dispatch task 60a96e7c-8970-40a3-861c-1bf412d75e2e starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:22:14,434 DEBUG awx.main.dispatch task 60a96e7c-8970-40a3-861c-1bf412d75e2e is finished 2021-11-02 10:22:14,532 DEBUG awx.main.dispatch task d382f004-8a0b-4487-bfbe-5c5b6c249796 is finished 2021-11-02 10:22:14,630 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(55da528c-fec7-4456-a736-f9be4fc07028, queue=awx_private_queue) [2021-11-02 10:22:14,630: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(55da528c-fec7-4456-a736-f9be4fc07028, queue=awx_private_queue) 2021-11-02 10:22:14,653 DEBUG awx.main.dispatch delivered 55da528c-fec7-4456-a736-f9be4fc07028 to worker[176] qsize 0 2021-11-02 10:22:14,657 DEBUG awx.main.dispatch task 55da528c-fec7-4456-a736-f9be4fc07028 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:22:14,671 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:22:14,679 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:21:44.667287+00:00 2021-11-02 10:22:14,915 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(65087a92-0617-4c87-b9cd-10c98d7d0fce, queue=awx_private_queue) [2021-11-02 10:22:14,915: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(65087a92-0617-4c87-b9cd-10c98d7d0fce, queue=awx_private_queue) 2021-11-02 10:22:14,952 DEBUG awx.main.dispatch delivered 65087a92-0617-4c87-b9cd-10c98d7d0fce to worker[181] qsize 0 2021-11-02 10:22:14,957 DEBUG awx.main.dispatch task 65087a92-0617-4c87-b9cd-10c98d7d0fce starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:22:15,179 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:22:15,189 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:22:15,222 DEBUG awx.main.dispatch task 65087a92-0617-4c87-b9cd-10c98d7d0fce is finished 2021-11-02 10:22:16,556 DEBUG awx.main.dispatch task 55da528c-fec7-4456-a736-f9be4fc07028 is finished 2021-11-02 10:22:34,916 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(efec6924-34e7-4e47-8096-8991dbd75819, queue=awx_private_queue) [2021-11-02 10:22:34,916: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(efec6924-34e7-4e47-8096-8991dbd75819, queue=awx_private_queue) 2021-11-02 10:22:34,941 DEBUG awx.main.dispatch delivered efec6924-34e7-4e47-8096-8991dbd75819 to worker[178] qsize 0 2021-11-02 10:22:34,944 DEBUG awx.main.dispatch task efec6924-34e7-4e47-8096-8991dbd75819 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:22:34,945 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:22:34,966 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:22:35,004 DEBUG awx.main.dispatch task efec6924-34e7-4e47-8096-8991dbd75819 is finished 2021-11-02 10:22:44,629 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(4bc79c7f-f821-4ad6-ac17-4dc9edb847c0, queue=awx_private_queue) [2021-11-02 10:22:44,629: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(4bc79c7f-f821-4ad6-ac17-4dc9edb847c0, queue=awx_private_queue) 2021-11-02 10:22:44,651 DEBUG awx.main.dispatch delivered 4bc79c7f-f821-4ad6-ac17-4dc9edb847c0 to worker[178] qsize 0 2021-11-02 10:22:44,653 DEBUG awx.main.dispatch task 4bc79c7f-f821-4ad6-ac17-4dc9edb847c0 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:22:44,672 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:22:44,674 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:22:14.672641+00:00 2021-11-02 10:22:44,752 DEBUG awx.main.dispatch task 4bc79c7f-f821-4ad6-ac17-4dc9edb847c0 is finished 2021-11-02 10:22:54,915 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(9733c746-25ac-4d83-bb85-bd48c4bf72fa, queue=awx_private_queue) [2021-11-02 10:22:54,915: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(9733c746-25ac-4d83-bb85-bd48c4bf72fa, queue=awx_private_queue) 2021-11-02 10:22:54,938 DEBUG awx.main.dispatch delivered 9733c746-25ac-4d83-bb85-bd48c4bf72fa to worker[176] qsize 0 2021-11-02 10:22:54,942 DEBUG awx.main.dispatch task 9733c746-25ac-4d83-bb85-bd48c4bf72fa starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:22:54,944 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:22:54,970 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:22:55,007 DEBUG awx.main.dispatch task 9733c746-25ac-4d83-bb85-bd48c4bf72fa is finished RESULT 2 OKREADY 2021-11-02 10:23:14,174 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(910974fc-d949-415b-a626-c78aa164b863, queue=dev-awx-0) [2021-11-02 10:23:14,174: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(910974fc-d949-415b-a626-c78aa164b863, queue=dev-awx-0) 2021-11-02 10:23:14,211 DEBUG awx.main.dispatch delivered 910974fc-d949-415b-a626-c78aa164b863 to worker[176] qsize 0 2021-11-02 10:23:14,213 DEBUG awx.main.dispatch task 910974fc-d949-415b-a626-c78aa164b863 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:23:14,215 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:23:14,273 DEBUG awx.main.dispatch task 910974fc-d949-415b-a626-c78aa164b863 is finished 2021-11-02 10:23:14,374 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(90db8ce4-b0e3-45c4-8877-b837fd522547, queue=dev-awx-0) [2021-11-02 10:23:14,374: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(90db8ce4-b0e3-45c4-8877-b837fd522547, queue=dev-awx-0) 2021-11-02 10:23:14,395 DEBUG awx.main.dispatch delivered 90db8ce4-b0e3-45c4-8877-b837fd522547 to worker[181] qsize 0 2021-11-02 10:23:14,398 DEBUG awx.main.dispatch task 90db8ce4-b0e3-45c4-8877-b837fd522547 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:23:14,412 DEBUG awx.main.dispatch task 90db8ce4-b0e3-45c4-8877-b837fd522547 is finished 2021-11-02 10:23:14,629 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(440cc269-00ab-4b08-b31b-9c78902f35c3, queue=awx_private_queue) [2021-11-02 10:23:14,629: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(440cc269-00ab-4b08-b31b-9c78902f35c3, queue=awx_private_queue) 2021-11-02 10:23:14,648 DEBUG awx.main.dispatch delivered 440cc269-00ab-4b08-b31b-9c78902f35c3 to worker[181] qsize 0 2021-11-02 10:23:14,651 DEBUG awx.main.dispatch task 440cc269-00ab-4b08-b31b-9c78902f35c3 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:23:14,662 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:23:14,666 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:22:44.672205+00:00 2021-11-02 10:23:14,684 DEBUG awx.main.dispatch task 440cc269-00ab-4b08-b31b-9c78902f35c3 is finished 2021-11-02 10:23:14,915 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b8950921-29ba-444a-8657-058fdeed917c, queue=awx_private_queue) [2021-11-02 10:23:14,915: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b8950921-29ba-444a-8657-058fdeed917c, queue=awx_private_queue) 2021-11-02 10:23:15,145 DEBUG awx.main.dispatch delivered b8950921-29ba-444a-8657-058fdeed917c to worker[183] qsize 0 2021-11-02 10:23:15,148 DEBUG awx.main.dispatch task b8950921-29ba-444a-8657-058fdeed917c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:23:15,150 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:23:15,169 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:23:15,198 DEBUG awx.main.dispatch task b8950921-29ba-444a-8657-058fdeed917c is finished 2021-11-02 10:23:34,924 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(952064b9-af07-4846-94ab-301c45c1546f, queue=awx_private_queue) [2021-11-02 10:23:34,924: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(952064b9-af07-4846-94ab-301c45c1546f, queue=awx_private_queue) 2021-11-02 10:23:34,950 DEBUG awx.main.dispatch delivered 952064b9-af07-4846-94ab-301c45c1546f to worker[178] qsize 0 2021-11-02 10:23:34,953 DEBUG awx.main.dispatch task 952064b9-af07-4846-94ab-301c45c1546f starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:23:34,956 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:23:34,975 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:23:35,010 DEBUG awx.main.dispatch task 952064b9-af07-4846-94ab-301c45c1546f is finished 2021-11-02 10:23:44,630 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(250e1bb9-2bec-4869-8c5d-8379b08a1bda, queue=awx_private_queue) [2021-11-02 10:23:44,630: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(250e1bb9-2bec-4869-8c5d-8379b08a1bda, queue=awx_private_queue) 2021-11-02 10:23:44,651 DEBUG awx.main.dispatch delivered 250e1bb9-2bec-4869-8c5d-8379b08a1bda to worker[176] qsize 0 2021-11-02 10:23:44,655 DEBUG awx.main.dispatch task 250e1bb9-2bec-4869-8c5d-8379b08a1bda starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:23:44,668 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:23:44,671 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:23:14.662964+00:00 2021-11-02 10:23:44,734 DEBUG awx.main.dispatch task 250e1bb9-2bec-4869-8c5d-8379b08a1bda is finished 2021-11-02 10:23:54,935 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(069d146a-50f8-44e5-9e22-a587de427e56, queue=awx_private_queue) [2021-11-02 10:23:54,935: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(069d146a-50f8-44e5-9e22-a587de427e56, queue=awx_private_queue) 2021-11-02 10:23:54,965 DEBUG awx.main.dispatch delivered 069d146a-50f8-44e5-9e22-a587de427e56 to worker[178] qsize 0 2021-11-02 10:23:54,975 DEBUG awx.main.dispatch task 069d146a-50f8-44e5-9e22-a587de427e56 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:23:54,979 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:23:55,000 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:23:55,029 DEBUG awx.main.dispatch task 069d146a-50f8-44e5-9e22-a587de427e56 is finished RESULT 2 OKREADY 2021-11-02 10:24:14,187 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(fe82ff1b-c72e-49c6-807f-b221bcaca46a, queue=dev-awx-0) [2021-11-02 10:24:14,187: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(fe82ff1b-c72e-49c6-807f-b221bcaca46a, queue=dev-awx-0) 2021-11-02 10:24:14,242 DEBUG awx.main.dispatch delivered fe82ff1b-c72e-49c6-807f-b221bcaca46a to worker[178] qsize 0 2021-11-02 10:24:14,246 DEBUG awx.main.dispatch task fe82ff1b-c72e-49c6-807f-b221bcaca46a starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:24:14,248 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:24:14,305 DEBUG awx.main.dispatch task fe82ff1b-c72e-49c6-807f-b221bcaca46a is finished 2021-11-02 10:24:14,374 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(14d1dcfc-c739-4baf-92fa-2773fd1cd8d5, queue=dev-awx-0) [2021-11-02 10:24:14,374: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(14d1dcfc-c739-4baf-92fa-2773fd1cd8d5, queue=dev-awx-0) 2021-11-02 10:24:14,395 DEBUG awx.main.dispatch delivered 14d1dcfc-c739-4baf-92fa-2773fd1cd8d5 to worker[183] qsize 0 2021-11-02 10:24:14,401 DEBUG awx.main.dispatch task 14d1dcfc-c739-4baf-92fa-2773fd1cd8d5 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:24:14,425 DEBUG awx.main.dispatch task 14d1dcfc-c739-4baf-92fa-2773fd1cd8d5 is finished 2021-11-02 10:24:14,629 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(bf10eb40-9e1e-461b-8a57-21a3b5e93bfc, queue=awx_private_queue) [2021-11-02 10:24:14,629: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(bf10eb40-9e1e-461b-8a57-21a3b5e93bfc, queue=awx_private_queue) 2021-11-02 10:24:14,648 DEBUG awx.main.dispatch delivered bf10eb40-9e1e-461b-8a57-21a3b5e93bfc to worker[181] qsize 0 2021-11-02 10:24:14,653 DEBUG awx.main.dispatch task bf10eb40-9e1e-461b-8a57-21a3b5e93bfc starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:24:14,669 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:24:14,674 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:23:44.668698+00:00 2021-11-02 10:24:14,689 DEBUG awx.main.dispatch task bf10eb40-9e1e-461b-8a57-21a3b5e93bfc is finished 2021-11-02 10:24:14,927 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(99076644-b6ed-45c9-810d-73250055e019, queue=awx_private_queue) [2021-11-02 10:24:14,927: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(99076644-b6ed-45c9-810d-73250055e019, queue=awx_private_queue) 2021-11-02 10:24:15,149 DEBUG awx.main.dispatch delivered 99076644-b6ed-45c9-810d-73250055e019 to worker[178] qsize 0 2021-11-02 10:24:15,152 DEBUG awx.main.dispatch task 99076644-b6ed-45c9-810d-73250055e019 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:24:15,154 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:24:15,170 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:24:15,204 DEBUG awx.main.dispatch task 99076644-b6ed-45c9-810d-73250055e019 is finished 2021-11-02 10:24:34,928 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(cef7c470-bc53-49e9-8e33-27d431d018e1, queue=awx_private_queue) [2021-11-02 10:24:34,928: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(cef7c470-bc53-49e9-8e33-27d431d018e1, queue=awx_private_queue) 2021-11-02 10:24:34,952 DEBUG awx.main.dispatch delivered cef7c470-bc53-49e9-8e33-27d431d018e1 to worker[178] qsize 0 2021-11-02 10:24:34,955 DEBUG awx.main.dispatch task cef7c470-bc53-49e9-8e33-27d431d018e1 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:24:34,958 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:24:34,979 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:24:35,013 DEBUG awx.main.dispatch task cef7c470-bc53-49e9-8e33-27d431d018e1 is finished 2021-11-02 10:24:44,629 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(357c4574-2b7c-466a-af63-c265f6906d20, queue=awx_private_queue) [2021-11-02 10:24:44,629: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(357c4574-2b7c-466a-af63-c265f6906d20, queue=awx_private_queue) 2021-11-02 10:24:44,650 DEBUG awx.main.dispatch delivered 357c4574-2b7c-466a-af63-c265f6906d20 to worker[176] qsize 0 2021-11-02 10:24:44,659 DEBUG awx.main.dispatch task 357c4574-2b7c-466a-af63-c265f6906d20 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:24:44,687 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:24:44,696 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:24:14.670047+00:00 2021-11-02 10:24:44,715 DEBUG awx.main.dispatch task 357c4574-2b7c-466a-af63-c265f6906d20 is finished 2021-11-02 10:24:54,928 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(2b1ed1b0-b847-4a1a-9ffe-937c8b86fecf, queue=awx_private_queue) [2021-11-02 10:24:54,928: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(2b1ed1b0-b847-4a1a-9ffe-937c8b86fecf, queue=awx_private_queue) 2021-11-02 10:24:54,959 DEBUG awx.main.dispatch delivered 2b1ed1b0-b847-4a1a-9ffe-937c8b86fecf to worker[181] qsize 0 2021-11-02 10:24:54,963 DEBUG awx.main.dispatch task 2b1ed1b0-b847-4a1a-9ffe-937c8b86fecf starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:24:54,964 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:24:54,984 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:24:55,016 DEBUG awx.main.dispatch task 2b1ed1b0-b847-4a1a-9ffe-937c8b86fecf is finished RESULT 2 OKREADY 2021-11-02 10:25:14,184 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(90c630c4-b33b-4a65-aec3-a3a0af1319d8, queue=dev-awx-0) [2021-11-02 10:25:14,184: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(90c630c4-b33b-4a65-aec3-a3a0af1319d8, queue=dev-awx-0) 2021-11-02 10:25:14,225 DEBUG awx.main.dispatch delivered 90c630c4-b33b-4a65-aec3-a3a0af1319d8 to worker[183] qsize 0 2021-11-02 10:25:14,229 DEBUG awx.main.dispatch task 90c630c4-b33b-4a65-aec3-a3a0af1319d8 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:25:14,232 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:25:14,286 DEBUG awx.main.dispatch task 90c630c4-b33b-4a65-aec3-a3a0af1319d8 is finished 2021-11-02 10:25:14,374 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(99d5d36c-462a-4ec9-a181-8fa3d187bb5e, queue=dev-awx-0) [2021-11-02 10:25:14,374: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(99d5d36c-462a-4ec9-a181-8fa3d187bb5e, queue=dev-awx-0) 2021-11-02 10:25:14,396 DEBUG awx.main.dispatch delivered 99d5d36c-462a-4ec9-a181-8fa3d187bb5e to worker[181] qsize 0 2021-11-02 10:25:14,400 DEBUG awx.main.dispatch task 99d5d36c-462a-4ec9-a181-8fa3d187bb5e starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:25:14,413 DEBUG awx.main.dispatch task 99d5d36c-462a-4ec9-a181-8fa3d187bb5e is finished 2021-11-02 10:25:14,630 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(a2738d3d-8e2a-4980-a645-3a553d74e660, queue=awx_private_queue) [2021-11-02 10:25:14,630: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(a2738d3d-8e2a-4980-a645-3a553d74e660, queue=awx_private_queue) 2021-11-02 10:25:14,653 DEBUG awx.main.dispatch delivered a2738d3d-8e2a-4980-a645-3a553d74e660 to worker[183] qsize 0 2021-11-02 10:25:14,656 DEBUG awx.main.dispatch task a2738d3d-8e2a-4980-a645-3a553d74e660 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:25:14,666 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:25:14,669 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:24:44.687409+00:00 2021-11-02 10:25:14,684 DEBUG awx.main.dispatch task a2738d3d-8e2a-4980-a645-3a553d74e660 is finished 2021-11-02 10:25:14,928 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c07e61cf-907b-4d0a-a7b9-d8872d7fa05d, queue=awx_private_queue) [2021-11-02 10:25:14,928: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c07e61cf-907b-4d0a-a7b9-d8872d7fa05d, queue=awx_private_queue) 2021-11-02 10:25:14,948 DEBUG awx.main.dispatch delivered c07e61cf-907b-4d0a-a7b9-d8872d7fa05d to worker[183] qsize 0 2021-11-02 10:25:14,950 DEBUG awx.main.dispatch task c07e61cf-907b-4d0a-a7b9-d8872d7fa05d starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:25:14,952 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:25:14,969 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:25:14,998 DEBUG awx.main.dispatch task c07e61cf-907b-4d0a-a7b9-d8872d7fa05d is finished 2021-11-02 10:25:34,939 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(15c74c77-6e17-4afb-a084-8f34ca829456, queue=awx_private_queue) [2021-11-02 10:25:34,939: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(15c74c77-6e17-4afb-a084-8f34ca829456, queue=awx_private_queue) 2021-11-02 10:25:34,960 DEBUG awx.main.dispatch delivered 15c74c77-6e17-4afb-a084-8f34ca829456 to worker[183] qsize 0 2021-11-02 10:25:34,963 DEBUG awx.main.dispatch task 15c74c77-6e17-4afb-a084-8f34ca829456 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:25:34,966 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:25:34,986 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:25:35,023 DEBUG awx.main.dispatch task 15c74c77-6e17-4afb-a084-8f34ca829456 is finished 2021-11-02 10:25:44,636 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(1455924d-a84f-4088-b53f-7afa53d183e3, queue=awx_private_queue) [2021-11-02 10:25:44,636: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(1455924d-a84f-4088-b53f-7afa53d183e3, queue=awx_private_queue) 2021-11-02 10:25:44,672 DEBUG awx.main.dispatch delivered 1455924d-a84f-4088-b53f-7afa53d183e3 to worker[176] qsize 0 2021-11-02 10:25:44,683 DEBUG awx.main.dispatch task 1455924d-a84f-4088-b53f-7afa53d183e3 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:25:44,886 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:25:44,890 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:25:14.666530+00:00 2021-11-02 10:25:44,934 DEBUG awx.main.dispatch task 1455924d-a84f-4088-b53f-7afa53d183e3 is finished 2021-11-02 10:25:54,941 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(70d6f997-ce45-4653-b86f-a7baa8e5c4b1, queue=awx_private_queue) [2021-11-02 10:25:54,941: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(70d6f997-ce45-4653-b86f-a7baa8e5c4b1, queue=awx_private_queue) 2021-11-02 10:25:54,965 DEBUG awx.main.dispatch delivered 70d6f997-ce45-4653-b86f-a7baa8e5c4b1 to worker[181] qsize 0 2021-11-02 10:25:54,971 DEBUG awx.main.dispatch task 70d6f997-ce45-4653-b86f-a7baa8e5c4b1 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:25:54,978 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:25:55,005 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:25:55,034 DEBUG awx.main.dispatch task 70d6f997-ce45-4653-b86f-a7baa8e5c4b1 is finished RESULT 2 OKREADY 2021-11-02 10:26:14,184 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(4eb0f52f-0bc3-4b4a-94f1-03f36cd37088, queue=dev-awx-0) [2021-11-02 10:26:14,184: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(4eb0f52f-0bc3-4b4a-94f1-03f36cd37088, queue=dev-awx-0) 2021-11-02 10:26:14,226 DEBUG awx.main.dispatch delivered 4eb0f52f-0bc3-4b4a-94f1-03f36cd37088 to worker[178] qsize 0 2021-11-02 10:26:14,232 DEBUG awx.main.dispatch task 4eb0f52f-0bc3-4b4a-94f1-03f36cd37088 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:26:14,239 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:26:14,316 DEBUG awx.main.dispatch task 4eb0f52f-0bc3-4b4a-94f1-03f36cd37088 is finished 2021-11-02 10:26:14,374 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(7183b757-63a2-40d3-aab0-d6ad973b7798, queue=dev-awx-0) [2021-11-02 10:26:14,374: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(7183b757-63a2-40d3-aab0-d6ad973b7798, queue=dev-awx-0) 2021-11-02 10:26:14,394 DEBUG awx.main.dispatch delivered 7183b757-63a2-40d3-aab0-d6ad973b7798 to worker[183] qsize 0 2021-11-02 10:26:14,397 DEBUG awx.main.dispatch task 7183b757-63a2-40d3-aab0-d6ad973b7798 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:26:14,416 DEBUG awx.main.dispatch task 7183b757-63a2-40d3-aab0-d6ad973b7798 is finished 2021-11-02 10:26:14,630 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(2d2fcfbd-9222-4ae4-851e-a0c4f248f830, queue=awx_private_queue) [2021-11-02 10:26:14,630: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(2d2fcfbd-9222-4ae4-851e-a0c4f248f830, queue=awx_private_queue) 2021-11-02 10:26:14,654 DEBUG awx.main.dispatch delivered 2d2fcfbd-9222-4ae4-851e-a0c4f248f830 to worker[178] qsize 0 2021-11-02 10:26:14,656 DEBUG awx.main.dispatch task 2d2fcfbd-9222-4ae4-851e-a0c4f248f830 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:26:14,666 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:26:14,669 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:25:44.887006+00:00 2021-11-02 10:26:14,686 DEBUG awx.main.dispatch task 2d2fcfbd-9222-4ae4-851e-a0c4f248f830 is finished 2021-11-02 10:26:14,940 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3d977bd5-f5c9-4b50-96f6-24568b66630c, queue=awx_private_queue) [2021-11-02 10:26:14,940: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3d977bd5-f5c9-4b50-96f6-24568b66630c, queue=awx_private_queue) 2021-11-02 10:26:14,963 DEBUG awx.main.dispatch delivered 3d977bd5-f5c9-4b50-96f6-24568b66630c to worker[178] qsize 0 2021-11-02 10:26:14,966 DEBUG awx.main.dispatch task 3d977bd5-f5c9-4b50-96f6-24568b66630c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:26:14,968 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:26:14,984 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:26:15,015 DEBUG awx.main.dispatch task 3d977bd5-f5c9-4b50-96f6-24568b66630c is finished 2021-11-02 10:26:34,951 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e076f00c-2025-4298-a99c-79f06c774a27, queue=awx_private_queue) [2021-11-02 10:26:34,951: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e076f00c-2025-4298-a99c-79f06c774a27, queue=awx_private_queue) 2021-11-02 10:26:34,967 DEBUG awx.main.dispatch delivered e076f00c-2025-4298-a99c-79f06c774a27 to worker[176] qsize 0 2021-11-02 10:26:34,969 DEBUG awx.main.dispatch task e076f00c-2025-4298-a99c-79f06c774a27 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:26:34,971 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:26:35,003 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:26:35,038 DEBUG awx.main.dispatch task e076f00c-2025-4298-a99c-79f06c774a27 is finished 2021-11-02 10:26:44,630 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(4155419e-fcdb-4e2e-8f70-538bf67686f4, queue=awx_private_queue) [2021-11-02 10:26:44,630: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(4155419e-fcdb-4e2e-8f70-538bf67686f4, queue=awx_private_queue) 2021-11-02 10:26:44,675 DEBUG awx.main.dispatch delivered 4155419e-fcdb-4e2e-8f70-538bf67686f4 to worker[183] qsize 0 2021-11-02 10:26:44,677 DEBUG awx.main.dispatch task 4155419e-fcdb-4e2e-8f70-538bf67686f4 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:26:44,686 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:26:44,689 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:26:14.666768+00:00 2021-11-02 10:26:44,718 DEBUG awx.main.dispatch task 4155419e-fcdb-4e2e-8f70-538bf67686f4 is finished 2021-11-02 10:26:54,952 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(78b30ccc-d50e-43bd-a217-c817df6f2ae3, queue=awx_private_queue) [2021-11-02 10:26:54,952: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(78b30ccc-d50e-43bd-a217-c817df6f2ae3, queue=awx_private_queue) 2021-11-02 10:26:54,980 DEBUG awx.main.dispatch delivered 78b30ccc-d50e-43bd-a217-c817df6f2ae3 to worker[178] qsize 0 2021-11-02 10:26:54,983 DEBUG awx.main.dispatch task 78b30ccc-d50e-43bd-a217-c817df6f2ae3 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:26:54,984 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:26:54,999 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:26:55,025 DEBUG awx.main.dispatch task 78b30ccc-d50e-43bd-a217-c817df6f2ae3 is finished RESULT 2 OKREADY 2021-11-02 10:27:14,205 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(7f8c2213-d2f3-4bf7-b919-a6352ce4bb8e, queue=dev-awx-0) [2021-11-02 10:27:14,205: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(7f8c2213-d2f3-4bf7-b919-a6352ce4bb8e, queue=dev-awx-0) 2021-11-02 10:27:14,374 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(2ddc6886-e843-434e-b5ae-6b7bf8ce0740, queue=dev-awx-0) [2021-11-02 10:27:14,374: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(2ddc6886-e843-434e-b5ae-6b7bf8ce0740, queue=dev-awx-0) 2021-11-02 10:27:14,242 DEBUG awx.main.dispatch delivered 7f8c2213-d2f3-4bf7-b919-a6352ce4bb8e to worker[176] qsize 0 2021-11-02 10:27:14,438 DEBUG awx.main.dispatch delivered 2ddc6886-e843-434e-b5ae-6b7bf8ce0740 to worker[181] qsize 0 2021-11-02 10:27:14,438 DEBUG awx.main.dispatch task 7f8c2213-d2f3-4bf7-b919-a6352ce4bb8e starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:27:14,441 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:27:14,440 DEBUG awx.main.dispatch task 2ddc6886-e843-434e-b5ae-6b7bf8ce0740 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:27:14,456 DEBUG awx.main.dispatch task 2ddc6886-e843-434e-b5ae-6b7bf8ce0740 is finished 2021-11-02 10:27:14,482 DEBUG awx.main.dispatch task 7f8c2213-d2f3-4bf7-b919-a6352ce4bb8e is finished 2021-11-02 10:27:14,630 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(fe56b4fa-dc5b-40ed-a86d-5796a361ee21, queue=awx_private_queue) [2021-11-02 10:27:14,630: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(fe56b4fa-dc5b-40ed-a86d-5796a361ee21, queue=awx_private_queue) 2021-11-02 10:27:14,653 DEBUG awx.main.dispatch delivered fe56b4fa-dc5b-40ed-a86d-5796a361ee21 to worker[178] qsize 0 2021-11-02 10:27:14,657 DEBUG awx.main.dispatch task fe56b4fa-dc5b-40ed-a86d-5796a361ee21 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:27:14,672 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:27:14,677 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:26:44.686757+00:00 2021-11-02 10:27:14,694 DEBUG awx.main.dispatch task fe56b4fa-dc5b-40ed-a86d-5796a361ee21 is finished 2021-11-02 10:27:14,952 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b085e980-08c9-490d-b731-236493fc2197, queue=awx_private_queue) [2021-11-02 10:27:14,952: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b085e980-08c9-490d-b731-236493fc2197, queue=awx_private_queue) 2021-11-02 10:27:14,978 DEBUG awx.main.dispatch delivered b085e980-08c9-490d-b731-236493fc2197 to worker[183] qsize 0 2021-11-02 10:27:14,981 DEBUG awx.main.dispatch task b085e980-08c9-490d-b731-236493fc2197 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:27:14,985 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:27:15,003 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:27:15,030 DEBUG awx.main.dispatch task b085e980-08c9-490d-b731-236493fc2197 is finished 2021-11-02 10:27:34,974 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ec206f50-110d-4560-a96b-3767eb178e28, queue=awx_private_queue) [2021-11-02 10:27:34,974: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ec206f50-110d-4560-a96b-3767eb178e28, queue=awx_private_queue) 2021-11-02 10:27:35,024 DEBUG awx.main.dispatch delivered ec206f50-110d-4560-a96b-3767eb178e28 to worker[181] qsize 0 2021-11-02 10:27:35,033 DEBUG awx.main.dispatch task ec206f50-110d-4560-a96b-3767eb178e28 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:27:35,039 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:27:35,068 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:27:35,106 DEBUG awx.main.dispatch task ec206f50-110d-4560-a96b-3767eb178e28 is finished 2021-11-02 10:27:44,633 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(09fb6631-f3ba-458d-bf8b-fe8c74a83a7f, queue=awx_private_queue) [2021-11-02 10:27:44,633: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(09fb6631-f3ba-458d-bf8b-fe8c74a83a7f, queue=awx_private_queue) 2021-11-02 10:27:44,659 DEBUG awx.main.dispatch delivered 09fb6631-f3ba-458d-bf8b-fe8c74a83a7f to worker[181] qsize 0 2021-11-02 10:27:44,663 DEBUG awx.main.dispatch task 09fb6631-f3ba-458d-bf8b-fe8c74a83a7f starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:27:44,676 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:27:44,681 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:27:14.672898+00:00 2021-11-02 10:27:44,726 DEBUG awx.main.dispatch task 09fb6631-f3ba-458d-bf8b-fe8c74a83a7f is finished 2021-11-02 10:27:54,973 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ac9066bc-8aa9-4a7e-a713-55fd2d263785, queue=awx_private_queue) [2021-11-02 10:27:54,973: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ac9066bc-8aa9-4a7e-a713-55fd2d263785, queue=awx_private_queue) 2021-11-02 10:27:54,989 DEBUG awx.main.dispatch delivered ac9066bc-8aa9-4a7e-a713-55fd2d263785 to worker[181] qsize 0 2021-11-02 10:27:54,991 DEBUG awx.main.dispatch task ac9066bc-8aa9-4a7e-a713-55fd2d263785 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:27:54,994 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:27:55,010 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:27:55,036 DEBUG awx.main.dispatch task ac9066bc-8aa9-4a7e-a713-55fd2d263785 is finished RESULT 2 OKREADY 2021-11-02 10:28:13,984 DEBUG awx.main.dispatch publish awx.main.tasks.awx_isolated_heartbeat(6ae6822e-ff91-4825-8730-79377624b549, queue=dev-awx-0) [2021-11-02 10:28:13,984: DEBUG/Process-1] publish awx.main.tasks.awx_isolated_heartbeat(6ae6822e-ff91-4825-8730-79377624b549, queue=dev-awx-0) 2021-11-02 10:28:14,006 DEBUG awx.main.dispatch delivered 6ae6822e-ff91-4825-8730-79377624b549 to worker[178] qsize 0 2021-11-02 10:28:14,010 DEBUG awx.main.dispatch task 6ae6822e-ff91-4825-8730-79377624b549 starting awx.main.tasks.awx_isolated_heartbeat(*[]) 2021-11-02 10:28:14,015 DEBUG awx.main.tasks Controlling node checking for any isolated management tasks. 2021-11-02 10:28:14,039 DEBUG awx.main.dispatch task 6ae6822e-ff91-4825-8730-79377624b549 is finished 2021-11-02 10:28:14,205 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(39d10716-f908-4eaf-91e3-3a3a8e8fb774, queue=dev-awx-0) [2021-11-02 10:28:14,205: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(39d10716-f908-4eaf-91e3-3a3a8e8fb774, queue=dev-awx-0) 2021-11-02 10:28:14,374 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(60ced3af-5c57-48e9-951c-8a4f98fa0c3a, queue=dev-awx-0) [2021-11-02 10:28:14,374: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(60ced3af-5c57-48e9-951c-8a4f98fa0c3a, queue=dev-awx-0) 2021-11-02 10:28:14,275 DEBUG awx.main.dispatch delivered 39d10716-f908-4eaf-91e3-3a3a8e8fb774 to worker[183] qsize 0 2021-11-02 10:28:14,474 DEBUG awx.main.dispatch delivered 60ced3af-5c57-48e9-951c-8a4f98fa0c3a to worker[176] qsize 0 2021-11-02 10:28:14,476 DEBUG awx.main.dispatch task 39d10716-f908-4eaf-91e3-3a3a8e8fb774 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:28:14,481 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:28:14,478 DEBUG awx.main.dispatch task 60ced3af-5c57-48e9-951c-8a4f98fa0c3a starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:28:14,500 DEBUG awx.main.dispatch task 60ced3af-5c57-48e9-951c-8a4f98fa0c3a is finished 2021-11-02 10:28:14,539 DEBUG awx.main.dispatch task 39d10716-f908-4eaf-91e3-3a3a8e8fb774 is finished 2021-11-02 10:28:14,631 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(972ad441-6a2f-4d50-b3d1-9ae5dc2fda93, queue=awx_private_queue) [2021-11-02 10:28:14,631: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(972ad441-6a2f-4d50-b3d1-9ae5dc2fda93, queue=awx_private_queue) 2021-11-02 10:28:14,648 DEBUG awx.main.dispatch delivered 972ad441-6a2f-4d50-b3d1-9ae5dc2fda93 to worker[176] qsize 0 2021-11-02 10:28:14,651 DEBUG awx.main.dispatch task 972ad441-6a2f-4d50-b3d1-9ae5dc2fda93 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:28:14,664 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:28:14,668 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:27:44.676676+00:00 2021-11-02 10:28:14,683 DEBUG awx.main.dispatch task 972ad441-6a2f-4d50-b3d1-9ae5dc2fda93 is finished 2021-11-02 10:28:14,973 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(892a1b17-ca1f-4c51-8147-f9b8eee58452, queue=awx_private_queue) [2021-11-02 10:28:14,973: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(892a1b17-ca1f-4c51-8147-f9b8eee58452, queue=awx_private_queue) 2021-11-02 10:28:14,994 DEBUG awx.main.dispatch delivered 892a1b17-ca1f-4c51-8147-f9b8eee58452 to worker[176] qsize 0 2021-11-02 10:28:14,996 DEBUG awx.main.dispatch task 892a1b17-ca1f-4c51-8147-f9b8eee58452 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:28:14,997 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:28:15,014 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:28:15,047 DEBUG awx.main.dispatch task 892a1b17-ca1f-4c51-8147-f9b8eee58452 is finished 2021-11-02 10:28:34,973 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5e9a3acd-8b36-4fae-8d84-45b2d4b8e206, queue=awx_private_queue) [2021-11-02 10:28:34,973: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5e9a3acd-8b36-4fae-8d84-45b2d4b8e206, queue=awx_private_queue) 2021-11-02 10:28:34,989 DEBUG awx.main.dispatch delivered 5e9a3acd-8b36-4fae-8d84-45b2d4b8e206 to worker[178] qsize 0 2021-11-02 10:28:34,992 DEBUG awx.main.dispatch task 5e9a3acd-8b36-4fae-8d84-45b2d4b8e206 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:28:34,994 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:28:35,010 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:28:35,039 DEBUG awx.main.dispatch task 5e9a3acd-8b36-4fae-8d84-45b2d4b8e206 is finished 2021-11-02 10:28:44,631 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(9e076db9-6231-4659-9d58-cc99a6fa1148, queue=awx_private_queue) [2021-11-02 10:28:44,631: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(9e076db9-6231-4659-9d58-cc99a6fa1148, queue=awx_private_queue) 2021-11-02 10:28:44,657 DEBUG awx.main.dispatch delivered 9e076db9-6231-4659-9d58-cc99a6fa1148 to worker[178] qsize 0 2021-11-02 10:28:44,661 DEBUG awx.main.dispatch task 9e076db9-6231-4659-9d58-cc99a6fa1148 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:28:44,672 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:28:44,675 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:28:14.664583+00:00 2021-11-02 10:28:44,787 DEBUG awx.main.dispatch task 9e076db9-6231-4659-9d58-cc99a6fa1148 is finished 2021-11-02 10:28:54,974 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(42b0e26e-4cf1-4511-9792-6240aa7f75c7, queue=awx_private_queue) [2021-11-02 10:28:54,974: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(42b0e26e-4cf1-4511-9792-6240aa7f75c7, queue=awx_private_queue) 2021-11-02 10:28:54,989 DEBUG awx.main.dispatch delivered 42b0e26e-4cf1-4511-9792-6240aa7f75c7 to worker[178] qsize 0 2021-11-02 10:28:54,991 DEBUG awx.main.dispatch task 42b0e26e-4cf1-4511-9792-6240aa7f75c7 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:28:54,992 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:28:55,009 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:28:55,044 DEBUG awx.main.dispatch task 42b0e26e-4cf1-4511-9792-6240aa7f75c7 is finished RESULT 2 OKREADY 2021-11-02 10:29:14,226 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(91b4c8e2-30c9-4ba6-acdb-b708ce37d3c7, queue=dev-awx-0) [2021-11-02 10:29:14,226: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(91b4c8e2-30c9-4ba6-acdb-b708ce37d3c7, queue=dev-awx-0) 2021-11-02 10:29:14,375 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(91a63d0d-ac4a-42d4-b681-52b85b393e6e, queue=dev-awx-0) [2021-11-02 10:29:14,375: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(91a63d0d-ac4a-42d4-b681-52b85b393e6e, queue=dev-awx-0) 2021-11-02 10:29:14,329 DEBUG awx.main.dispatch delivered 91b4c8e2-30c9-4ba6-acdb-b708ce37d3c7 to worker[176] qsize 0 2021-11-02 10:29:14,551 DEBUG awx.main.dispatch delivered 91a63d0d-ac4a-42d4-b681-52b85b393e6e to worker[181] qsize 0 2021-11-02 10:29:14,555 DEBUG awx.main.dispatch task 91b4c8e2-30c9-4ba6-acdb-b708ce37d3c7 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:29:14,564 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:29:14,558 DEBUG awx.main.dispatch task 91a63d0d-ac4a-42d4-b681-52b85b393e6e starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:29:14,590 DEBUG awx.main.dispatch task 91a63d0d-ac4a-42d4-b681-52b85b393e6e is finished 2021-11-02 10:29:14,600 DEBUG awx.main.dispatch task 91b4c8e2-30c9-4ba6-acdb-b708ce37d3c7 is finished 2021-11-02 10:29:14,632 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(77ab7089-f64b-4a47-b6f1-a2683ee926fd, queue=awx_private_queue) [2021-11-02 10:29:14,632: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(77ab7089-f64b-4a47-b6f1-a2683ee926fd, queue=awx_private_queue) 2021-11-02 10:29:14,654 DEBUG awx.main.dispatch delivered 77ab7089-f64b-4a47-b6f1-a2683ee926fd to worker[176] qsize 0 2021-11-02 10:29:14,656 DEBUG awx.main.dispatch task 77ab7089-f64b-4a47-b6f1-a2683ee926fd starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:29:14,665 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:29:14,667 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:28:44.672481+00:00 2021-11-02 10:29:14,683 DEBUG awx.main.dispatch task 77ab7089-f64b-4a47-b6f1-a2683ee926fd is finished 2021-11-02 10:29:14,974 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(60ffbf27-43ba-4a16-bf33-11777fb0a366, queue=awx_private_queue) [2021-11-02 10:29:14,974: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(60ffbf27-43ba-4a16-bf33-11777fb0a366, queue=awx_private_queue) 2021-11-02 10:29:14,989 DEBUG awx.main.dispatch delivered 60ffbf27-43ba-4a16-bf33-11777fb0a366 to worker[178] qsize 0 2021-11-02 10:29:14,993 DEBUG awx.main.dispatch task 60ffbf27-43ba-4a16-bf33-11777fb0a366 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:29:14,996 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:29:15,018 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:29:15,048 DEBUG awx.main.dispatch task 60ffbf27-43ba-4a16-bf33-11777fb0a366 is finished 2021-11-02 10:29:34,986 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3392058f-e48f-4a0a-962b-4549044ce24f, queue=awx_private_queue) [2021-11-02 10:29:34,986: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3392058f-e48f-4a0a-962b-4549044ce24f, queue=awx_private_queue) 2021-11-02 10:29:35,009 DEBUG awx.main.dispatch delivered 3392058f-e48f-4a0a-962b-4549044ce24f to worker[183] qsize 0 2021-11-02 10:29:35,014 DEBUG awx.main.dispatch task 3392058f-e48f-4a0a-962b-4549044ce24f starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:29:35,019 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:29:35,042 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:29:35,082 DEBUG awx.main.dispatch task 3392058f-e48f-4a0a-962b-4549044ce24f is finished 2021-11-02 10:29:44,631 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(c86b0043-e0b1-4df9-920e-ca960236ed8e, queue=awx_private_queue) [2021-11-02 10:29:44,631: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(c86b0043-e0b1-4df9-920e-ca960236ed8e, queue=awx_private_queue) 2021-11-02 10:29:44,655 DEBUG awx.main.dispatch delivered c86b0043-e0b1-4df9-920e-ca960236ed8e to worker[181] qsize 0 2021-11-02 10:29:44,658 DEBUG awx.main.dispatch task c86b0043-e0b1-4df9-920e-ca960236ed8e starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:29:44,673 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:29:44,678 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:29:14.665463+00:00 2021-11-02 10:29:44,769 DEBUG awx.main.dispatch task c86b0043-e0b1-4df9-920e-ca960236ed8e is finished 2021-11-02 10:29:54,986 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d4bff36d-518a-4509-a010-cf86a49bd507, queue=awx_private_queue) [2021-11-02 10:29:54,986: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d4bff36d-518a-4509-a010-cf86a49bd507, queue=awx_private_queue) 2021-11-02 10:29:55,001 DEBUG awx.main.dispatch delivered d4bff36d-518a-4509-a010-cf86a49bd507 to worker[178] qsize 0 2021-11-02 10:29:55,004 DEBUG awx.main.dispatch task d4bff36d-518a-4509-a010-cf86a49bd507 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:29:55,006 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:29:55,027 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:29:55,060 DEBUG awx.main.dispatch task d4bff36d-518a-4509-a010-cf86a49bd507 is finished RESULT 2 OKREADY 2021-11-02 10:30:14,228 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(61a507bd-b8b2-460e-b021-b76558e44158, queue=dev-awx-0) [2021-11-02 10:30:14,228: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(61a507bd-b8b2-460e-b021-b76558e44158, queue=dev-awx-0) 2021-11-02 10:30:14,269 DEBUG awx.main.dispatch delivered 61a507bd-b8b2-460e-b021-b76558e44158 to worker[178] qsize 0 2021-11-02 10:30:14,272 DEBUG awx.main.dispatch task 61a507bd-b8b2-460e-b021-b76558e44158 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:30:14,274 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:30:14,329 DEBUG awx.main.dispatch task 61a507bd-b8b2-460e-b021-b76558e44158 is finished 2021-11-02 10:30:14,374 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(67652b05-1b1e-445f-bb58-748af0c57dae, queue=dev-awx-0) [2021-11-02 10:30:14,374: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(67652b05-1b1e-445f-bb58-748af0c57dae, queue=dev-awx-0) 2021-11-02 10:30:14,408 DEBUG awx.main.dispatch delivered 67652b05-1b1e-445f-bb58-748af0c57dae to worker[183] qsize 0 2021-11-02 10:30:14,590 DEBUG awx.main.dispatch task 67652b05-1b1e-445f-bb58-748af0c57dae starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:30:14,631 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(73f96a67-21e3-473c-b368-835a910d87d5, queue=awx_private_queue) [2021-11-02 10:30:14,631: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(73f96a67-21e3-473c-b368-835a910d87d5, queue=awx_private_queue) 2021-11-02 10:30:14,636 DEBUG awx.main.dispatch task 67652b05-1b1e-445f-bb58-748af0c57dae is finished 2021-11-02 10:30:14,652 DEBUG awx.main.dispatch delivered 73f96a67-21e3-473c-b368-835a910d87d5 to worker[183] qsize 0 2021-11-02 10:30:14,654 DEBUG awx.main.dispatch task 73f96a67-21e3-473c-b368-835a910d87d5 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:30:14,662 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:30:14,665 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:29:44.673439+00:00 2021-11-02 10:30:14,678 DEBUG awx.main.dispatch task 73f96a67-21e3-473c-b368-835a910d87d5 is finished 2021-11-02 10:30:14,986 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(8de39731-fbe3-40a9-9783-281c2d227740, queue=awx_private_queue) [2021-11-02 10:30:14,986: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(8de39731-fbe3-40a9-9783-281c2d227740, queue=awx_private_queue) 2021-11-02 10:30:15,003 DEBUG awx.main.dispatch delivered 8de39731-fbe3-40a9-9783-281c2d227740 to worker[176] qsize 0 2021-11-02 10:30:15,006 DEBUG awx.main.dispatch task 8de39731-fbe3-40a9-9783-281c2d227740 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:30:15,009 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:30:15,030 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:30:15,067 DEBUG awx.main.dispatch task 8de39731-fbe3-40a9-9783-281c2d227740 is finished 2021-11-02 10:30:34,986 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(cef9e99a-ead8-4090-b2ab-a481b048820a, queue=awx_private_queue) [2021-11-02 10:30:34,986: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(cef9e99a-ead8-4090-b2ab-a481b048820a, queue=awx_private_queue) 2021-11-02 10:30:35,009 DEBUG awx.main.dispatch delivered cef9e99a-ead8-4090-b2ab-a481b048820a to worker[183] qsize 0 2021-11-02 10:30:35,012 DEBUG awx.main.dispatch task cef9e99a-ead8-4090-b2ab-a481b048820a starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:30:35,014 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:30:35,031 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:30:35,060 DEBUG awx.main.dispatch task cef9e99a-ead8-4090-b2ab-a481b048820a is finished 2021-11-02 10:30:44,637 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(97392df6-e2c8-431a-a8f4-01b3e37fcb16, queue=awx_private_queue) [2021-11-02 10:30:44,637: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(97392df6-e2c8-431a-a8f4-01b3e37fcb16, queue=awx_private_queue) 2021-11-02 10:30:44,674 DEBUG awx.main.dispatch delivered 97392df6-e2c8-431a-a8f4-01b3e37fcb16 to worker[181] qsize 0 2021-11-02 10:30:44,685 DEBUG awx.main.dispatch task 97392df6-e2c8-431a-a8f4-01b3e37fcb16 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:30:44,707 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:30:44,715 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:30:14.662823+00:00 2021-11-02 10:30:44,827 DEBUG awx.main.dispatch task 97392df6-e2c8-431a-a8f4-01b3e37fcb16 is finished 2021-11-02 10:30:54,994 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6754c057-f8e6-4f8b-96ed-dffe023de1eb, queue=awx_private_queue) [2021-11-02 10:30:54,994: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6754c057-f8e6-4f8b-96ed-dffe023de1eb, queue=awx_private_queue) 2021-11-02 10:30:55,016 DEBUG awx.main.dispatch delivered 6754c057-f8e6-4f8b-96ed-dffe023de1eb to worker[183] qsize 0 2021-11-02 10:30:55,020 DEBUG awx.main.dispatch task 6754c057-f8e6-4f8b-96ed-dffe023de1eb starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:30:55,024 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:30:55,045 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:30:55,075 DEBUG awx.main.dispatch task 6754c057-f8e6-4f8b-96ed-dffe023de1eb is finished RESULT 2 OKREADY 2021-11-02 10:31:14,235 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(5d21b8e8-92dc-4d0d-a48d-0ce5cb924b59, queue=dev-awx-0) [2021-11-02 10:31:14,235: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(5d21b8e8-92dc-4d0d-a48d-0ce5cb924b59, queue=dev-awx-0) 2021-11-02 10:31:14,282 DEBUG awx.main.dispatch delivered 5d21b8e8-92dc-4d0d-a48d-0ce5cb924b59 to worker[181] qsize 0 2021-11-02 10:31:14,286 DEBUG awx.main.dispatch task 5d21b8e8-92dc-4d0d-a48d-0ce5cb924b59 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:31:14,288 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:31:14,331 DEBUG awx.main.dispatch task 5d21b8e8-92dc-4d0d-a48d-0ce5cb924b59 is finished 2021-11-02 10:31:14,374 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(a78876d6-9963-4952-a45c-de3208a47d23, queue=dev-awx-0) [2021-11-02 10:31:14,374: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(a78876d6-9963-4952-a45c-de3208a47d23, queue=dev-awx-0) 2021-11-02 10:31:14,389 DEBUG awx.main.dispatch delivered a78876d6-9963-4952-a45c-de3208a47d23 to worker[176] qsize 0 2021-11-02 10:31:14,394 DEBUG awx.main.dispatch task a78876d6-9963-4952-a45c-de3208a47d23 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:31:14,421 DEBUG awx.main.dispatch task a78876d6-9963-4952-a45c-de3208a47d23 is finished 2021-11-02 10:31:14,633 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d7c54a9e-391b-4d5f-8973-401fc84fb8cd, queue=awx_private_queue) [2021-11-02 10:31:14,633: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d7c54a9e-391b-4d5f-8973-401fc84fb8cd, queue=awx_private_queue) 2021-11-02 10:31:14,679 DEBUG awx.main.dispatch delivered d7c54a9e-391b-4d5f-8973-401fc84fb8cd to worker[181] qsize 0 2021-11-02 10:31:14,934 DEBUG awx.main.dispatch task d7c54a9e-391b-4d5f-8973-401fc84fb8cd starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:31:14,946 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:31:14,949 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:30:44.708095+00:00 2021-11-02 10:31:14,965 DEBUG awx.main.dispatch task d7c54a9e-391b-4d5f-8973-401fc84fb8cd is finished 2021-11-02 10:31:14,991 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(09a0452c-5fea-4872-8a64-73cf1887b6c4, queue=awx_private_queue) [2021-11-02 10:31:14,991: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(09a0452c-5fea-4872-8a64-73cf1887b6c4, queue=awx_private_queue) 2021-11-02 10:31:15,007 DEBUG awx.main.dispatch delivered 09a0452c-5fea-4872-8a64-73cf1887b6c4 to worker[178] qsize 0 2021-11-02 10:31:15,011 DEBUG awx.main.dispatch task 09a0452c-5fea-4872-8a64-73cf1887b6c4 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:31:15,017 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:31:15,039 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:31:15,070 DEBUG awx.main.dispatch task 09a0452c-5fea-4872-8a64-73cf1887b6c4 is finished 2021-11-02 10:31:35,002 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c1e4126c-73e6-4221-8aac-fb39894bf2a8, queue=awx_private_queue) [2021-11-02 10:31:35,002: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c1e4126c-73e6-4221-8aac-fb39894bf2a8, queue=awx_private_queue) 2021-11-02 10:31:35,025 DEBUG awx.main.dispatch delivered c1e4126c-73e6-4221-8aac-fb39894bf2a8 to worker[176] qsize 0 2021-11-02 10:31:35,028 DEBUG awx.main.dispatch task c1e4126c-73e6-4221-8aac-fb39894bf2a8 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:31:35,031 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:31:35,055 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:31:35,088 DEBUG awx.main.dispatch task c1e4126c-73e6-4221-8aac-fb39894bf2a8 is finished 2021-11-02 10:31:44,634 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(4011168f-fdec-4b75-a120-d3f50bb48fdb, queue=awx_private_queue) [2021-11-02 10:31:44,634: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(4011168f-fdec-4b75-a120-d3f50bb48fdb, queue=awx_private_queue) 2021-11-02 10:31:44,657 DEBUG awx.main.dispatch delivered 4011168f-fdec-4b75-a120-d3f50bb48fdb to worker[183] qsize 0 2021-11-02 10:31:44,660 DEBUG awx.main.dispatch task 4011168f-fdec-4b75-a120-d3f50bb48fdb starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:31:44,674 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:31:44,679 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:31:14.946359+00:00 2021-11-02 10:31:44,712 DEBUG awx.main.dispatch task 4011168f-fdec-4b75-a120-d3f50bb48fdb is finished 2021-11-02 10:31:55,003 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(303f9946-5f88-40cb-9cdf-147db297de01, queue=awx_private_queue) [2021-11-02 10:31:55,003: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(303f9946-5f88-40cb-9cdf-147db297de01, queue=awx_private_queue) 2021-11-02 10:31:55,018 DEBUG awx.main.dispatch delivered 303f9946-5f88-40cb-9cdf-147db297de01 to worker[183] qsize 0 2021-11-02 10:31:55,020 DEBUG awx.main.dispatch task 303f9946-5f88-40cb-9cdf-147db297de01 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:31:55,022 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:31:55,041 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:31:55,070 DEBUG awx.main.dispatch task 303f9946-5f88-40cb-9cdf-147db297de01 is finished RESULT 2 OKREADY 2021-11-02 10:32:14,234 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(058458d2-b0ca-452c-8583-0fd170aa9672, queue=dev-awx-0) [2021-11-02 10:32:14,234: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(058458d2-b0ca-452c-8583-0fd170aa9672, queue=dev-awx-0) 2021-11-02 10:32:14,274 DEBUG awx.main.dispatch delivered 058458d2-b0ca-452c-8583-0fd170aa9672 to worker[181] qsize 0 2021-11-02 10:32:14,277 DEBUG awx.main.dispatch task 058458d2-b0ca-452c-8583-0fd170aa9672 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:32:14,280 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:32:14,328 DEBUG awx.main.dispatch task 058458d2-b0ca-452c-8583-0fd170aa9672 is finished 2021-11-02 10:32:14,374 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(d1602c67-24e8-4d93-bc79-a2a7444204f2, queue=dev-awx-0) [2021-11-02 10:32:14,374: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(d1602c67-24e8-4d93-bc79-a2a7444204f2, queue=dev-awx-0) 2021-11-02 10:32:14,396 DEBUG awx.main.dispatch delivered d1602c67-24e8-4d93-bc79-a2a7444204f2 to worker[176] qsize 0 2021-11-02 10:32:14,399 DEBUG awx.main.dispatch task d1602c67-24e8-4d93-bc79-a2a7444204f2 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:32:14,413 DEBUG awx.main.dispatch task d1602c67-24e8-4d93-bc79-a2a7444204f2 is finished 2021-11-02 10:32:14,634 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(3dc8ec24-27ff-44b5-b23c-a7fcebc8f4e4, queue=awx_private_queue) [2021-11-02 10:32:14,634: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(3dc8ec24-27ff-44b5-b23c-a7fcebc8f4e4, queue=awx_private_queue) 2021-11-02 10:32:14,677 DEBUG awx.main.dispatch delivered 3dc8ec24-27ff-44b5-b23c-a7fcebc8f4e4 to worker[183] qsize 0 2021-11-02 10:32:14,680 DEBUG awx.main.dispatch task 3dc8ec24-27ff-44b5-b23c-a7fcebc8f4e4 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:32:14,692 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:32:14,695 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:31:44.674245+00:00 2021-11-02 10:32:14,712 DEBUG awx.main.dispatch task 3dc8ec24-27ff-44b5-b23c-a7fcebc8f4e4 is finished 2021-11-02 10:32:15,003 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(fa07fb5d-f1fc-45c4-acd6-af192ad785d8, queue=awx_private_queue) [2021-11-02 10:32:15,003: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(fa07fb5d-f1fc-45c4-acd6-af192ad785d8, queue=awx_private_queue) 2021-11-02 10:32:15,259 DEBUG awx.main.dispatch delivered fa07fb5d-f1fc-45c4-acd6-af192ad785d8 to worker[176] qsize 0 2021-11-02 10:32:15,262 DEBUG awx.main.dispatch task fa07fb5d-f1fc-45c4-acd6-af192ad785d8 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:32:15,263 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:32:15,278 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:32:15,306 DEBUG awx.main.dispatch task fa07fb5d-f1fc-45c4-acd6-af192ad785d8 is finished 2021-11-02 10:32:35,010 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(33a05a3c-33bd-4028-991a-88009aad416b, queue=awx_private_queue) [2021-11-02 10:32:35,010: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(33a05a3c-33bd-4028-991a-88009aad416b, queue=awx_private_queue) 2021-11-02 10:32:35,043 DEBUG awx.main.dispatch delivered 33a05a3c-33bd-4028-991a-88009aad416b to worker[176] qsize 0 2021-11-02 10:32:35,052 DEBUG awx.main.dispatch task 33a05a3c-33bd-4028-991a-88009aad416b starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:32:35,057 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:32:35,080 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:32:35,112 DEBUG awx.main.dispatch task 33a05a3c-33bd-4028-991a-88009aad416b is finished 2021-11-02 10:32:44,634 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(3e6519b8-2463-4e42-bbbe-f3b37c6da98f, queue=awx_private_queue) [2021-11-02 10:32:44,634: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(3e6519b8-2463-4e42-bbbe-f3b37c6da98f, queue=awx_private_queue) 2021-11-02 10:32:44,660 DEBUG awx.main.dispatch delivered 3e6519b8-2463-4e42-bbbe-f3b37c6da98f to worker[178] qsize 0 2021-11-02 10:32:44,667 DEBUG awx.main.dispatch task 3e6519b8-2463-4e42-bbbe-f3b37c6da98f starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:32:44,695 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:32:44,708 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:32:14.692583+00:00 2021-11-02 10:32:44,759 DEBUG awx.main.dispatch task 3e6519b8-2463-4e42-bbbe-f3b37c6da98f is finished 2021-11-02 10:32:55,004 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0d2354c7-9988-4baa-b6dd-9ab1a32d3f23, queue=awx_private_queue) [2021-11-02 10:32:55,004: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0d2354c7-9988-4baa-b6dd-9ab1a32d3f23, queue=awx_private_queue) 2021-11-02 10:32:55,036 DEBUG awx.main.dispatch delivered 0d2354c7-9988-4baa-b6dd-9ab1a32d3f23 to worker[176] qsize 0 2021-11-02 10:32:55,039 DEBUG awx.main.dispatch task 0d2354c7-9988-4baa-b6dd-9ab1a32d3f23 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:32:55,041 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:32:55,061 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:32:55,092 DEBUG awx.main.dispatch task 0d2354c7-9988-4baa-b6dd-9ab1a32d3f23 is finished RESULT 2 OKREADY 2021-11-02 10:33:14,244 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(23c0eaa7-deee-45a3-a862-2d238177409c, queue=dev-awx-0) [2021-11-02 10:33:14,244: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(23c0eaa7-deee-45a3-a862-2d238177409c, queue=dev-awx-0) 2021-11-02 10:33:14,292 DEBUG awx.main.dispatch delivered 23c0eaa7-deee-45a3-a862-2d238177409c to worker[181] qsize 0 2021-11-02 10:33:14,297 DEBUG awx.main.dispatch task 23c0eaa7-deee-45a3-a862-2d238177409c starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:33:14,304 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:33:14,361 DEBUG awx.main.dispatch task 23c0eaa7-deee-45a3-a862-2d238177409c is finished 2021-11-02 10:33:14,374 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(6655e637-00ea-406c-a038-9dfdd1186a49, queue=dev-awx-0) [2021-11-02 10:33:14,374: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(6655e637-00ea-406c-a038-9dfdd1186a49, queue=dev-awx-0) 2021-11-02 10:33:14,397 DEBUG awx.main.dispatch delivered 6655e637-00ea-406c-a038-9dfdd1186a49 to worker[181] qsize 0 2021-11-02 10:33:14,400 DEBUG awx.main.dispatch task 6655e637-00ea-406c-a038-9dfdd1186a49 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:33:14,414 DEBUG awx.main.dispatch task 6655e637-00ea-406c-a038-9dfdd1186a49 is finished 2021-11-02 10:33:14,634 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(9e6e0577-0be2-42ac-a110-483bbf8e1b43, queue=awx_private_queue) [2021-11-02 10:33:14,634: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(9e6e0577-0be2-42ac-a110-483bbf8e1b43, queue=awx_private_queue) 2021-11-02 10:33:14,670 DEBUG awx.main.dispatch delivered 9e6e0577-0be2-42ac-a110-483bbf8e1b43 to worker[178] qsize 0 2021-11-02 10:33:14,673 DEBUG awx.main.dispatch task 9e6e0577-0be2-42ac-a110-483bbf8e1b43 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:33:14,683 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:33:14,686 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:32:44.696791+00:00 2021-11-02 10:33:14,703 DEBUG awx.main.dispatch task 9e6e0577-0be2-42ac-a110-483bbf8e1b43 is finished 2021-11-02 10:33:15,004 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(67b6ab81-f472-4a70-9f1c-67621b419f73, queue=awx_private_queue) [2021-11-02 10:33:15,004: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(67b6ab81-f472-4a70-9f1c-67621b419f73, queue=awx_private_queue) 2021-11-02 10:33:15,246 DEBUG awx.main.dispatch delivered 67b6ab81-f472-4a70-9f1c-67621b419f73 to worker[178] qsize 0 2021-11-02 10:33:15,249 DEBUG awx.main.dispatch task 67b6ab81-f472-4a70-9f1c-67621b419f73 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:33:15,250 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:33:15,266 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:33:15,297 DEBUG awx.main.dispatch task 67b6ab81-f472-4a70-9f1c-67621b419f73 is finished 2021-11-02 10:33:35,005 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(288ab8c5-2914-4cf7-9dfc-6f19c5236d1c, queue=awx_private_queue) [2021-11-02 10:33:35,005: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(288ab8c5-2914-4cf7-9dfc-6f19c5236d1c, queue=awx_private_queue) 2021-11-02 10:33:35,026 DEBUG awx.main.dispatch delivered 288ab8c5-2914-4cf7-9dfc-6f19c5236d1c to worker[181] qsize 0 2021-11-02 10:33:35,031 DEBUG awx.main.dispatch task 288ab8c5-2914-4cf7-9dfc-6f19c5236d1c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:33:35,032 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:33:35,047 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:33:35,075 DEBUG awx.main.dispatch task 288ab8c5-2914-4cf7-9dfc-6f19c5236d1c is finished 2021-11-02 10:33:44,634 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d6ac1e34-b994-4884-90be-0af1854e1106, queue=awx_private_queue) [2021-11-02 10:33:44,634: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d6ac1e34-b994-4884-90be-0af1854e1106, queue=awx_private_queue) 2021-11-02 10:33:44,660 DEBUG awx.main.dispatch delivered d6ac1e34-b994-4884-90be-0af1854e1106 to worker[176] qsize 0 2021-11-02 10:33:44,662 DEBUG awx.main.dispatch task d6ac1e34-b994-4884-90be-0af1854e1106 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:33:44,673 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:33:44,676 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:33:14.684057+00:00 2021-11-02 10:33:44,740 DEBUG awx.main.dispatch task d6ac1e34-b994-4884-90be-0af1854e1106 is finished 2021-11-02 10:33:55,008 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(4fdf17f5-9370-400c-a714-6766117e0a6c, queue=awx_private_queue) [2021-11-02 10:33:55,008: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(4fdf17f5-9370-400c-a714-6766117e0a6c, queue=awx_private_queue) 2021-11-02 10:33:55,031 DEBUG awx.main.dispatch delivered 4fdf17f5-9370-400c-a714-6766117e0a6c to worker[178] qsize 0 2021-11-02 10:33:55,034 DEBUG awx.main.dispatch task 4fdf17f5-9370-400c-a714-6766117e0a6c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:33:55,037 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:33:55,054 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:33:55,087 DEBUG awx.main.dispatch task 4fdf17f5-9370-400c-a714-6766117e0a6c is finished RESULT 2 OKREADY 2021-11-02 10:34:14,265 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(5ac47c8b-0088-4cf4-9806-656ba2b6302c, queue=dev-awx-0) [2021-11-02 10:34:14,265: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(5ac47c8b-0088-4cf4-9806-656ba2b6302c, queue=dev-awx-0) 2021-11-02 10:34:14,341 DEBUG awx.main.dispatch delivered 5ac47c8b-0088-4cf4-9806-656ba2b6302c to worker[178] qsize 0 2021-11-02 10:34:14,353 DEBUG awx.main.dispatch task 5ac47c8b-0088-4cf4-9806-656ba2b6302c starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:34:14,362 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:34:14,375 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(1cce7944-a056-40ce-b7d5-3cb0f7c8e1d5, queue=dev-awx-0) [2021-11-02 10:34:14,375: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(1cce7944-a056-40ce-b7d5-3cb0f7c8e1d5, queue=dev-awx-0) 2021-11-02 10:34:14,398 DEBUG awx.main.dispatch delivered 1cce7944-a056-40ce-b7d5-3cb0f7c8e1d5 to worker[176] qsize 0 2021-11-02 10:34:14,403 DEBUG awx.main.dispatch task 1cce7944-a056-40ce-b7d5-3cb0f7c8e1d5 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:34:14,408 DEBUG awx.main.dispatch task 5ac47c8b-0088-4cf4-9806-656ba2b6302c is finished 2021-11-02 10:34:14,424 DEBUG awx.main.dispatch task 1cce7944-a056-40ce-b7d5-3cb0f7c8e1d5 is finished 2021-11-02 10:34:14,634 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(f9f83783-7e97-4c35-9bf7-d36d06e90852, queue=awx_private_queue) [2021-11-02 10:34:14,634: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(f9f83783-7e97-4c35-9bf7-d36d06e90852, queue=awx_private_queue) 2021-11-02 10:34:14,657 DEBUG awx.main.dispatch delivered f9f83783-7e97-4c35-9bf7-d36d06e90852 to worker[176] qsize 0 2021-11-02 10:34:14,665 DEBUG awx.main.dispatch task f9f83783-7e97-4c35-9bf7-d36d06e90852 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:34:14,675 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:34:14,678 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:33:44.674130+00:00 2021-11-02 10:34:14,692 DEBUG awx.main.dispatch task f9f83783-7e97-4c35-9bf7-d36d06e90852 is finished 2021-11-02 10:34:15,008 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(74926eb3-7880-4b25-9b6f-d6fa46c5fd67, queue=awx_private_queue) [2021-11-02 10:34:15,008: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(74926eb3-7880-4b25-9b6f-d6fa46c5fd67, queue=awx_private_queue) 2021-11-02 10:34:15,230 DEBUG awx.main.dispatch delivered 74926eb3-7880-4b25-9b6f-d6fa46c5fd67 to worker[176] qsize 0 2021-11-02 10:34:15,232 DEBUG awx.main.dispatch task 74926eb3-7880-4b25-9b6f-d6fa46c5fd67 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:34:15,233 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:34:15,250 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:34:15,281 DEBUG awx.main.dispatch task 74926eb3-7880-4b25-9b6f-d6fa46c5fd67 is finished 2021-11-02 10:34:35,010 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f12515b6-f191-401a-befc-4ae898d91f76, queue=awx_private_queue) [2021-11-02 10:34:35,010: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f12515b6-f191-401a-befc-4ae898d91f76, queue=awx_private_queue) 2021-11-02 10:34:35,035 DEBUG awx.main.dispatch delivered f12515b6-f191-401a-befc-4ae898d91f76 to worker[183] qsize 0 2021-11-02 10:34:35,043 DEBUG awx.main.dispatch task f12515b6-f191-401a-befc-4ae898d91f76 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:34:35,050 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:34:35,079 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:34:35,111 DEBUG awx.main.dispatch task f12515b6-f191-401a-befc-4ae898d91f76 is finished 2021-11-02 10:34:44,634 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(5b17c140-ba62-4f78-b0cd-2861b90bdaa1, queue=awx_private_queue) [2021-11-02 10:34:44,634: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(5b17c140-ba62-4f78-b0cd-2861b90bdaa1, queue=awx_private_queue) 2021-11-02 10:34:44,654 DEBUG awx.main.dispatch delivered 5b17c140-ba62-4f78-b0cd-2861b90bdaa1 to worker[176] qsize 0 2021-11-02 10:34:44,657 DEBUG awx.main.dispatch task 5b17c140-ba62-4f78-b0cd-2861b90bdaa1 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:34:44,668 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:34:44,671 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:34:14.675698+00:00 2021-11-02 10:34:44,714 DEBUG awx.main.dispatch task 5b17c140-ba62-4f78-b0cd-2861b90bdaa1 is finished 2021-11-02 10:34:55,008 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(1c7eb332-5f20-4888-bff6-ae38a67e9a33, queue=awx_private_queue) [2021-11-02 10:34:55,008: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(1c7eb332-5f20-4888-bff6-ae38a67e9a33, queue=awx_private_queue) 2021-11-02 10:34:55,024 DEBUG awx.main.dispatch delivered 1c7eb332-5f20-4888-bff6-ae38a67e9a33 to worker[181] qsize 0 2021-11-02 10:34:55,029 DEBUG awx.main.dispatch task 1c7eb332-5f20-4888-bff6-ae38a67e9a33 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:34:55,037 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:34:55,063 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:34:55,098 DEBUG awx.main.dispatch task 1c7eb332-5f20-4888-bff6-ae38a67e9a33 is finished RESULT 2 OKREADY 2021-11-02 10:35:14,267 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(c9b0379f-67eb-489c-bc90-cc024d68145d, queue=dev-awx-0) [2021-11-02 10:35:14,267: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(c9b0379f-67eb-489c-bc90-cc024d68145d, queue=dev-awx-0) 2021-11-02 10:35:14,305 DEBUG awx.main.dispatch delivered c9b0379f-67eb-489c-bc90-cc024d68145d to worker[181] qsize 0 2021-11-02 10:35:14,308 DEBUG awx.main.dispatch task c9b0379f-67eb-489c-bc90-cc024d68145d starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:35:14,309 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:35:14,349 DEBUG awx.main.dispatch task c9b0379f-67eb-489c-bc90-cc024d68145d is finished 2021-11-02 10:35:14,374 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(9ca1f1c1-887f-48e9-8c24-17846be561ad, queue=dev-awx-0) [2021-11-02 10:35:14,374: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(9ca1f1c1-887f-48e9-8c24-17846be561ad, queue=dev-awx-0) 2021-11-02 10:35:14,395 DEBUG awx.main.dispatch delivered 9ca1f1c1-887f-48e9-8c24-17846be561ad to worker[178] qsize 0 2021-11-02 10:35:14,398 DEBUG awx.main.dispatch task 9ca1f1c1-887f-48e9-8c24-17846be561ad starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:35:14,416 DEBUG awx.main.dispatch task 9ca1f1c1-887f-48e9-8c24-17846be561ad is finished 2021-11-02 10:35:14,634 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(0f0c7710-23ff-4479-84f1-376c3e3c7074, queue=awx_private_queue) [2021-11-02 10:35:14,634: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(0f0c7710-23ff-4479-84f1-376c3e3c7074, queue=awx_private_queue) 2021-11-02 10:35:14,658 DEBUG awx.main.dispatch delivered 0f0c7710-23ff-4479-84f1-376c3e3c7074 to worker[178] qsize 0 2021-11-02 10:35:14,661 DEBUG awx.main.dispatch task 0f0c7710-23ff-4479-84f1-376c3e3c7074 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:35:14,673 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:35:14,676 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:34:44.668212+00:00 2021-11-02 10:35:14,692 DEBUG awx.main.dispatch task 0f0c7710-23ff-4479-84f1-376c3e3c7074 is finished 2021-11-02 10:35:15,008 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0bf1eff6-e296-4881-bd82-2a42dfbf0134, queue=awx_private_queue) [2021-11-02 10:35:15,008: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0bf1eff6-e296-4881-bd82-2a42dfbf0134, queue=awx_private_queue) 2021-11-02 10:35:15,044 DEBUG awx.main.dispatch delivered 0bf1eff6-e296-4881-bd82-2a42dfbf0134 to worker[183] qsize 0 2021-11-02 10:35:15,049 DEBUG awx.main.dispatch task 0bf1eff6-e296-4881-bd82-2a42dfbf0134 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:35:15,050 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:35:15,067 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:35:15,097 DEBUG awx.main.dispatch task 0bf1eff6-e296-4881-bd82-2a42dfbf0134 is finished 2021-11-02 10:35:35,019 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6dabb87b-14a3-47df-9ce6-963ff1f552eb, queue=awx_private_queue) [2021-11-02 10:35:35,019: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6dabb87b-14a3-47df-9ce6-963ff1f552eb, queue=awx_private_queue) 2021-11-02 10:35:35,224 DEBUG awx.main.dispatch delivered 6dabb87b-14a3-47df-9ce6-963ff1f552eb to worker[176] qsize 0 2021-11-02 10:35:35,226 DEBUG awx.main.dispatch task 6dabb87b-14a3-47df-9ce6-963ff1f552eb starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:35:35,228 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:35:35,245 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:35:35,271 DEBUG awx.main.dispatch task 6dabb87b-14a3-47df-9ce6-963ff1f552eb is finished 2021-11-02 10:35:44,635 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(5f455c1e-ad4d-48e9-bc92-8224541796f5, queue=awx_private_queue) [2021-11-02 10:35:44,635: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(5f455c1e-ad4d-48e9-bc92-8224541796f5, queue=awx_private_queue) 2021-11-02 10:35:44,654 DEBUG awx.main.dispatch delivered 5f455c1e-ad4d-48e9-bc92-8224541796f5 to worker[181] qsize 0 2021-11-02 10:35:44,657 DEBUG awx.main.dispatch task 5f455c1e-ad4d-48e9-bc92-8224541796f5 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:35:44,667 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:35:44,670 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:35:14.673222+00:00 2021-11-02 10:35:44,753 DEBUG awx.main.dispatch task 5f455c1e-ad4d-48e9-bc92-8224541796f5 is finished 2021-11-02 10:35:55,025 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0bc8bd63-424c-4772-8654-04f23b27e1e5, queue=awx_private_queue) [2021-11-02 10:35:55,025: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0bc8bd63-424c-4772-8654-04f23b27e1e5, queue=awx_private_queue) 2021-11-02 10:35:55,059 DEBUG awx.main.dispatch delivered 0bc8bd63-424c-4772-8654-04f23b27e1e5 to worker[178] qsize 0 2021-11-02 10:35:55,071 DEBUG awx.main.dispatch task 0bc8bd63-424c-4772-8654-04f23b27e1e5 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:35:55,082 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:35:55,123 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:35:55,155 DEBUG awx.main.dispatch task 0bc8bd63-424c-4772-8654-04f23b27e1e5 is finished RESULT 2 OKREADY 2021-11-02 10:36:14,279 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(c9aa9e35-480d-4399-b684-0e6906929d60, queue=dev-awx-0) [2021-11-02 10:36:14,279: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(c9aa9e35-480d-4399-b684-0e6906929d60, queue=dev-awx-0) 2021-11-02 10:36:14,321 DEBUG awx.main.dispatch delivered c9aa9e35-480d-4399-b684-0e6906929d60 to worker[178] qsize 0 2021-11-02 10:36:14,323 DEBUG awx.main.dispatch task c9aa9e35-480d-4399-b684-0e6906929d60 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:36:14,326 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:36:14,374 DEBUG awx.main.dispatch task c9aa9e35-480d-4399-b684-0e6906929d60 is finished 2021-11-02 10:36:14,375 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(c6aca1af-791c-40c1-b548-a25f830e89cd, queue=dev-awx-0) [2021-11-02 10:36:14,375: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(c6aca1af-791c-40c1-b548-a25f830e89cd, queue=dev-awx-0) 2021-11-02 10:36:14,409 DEBUG awx.main.dispatch delivered c6aca1af-791c-40c1-b548-a25f830e89cd to worker[176] qsize 0 2021-11-02 10:36:14,413 DEBUG awx.main.dispatch task c6aca1af-791c-40c1-b548-a25f830e89cd starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:36:14,450 DEBUG awx.main.dispatch task c6aca1af-791c-40c1-b548-a25f830e89cd is finished 2021-11-02 10:36:14,634 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(01a6c74b-e1d7-4f3a-aadd-eb124dba3ac2, queue=awx_private_queue) [2021-11-02 10:36:14,634: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(01a6c74b-e1d7-4f3a-aadd-eb124dba3ac2, queue=awx_private_queue) 2021-11-02 10:36:14,656 DEBUG awx.main.dispatch delivered 01a6c74b-e1d7-4f3a-aadd-eb124dba3ac2 to worker[183] qsize 0 2021-11-02 10:36:14,663 DEBUG awx.main.dispatch task 01a6c74b-e1d7-4f3a-aadd-eb124dba3ac2 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:36:14,684 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:36:14,691 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:35:44.667755+00:00 2021-11-02 10:36:14,711 DEBUG awx.main.dispatch task 01a6c74b-e1d7-4f3a-aadd-eb124dba3ac2 is finished 2021-11-02 10:36:15,022 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a63dd2c6-e9f5-4d8c-bb22-d881ec72c306, queue=awx_private_queue) [2021-11-02 10:36:15,022: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a63dd2c6-e9f5-4d8c-bb22-d881ec72c306, queue=awx_private_queue) 2021-11-02 10:36:15,046 DEBUG awx.main.dispatch delivered a63dd2c6-e9f5-4d8c-bb22-d881ec72c306 to worker[181] qsize 0 2021-11-02 10:36:15,052 DEBUG awx.main.dispatch task a63dd2c6-e9f5-4d8c-bb22-d881ec72c306 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:36:15,059 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:36:15,084 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:36:15,120 DEBUG awx.main.dispatch task a63dd2c6-e9f5-4d8c-bb22-d881ec72c306 is finished 2021-11-02 10:36:35,032 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(4893505a-4b36-4e31-a8ef-7ef438d9473d, queue=awx_private_queue) [2021-11-02 10:36:35,032: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(4893505a-4b36-4e31-a8ef-7ef438d9473d, queue=awx_private_queue) 2021-11-02 10:36:35,272 DEBUG awx.main.dispatch delivered 4893505a-4b36-4e31-a8ef-7ef438d9473d to worker[178] qsize 0 2021-11-02 10:36:35,275 DEBUG awx.main.dispatch task 4893505a-4b36-4e31-a8ef-7ef438d9473d starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:36:35,278 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:36:35,295 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:36:35,329 DEBUG awx.main.dispatch task 4893505a-4b36-4e31-a8ef-7ef438d9473d is finished 2021-11-02 10:36:44,636 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(367eb32d-19bb-43f6-b3ed-b0cae4ce6fcb, queue=awx_private_queue) [2021-11-02 10:36:44,636: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(367eb32d-19bb-43f6-b3ed-b0cae4ce6fcb, queue=awx_private_queue) 2021-11-02 10:36:44,666 DEBUG awx.main.dispatch delivered 367eb32d-19bb-43f6-b3ed-b0cae4ce6fcb to worker[176] qsize 0 2021-11-02 10:36:44,669 DEBUG awx.main.dispatch task 367eb32d-19bb-43f6-b3ed-b0cae4ce6fcb starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:36:44,682 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:36:44,687 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:36:14.684989+00:00 2021-11-02 10:36:44,727 DEBUG awx.main.dispatch task 367eb32d-19bb-43f6-b3ed-b0cae4ce6fcb is finished 2021-11-02 10:36:55,032 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7d9d8a68-6e15-4513-8691-aa6f9e0fbcda, queue=awx_private_queue) [2021-11-02 10:36:55,032: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7d9d8a68-6e15-4513-8691-aa6f9e0fbcda, queue=awx_private_queue) 2021-11-02 10:36:55,053 DEBUG awx.main.dispatch delivered 7d9d8a68-6e15-4513-8691-aa6f9e0fbcda to worker[176] qsize 0 2021-11-02 10:36:55,055 DEBUG awx.main.dispatch task 7d9d8a68-6e15-4513-8691-aa6f9e0fbcda starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:36:55,057 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:36:55,076 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:36:55,106 DEBUG awx.main.dispatch task 7d9d8a68-6e15-4513-8691-aa6f9e0fbcda is finished RESULT 2 OKREADY 2021-11-02 10:37:14,287 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(cb1ca235-b01b-43e0-a289-87283345b169, queue=dev-awx-0) [2021-11-02 10:37:14,287: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(cb1ca235-b01b-43e0-a289-87283345b169, queue=dev-awx-0) 2021-11-02 10:37:14,332 DEBUG awx.main.dispatch delivered cb1ca235-b01b-43e0-a289-87283345b169 to worker[183] qsize 0 2021-11-02 10:37:14,335 DEBUG awx.main.dispatch task cb1ca235-b01b-43e0-a289-87283345b169 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:37:14,337 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:37:14,375 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(44b3bd76-2fdf-4044-9e33-18ebfcfa4241, queue=dev-awx-0) [2021-11-02 10:37:14,375: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(44b3bd76-2fdf-4044-9e33-18ebfcfa4241, queue=dev-awx-0) 2021-11-02 10:37:14,397 DEBUG awx.main.dispatch delivered 44b3bd76-2fdf-4044-9e33-18ebfcfa4241 to worker[176] qsize 0 2021-11-02 10:37:14,400 DEBUG awx.main.dispatch task 44b3bd76-2fdf-4044-9e33-18ebfcfa4241 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:37:14,416 DEBUG awx.main.dispatch task 44b3bd76-2fdf-4044-9e33-18ebfcfa4241 is finished 2021-11-02 10:37:14,433 DEBUG awx.main.dispatch task cb1ca235-b01b-43e0-a289-87283345b169 is finished 2021-11-02 10:37:14,636 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(997d2c26-8c8d-4641-bb88-00392f16c3c1, queue=awx_private_queue) [2021-11-02 10:37:14,636: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(997d2c26-8c8d-4641-bb88-00392f16c3c1, queue=awx_private_queue) 2021-11-02 10:37:14,671 DEBUG awx.main.dispatch delivered 997d2c26-8c8d-4641-bb88-00392f16c3c1 to worker[176] qsize 0 2021-11-02 10:37:14,675 DEBUG awx.main.dispatch task 997d2c26-8c8d-4641-bb88-00392f16c3c1 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:37:14,685 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:37:14,688 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:36:44.683251+00:00 2021-11-02 10:37:14,707 DEBUG awx.main.dispatch task 997d2c26-8c8d-4641-bb88-00392f16c3c1 is finished 2021-11-02 10:37:15,032 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(14ab23be-18bc-469b-82cf-1d571e0c2024, queue=awx_private_queue) [2021-11-02 10:37:15,032: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(14ab23be-18bc-469b-82cf-1d571e0c2024, queue=awx_private_queue) 2021-11-02 10:37:15,063 DEBUG awx.main.dispatch delivered 14ab23be-18bc-469b-82cf-1d571e0c2024 to worker[178] qsize 0 2021-11-02 10:37:15,066 DEBUG awx.main.dispatch task 14ab23be-18bc-469b-82cf-1d571e0c2024 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:37:15,067 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:37:15,083 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:37:15,111 DEBUG awx.main.dispatch task 14ab23be-18bc-469b-82cf-1d571e0c2024 is finished 2021-11-02 10:37:35,048 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(986908ba-289b-4784-910b-4a7ff4515c12, queue=awx_private_queue) [2021-11-02 10:37:35,048: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(986908ba-289b-4784-910b-4a7ff4515c12, queue=awx_private_queue) 2021-11-02 10:37:35,261 DEBUG awx.main.dispatch delivered 986908ba-289b-4784-910b-4a7ff4515c12 to worker[183] qsize 0 2021-11-02 10:37:35,268 DEBUG awx.main.dispatch task 986908ba-289b-4784-910b-4a7ff4515c12 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:37:35,273 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:37:35,293 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:37:35,323 DEBUG awx.main.dispatch task 986908ba-289b-4784-910b-4a7ff4515c12 is finished 2021-11-02 10:37:44,636 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(b193d817-5db8-4bb5-913a-4658fc6d9a38, queue=awx_private_queue) [2021-11-02 10:37:44,636: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(b193d817-5db8-4bb5-913a-4658fc6d9a38, queue=awx_private_queue) 2021-11-02 10:37:44,653 DEBUG awx.main.dispatch delivered b193d817-5db8-4bb5-913a-4658fc6d9a38 to worker[178] qsize 0 2021-11-02 10:37:44,660 DEBUG awx.main.dispatch task b193d817-5db8-4bb5-913a-4658fc6d9a38 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:37:44,679 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:37:44,684 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:37:14.685772+00:00 2021-11-02 10:37:44,742 DEBUG awx.main.dispatch task b193d817-5db8-4bb5-913a-4658fc6d9a38 is finished 2021-11-02 10:37:55,045 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c6eacdba-b9ea-4d63-9dc1-ff6a8b2cf881, queue=awx_private_queue) [2021-11-02 10:37:55,045: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c6eacdba-b9ea-4d63-9dc1-ff6a8b2cf881, queue=awx_private_queue) 2021-11-02 10:37:55,066 DEBUG awx.main.dispatch delivered c6eacdba-b9ea-4d63-9dc1-ff6a8b2cf881 to worker[178] qsize 0 2021-11-02 10:37:55,069 DEBUG awx.main.dispatch task c6eacdba-b9ea-4d63-9dc1-ff6a8b2cf881 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:37:55,070 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:37:55,087 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:37:55,116 DEBUG awx.main.dispatch task c6eacdba-b9ea-4d63-9dc1-ff6a8b2cf881 is finished RESULT 2 OKREADY 2021-11-02 10:38:13,985 DEBUG awx.main.dispatch publish awx.main.tasks.awx_isolated_heartbeat(32afb75a-d6f0-4181-892c-eed4a00076ee, queue=dev-awx-0) [2021-11-02 10:38:13,985: DEBUG/Process-1] publish awx.main.tasks.awx_isolated_heartbeat(32afb75a-d6f0-4181-892c-eed4a00076ee, queue=dev-awx-0) 2021-11-02 10:38:14,011 DEBUG awx.main.dispatch delivered 32afb75a-d6f0-4181-892c-eed4a00076ee to worker[183] qsize 0 2021-11-02 10:38:14,014 DEBUG awx.main.dispatch task 32afb75a-d6f0-4181-892c-eed4a00076ee starting awx.main.tasks.awx_isolated_heartbeat(*[]) 2021-11-02 10:38:14,016 DEBUG awx.main.tasks Controlling node checking for any isolated management tasks. 2021-11-02 10:38:14,043 DEBUG awx.main.dispatch task 32afb75a-d6f0-4181-892c-eed4a00076ee is finished 2021-11-02 10:38:14,287 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(8a6cf0eb-ceb1-4f78-b443-57554f152cd0, queue=dev-awx-0) [2021-11-02 10:38:14,287: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(8a6cf0eb-ceb1-4f78-b443-57554f152cd0, queue=dev-awx-0) 2021-11-02 10:38:14,341 DEBUG awx.main.dispatch delivered 8a6cf0eb-ceb1-4f78-b443-57554f152cd0 to worker[183] qsize 0 2021-11-02 10:38:14,345 DEBUG awx.main.dispatch task 8a6cf0eb-ceb1-4f78-b443-57554f152cd0 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:38:14,346 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:38:14,371 DEBUG awx.main.dispatch task 8a6cf0eb-ceb1-4f78-b443-57554f152cd0 is finished 2021-11-02 10:38:14,375 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(d1ba4d6f-b346-4d25-9352-b617693f21cc, queue=dev-awx-0) [2021-11-02 10:38:14,375: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(d1ba4d6f-b346-4d25-9352-b617693f21cc, queue=dev-awx-0) 2021-11-02 10:38:14,397 DEBUG awx.main.dispatch delivered d1ba4d6f-b346-4d25-9352-b617693f21cc to worker[176] qsize 0 2021-11-02 10:38:14,401 DEBUG awx.main.dispatch task d1ba4d6f-b346-4d25-9352-b617693f21cc starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:38:14,422 DEBUG awx.main.dispatch task d1ba4d6f-b346-4d25-9352-b617693f21cc is finished 2021-11-02 10:38:14,635 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(561a48a8-6b51-44ec-b34b-9ef2fbd5d31b, queue=awx_private_queue) [2021-11-02 10:38:14,635: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(561a48a8-6b51-44ec-b34b-9ef2fbd5d31b, queue=awx_private_queue) 2021-11-02 10:38:14,654 DEBUG awx.main.dispatch delivered 561a48a8-6b51-44ec-b34b-9ef2fbd5d31b to worker[176] qsize 0 2021-11-02 10:38:14,657 DEBUG awx.main.dispatch task 561a48a8-6b51-44ec-b34b-9ef2fbd5d31b starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:38:14,669 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:38:14,673 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:37:44.679802+00:00 2021-11-02 10:38:14,706 DEBUG awx.main.dispatch task 561a48a8-6b51-44ec-b34b-9ef2fbd5d31b is finished 2021-11-02 10:38:15,050 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f0ae1498-1cfc-418c-846b-63ac533a6cbd, queue=awx_private_queue) [2021-11-02 10:38:15,050: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f0ae1498-1cfc-418c-846b-63ac533a6cbd, queue=awx_private_queue) 2021-11-02 10:38:15,074 DEBUG awx.main.dispatch delivered f0ae1498-1cfc-418c-846b-63ac533a6cbd to worker[181] qsize 0 2021-11-02 10:38:15,080 DEBUG awx.main.dispatch task f0ae1498-1cfc-418c-846b-63ac533a6cbd starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:38:15,088 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:38:15,113 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:38:15,141 DEBUG awx.main.dispatch task f0ae1498-1cfc-418c-846b-63ac533a6cbd is finished 2021-11-02 10:38:35,056 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(02ccd372-ec3d-4e5e-bf98-efadf85a8d85, queue=awx_private_queue) [2021-11-02 10:38:35,056: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(02ccd372-ec3d-4e5e-bf98-efadf85a8d85, queue=awx_private_queue) 2021-11-02 10:38:35,282 DEBUG awx.main.dispatch delivered 02ccd372-ec3d-4e5e-bf98-efadf85a8d85 to worker[183] qsize 0 2021-11-02 10:38:35,285 DEBUG awx.main.dispatch task 02ccd372-ec3d-4e5e-bf98-efadf85a8d85 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:38:35,287 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:38:35,305 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:38:35,339 DEBUG awx.main.dispatch task 02ccd372-ec3d-4e5e-bf98-efadf85a8d85 is finished 2021-11-02 10:38:44,636 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(9c30a9a2-3e26-42c4-be99-e736602b42bb, queue=awx_private_queue) [2021-11-02 10:38:44,636: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(9c30a9a2-3e26-42c4-be99-e736602b42bb, queue=awx_private_queue) 2021-11-02 10:38:44,660 DEBUG awx.main.dispatch delivered 9c30a9a2-3e26-42c4-be99-e736602b42bb to worker[181] qsize 0 2021-11-02 10:38:44,664 DEBUG awx.main.dispatch task 9c30a9a2-3e26-42c4-be99-e736602b42bb starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:38:44,674 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:38:44,677 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:38:14.669723+00:00 2021-11-02 10:38:44,731 DEBUG awx.main.dispatch task 9c30a9a2-3e26-42c4-be99-e736602b42bb is finished 2021-11-02 10:38:55,057 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7d866a11-200b-498a-b26a-b0bfb613230f, queue=awx_private_queue) [2021-11-02 10:38:55,057: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7d866a11-200b-498a-b26a-b0bfb613230f, queue=awx_private_queue) 2021-11-02 10:38:55,079 DEBUG awx.main.dispatch delivered 7d866a11-200b-498a-b26a-b0bfb613230f to worker[176] qsize 0 2021-11-02 10:38:55,082 DEBUG awx.main.dispatch task 7d866a11-200b-498a-b26a-b0bfb613230f starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:38:55,084 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:38:55,110 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:38:55,150 DEBUG awx.main.dispatch task 7d866a11-200b-498a-b26a-b0bfb613230f is finished RESULT 2 OKREADY 2021-11-02 10:39:14,296 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(dca47763-608c-4f59-a4fe-80c1431cbdae, queue=dev-awx-0) [2021-11-02 10:39:14,296: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(dca47763-608c-4f59-a4fe-80c1431cbdae, queue=dev-awx-0) 2021-11-02 10:39:14,337 DEBUG awx.main.dispatch delivered dca47763-608c-4f59-a4fe-80c1431cbdae to worker[176] qsize 0 2021-11-02 10:39:14,340 DEBUG awx.main.dispatch task dca47763-608c-4f59-a4fe-80c1431cbdae starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:39:14,343 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:39:14,370 DEBUG awx.main.dispatch task dca47763-608c-4f59-a4fe-80c1431cbdae is finished 2021-11-02 10:39:14,375 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(fb609194-ffdc-4968-a25b-e0d684287092, queue=dev-awx-0) [2021-11-02 10:39:14,375: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(fb609194-ffdc-4968-a25b-e0d684287092, queue=dev-awx-0) 2021-11-02 10:39:14,408 DEBUG awx.main.dispatch delivered fb609194-ffdc-4968-a25b-e0d684287092 to worker[181] qsize 0 2021-11-02 10:39:14,411 DEBUG awx.main.dispatch task fb609194-ffdc-4968-a25b-e0d684287092 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:39:14,426 DEBUG awx.main.dispatch task fb609194-ffdc-4968-a25b-e0d684287092 is finished 2021-11-02 10:39:14,635 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(f17d876d-b2ec-40f0-ac0a-378ac29ef82c, queue=awx_private_queue) [2021-11-02 10:39:14,635: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(f17d876d-b2ec-40f0-ac0a-378ac29ef82c, queue=awx_private_queue) 2021-11-02 10:39:14,657 DEBUG awx.main.dispatch delivered f17d876d-b2ec-40f0-ac0a-378ac29ef82c to worker[176] qsize 0 2021-11-02 10:39:14,659 DEBUG awx.main.dispatch task f17d876d-b2ec-40f0-ac0a-378ac29ef82c starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:39:14,669 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:39:14,672 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:38:44.674698+00:00 2021-11-02 10:39:14,684 DEBUG awx.main.dispatch task f17d876d-b2ec-40f0-ac0a-378ac29ef82c is finished 2021-11-02 10:39:15,056 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(2ed0210c-d23a-458c-aaa2-2f3f91f24d09, queue=awx_private_queue) [2021-11-02 10:39:15,056: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(2ed0210c-d23a-458c-aaa2-2f3f91f24d09, queue=awx_private_queue) 2021-11-02 10:39:15,072 DEBUG awx.main.dispatch delivered 2ed0210c-d23a-458c-aaa2-2f3f91f24d09 to worker[178] qsize 0 2021-11-02 10:39:15,075 DEBUG awx.main.dispatch task 2ed0210c-d23a-458c-aaa2-2f3f91f24d09 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:39:15,078 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:39:15,094 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:39:15,122 DEBUG awx.main.dispatch task 2ed0210c-d23a-458c-aaa2-2f3f91f24d09 is finished 2021-11-02 10:39:35,077 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(adab94d5-698a-4fcc-8e47-8f0fe1399ce0, queue=awx_private_queue) [2021-11-02 10:39:35,077: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(adab94d5-698a-4fcc-8e47-8f0fe1399ce0, queue=awx_private_queue) 2021-11-02 10:39:35,328 DEBUG awx.main.dispatch delivered adab94d5-698a-4fcc-8e47-8f0fe1399ce0 to worker[183] qsize 0 2021-11-02 10:39:35,339 DEBUG awx.main.dispatch task adab94d5-698a-4fcc-8e47-8f0fe1399ce0 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:39:35,346 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:39:35,376 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:39:35,420 DEBUG awx.main.dispatch task adab94d5-698a-4fcc-8e47-8f0fe1399ce0 is finished 2021-11-02 10:39:44,637 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(4d8af453-c8cd-49a9-bfee-8670429609a2, queue=awx_private_queue) [2021-11-02 10:39:44,637: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(4d8af453-c8cd-49a9-bfee-8670429609a2, queue=awx_private_queue) 2021-11-02 10:39:44,662 DEBUG awx.main.dispatch delivered 4d8af453-c8cd-49a9-bfee-8670429609a2 to worker[178] qsize 0 2021-11-02 10:39:44,672 DEBUG awx.main.dispatch task 4d8af453-c8cd-49a9-bfee-8670429609a2 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:39:44,689 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:39:44,694 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:39:14.669673+00:00 2021-11-02 10:39:44,754 DEBUG awx.main.dispatch task 4d8af453-c8cd-49a9-bfee-8670429609a2 is finished 2021-11-02 10:39:55,073 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(50210ade-eae9-41c7-b6f7-82b75ef678fa, queue=awx_private_queue) [2021-11-02 10:39:55,073: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(50210ade-eae9-41c7-b6f7-82b75ef678fa, queue=awx_private_queue) 2021-11-02 10:39:55,092 DEBUG awx.main.dispatch delivered 50210ade-eae9-41c7-b6f7-82b75ef678fa to worker[178] qsize 0 2021-11-02 10:39:55,099 DEBUG awx.main.dispatch task 50210ade-eae9-41c7-b6f7-82b75ef678fa starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:39:55,101 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:39:55,120 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:39:55,148 DEBUG awx.main.dispatch task 50210ade-eae9-41c7-b6f7-82b75ef678fa is finished RESULT 2 OKREADY 2021-11-02 10:40:14,297 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(15aaff6e-82f1-4691-8c20-e9c1304e4072, queue=dev-awx-0) [2021-11-02 10:40:14,297: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(15aaff6e-82f1-4691-8c20-e9c1304e4072, queue=dev-awx-0) 2021-11-02 10:40:14,341 DEBUG awx.main.dispatch delivered 15aaff6e-82f1-4691-8c20-e9c1304e4072 to worker[178] qsize 0 2021-11-02 10:40:14,344 DEBUG awx.main.dispatch task 15aaff6e-82f1-4691-8c20-e9c1304e4072 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:40:14,346 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:40:14,374 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(c32ec780-0f3f-4396-b810-48a300946da0, queue=dev-awx-0) [2021-11-02 10:40:14,374: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(c32ec780-0f3f-4396-b810-48a300946da0, queue=dev-awx-0) 2021-11-02 10:40:14,391 DEBUG awx.main.dispatch delivered c32ec780-0f3f-4396-b810-48a300946da0 to worker[181] qsize 0 2021-11-02 10:40:14,398 DEBUG awx.main.dispatch task c32ec780-0f3f-4396-b810-48a300946da0 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:40:14,426 DEBUG awx.main.dispatch task c32ec780-0f3f-4396-b810-48a300946da0 is finished 2021-11-02 10:40:14,457 DEBUG awx.main.dispatch task 15aaff6e-82f1-4691-8c20-e9c1304e4072 is finished 2021-11-02 10:40:14,635 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(19bb9f77-4574-40ea-9e98-4f69eda0554c, queue=awx_private_queue) [2021-11-02 10:40:14,635: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(19bb9f77-4574-40ea-9e98-4f69eda0554c, queue=awx_private_queue) 2021-11-02 10:40:14,651 DEBUG awx.main.dispatch delivered 19bb9f77-4574-40ea-9e98-4f69eda0554c to worker[181] qsize 0 2021-11-02 10:40:14,654 DEBUG awx.main.dispatch task 19bb9f77-4574-40ea-9e98-4f69eda0554c starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:40:14,663 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:40:14,666 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:39:44.690115+00:00 2021-11-02 10:40:14,704 DEBUG awx.main.dispatch task 19bb9f77-4574-40ea-9e98-4f69eda0554c is finished 2021-11-02 10:40:15,073 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c88fd41f-238c-480c-a4fd-b84c98b84cf7, queue=awx_private_queue) [2021-11-02 10:40:15,073: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c88fd41f-238c-480c-a4fd-b84c98b84cf7, queue=awx_private_queue) 2021-11-02 10:40:15,090 DEBUG awx.main.dispatch delivered c88fd41f-238c-480c-a4fd-b84c98b84cf7 to worker[176] qsize 0 2021-11-02 10:40:15,095 DEBUG awx.main.dispatch task c88fd41f-238c-480c-a4fd-b84c98b84cf7 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:40:15,102 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:40:15,127 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:40:15,160 DEBUG awx.main.dispatch task c88fd41f-238c-480c-a4fd-b84c98b84cf7 is finished 2021-11-02 10:40:35,083 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(765ae7fb-810f-4702-a1ab-46b0206636fa, queue=awx_private_queue) [2021-11-02 10:40:35,083: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(765ae7fb-810f-4702-a1ab-46b0206636fa, queue=awx_private_queue) 2021-11-02 10:40:35,099 DEBUG awx.main.dispatch delivered 765ae7fb-810f-4702-a1ab-46b0206636fa to worker[181] qsize 0 2021-11-02 10:40:35,108 DEBUG awx.main.dispatch task 765ae7fb-810f-4702-a1ab-46b0206636fa starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:40:35,109 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:40:35,124 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:40:35,159 DEBUG awx.main.dispatch task 765ae7fb-810f-4702-a1ab-46b0206636fa is finished 2021-11-02 10:40:44,635 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(07d34d0e-1ed2-45e1-8284-10329391899e, queue=awx_private_queue) [2021-11-02 10:40:44,635: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(07d34d0e-1ed2-45e1-8284-10329391899e, queue=awx_private_queue) 2021-11-02 10:40:44,652 DEBUG awx.main.dispatch delivered 07d34d0e-1ed2-45e1-8284-10329391899e to worker[181] qsize 0 2021-11-02 10:40:44,655 DEBUG awx.main.dispatch task 07d34d0e-1ed2-45e1-8284-10329391899e starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:40:44,667 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:40:44,670 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:40:14.663555+00:00 2021-11-02 10:40:44,716 DEBUG awx.main.dispatch task 07d34d0e-1ed2-45e1-8284-10329391899e is finished 2021-11-02 10:40:55,085 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(9e0ee30b-f452-4914-a05d-e59d1f8d1c29, queue=awx_private_queue) [2021-11-02 10:40:55,085: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(9e0ee30b-f452-4914-a05d-e59d1f8d1c29, queue=awx_private_queue) 2021-11-02 10:40:55,114 DEBUG awx.main.dispatch delivered 9e0ee30b-f452-4914-a05d-e59d1f8d1c29 to worker[178] qsize 0 2021-11-02 10:40:55,326 DEBUG awx.main.dispatch task 9e0ee30b-f452-4914-a05d-e59d1f8d1c29 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:40:55,330 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:40:55,351 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:40:55,382 DEBUG awx.main.dispatch task 9e0ee30b-f452-4914-a05d-e59d1f8d1c29 is finished RESULT 2 OKREADY 2021-11-02 10:41:14,313 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(8c82f831-05ba-4a4c-b467-a20b2584be0f, queue=dev-awx-0) [2021-11-02 10:41:14,313: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(8c82f831-05ba-4a4c-b467-a20b2584be0f, queue=dev-awx-0) 2021-11-02 10:41:14,373 DEBUG awx.main.dispatch delivered 8c82f831-05ba-4a4c-b467-a20b2584be0f to worker[178] qsize 0 2021-11-02 10:41:14,375 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(db7d6a32-86db-473d-acd8-cdb740c4f8e1, queue=dev-awx-0) [2021-11-02 10:41:14,375: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(db7d6a32-86db-473d-acd8-cdb740c4f8e1, queue=dev-awx-0) 2021-11-02 10:41:14,377 DEBUG awx.main.dispatch task 8c82f831-05ba-4a4c-b467-a20b2584be0f starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:41:14,379 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:41:14,399 DEBUG awx.main.dispatch delivered db7d6a32-86db-473d-acd8-cdb740c4f8e1 to worker[176] qsize 0 2021-11-02 10:41:14,405 DEBUG awx.main.dispatch task db7d6a32-86db-473d-acd8-cdb740c4f8e1 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:41:14,428 DEBUG awx.main.dispatch task db7d6a32-86db-473d-acd8-cdb740c4f8e1 is finished 2021-11-02 10:41:14,434 DEBUG awx.main.dispatch task 8c82f831-05ba-4a4c-b467-a20b2584be0f is finished 2021-11-02 10:41:14,636 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(beec645f-210d-49d1-a46f-62ab8580bdeb, queue=awx_private_queue) [2021-11-02 10:41:14,636: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(beec645f-210d-49d1-a46f-62ab8580bdeb, queue=awx_private_queue) 2021-11-02 10:41:14,660 DEBUG awx.main.dispatch delivered beec645f-210d-49d1-a46f-62ab8580bdeb to worker[181] qsize 0 2021-11-02 10:41:14,665 DEBUG awx.main.dispatch task beec645f-210d-49d1-a46f-62ab8580bdeb starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:41:14,681 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:41:14,686 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:40:44.667605+00:00 2021-11-02 10:41:14,703 DEBUG awx.main.dispatch task beec645f-210d-49d1-a46f-62ab8580bdeb is finished 2021-11-02 10:41:15,084 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(85d20d72-2018-49c9-812e-8e10ac4a2801, queue=awx_private_queue) [2021-11-02 10:41:15,084: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(85d20d72-2018-49c9-812e-8e10ac4a2801, queue=awx_private_queue) 2021-11-02 10:41:15,119 DEBUG awx.main.dispatch delivered 85d20d72-2018-49c9-812e-8e10ac4a2801 to worker[183] qsize 0 2021-11-02 10:41:15,123 DEBUG awx.main.dispatch task 85d20d72-2018-49c9-812e-8e10ac4a2801 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:41:15,128 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:41:15,148 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:41:15,177 DEBUG awx.main.dispatch task 85d20d72-2018-49c9-812e-8e10ac4a2801 is finished 2021-11-02 10:41:35,089 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3b02ca44-f96d-442a-9343-64a4762e08d0, queue=awx_private_queue) [2021-11-02 10:41:35,089: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3b02ca44-f96d-442a-9343-64a4762e08d0, queue=awx_private_queue) 2021-11-02 10:41:35,105 DEBUG awx.main.dispatch delivered 3b02ca44-f96d-442a-9343-64a4762e08d0 to worker[178] qsize 0 2021-11-02 10:41:35,108 DEBUG awx.main.dispatch task 3b02ca44-f96d-442a-9343-64a4762e08d0 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:41:35,110 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:41:35,127 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:41:35,158 DEBUG awx.main.dispatch task 3b02ca44-f96d-442a-9343-64a4762e08d0 is finished 2021-11-02 10:41:44,635 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(ed4ea426-73a1-4ff8-b450-84c786dc555d, queue=awx_private_queue) [2021-11-02 10:41:44,635: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(ed4ea426-73a1-4ff8-b450-84c786dc555d, queue=awx_private_queue) 2021-11-02 10:41:44,654 DEBUG awx.main.dispatch delivered ed4ea426-73a1-4ff8-b450-84c786dc555d to worker[181] qsize 0 2021-11-02 10:41:44,657 DEBUG awx.main.dispatch task ed4ea426-73a1-4ff8-b450-84c786dc555d starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:41:44,669 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:41:44,671 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:41:14.681696+00:00 2021-11-02 10:41:44,719 DEBUG awx.main.dispatch task ed4ea426-73a1-4ff8-b450-84c786dc555d is finished 2021-11-02 10:41:55,089 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0d7caa7a-7205-4128-b631-9e84363547f6, queue=awx_private_queue) [2021-11-02 10:41:55,089: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0d7caa7a-7205-4128-b631-9e84363547f6, queue=awx_private_queue) 2021-11-02 10:41:55,113 DEBUG awx.main.dispatch delivered 0d7caa7a-7205-4128-b631-9e84363547f6 to worker[176] qsize 0 2021-11-02 10:41:55,116 DEBUG awx.main.dispatch task 0d7caa7a-7205-4128-b631-9e84363547f6 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:41:55,119 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:41:55,140 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:41:55,182 DEBUG awx.main.dispatch task 0d7caa7a-7205-4128-b631-9e84363547f6 is finished RESULT 2 OKREADY 2021-11-02 10:42:14,318 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(f7b7ccd6-1097-43f3-8486-6288b3cdf51e, queue=dev-awx-0) [2021-11-02 10:42:14,318: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(f7b7ccd6-1097-43f3-8486-6288b3cdf51e, queue=dev-awx-0) 2021-11-02 10:42:14,375 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(044ed667-e56c-4432-abab-b7fcca547669, queue=dev-awx-0) [2021-11-02 10:42:14,375: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(044ed667-e56c-4432-abab-b7fcca547669, queue=dev-awx-0) 2021-11-02 10:42:14,365 DEBUG awx.main.dispatch delivered f7b7ccd6-1097-43f3-8486-6288b3cdf51e to worker[176] qsize 0 2021-11-02 10:42:14,562 DEBUG awx.main.dispatch delivered 044ed667-e56c-4432-abab-b7fcca547669 to worker[181] qsize 0 2021-11-02 10:42:14,563 DEBUG awx.main.dispatch task f7b7ccd6-1097-43f3-8486-6288b3cdf51e starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:42:14,566 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:42:14,565 DEBUG awx.main.dispatch task 044ed667-e56c-4432-abab-b7fcca547669 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:42:14,579 DEBUG awx.main.dispatch task 044ed667-e56c-4432-abab-b7fcca547669 is finished 2021-11-02 10:42:14,609 DEBUG awx.main.dispatch task f7b7ccd6-1097-43f3-8486-6288b3cdf51e is finished 2021-11-02 10:42:14,636 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(a89b39ad-a93e-400b-a2b9-de348a0645f3, queue=awx_private_queue) [2021-11-02 10:42:14,636: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(a89b39ad-a93e-400b-a2b9-de348a0645f3, queue=awx_private_queue) 2021-11-02 10:42:14,660 DEBUG awx.main.dispatch delivered a89b39ad-a93e-400b-a2b9-de348a0645f3 to worker[181] qsize 0 2021-11-02 10:42:14,664 DEBUG awx.main.dispatch task a89b39ad-a93e-400b-a2b9-de348a0645f3 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:42:14,674 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:42:14,679 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:41:44.669198+00:00 2021-11-02 10:42:14,698 DEBUG awx.main.dispatch task a89b39ad-a93e-400b-a2b9-de348a0645f3 is finished 2021-11-02 10:42:15,089 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0447393f-2934-4a34-8f47-4377d0644d28, queue=awx_private_queue) [2021-11-02 10:42:15,089: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0447393f-2934-4a34-8f47-4377d0644d28, queue=awx_private_queue) 2021-11-02 10:42:15,106 DEBUG awx.main.dispatch delivered 0447393f-2934-4a34-8f47-4377d0644d28 to worker[176] qsize 0 2021-11-02 10:42:15,108 DEBUG awx.main.dispatch task 0447393f-2934-4a34-8f47-4377d0644d28 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:42:15,110 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:42:15,127 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:42:15,160 DEBUG awx.main.dispatch task 0447393f-2934-4a34-8f47-4377d0644d28 is finished 2021-11-02 10:42:35,090 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0b5cf4ba-7142-4a06-84bb-313c019a2ae7, queue=awx_private_queue) [2021-11-02 10:42:35,090: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0b5cf4ba-7142-4a06-84bb-313c019a2ae7, queue=awx_private_queue) 2021-11-02 10:42:35,130 DEBUG awx.main.dispatch delivered 0b5cf4ba-7142-4a06-84bb-313c019a2ae7 to worker[181] qsize 0 2021-11-02 10:42:35,134 DEBUG awx.main.dispatch task 0b5cf4ba-7142-4a06-84bb-313c019a2ae7 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:42:35,135 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:42:35,151 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:42:35,180 DEBUG awx.main.dispatch task 0b5cf4ba-7142-4a06-84bb-313c019a2ae7 is finished 2021-11-02 10:42:44,642 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(b51bc1ec-6a3f-44c5-b1f6-608060cdd46b, queue=awx_private_queue) [2021-11-02 10:42:44,642: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(b51bc1ec-6a3f-44c5-b1f6-608060cdd46b, queue=awx_private_queue) 2021-11-02 10:42:44,679 DEBUG awx.main.dispatch delivered b51bc1ec-6a3f-44c5-b1f6-608060cdd46b to worker[181] qsize 0 2021-11-02 10:42:44,688 DEBUG awx.main.dispatch task b51bc1ec-6a3f-44c5-b1f6-608060cdd46b starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:42:44,703 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:42:44,708 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:42:14.675061+00:00 2021-11-02 10:42:44,763 DEBUG awx.main.dispatch task b51bc1ec-6a3f-44c5-b1f6-608060cdd46b is finished 2021-11-02 10:42:55,098 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6a18e593-3eae-4858-b56c-1548df670c5e, queue=awx_private_queue) [2021-11-02 10:42:55,098: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6a18e593-3eae-4858-b56c-1548df670c5e, queue=awx_private_queue) 2021-11-02 10:42:55,134 DEBUG awx.main.dispatch delivered 6a18e593-3eae-4858-b56c-1548df670c5e to worker[176] qsize 0 2021-11-02 10:42:55,139 DEBUG awx.main.dispatch task 6a18e593-3eae-4858-b56c-1548df670c5e starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:42:55,145 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:42:55,169 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:42:55,200 DEBUG awx.main.dispatch task 6a18e593-3eae-4858-b56c-1548df670c5e is finished RESULT 2 OKREADY 2021-11-02 10:43:14,321 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(d2415237-f4c7-45e3-8af5-48efdac3682a, queue=dev-awx-0) [2021-11-02 10:43:14,321: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(d2415237-f4c7-45e3-8af5-48efdac3682a, queue=dev-awx-0) 2021-11-02 10:43:14,391 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(baffa647-733b-4156-8fd4-35e333f123c3, queue=dev-awx-0) [2021-11-02 10:43:14,391: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(baffa647-733b-4156-8fd4-35e333f123c3, queue=dev-awx-0) 2021-11-02 10:43:14,415 DEBUG awx.main.dispatch delivered d2415237-f4c7-45e3-8af5-48efdac3682a to worker[178] qsize 0 2021-11-02 10:43:14,617 DEBUG awx.main.dispatch delivered baffa647-733b-4156-8fd4-35e333f123c3 to worker[183] qsize 0 2021-11-02 10:43:14,619 DEBUG awx.main.dispatch task d2415237-f4c7-45e3-8af5-48efdac3682a starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:43:14,626 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:43:14,622 DEBUG awx.main.dispatch task baffa647-733b-4156-8fd4-35e333f123c3 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:43:14,636 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(b15ae5fe-69d5-4783-bd6f-657e31448f10, queue=awx_private_queue) [2021-11-02 10:43:14,636: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(b15ae5fe-69d5-4783-bd6f-657e31448f10, queue=awx_private_queue) 2021-11-02 10:43:14,649 DEBUG awx.main.dispatch task baffa647-733b-4156-8fd4-35e333f123c3 is finished 2021-11-02 10:43:14,656 DEBUG awx.main.dispatch delivered b15ae5fe-69d5-4783-bd6f-657e31448f10 to worker[176] qsize 0 2021-11-02 10:43:14,658 DEBUG awx.main.dispatch task b15ae5fe-69d5-4783-bd6f-657e31448f10 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:43:14,669 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:43:14,673 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:42:44.703284+00:00 2021-11-02 10:43:14,774 DEBUG awx.main.dispatch task d2415237-f4c7-45e3-8af5-48efdac3682a is finished 2021-11-02 10:43:14,800 DEBUG awx.main.dispatch task b15ae5fe-69d5-4783-bd6f-657e31448f10 is finished 2021-11-02 10:43:15,098 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(edac121d-df37-44f9-9c63-c902eb290ae9, queue=awx_private_queue) [2021-11-02 10:43:15,098: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(edac121d-df37-44f9-9c63-c902eb290ae9, queue=awx_private_queue) 2021-11-02 10:43:15,121 DEBUG awx.main.dispatch delivered edac121d-df37-44f9-9c63-c902eb290ae9 to worker[178] qsize 0 2021-11-02 10:43:15,124 DEBUG awx.main.dispatch task edac121d-df37-44f9-9c63-c902eb290ae9 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:43:15,126 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:43:15,144 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:43:15,176 DEBUG awx.main.dispatch task edac121d-df37-44f9-9c63-c902eb290ae9 is finished 2021-11-02 10:43:35,098 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(8a744d96-1b17-478b-ad4f-6c99e5c15c56, queue=awx_private_queue) [2021-11-02 10:43:35,098: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(8a744d96-1b17-478b-ad4f-6c99e5c15c56, queue=awx_private_queue) 2021-11-02 10:43:35,125 DEBUG awx.main.dispatch delivered 8a744d96-1b17-478b-ad4f-6c99e5c15c56 to worker[178] qsize 0 2021-11-02 10:43:35,128 DEBUG awx.main.dispatch task 8a744d96-1b17-478b-ad4f-6c99e5c15c56 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:43:35,130 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:43:35,148 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:43:35,177 DEBUG awx.main.dispatch task 8a744d96-1b17-478b-ad4f-6c99e5c15c56 is finished 2021-11-02 10:43:44,636 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(e68739ed-4c29-4a3f-b5de-1d6571396d5a, queue=awx_private_queue) [2021-11-02 10:43:44,636: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(e68739ed-4c29-4a3f-b5de-1d6571396d5a, queue=awx_private_queue) 2021-11-02 10:43:44,651 DEBUG awx.main.dispatch delivered e68739ed-4c29-4a3f-b5de-1d6571396d5a to worker[181] qsize 0 2021-11-02 10:43:44,654 DEBUG awx.main.dispatch task e68739ed-4c29-4a3f-b5de-1d6571396d5a starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:43:44,667 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:43:44,671 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:43:14.670011+00:00 2021-11-02 10:43:46,048 DEBUG awx.main.dispatch task e68739ed-4c29-4a3f-b5de-1d6571396d5a is finished 2021-11-02 10:43:55,099 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(1fd30dc1-c5d8-49bc-bb4d-981160437790, queue=awx_private_queue) [2021-11-02 10:43:55,099: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(1fd30dc1-c5d8-49bc-bb4d-981160437790, queue=awx_private_queue) 2021-11-02 10:43:55,116 DEBUG awx.main.dispatch delivered 1fd30dc1-c5d8-49bc-bb4d-981160437790 to worker[178] qsize 0 2021-11-02 10:43:55,118 DEBUG awx.main.dispatch task 1fd30dc1-c5d8-49bc-bb4d-981160437790 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:43:55,120 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:43:55,142 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:43:55,176 DEBUG awx.main.dispatch task 1fd30dc1-c5d8-49bc-bb4d-981160437790 is finished RESULT 2 OKREADY 2021-11-02 10:44:14,336 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(4828ddce-45e8-4e18-a385-2d69aa7f0d5f, queue=dev-awx-0) [2021-11-02 10:44:14,336: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(4828ddce-45e8-4e18-a385-2d69aa7f0d5f, queue=dev-awx-0) 2021-11-02 10:44:14,389 DEBUG awx.main.dispatch delivered 4828ddce-45e8-4e18-a385-2d69aa7f0d5f to worker[178] qsize 0 2021-11-02 10:44:14,392 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(da7c7bf8-0de9-466c-aac4-8678e4c1474a, queue=dev-awx-0) [2021-11-02 10:44:14,392: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(da7c7bf8-0de9-466c-aac4-8678e4c1474a, queue=dev-awx-0) 2021-11-02 10:44:14,406 DEBUG awx.main.dispatch task 4828ddce-45e8-4e18-a385-2d69aa7f0d5f starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:44:14,421 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:44:14,604 DEBUG awx.main.dispatch task 4828ddce-45e8-4e18-a385-2d69aa7f0d5f is finished 2021-11-02 10:44:14,426 DEBUG awx.main.dispatch delivered da7c7bf8-0de9-466c-aac4-8678e4c1474a to worker[181] qsize 0 2021-11-02 10:44:14,633 DEBUG awx.main.dispatch task da7c7bf8-0de9-466c-aac4-8678e4c1474a starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:44:14,636 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(401cb385-1751-41af-b0c2-4417517c05b2, queue=awx_private_queue) [2021-11-02 10:44:14,636: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(401cb385-1751-41af-b0c2-4417517c05b2, queue=awx_private_queue) 2021-11-02 10:44:14,651 DEBUG awx.main.dispatch delivered 401cb385-1751-41af-b0c2-4417517c05b2 to worker[176] qsize 0 2021-11-02 10:44:14,653 DEBUG awx.main.dispatch task da7c7bf8-0de9-466c-aac4-8678e4c1474a is finished 2021-11-02 10:44:14,654 DEBUG awx.main.dispatch task 401cb385-1751-41af-b0c2-4417517c05b2 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:44:14,668 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:44:14,673 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:43:44.668140+00:00 2021-11-02 10:44:15,099 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(07481be4-df22-4db3-897a-40d0b91095d7, queue=awx_private_queue) [2021-11-02 10:44:15,099: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(07481be4-df22-4db3-897a-40d0b91095d7, queue=awx_private_queue) 2021-11-02 10:44:15,114 DEBUG awx.main.dispatch delivered 07481be4-df22-4db3-897a-40d0b91095d7 to worker[181] qsize 0 2021-11-02 10:44:15,117 DEBUG awx.main.dispatch task 07481be4-df22-4db3-897a-40d0b91095d7 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:44:15,119 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:44:15,138 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:44:15,176 DEBUG awx.main.dispatch task 07481be4-df22-4db3-897a-40d0b91095d7 is finished 2021-11-02 10:44:15,407 DEBUG awx.main.dispatch task 401cb385-1751-41af-b0c2-4417517c05b2 is finished 2021-11-02 10:44:35,105 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(09ea6572-46b3-46f7-95b4-e28ab9b9b35e, queue=awx_private_queue) [2021-11-02 10:44:35,105: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(09ea6572-46b3-46f7-95b4-e28ab9b9b35e, queue=awx_private_queue) 2021-11-02 10:44:35,130 DEBUG awx.main.dispatch delivered 09ea6572-46b3-46f7-95b4-e28ab9b9b35e to worker[176] qsize 0 2021-11-02 10:44:35,133 DEBUG awx.main.dispatch task 09ea6572-46b3-46f7-95b4-e28ab9b9b35e starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:44:35,136 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:44:35,159 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:44:35,194 DEBUG awx.main.dispatch task 09ea6572-46b3-46f7-95b4-e28ab9b9b35e is finished 2021-11-02 10:44:44,636 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(1aab28b3-07b2-4ea5-85f8-d9d6e077e13f, queue=awx_private_queue) [2021-11-02 10:44:44,636: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(1aab28b3-07b2-4ea5-85f8-d9d6e077e13f, queue=awx_private_queue) 2021-11-02 10:44:44,655 DEBUG awx.main.dispatch delivered 1aab28b3-07b2-4ea5-85f8-d9d6e077e13f to worker[178] qsize 0 2021-11-02 10:44:44,658 DEBUG awx.main.dispatch task 1aab28b3-07b2-4ea5-85f8-d9d6e077e13f starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:44:44,671 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:44:44,674 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:44:14.669083+00:00 2021-11-02 10:44:44,755 DEBUG awx.main.dispatch task 1aab28b3-07b2-4ea5-85f8-d9d6e077e13f is finished 2021-11-02 10:44:55,105 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(1a489a3b-8a3d-4973-acb7-5a9944d36b13, queue=awx_private_queue) [2021-11-02 10:44:55,105: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(1a489a3b-8a3d-4973-acb7-5a9944d36b13, queue=awx_private_queue) 2021-11-02 10:44:55,119 DEBUG awx.main.dispatch delivered 1a489a3b-8a3d-4973-acb7-5a9944d36b13 to worker[176] qsize 0 2021-11-02 10:44:55,122 DEBUG awx.main.dispatch task 1a489a3b-8a3d-4973-acb7-5a9944d36b13 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:44:55,124 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:44:55,142 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:44:55,176 DEBUG awx.main.dispatch task 1a489a3b-8a3d-4973-acb7-5a9944d36b13 is finished RESULT 2 OKREADY 2021-11-02 10:45:14,342 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(9ff04cf4-75f9-462a-a0af-4227cf082ed8, queue=dev-awx-0) [2021-11-02 10:45:14,342: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(9ff04cf4-75f9-462a-a0af-4227cf082ed8, queue=dev-awx-0) 2021-11-02 10:45:14,380 DEBUG awx.main.dispatch delivered 9ff04cf4-75f9-462a-a0af-4227cf082ed8 to worker[178] qsize 0 2021-11-02 10:45:14,383 DEBUG awx.main.dispatch task 9ff04cf4-75f9-462a-a0af-4227cf082ed8 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:45:14,384 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:45:14,391 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(bcb90f08-6160-496a-8f42-fe25f69746ee, queue=dev-awx-0) [2021-11-02 10:45:14,391: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(bcb90f08-6160-496a-8f42-fe25f69746ee, queue=dev-awx-0) 2021-11-02 10:45:14,407 DEBUG awx.main.dispatch delivered bcb90f08-6160-496a-8f42-fe25f69746ee to worker[183] qsize 0 2021-11-02 10:45:14,411 DEBUG awx.main.dispatch task bcb90f08-6160-496a-8f42-fe25f69746ee starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:45:14,432 DEBUG awx.main.dispatch task bcb90f08-6160-496a-8f42-fe25f69746ee is finished 2021-11-02 10:45:14,511 DEBUG awx.main.dispatch task 9ff04cf4-75f9-462a-a0af-4227cf082ed8 is finished 2021-11-02 10:45:14,636 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(df62837b-465f-4a0c-b207-a7014519e674, queue=awx_private_queue) [2021-11-02 10:45:14,636: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(df62837b-465f-4a0c-b207-a7014519e674, queue=awx_private_queue) 2021-11-02 10:45:14,654 DEBUG awx.main.dispatch delivered df62837b-465f-4a0c-b207-a7014519e674 to worker[183] qsize 0 2021-11-02 10:45:14,845 DEBUG awx.main.dispatch task df62837b-465f-4a0c-b207-a7014519e674 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:45:14,856 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:45:14,859 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:44:44.671484+00:00 2021-11-02 10:45:14,877 DEBUG awx.main.dispatch task df62837b-465f-4a0c-b207-a7014519e674 is finished 2021-11-02 10:45:15,105 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ca443cdf-d741-4809-8aa5-8c774db109c0, queue=awx_private_queue) [2021-11-02 10:45:15,105: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ca443cdf-d741-4809-8aa5-8c774db109c0, queue=awx_private_queue) 2021-11-02 10:45:15,125 DEBUG awx.main.dispatch delivered ca443cdf-d741-4809-8aa5-8c774db109c0 to worker[183] qsize 0 2021-11-02 10:45:15,128 DEBUG awx.main.dispatch task ca443cdf-d741-4809-8aa5-8c774db109c0 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:45:15,129 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:45:15,148 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:45:15,186 DEBUG awx.main.dispatch task ca443cdf-d741-4809-8aa5-8c774db109c0 is finished 2021-11-02 10:45:35,116 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e2226e1d-9bda-432f-b9fc-454f53d1c6dd, queue=awx_private_queue) [2021-11-02 10:45:35,116: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e2226e1d-9bda-432f-b9fc-454f53d1c6dd, queue=awx_private_queue) 2021-11-02 10:45:35,148 DEBUG awx.main.dispatch delivered e2226e1d-9bda-432f-b9fc-454f53d1c6dd to worker[181] qsize 0 2021-11-02 10:45:35,150 DEBUG awx.main.dispatch task e2226e1d-9bda-432f-b9fc-454f53d1c6dd starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:45:35,153 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:45:35,171 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:45:35,194 DEBUG awx.main.dispatch task e2226e1d-9bda-432f-b9fc-454f53d1c6dd is finished 2021-11-02 10:45:44,636 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(aec700cd-7cba-42e6-ac33-1f8cec1141aa, queue=awx_private_queue) [2021-11-02 10:45:44,636: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(aec700cd-7cba-42e6-ac33-1f8cec1141aa, queue=awx_private_queue) 2021-11-02 10:45:44,655 DEBUG awx.main.dispatch delivered aec700cd-7cba-42e6-ac33-1f8cec1141aa to worker[183] qsize 0 2021-11-02 10:45:44,658 DEBUG awx.main.dispatch task aec700cd-7cba-42e6-ac33-1f8cec1141aa starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:45:44,672 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:45:44,675 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:45:14.856319+00:00 2021-11-02 10:45:44,726 DEBUG awx.main.dispatch task aec700cd-7cba-42e6-ac33-1f8cec1141aa is finished 2021-11-02 10:45:55,121 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0606f634-4c8f-4137-9566-362d9d7a12bc, queue=awx_private_queue) [2021-11-02 10:45:55,121: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0606f634-4c8f-4137-9566-362d9d7a12bc, queue=awx_private_queue) 2021-11-02 10:45:55,149 DEBUG awx.main.dispatch delivered 0606f634-4c8f-4137-9566-362d9d7a12bc to worker[183] qsize 0 2021-11-02 10:45:55,157 DEBUG awx.main.dispatch task 0606f634-4c8f-4137-9566-362d9d7a12bc starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:45:55,162 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:45:55,186 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:45:55,221 DEBUG awx.main.dispatch task 0606f634-4c8f-4137-9566-362d9d7a12bc is finished RESULT 2 OKREADY 2021-11-02 10:46:14,355 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(740f79e7-5ef1-4a28-996c-c50c29137b12, queue=dev-awx-0) [2021-11-02 10:46:14,355: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(740f79e7-5ef1-4a28-996c-c50c29137b12, queue=dev-awx-0) 2021-11-02 10:46:14,392 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(c7fa94e6-6f4a-4b51-a32d-ba006f04c563, queue=dev-awx-0) [2021-11-02 10:46:14,392: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(c7fa94e6-6f4a-4b51-a32d-ba006f04c563, queue=dev-awx-0) 2021-11-02 10:46:14,405 DEBUG awx.main.dispatch delivered 740f79e7-5ef1-4a28-996c-c50c29137b12 to worker[178] qsize 0 2021-11-02 10:46:14,411 DEBUG awx.main.dispatch task 740f79e7-5ef1-4a28-996c-c50c29137b12 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:46:14,418 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:46:14,437 DEBUG awx.main.dispatch delivered c7fa94e6-6f4a-4b51-a32d-ba006f04c563 to worker[183] qsize 0 2021-11-02 10:46:14,439 DEBUG awx.main.dispatch task c7fa94e6-6f4a-4b51-a32d-ba006f04c563 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:46:14,454 DEBUG awx.main.dispatch task c7fa94e6-6f4a-4b51-a32d-ba006f04c563 is finished 2021-11-02 10:46:14,479 DEBUG awx.main.dispatch task 740f79e7-5ef1-4a28-996c-c50c29137b12 is finished 2021-11-02 10:46:14,637 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(97ace0b9-fa16-49dd-8205-6c07f1373dac, queue=awx_private_queue) [2021-11-02 10:46:14,637: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(97ace0b9-fa16-49dd-8205-6c07f1373dac, queue=awx_private_queue) 2021-11-02 10:46:14,685 DEBUG awx.main.dispatch delivered 97ace0b9-fa16-49dd-8205-6c07f1373dac to worker[183] qsize 0 2021-11-02 10:46:14,891 DEBUG awx.main.dispatch task 97ace0b9-fa16-49dd-8205-6c07f1373dac starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:46:14,900 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:46:14,902 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:45:44.672427+00:00 2021-11-02 10:46:14,915 DEBUG awx.main.dispatch task 97ace0b9-fa16-49dd-8205-6c07f1373dac is finished 2021-11-02 10:46:15,118 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6ca2c5a3-ff5a-4650-b22c-3dfe94e90c50, queue=awx_private_queue) [2021-11-02 10:46:15,118: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6ca2c5a3-ff5a-4650-b22c-3dfe94e90c50, queue=awx_private_queue) 2021-11-02 10:46:15,138 DEBUG awx.main.dispatch delivered 6ca2c5a3-ff5a-4650-b22c-3dfe94e90c50 to worker[178] qsize 0 2021-11-02 10:46:15,140 DEBUG awx.main.dispatch task 6ca2c5a3-ff5a-4650-b22c-3dfe94e90c50 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:46:15,142 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:46:15,160 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:46:15,190 DEBUG awx.main.dispatch task 6ca2c5a3-ff5a-4650-b22c-3dfe94e90c50 is finished 2021-11-02 10:46:35,126 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(176ed7fa-275a-42db-bad2-46d9d09fa706, queue=awx_private_queue) [2021-11-02 10:46:35,126: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(176ed7fa-275a-42db-bad2-46d9d09fa706, queue=awx_private_queue) 2021-11-02 10:46:35,142 DEBUG awx.main.dispatch delivered 176ed7fa-275a-42db-bad2-46d9d09fa706 to worker[176] qsize 0 2021-11-02 10:46:35,146 DEBUG awx.main.dispatch task 176ed7fa-275a-42db-bad2-46d9d09fa706 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:46:35,151 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:46:35,175 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:46:35,205 DEBUG awx.main.dispatch task 176ed7fa-275a-42db-bad2-46d9d09fa706 is finished 2021-11-02 10:46:44,637 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(638fa100-264b-40fb-8015-53a5806d9ecd, queue=awx_private_queue) [2021-11-02 10:46:44,637: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(638fa100-264b-40fb-8015-53a5806d9ecd, queue=awx_private_queue) 2021-11-02 10:46:44,664 DEBUG awx.main.dispatch delivered 638fa100-264b-40fb-8015-53a5806d9ecd to worker[176] qsize 0 2021-11-02 10:46:44,667 DEBUG awx.main.dispatch task 638fa100-264b-40fb-8015-53a5806d9ecd starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:46:44,680 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:46:44,685 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:46:14.900251+00:00 2021-11-02 10:46:44,722 DEBUG awx.main.dispatch task 638fa100-264b-40fb-8015-53a5806d9ecd is finished 2021-11-02 10:46:55,127 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(2d0c6a84-01e5-40a2-a024-06ebc049019c, queue=awx_private_queue) [2021-11-02 10:46:55,127: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(2d0c6a84-01e5-40a2-a024-06ebc049019c, queue=awx_private_queue) 2021-11-02 10:46:55,151 DEBUG awx.main.dispatch delivered 2d0c6a84-01e5-40a2-a024-06ebc049019c to worker[178] qsize 0 2021-11-02 10:46:55,153 DEBUG awx.main.dispatch task 2d0c6a84-01e5-40a2-a024-06ebc049019c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:46:55,155 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:46:55,177 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:46:55,212 DEBUG awx.main.dispatch task 2d0c6a84-01e5-40a2-a024-06ebc049019c is finished RESULT 2 OKREADY 2021-11-02 10:47:14,353 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(4789d90a-c84a-430b-89ca-72212ff4282b, queue=dev-awx-0) [2021-11-02 10:47:14,353: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(4789d90a-c84a-430b-89ca-72212ff4282b, queue=dev-awx-0) 2021-11-02 10:47:14,390 DEBUG awx.main.dispatch delivered 4789d90a-c84a-430b-89ca-72212ff4282b to worker[178] qsize 0 2021-11-02 10:47:14,391 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(0c568e24-afab-460e-8044-59299809c6b1, queue=dev-awx-0) [2021-11-02 10:47:14,391: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(0c568e24-afab-460e-8044-59299809c6b1, queue=dev-awx-0) 2021-11-02 10:47:14,394 DEBUG awx.main.dispatch task 4789d90a-c84a-430b-89ca-72212ff4282b starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:47:14,395 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:47:14,405 DEBUG awx.main.dispatch delivered 0c568e24-afab-460e-8044-59299809c6b1 to worker[176] qsize 0 2021-11-02 10:47:14,407 DEBUG awx.main.dispatch task 0c568e24-afab-460e-8044-59299809c6b1 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:47:14,419 DEBUG awx.main.dispatch task 0c568e24-afab-460e-8044-59299809c6b1 is finished 2021-11-02 10:47:14,436 DEBUG awx.main.dispatch task 4789d90a-c84a-430b-89ca-72212ff4282b is finished 2021-11-02 10:47:14,637 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(57f0a357-e2be-4218-9081-5748ce9cb809, queue=awx_private_queue) [2021-11-02 10:47:14,637: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(57f0a357-e2be-4218-9081-5748ce9cb809, queue=awx_private_queue) 2021-11-02 10:47:14,672 DEBUG awx.main.dispatch delivered 57f0a357-e2be-4218-9081-5748ce9cb809 to worker[181] qsize 0 2021-11-02 10:47:14,678 DEBUG awx.main.dispatch task 57f0a357-e2be-4218-9081-5748ce9cb809 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:47:14,959 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:47:14,963 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:46:44.681113+00:00 2021-11-02 10:47:14,980 DEBUG awx.main.dispatch task 57f0a357-e2be-4218-9081-5748ce9cb809 is finished 2021-11-02 10:47:15,127 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(156b0872-bdb6-4d5e-a5cc-35c25a2caeeb, queue=awx_private_queue) [2021-11-02 10:47:15,127: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(156b0872-bdb6-4d5e-a5cc-35c25a2caeeb, queue=awx_private_queue) 2021-11-02 10:47:15,150 DEBUG awx.main.dispatch delivered 156b0872-bdb6-4d5e-a5cc-35c25a2caeeb to worker[176] qsize 0 2021-11-02 10:47:15,154 DEBUG awx.main.dispatch task 156b0872-bdb6-4d5e-a5cc-35c25a2caeeb starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:47:15,155 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:47:15,173 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:47:15,211 DEBUG awx.main.dispatch task 156b0872-bdb6-4d5e-a5cc-35c25a2caeeb is finished 2021-11-02 10:47:35,145 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e2b56426-5f76-4ad3-93bc-cda8a80ec6e9, queue=awx_private_queue) [2021-11-02 10:47:35,145: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e2b56426-5f76-4ad3-93bc-cda8a80ec6e9, queue=awx_private_queue) 2021-11-02 10:47:35,187 DEBUG awx.main.dispatch delivered e2b56426-5f76-4ad3-93bc-cda8a80ec6e9 to worker[178] qsize 0 2021-11-02 10:47:35,193 DEBUG awx.main.dispatch task e2b56426-5f76-4ad3-93bc-cda8a80ec6e9 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:47:35,198 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:47:35,223 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:47:35,261 DEBUG awx.main.dispatch task e2b56426-5f76-4ad3-93bc-cda8a80ec6e9 is finished 2021-11-02 10:47:44,642 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(5b760543-e985-4b46-9071-4527f817554e, queue=awx_private_queue) [2021-11-02 10:47:44,642: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(5b760543-e985-4b46-9071-4527f817554e, queue=awx_private_queue) 2021-11-02 10:47:44,675 DEBUG awx.main.dispatch delivered 5b760543-e985-4b46-9071-4527f817554e to worker[181] qsize 0 2021-11-02 10:47:44,683 DEBUG awx.main.dispatch task 5b760543-e985-4b46-9071-4527f817554e starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:47:44,701 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:47:44,707 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:47:14.960053+00:00 2021-11-02 10:47:44,761 DEBUG awx.main.dispatch task 5b760543-e985-4b46-9071-4527f817554e is finished 2021-11-02 10:47:55,141 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0647d2cf-67e3-41fa-91bb-a61f4dfda74c, queue=awx_private_queue) [2021-11-02 10:47:55,141: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0647d2cf-67e3-41fa-91bb-a61f4dfda74c, queue=awx_private_queue) 2021-11-02 10:47:55,160 DEBUG awx.main.dispatch delivered 0647d2cf-67e3-41fa-91bb-a61f4dfda74c to worker[183] qsize 0 2021-11-02 10:47:55,165 DEBUG awx.main.dispatch task 0647d2cf-67e3-41fa-91bb-a61f4dfda74c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:47:55,170 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:47:55,195 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:47:55,225 DEBUG awx.main.dispatch task 0647d2cf-67e3-41fa-91bb-a61f4dfda74c is finished RESULT 2 OKREADY 2021-11-02 10:48:13,994 DEBUG awx.main.dispatch publish awx.main.tasks.awx_isolated_heartbeat(233f36e4-e957-473e-9889-3858beb1aa68, queue=dev-awx-0) [2021-11-02 10:48:13,994: DEBUG/Process-1] publish awx.main.tasks.awx_isolated_heartbeat(233f36e4-e957-473e-9889-3858beb1aa68, queue=dev-awx-0) 2021-11-02 10:48:14,018 DEBUG awx.main.dispatch delivered 233f36e4-e957-473e-9889-3858beb1aa68 to worker[183] qsize 0 2021-11-02 10:48:14,022 DEBUG awx.main.dispatch task 233f36e4-e957-473e-9889-3858beb1aa68 starting awx.main.tasks.awx_isolated_heartbeat(*[]) 2021-11-02 10:48:14,025 DEBUG awx.main.tasks Controlling node checking for any isolated management tasks. 2021-11-02 10:48:14,049 DEBUG awx.main.dispatch task 233f36e4-e957-473e-9889-3858beb1aa68 is finished 2021-11-02 10:48:14,353 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(7751daa5-8c8f-4bc9-a827-5d812ba87ac3, queue=dev-awx-0) [2021-11-02 10:48:14,353: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(7751daa5-8c8f-4bc9-a827-5d812ba87ac3, queue=dev-awx-0) 2021-11-02 10:48:14,391 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(8bd608a7-1a1d-4dcf-879a-ac125079bbba, queue=dev-awx-0) [2021-11-02 10:48:14,391: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(8bd608a7-1a1d-4dcf-879a-ac125079bbba, queue=dev-awx-0) 2021-11-02 10:48:14,400 DEBUG awx.main.dispatch delivered 7751daa5-8c8f-4bc9-a827-5d812ba87ac3 to worker[178] qsize 0 2021-11-02 10:48:14,402 DEBUG awx.main.dispatch task 7751daa5-8c8f-4bc9-a827-5d812ba87ac3 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:48:14,405 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:48:14,413 DEBUG awx.main.dispatch delivered 8bd608a7-1a1d-4dcf-879a-ac125079bbba to worker[183] qsize 0 2021-11-02 10:48:14,415 DEBUG awx.main.dispatch task 8bd608a7-1a1d-4dcf-879a-ac125079bbba starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:48:14,430 DEBUG awx.main.dispatch task 8bd608a7-1a1d-4dcf-879a-ac125079bbba is finished 2021-11-02 10:48:14,457 DEBUG awx.main.dispatch task 7751daa5-8c8f-4bc9-a827-5d812ba87ac3 is finished 2021-11-02 10:48:14,638 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(f290bc80-d19c-450c-a456-9dd8ead6b306, queue=awx_private_queue) [2021-11-02 10:48:14,638: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(f290bc80-d19c-450c-a456-9dd8ead6b306, queue=awx_private_queue) 2021-11-02 10:48:14,671 DEBUG awx.main.dispatch delivered f290bc80-d19c-450c-a456-9dd8ead6b306 to worker[178] qsize 0 2021-11-02 10:48:14,674 DEBUG awx.main.dispatch task f290bc80-d19c-450c-a456-9dd8ead6b306 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:48:14,684 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:48:14,694 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:47:44.701547+00:00 2021-11-02 10:48:14,717 DEBUG awx.main.dispatch task f290bc80-d19c-450c-a456-9dd8ead6b306 is finished 2021-11-02 10:48:15,140 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(78c67614-3492-439a-b7a9-980ab726b15a, queue=awx_private_queue) [2021-11-02 10:48:15,140: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(78c67614-3492-439a-b7a9-980ab726b15a, queue=awx_private_queue) 2021-11-02 10:48:15,156 DEBUG awx.main.dispatch delivered 78c67614-3492-439a-b7a9-980ab726b15a to worker[178] qsize 0 2021-11-02 10:48:15,385 DEBUG awx.main.dispatch task 78c67614-3492-439a-b7a9-980ab726b15a starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:48:15,386 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:48:15,402 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:48:15,436 DEBUG awx.main.dispatch task 78c67614-3492-439a-b7a9-980ab726b15a is finished 2021-11-02 10:48:35,149 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(8d40a19b-bf72-4753-b193-5e4296e69071, queue=awx_private_queue) [2021-11-02 10:48:35,149: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(8d40a19b-bf72-4753-b193-5e4296e69071, queue=awx_private_queue) 2021-11-02 10:48:35,174 DEBUG awx.main.dispatch delivered 8d40a19b-bf72-4753-b193-5e4296e69071 to worker[181] qsize 0 2021-11-02 10:48:35,176 DEBUG awx.main.dispatch task 8d40a19b-bf72-4753-b193-5e4296e69071 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:48:35,184 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:48:35,212 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:48:35,251 DEBUG awx.main.dispatch task 8d40a19b-bf72-4753-b193-5e4296e69071 is finished 2021-11-02 10:48:44,639 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(60cdf11d-34d7-48c0-80a4-796e6db31fda, queue=awx_private_queue) [2021-11-02 10:48:44,639: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(60cdf11d-34d7-48c0-80a4-796e6db31fda, queue=awx_private_queue) 2021-11-02 10:48:44,656 DEBUG awx.main.dispatch delivered 60cdf11d-34d7-48c0-80a4-796e6db31fda to worker[181] qsize 0 2021-11-02 10:48:44,658 DEBUG awx.main.dispatch task 60cdf11d-34d7-48c0-80a4-796e6db31fda starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:48:44,668 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:48:44,671 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:48:14.684997+00:00 2021-11-02 10:48:44,701 DEBUG awx.main.dispatch task 60cdf11d-34d7-48c0-80a4-796e6db31fda is finished 2021-11-02 10:48:55,154 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6c89e256-0612-4dd2-81fb-041d0bd7567b, queue=awx_private_queue) [2021-11-02 10:48:55,154: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6c89e256-0612-4dd2-81fb-041d0bd7567b, queue=awx_private_queue) 2021-11-02 10:48:55,171 DEBUG awx.main.dispatch delivered 6c89e256-0612-4dd2-81fb-041d0bd7567b to worker[181] qsize 0 2021-11-02 10:48:55,174 DEBUG awx.main.dispatch task 6c89e256-0612-4dd2-81fb-041d0bd7567b starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:48:55,176 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:48:55,195 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:48:55,227 DEBUG awx.main.dispatch task 6c89e256-0612-4dd2-81fb-041d0bd7567b is finished RESULT 2 OKREADY 2021-11-02 10:49:14,362 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(4f0b0893-5f48-4867-a7a9-ab35012e62cb, queue=dev-awx-0) [2021-11-02 10:49:14,362: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(4f0b0893-5f48-4867-a7a9-ab35012e62cb, queue=dev-awx-0) 2021-11-02 10:49:14,394 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(f73a65fe-ec3d-4408-b094-85ed7fc011fb, queue=dev-awx-0) [2021-11-02 10:49:14,394: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(f73a65fe-ec3d-4408-b094-85ed7fc011fb, queue=dev-awx-0) 2021-11-02 10:49:14,409 DEBUG awx.main.dispatch delivered 4f0b0893-5f48-4867-a7a9-ab35012e62cb to worker[176] qsize 0 2021-11-02 10:49:14,412 DEBUG awx.main.dispatch delivered f73a65fe-ec3d-4408-b094-85ed7fc011fb to worker[181] qsize 0 2021-11-02 10:49:14,415 DEBUG awx.main.dispatch task f73a65fe-ec3d-4408-b094-85ed7fc011fb starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:49:14,415 DEBUG awx.main.dispatch task 4f0b0893-5f48-4867-a7a9-ab35012e62cb starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:49:14,424 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:49:14,432 DEBUG awx.main.dispatch task f73a65fe-ec3d-4408-b094-85ed7fc011fb is finished 2021-11-02 10:49:14,462 DEBUG awx.main.dispatch task 4f0b0893-5f48-4867-a7a9-ab35012e62cb is finished 2021-11-02 10:49:14,638 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(481bcf5a-de57-41c0-aae4-230bc1a534d6, queue=awx_private_queue) [2021-11-02 10:49:14,638: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(481bcf5a-de57-41c0-aae4-230bc1a534d6, queue=awx_private_queue) 2021-11-02 10:49:14,657 DEBUG awx.main.dispatch delivered 481bcf5a-de57-41c0-aae4-230bc1a534d6 to worker[176] qsize 0 2021-11-02 10:49:14,660 DEBUG awx.main.dispatch task 481bcf5a-de57-41c0-aae4-230bc1a534d6 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:49:14,671 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:49:14,674 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:48:44.669198+00:00 2021-11-02 10:49:14,697 DEBUG awx.main.dispatch task 481bcf5a-de57-41c0-aae4-230bc1a534d6 is finished 2021-11-02 10:49:15,154 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d2f1570f-991e-4f64-a07f-aa3f382ecdc7, queue=awx_private_queue) [2021-11-02 10:49:15,154: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d2f1570f-991e-4f64-a07f-aa3f382ecdc7, queue=awx_private_queue) 2021-11-02 10:49:15,170 DEBUG awx.main.dispatch delivered d2f1570f-991e-4f64-a07f-aa3f382ecdc7 to worker[178] qsize 0 2021-11-02 10:49:15,370 DEBUG awx.main.dispatch task d2f1570f-991e-4f64-a07f-aa3f382ecdc7 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:49:15,373 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:49:15,392 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:49:15,420 DEBUG awx.main.dispatch task d2f1570f-991e-4f64-a07f-aa3f382ecdc7 is finished 2021-11-02 10:49:35,173 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f47fe0bb-469d-497b-b1d3-7cff63539de6, queue=awx_private_queue) [2021-11-02 10:49:35,173: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f47fe0bb-469d-497b-b1d3-7cff63539de6, queue=awx_private_queue) 2021-11-02 10:49:35,209 DEBUG awx.main.dispatch delivered f47fe0bb-469d-497b-b1d3-7cff63539de6 to worker[176] qsize 0 2021-11-02 10:49:35,221 DEBUG awx.main.dispatch task f47fe0bb-469d-497b-b1d3-7cff63539de6 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:49:35,227 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:49:35,258 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:49:35,296 DEBUG awx.main.dispatch task f47fe0bb-469d-497b-b1d3-7cff63539de6 is finished 2021-11-02 10:49:44,639 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(df24168b-189a-41fb-ab10-10c53ced5385, queue=awx_private_queue) [2021-11-02 10:49:44,639: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(df24168b-189a-41fb-ab10-10c53ced5385, queue=awx_private_queue) 2021-11-02 10:49:44,663 DEBUG awx.main.dispatch delivered df24168b-189a-41fb-ab10-10c53ced5385 to worker[183] qsize 0 2021-11-02 10:49:44,668 DEBUG awx.main.dispatch task df24168b-189a-41fb-ab10-10c53ced5385 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:49:44,687 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:49:44,701 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:49:14.671352+00:00 2021-11-02 10:49:44,727 DEBUG awx.main.dispatch task df24168b-189a-41fb-ab10-10c53ced5385 is finished 2021-11-02 10:49:55,169 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(4ce54eaf-494b-4478-a45f-0f3438b09c8e, queue=awx_private_queue) [2021-11-02 10:49:55,169: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(4ce54eaf-494b-4478-a45f-0f3438b09c8e, queue=awx_private_queue) 2021-11-02 10:49:55,191 DEBUG awx.main.dispatch delivered 4ce54eaf-494b-4478-a45f-0f3438b09c8e to worker[181] qsize 0 2021-11-02 10:49:55,195 DEBUG awx.main.dispatch task 4ce54eaf-494b-4478-a45f-0f3438b09c8e starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:49:55,200 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:49:55,225 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:49:55,255 DEBUG awx.main.dispatch task 4ce54eaf-494b-4478-a45f-0f3438b09c8e is finished RESULT 2 OKREADY 2021-11-02 10:50:14,373 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(2f60133d-cdbf-487e-8283-36efbf26c19e, queue=dev-awx-0) [2021-11-02 10:50:14,373: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(2f60133d-cdbf-487e-8283-36efbf26c19e, queue=dev-awx-0) 2021-11-02 10:50:14,397 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(14ff7495-3efa-4bc6-8b07-b7a47a570343, queue=dev-awx-0) [2021-11-02 10:50:14,397: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(14ff7495-3efa-4bc6-8b07-b7a47a570343, queue=dev-awx-0) 2021-11-02 10:50:14,417 DEBUG awx.main.dispatch delivered 2f60133d-cdbf-487e-8283-36efbf26c19e to worker[183] qsize 0 2021-11-02 10:50:14,420 DEBUG awx.main.dispatch task 2f60133d-cdbf-487e-8283-36efbf26c19e starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:50:14,422 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:50:14,439 DEBUG awx.main.dispatch delivered 14ff7495-3efa-4bc6-8b07-b7a47a570343 to worker[176] qsize 0 2021-11-02 10:50:14,442 DEBUG awx.main.dispatch task 14ff7495-3efa-4bc6-8b07-b7a47a570343 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:50:14,458 DEBUG awx.main.dispatch task 14ff7495-3efa-4bc6-8b07-b7a47a570343 is finished 2021-11-02 10:50:14,475 DEBUG awx.main.dispatch task 2f60133d-cdbf-487e-8283-36efbf26c19e is finished 2021-11-02 10:50:14,639 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d3f3af36-d2d7-4960-97c1-43a90dddfef4, queue=awx_private_queue) [2021-11-02 10:50:14,639: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d3f3af36-d2d7-4960-97c1-43a90dddfef4, queue=awx_private_queue) 2021-11-02 10:50:14,659 DEBUG awx.main.dispatch delivered d3f3af36-d2d7-4960-97c1-43a90dddfef4 to worker[176] qsize 0 2021-11-02 10:50:14,662 DEBUG awx.main.dispatch task d3f3af36-d2d7-4960-97c1-43a90dddfef4 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:50:14,670 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:50:14,673 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:49:44.688543+00:00 2021-11-02 10:50:14,686 DEBUG awx.main.dispatch task d3f3af36-d2d7-4960-97c1-43a90dddfef4 is finished 2021-11-02 10:50:15,169 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3248c963-492d-4e7c-8754-02dc1fffa012, queue=awx_private_queue) [2021-11-02 10:50:15,169: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3248c963-492d-4e7c-8754-02dc1fffa012, queue=awx_private_queue) 2021-11-02 10:50:15,206 DEBUG awx.main.dispatch delivered 3248c963-492d-4e7c-8754-02dc1fffa012 to worker[181] qsize 0 2021-11-02 10:50:15,386 DEBUG awx.main.dispatch task 3248c963-492d-4e7c-8754-02dc1fffa012 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:50:15,388 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:50:15,405 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:50:15,438 DEBUG awx.main.dispatch task 3248c963-492d-4e7c-8754-02dc1fffa012 is finished 2021-11-02 10:50:35,177 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(939aa1d3-fcc2-4228-8d48-7fc17909511a, queue=awx_private_queue) [2021-11-02 10:50:35,177: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(939aa1d3-fcc2-4228-8d48-7fc17909511a, queue=awx_private_queue) 2021-11-02 10:50:35,196 DEBUG awx.main.dispatch delivered 939aa1d3-fcc2-4228-8d48-7fc17909511a to worker[181] qsize 0 2021-11-02 10:50:35,199 DEBUG awx.main.dispatch task 939aa1d3-fcc2-4228-8d48-7fc17909511a starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:50:35,201 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:50:35,217 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:50:35,244 DEBUG awx.main.dispatch task 939aa1d3-fcc2-4228-8d48-7fc17909511a is finished 2021-11-02 10:50:44,639 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(f2924b07-77ea-41f0-b647-57ce98a495aa, queue=awx_private_queue) [2021-11-02 10:50:44,639: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(f2924b07-77ea-41f0-b647-57ce98a495aa, queue=awx_private_queue) 2021-11-02 10:50:44,663 DEBUG awx.main.dispatch delivered f2924b07-77ea-41f0-b647-57ce98a495aa to worker[176] qsize 0 2021-11-02 10:50:44,666 DEBUG awx.main.dispatch task f2924b07-77ea-41f0-b647-57ce98a495aa starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:50:44,676 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:50:44,680 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:50:14.670987+00:00 2021-11-02 10:50:44,793 DEBUG awx.main.dispatch task f2924b07-77ea-41f0-b647-57ce98a495aa is finished 2021-11-02 10:50:55,179 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(9a3ced82-2704-4fe7-83f6-bddb1a5412db, queue=awx_private_queue) [2021-11-02 10:50:55,179: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(9a3ced82-2704-4fe7-83f6-bddb1a5412db, queue=awx_private_queue) 2021-11-02 10:50:55,202 DEBUG awx.main.dispatch delivered 9a3ced82-2704-4fe7-83f6-bddb1a5412db to worker[176] qsize 0 2021-11-02 10:50:55,206 DEBUG awx.main.dispatch task 9a3ced82-2704-4fe7-83f6-bddb1a5412db starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:50:55,209 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:50:55,232 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:50:55,265 DEBUG awx.main.dispatch task 9a3ced82-2704-4fe7-83f6-bddb1a5412db is finished RESULT 2 OKREADY 2021-11-02 10:51:14,381 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(0c165db0-2294-4a21-b675-3e487feac511, queue=dev-awx-0) [2021-11-02 10:51:14,381: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(0c165db0-2294-4a21-b675-3e487feac511, queue=dev-awx-0) 2021-11-02 10:51:14,420 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(559f978b-f845-4b8c-891d-60b23ab5cc3d, queue=dev-awx-0) [2021-11-02 10:51:14,420: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(559f978b-f845-4b8c-891d-60b23ab5cc3d, queue=dev-awx-0) 2021-11-02 10:51:14,455 DEBUG awx.main.dispatch delivered 0c165db0-2294-4a21-b675-3e487feac511 to worker[183] qsize 0 2021-11-02 10:51:14,460 DEBUG awx.main.dispatch delivered 559f978b-f845-4b8c-891d-60b23ab5cc3d to worker[178] qsize 0 2021-11-02 10:51:14,463 DEBUG awx.main.dispatch task 0c165db0-2294-4a21-b675-3e487feac511 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:51:14,472 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:51:14,467 DEBUG awx.main.dispatch task 559f978b-f845-4b8c-891d-60b23ab5cc3d starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:51:14,497 DEBUG awx.main.dispatch task 559f978b-f845-4b8c-891d-60b23ab5cc3d is finished 2021-11-02 10:51:14,532 DEBUG awx.main.dispatch task 0c165db0-2294-4a21-b675-3e487feac511 is finished 2021-11-02 10:51:14,639 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(91af45f0-e8f3-4305-aec3-25bf102be1c9, queue=awx_private_queue) [2021-11-02 10:51:14,639: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(91af45f0-e8f3-4305-aec3-25bf102be1c9, queue=awx_private_queue) 2021-11-02 10:51:14,663 DEBUG awx.main.dispatch delivered 91af45f0-e8f3-4305-aec3-25bf102be1c9 to worker[178] qsize 0 2021-11-02 10:51:14,666 DEBUG awx.main.dispatch task 91af45f0-e8f3-4305-aec3-25bf102be1c9 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:51:14,678 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:51:14,682 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:50:44.676893+00:00 2021-11-02 10:51:14,709 DEBUG awx.main.dispatch task 91af45f0-e8f3-4305-aec3-25bf102be1c9 is finished 2021-11-02 10:51:15,179 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(324a575f-8e8a-47d1-9ade-ee4dd2828d03, queue=awx_private_queue) [2021-11-02 10:51:15,179: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(324a575f-8e8a-47d1-9ade-ee4dd2828d03, queue=awx_private_queue) 2021-11-02 10:51:15,229 DEBUG awx.main.dispatch delivered 324a575f-8e8a-47d1-9ade-ee4dd2828d03 to worker[178] qsize 0 2021-11-02 10:51:15,433 DEBUG awx.main.dispatch task 324a575f-8e8a-47d1-9ade-ee4dd2828d03 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:51:15,435 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:51:15,457 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:51:15,503 DEBUG awx.main.dispatch task 324a575f-8e8a-47d1-9ade-ee4dd2828d03 is finished 2021-11-02 10:51:35,190 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5a5d8384-06e0-49d7-8a09-4cbf95281f9d, queue=awx_private_queue) [2021-11-02 10:51:35,190: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5a5d8384-06e0-49d7-8a09-4cbf95281f9d, queue=awx_private_queue) 2021-11-02 10:51:35,218 DEBUG awx.main.dispatch delivered 5a5d8384-06e0-49d7-8a09-4cbf95281f9d to worker[176] qsize 0 2021-11-02 10:51:35,223 DEBUG awx.main.dispatch task 5a5d8384-06e0-49d7-8a09-4cbf95281f9d starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:51:35,229 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:51:35,254 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:51:35,291 DEBUG awx.main.dispatch task 5a5d8384-06e0-49d7-8a09-4cbf95281f9d is finished 2021-11-02 10:51:44,639 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(6d02b4c8-a3e8-4733-991a-0955c2863543, queue=awx_private_queue) [2021-11-02 10:51:44,639: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(6d02b4c8-a3e8-4733-991a-0955c2863543, queue=awx_private_queue) 2021-11-02 10:51:44,667 DEBUG awx.main.dispatch delivered 6d02b4c8-a3e8-4733-991a-0955c2863543 to worker[176] qsize 0 2021-11-02 10:51:44,670 DEBUG awx.main.dispatch task 6d02b4c8-a3e8-4733-991a-0955c2863543 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:51:44,681 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:51:44,685 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:51:14.678479+00:00 2021-11-02 10:51:44,744 DEBUG awx.main.dispatch task 6d02b4c8-a3e8-4733-991a-0955c2863543 is finished 2021-11-02 10:51:55,189 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(9e4c66f8-4a78-426c-93d3-9baa5370696f, queue=awx_private_queue) [2021-11-02 10:51:55,189: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(9e4c66f8-4a78-426c-93d3-9baa5370696f, queue=awx_private_queue) 2021-11-02 10:51:55,206 DEBUG awx.main.dispatch delivered 9e4c66f8-4a78-426c-93d3-9baa5370696f to worker[181] qsize 0 2021-11-02 10:51:55,211 DEBUG awx.main.dispatch task 9e4c66f8-4a78-426c-93d3-9baa5370696f starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:51:55,218 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:51:55,243 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:51:55,277 DEBUG awx.main.dispatch task 9e4c66f8-4a78-426c-93d3-9baa5370696f is finished RESULT 2 OKREADY 2021-11-02 10:52:14,380 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(5d05c0b8-0ee0-41eb-b52d-12341ac0c162, queue=dev-awx-0) [2021-11-02 10:52:14,380: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(5d05c0b8-0ee0-41eb-b52d-12341ac0c162, queue=dev-awx-0) 2021-11-02 10:52:14,420 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(ff41ef7a-8860-4d71-ab05-6028cdd13c68, queue=dev-awx-0) [2021-11-02 10:52:14,420: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(ff41ef7a-8860-4d71-ab05-6028cdd13c68, queue=dev-awx-0) 2021-11-02 10:52:14,425 DEBUG awx.main.dispatch delivered 5d05c0b8-0ee0-41eb-b52d-12341ac0c162 to worker[176] qsize 0 2021-11-02 10:52:14,429 DEBUG awx.main.dispatch task 5d05c0b8-0ee0-41eb-b52d-12341ac0c162 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:52:14,431 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:52:14,455 DEBUG awx.main.dispatch delivered ff41ef7a-8860-4d71-ab05-6028cdd13c68 to worker[181] qsize 0 2021-11-02 10:52:14,457 DEBUG awx.main.dispatch task ff41ef7a-8860-4d71-ab05-6028cdd13c68 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:52:14,471 DEBUG awx.main.dispatch task ff41ef7a-8860-4d71-ab05-6028cdd13c68 is finished 2021-11-02 10:52:14,538 DEBUG awx.main.dispatch task 5d05c0b8-0ee0-41eb-b52d-12341ac0c162 is finished 2021-11-02 10:52:14,639 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(b5506a40-1026-4c0b-8a06-224a155d068c, queue=awx_private_queue) [2021-11-02 10:52:14,639: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(b5506a40-1026-4c0b-8a06-224a155d068c, queue=awx_private_queue) 2021-11-02 10:52:14,676 DEBUG awx.main.dispatch delivered b5506a40-1026-4c0b-8a06-224a155d068c to worker[176] qsize 0 2021-11-02 10:52:14,679 DEBUG awx.main.dispatch task b5506a40-1026-4c0b-8a06-224a155d068c starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:52:14,689 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:52:14,692 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:51:44.681933+00:00 2021-11-02 10:52:14,725 DEBUG awx.main.dispatch task b5506a40-1026-4c0b-8a06-224a155d068c is finished 2021-11-02 10:52:15,189 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(cdd54038-db79-4fc2-b6e4-1d049c0c3737, queue=awx_private_queue) [2021-11-02 10:52:15,189: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(cdd54038-db79-4fc2-b6e4-1d049c0c3737, queue=awx_private_queue) 2021-11-02 10:52:15,220 DEBUG awx.main.dispatch delivered cdd54038-db79-4fc2-b6e4-1d049c0c3737 to worker[181] qsize 0 2021-11-02 10:52:15,222 DEBUG awx.main.dispatch task cdd54038-db79-4fc2-b6e4-1d049c0c3737 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:52:15,224 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:52:15,241 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:52:15,270 DEBUG awx.main.dispatch task cdd54038-db79-4fc2-b6e4-1d049c0c3737 is finished 2021-11-02 10:52:35,200 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d9df620d-cf43-4b25-be62-1a820d0050db, queue=awx_private_queue) [2021-11-02 10:52:35,200: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d9df620d-cf43-4b25-be62-1a820d0050db, queue=awx_private_queue) 2021-11-02 10:52:35,419 DEBUG awx.main.dispatch delivered d9df620d-cf43-4b25-be62-1a820d0050db to worker[181] qsize 0 2021-11-02 10:52:35,423 DEBUG awx.main.dispatch task d9df620d-cf43-4b25-be62-1a820d0050db starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:52:35,424 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:52:35,441 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:52:35,476 DEBUG awx.main.dispatch task d9df620d-cf43-4b25-be62-1a820d0050db is finished 2021-11-02 10:52:44,649 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(a90948ec-25d7-41e5-b47c-973971664a99, queue=awx_private_queue) [2021-11-02 10:52:44,649: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(a90948ec-25d7-41e5-b47c-973971664a99, queue=awx_private_queue) 2021-11-02 10:52:44,698 DEBUG awx.main.dispatch delivered a90948ec-25d7-41e5-b47c-973971664a99 to worker[181] qsize 0 2021-11-02 10:52:44,706 DEBUG awx.main.dispatch task a90948ec-25d7-41e5-b47c-973971664a99 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:52:44,727 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:52:44,733 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:52:14.690199+00:00 2021-11-02 10:52:44,787 DEBUG awx.main.dispatch task a90948ec-25d7-41e5-b47c-973971664a99 is finished 2021-11-02 10:52:55,202 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e8f8193d-fb35-4bde-b26d-9bf016a7fc4f, queue=awx_private_queue) [2021-11-02 10:52:55,202: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e8f8193d-fb35-4bde-b26d-9bf016a7fc4f, queue=awx_private_queue) 2021-11-02 10:52:55,225 DEBUG awx.main.dispatch delivered e8f8193d-fb35-4bde-b26d-9bf016a7fc4f to worker[181] qsize 0 2021-11-02 10:52:55,228 DEBUG awx.main.dispatch task e8f8193d-fb35-4bde-b26d-9bf016a7fc4f starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:52:55,230 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:52:55,249 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:52:55,279 DEBUG awx.main.dispatch task e8f8193d-fb35-4bde-b26d-9bf016a7fc4f is finished RESULT 2 OKREADY 2021-11-02 10:53:14,385 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(2ef098db-98fa-4619-8124-62181dacef10, queue=dev-awx-0) [2021-11-02 10:53:14,385: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(2ef098db-98fa-4619-8124-62181dacef10, queue=dev-awx-0) 2021-11-02 10:53:14,420 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(c4c152e5-5689-473f-8651-5a6244ead754, queue=dev-awx-0) [2021-11-02 10:53:14,420: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(c4c152e5-5689-473f-8651-5a6244ead754, queue=dev-awx-0) 2021-11-02 10:53:14,434 DEBUG awx.main.dispatch delivered 2ef098db-98fa-4619-8124-62181dacef10 to worker[183] qsize 0 2021-11-02 10:53:14,440 DEBUG awx.main.dispatch delivered c4c152e5-5689-473f-8651-5a6244ead754 to worker[176] qsize 0 2021-11-02 10:53:14,440 DEBUG awx.main.dispatch task 2ef098db-98fa-4619-8124-62181dacef10 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:53:14,446 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:53:14,446 DEBUG awx.main.dispatch task c4c152e5-5689-473f-8651-5a6244ead754 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:53:14,468 DEBUG awx.main.dispatch task c4c152e5-5689-473f-8651-5a6244ead754 is finished 2021-11-02 10:53:14,619 DEBUG awx.main.dispatch task 2ef098db-98fa-4619-8124-62181dacef10 is finished 2021-11-02 10:53:14,642 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(44d4dbfc-3df3-4ede-bf90-4d12db0fb623, queue=awx_private_queue) [2021-11-02 10:53:14,642: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(44d4dbfc-3df3-4ede-bf90-4d12db0fb623, queue=awx_private_queue) 2021-11-02 10:53:14,662 DEBUG awx.main.dispatch delivered 44d4dbfc-3df3-4ede-bf90-4d12db0fb623 to worker[183] qsize 0 2021-11-02 10:53:14,665 DEBUG awx.main.dispatch task 44d4dbfc-3df3-4ede-bf90-4d12db0fb623 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:53:14,674 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:53:14,677 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:52:44.727756+00:00 2021-11-02 10:53:14,713 DEBUG awx.main.dispatch task 44d4dbfc-3df3-4ede-bf90-4d12db0fb623 is finished 2021-11-02 10:53:15,201 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d52c2519-5ac2-4b69-af47-93d1b9522dd0, queue=awx_private_queue) [2021-11-02 10:53:15,201: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d52c2519-5ac2-4b69-af47-93d1b9522dd0, queue=awx_private_queue) 2021-11-02 10:53:15,216 DEBUG awx.main.dispatch delivered d52c2519-5ac2-4b69-af47-93d1b9522dd0 to worker[178] qsize 0 2021-11-02 10:53:15,221 DEBUG awx.main.dispatch task d52c2519-5ac2-4b69-af47-93d1b9522dd0 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:53:15,225 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:53:15,250 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:53:15,282 DEBUG awx.main.dispatch task d52c2519-5ac2-4b69-af47-93d1b9522dd0 is finished 2021-11-02 10:53:35,201 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(8d269af7-3ba3-4645-94f7-2bbde7051ec6, queue=awx_private_queue) [2021-11-02 10:53:35,201: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(8d269af7-3ba3-4645-94f7-2bbde7051ec6, queue=awx_private_queue) 2021-11-02 10:53:35,470 DEBUG awx.main.dispatch delivered 8d269af7-3ba3-4645-94f7-2bbde7051ec6 to worker[178] qsize 0 2021-11-02 10:53:35,474 DEBUG awx.main.dispatch task 8d269af7-3ba3-4645-94f7-2bbde7051ec6 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:53:35,476 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:53:35,497 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:53:35,531 DEBUG awx.main.dispatch task 8d269af7-3ba3-4645-94f7-2bbde7051ec6 is finished 2021-11-02 10:53:44,642 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(ac7e5acd-5500-4db7-9f98-7458e8f39e4d, queue=awx_private_queue) [2021-11-02 10:53:44,642: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(ac7e5acd-5500-4db7-9f98-7458e8f39e4d, queue=awx_private_queue) 2021-11-02 10:53:44,665 DEBUG awx.main.dispatch delivered ac7e5acd-5500-4db7-9f98-7458e8f39e4d to worker[176] qsize 0 2021-11-02 10:53:44,667 DEBUG awx.main.dispatch task ac7e5acd-5500-4db7-9f98-7458e8f39e4d starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:53:44,679 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:53:44,683 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:53:14.674471+00:00 2021-11-02 10:53:44,761 DEBUG awx.main.dispatch task ac7e5acd-5500-4db7-9f98-7458e8f39e4d is finished 2021-11-02 10:53:55,203 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ebf34515-5f4d-40bd-8618-d045f5aa9d89, queue=awx_private_queue) [2021-11-02 10:53:55,203: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ebf34515-5f4d-40bd-8618-d045f5aa9d89, queue=awx_private_queue) 2021-11-02 10:53:55,225 DEBUG awx.main.dispatch delivered ebf34515-5f4d-40bd-8618-d045f5aa9d89 to worker[181] qsize 0 2021-11-02 10:53:55,228 DEBUG awx.main.dispatch task ebf34515-5f4d-40bd-8618-d045f5aa9d89 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:53:55,231 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:53:55,250 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:53:55,279 DEBUG awx.main.dispatch task ebf34515-5f4d-40bd-8618-d045f5aa9d89 is finished RESULT 2 OKREADY 2021-11-02 10:54:14,397 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(f7d3d307-c3c9-40f3-abe6-4a6b8840cb1c, queue=dev-awx-0) [2021-11-02 10:54:14,397: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(f7d3d307-c3c9-40f3-abe6-4a6b8840cb1c, queue=dev-awx-0) 2021-11-02 10:54:14,426 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(adc5bcb9-1cb4-48c5-ad50-5b124212366f, queue=dev-awx-0) [2021-11-02 10:54:14,426: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(adc5bcb9-1cb4-48c5-ad50-5b124212366f, queue=dev-awx-0) 2021-11-02 10:54:14,447 DEBUG awx.main.dispatch delivered f7d3d307-c3c9-40f3-abe6-4a6b8840cb1c to worker[176] qsize 0 2021-11-02 10:54:14,453 DEBUG awx.main.dispatch delivered adc5bcb9-1cb4-48c5-ad50-5b124212366f to worker[178] qsize 0 2021-11-02 10:54:14,455 DEBUG awx.main.dispatch task f7d3d307-c3c9-40f3-abe6-4a6b8840cb1c starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:54:14,463 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:54:14,461 DEBUG awx.main.dispatch task adc5bcb9-1cb4-48c5-ad50-5b124212366f starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:54:14,494 DEBUG awx.main.dispatch task adc5bcb9-1cb4-48c5-ad50-5b124212366f is finished 2021-11-02 10:54:14,500 DEBUG awx.main.dispatch task f7d3d307-c3c9-40f3-abe6-4a6b8840cb1c is finished 2021-11-02 10:54:14,642 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(54846aca-aeb8-4d8b-a6cd-2dc42d009521, queue=awx_private_queue) [2021-11-02 10:54:14,642: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(54846aca-aeb8-4d8b-a6cd-2dc42d009521, queue=awx_private_queue) 2021-11-02 10:54:14,665 DEBUG awx.main.dispatch delivered 54846aca-aeb8-4d8b-a6cd-2dc42d009521 to worker[176] qsize 0 2021-11-02 10:54:14,668 DEBUG awx.main.dispatch task 54846aca-aeb8-4d8b-a6cd-2dc42d009521 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:54:14,678 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:54:14,681 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:53:44.679960+00:00 2021-11-02 10:54:14,695 DEBUG awx.main.dispatch task 54846aca-aeb8-4d8b-a6cd-2dc42d009521 is finished 2021-11-02 10:54:15,202 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c58ea4f5-85f0-4b58-8511-ef6c832ad6bc, queue=awx_private_queue) [2021-11-02 10:54:15,202: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c58ea4f5-85f0-4b58-8511-ef6c832ad6bc, queue=awx_private_queue) 2021-11-02 10:54:15,221 DEBUG awx.main.dispatch delivered c58ea4f5-85f0-4b58-8511-ef6c832ad6bc to worker[178] qsize 0 2021-11-02 10:54:15,223 DEBUG awx.main.dispatch task c58ea4f5-85f0-4b58-8511-ef6c832ad6bc starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:54:15,227 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:54:15,246 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:54:15,277 DEBUG awx.main.dispatch task c58ea4f5-85f0-4b58-8511-ef6c832ad6bc is finished 2021-11-02 10:54:35,206 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d041f1a0-8847-4793-9845-5f8cd856f254, queue=awx_private_queue) [2021-11-02 10:54:35,206: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d041f1a0-8847-4793-9845-5f8cd856f254, queue=awx_private_queue) 2021-11-02 10:54:35,467 DEBUG awx.main.dispatch delivered d041f1a0-8847-4793-9845-5f8cd856f254 to worker[181] qsize 0 2021-11-02 10:54:35,473 DEBUG awx.main.dispatch task d041f1a0-8847-4793-9845-5f8cd856f254 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:54:35,477 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:54:35,500 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:54:35,538 DEBUG awx.main.dispatch task d041f1a0-8847-4793-9845-5f8cd856f254 is finished 2021-11-02 10:54:44,643 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(fc31dcfa-2e4f-4958-9dfe-62cbb4ba4448, queue=awx_private_queue) [2021-11-02 10:54:44,643: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(fc31dcfa-2e4f-4958-9dfe-62cbb4ba4448, queue=awx_private_queue) 2021-11-02 10:54:44,667 DEBUG awx.main.dispatch delivered fc31dcfa-2e4f-4958-9dfe-62cbb4ba4448 to worker[178] qsize 0 2021-11-02 10:54:44,672 DEBUG awx.main.dispatch task fc31dcfa-2e4f-4958-9dfe-62cbb4ba4448 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:54:44,698 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:54:44,701 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:54:14.678345+00:00 2021-11-02 10:54:44,747 DEBUG awx.main.dispatch task fc31dcfa-2e4f-4958-9dfe-62cbb4ba4448 is finished 2021-11-02 10:54:55,203 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(cec4773a-8585-461e-abbd-796af3f2dd52, queue=awx_private_queue) [2021-11-02 10:54:55,203: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(cec4773a-8585-461e-abbd-796af3f2dd52, queue=awx_private_queue) 2021-11-02 10:54:55,223 DEBUG awx.main.dispatch delivered cec4773a-8585-461e-abbd-796af3f2dd52 to worker[183] qsize 0 2021-11-02 10:54:55,226 DEBUG awx.main.dispatch task cec4773a-8585-461e-abbd-796af3f2dd52 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:54:55,231 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:54:55,257 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:54:55,285 DEBUG awx.main.dispatch task cec4773a-8585-461e-abbd-796af3f2dd52 is finished RESULT 2 OKREADY 2021-11-02 10:55:14,395 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(165d906d-77e0-49ce-8eaf-23b4bf345a00, queue=dev-awx-0) [2021-11-02 10:55:14,395: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(165d906d-77e0-49ce-8eaf-23b4bf345a00, queue=dev-awx-0) 2021-11-02 10:55:14,426 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(eba6de11-6f77-4d3d-8cd4-e1f83c105498, queue=dev-awx-0) [2021-11-02 10:55:14,426: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(eba6de11-6f77-4d3d-8cd4-e1f83c105498, queue=dev-awx-0) 2021-11-02 10:55:14,430 DEBUG awx.main.dispatch delivered 165d906d-77e0-49ce-8eaf-23b4bf345a00 to worker[183] qsize 0 2021-11-02 10:55:14,432 DEBUG awx.main.dispatch task 165d906d-77e0-49ce-8eaf-23b4bf345a00 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:55:14,434 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:55:14,442 DEBUG awx.main.dispatch delivered eba6de11-6f77-4d3d-8cd4-e1f83c105498 to worker[181] qsize 0 2021-11-02 10:55:14,444 DEBUG awx.main.dispatch task eba6de11-6f77-4d3d-8cd4-e1f83c105498 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:55:14,457 DEBUG awx.main.dispatch task eba6de11-6f77-4d3d-8cd4-e1f83c105498 is finished 2021-11-02 10:55:14,520 DEBUG awx.main.dispatch task 165d906d-77e0-49ce-8eaf-23b4bf345a00 is finished 2021-11-02 10:55:14,642 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d75f3b69-232f-4360-8777-faef0ca24836, queue=awx_private_queue) [2021-11-02 10:55:14,642: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d75f3b69-232f-4360-8777-faef0ca24836, queue=awx_private_queue) 2021-11-02 10:55:14,665 DEBUG awx.main.dispatch delivered d75f3b69-232f-4360-8777-faef0ca24836 to worker[181] qsize 0 2021-11-02 10:55:14,667 DEBUG awx.main.dispatch task d75f3b69-232f-4360-8777-faef0ca24836 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:55:14,677 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:55:14,680 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:54:44.698557+00:00 2021-11-02 10:55:14,695 DEBUG awx.main.dispatch task d75f3b69-232f-4360-8777-faef0ca24836 is finished 2021-11-02 10:55:15,203 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(268096db-b5c5-43fe-ab6b-81a4d45d9e46, queue=awx_private_queue) [2021-11-02 10:55:15,203: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(268096db-b5c5-43fe-ab6b-81a4d45d9e46, queue=awx_private_queue) 2021-11-02 10:55:15,226 DEBUG awx.main.dispatch delivered 268096db-b5c5-43fe-ab6b-81a4d45d9e46 to worker[181] qsize 0 2021-11-02 10:55:15,228 DEBUG awx.main.dispatch task 268096db-b5c5-43fe-ab6b-81a4d45d9e46 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:55:15,230 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:55:15,247 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:55:15,283 DEBUG awx.main.dispatch task 268096db-b5c5-43fe-ab6b-81a4d45d9e46 is finished 2021-11-02 10:55:35,203 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(dea5b93c-97a6-4d14-be94-0d0dfa0acfec, queue=awx_private_queue) [2021-11-02 10:55:35,203: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(dea5b93c-97a6-4d14-be94-0d0dfa0acfec, queue=awx_private_queue) 2021-11-02 10:55:35,243 DEBUG awx.main.dispatch delivered dea5b93c-97a6-4d14-be94-0d0dfa0acfec to worker[183] qsize 0 2021-11-02 10:55:35,245 DEBUG awx.main.dispatch task dea5b93c-97a6-4d14-be94-0d0dfa0acfec starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:55:35,246 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:55:35,262 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:55:35,289 DEBUG awx.main.dispatch task dea5b93c-97a6-4d14-be94-0d0dfa0acfec is finished 2021-11-02 10:55:44,643 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(5e915040-1b2d-4840-bfe8-80ad96fc3304, queue=awx_private_queue) [2021-11-02 10:55:44,643: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(5e915040-1b2d-4840-bfe8-80ad96fc3304, queue=awx_private_queue) 2021-11-02 10:55:44,874 DEBUG awx.main.dispatch delivered 5e915040-1b2d-4840-bfe8-80ad96fc3304 to worker[178] qsize 0 2021-11-02 10:55:44,879 DEBUG awx.main.dispatch task 5e915040-1b2d-4840-bfe8-80ad96fc3304 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:55:44,894 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:55:44,899 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:55:14.677514+00:00 2021-11-02 10:55:44,951 DEBUG awx.main.dispatch task 5e915040-1b2d-4840-bfe8-80ad96fc3304 is finished 2021-11-02 10:55:55,214 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(52fd0cc1-e718-45e9-9c6c-42a2833f7c82, queue=awx_private_queue) [2021-11-02 10:55:55,214: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(52fd0cc1-e718-45e9-9c6c-42a2833f7c82, queue=awx_private_queue) 2021-11-02 10:55:55,249 DEBUG awx.main.dispatch delivered 52fd0cc1-e718-45e9-9c6c-42a2833f7c82 to worker[178] qsize 0 2021-11-02 10:55:55,261 DEBUG awx.main.dispatch task 52fd0cc1-e718-45e9-9c6c-42a2833f7c82 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:55:55,266 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:55:55,290 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:55:55,323 DEBUG awx.main.dispatch task 52fd0cc1-e718-45e9-9c6c-42a2833f7c82 is finished RESULT 2 OKREADY 2021-11-02 10:56:14,404 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(eaeae23f-f7cc-48db-8ae0-4f2ba6e3b884, queue=dev-awx-0) [2021-11-02 10:56:14,404: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(eaeae23f-f7cc-48db-8ae0-4f2ba6e3b884, queue=dev-awx-0) 2021-11-02 10:56:14,430 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(2de60015-9ccf-4fad-8d38-228ed9f29ad1, queue=dev-awx-0) [2021-11-02 10:56:14,430: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(2de60015-9ccf-4fad-8d38-228ed9f29ad1, queue=dev-awx-0) 2021-11-02 10:56:14,453 DEBUG awx.main.dispatch delivered eaeae23f-f7cc-48db-8ae0-4f2ba6e3b884 to worker[178] qsize 0 2021-11-02 10:56:14,456 DEBUG awx.main.dispatch task eaeae23f-f7cc-48db-8ae0-4f2ba6e3b884 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:56:14,458 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:56:14,466 DEBUG awx.main.dispatch delivered 2de60015-9ccf-4fad-8d38-228ed9f29ad1 to worker[183] qsize 0 2021-11-02 10:56:14,470 DEBUG awx.main.dispatch task 2de60015-9ccf-4fad-8d38-228ed9f29ad1 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:56:14,484 DEBUG awx.main.dispatch task eaeae23f-f7cc-48db-8ae0-4f2ba6e3b884 is finished 2021-11-02 10:56:14,491 DEBUG awx.main.dispatch task 2de60015-9ccf-4fad-8d38-228ed9f29ad1 is finished 2021-11-02 10:56:14,643 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d74cbe2c-adbc-4efc-8143-da0a78690975, queue=awx_private_queue) [2021-11-02 10:56:14,643: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d74cbe2c-adbc-4efc-8143-da0a78690975, queue=awx_private_queue) 2021-11-02 10:56:14,665 DEBUG awx.main.dispatch delivered d74cbe2c-adbc-4efc-8143-da0a78690975 to worker[181] qsize 0 2021-11-02 10:56:14,669 DEBUG awx.main.dispatch task d74cbe2c-adbc-4efc-8143-da0a78690975 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:56:14,685 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:56:14,690 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:55:44.894296+00:00 2021-11-02 10:56:14,707 DEBUG awx.main.dispatch task d74cbe2c-adbc-4efc-8143-da0a78690975 is finished 2021-11-02 10:56:15,206 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7c92dbda-1ef0-4a03-baef-25915afc6e21, queue=awx_private_queue) [2021-11-02 10:56:15,206: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7c92dbda-1ef0-4a03-baef-25915afc6e21, queue=awx_private_queue) 2021-11-02 10:56:15,223 DEBUG awx.main.dispatch delivered 7c92dbda-1ef0-4a03-baef-25915afc6e21 to worker[181] qsize 0 2021-11-02 10:56:15,225 DEBUG awx.main.dispatch task 7c92dbda-1ef0-4a03-baef-25915afc6e21 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:56:15,226 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:56:15,242 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:56:15,272 DEBUG awx.main.dispatch task 7c92dbda-1ef0-4a03-baef-25915afc6e21 is finished 2021-11-02 10:56:35,217 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(044949f6-9d9a-40f4-9b6e-a33bd1d2269b, queue=awx_private_queue) [2021-11-02 10:56:35,217: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(044949f6-9d9a-40f4-9b6e-a33bd1d2269b, queue=awx_private_queue) 2021-11-02 10:56:35,237 DEBUG awx.main.dispatch delivered 044949f6-9d9a-40f4-9b6e-a33bd1d2269b to worker[176] qsize 0 2021-11-02 10:56:35,241 DEBUG awx.main.dispatch task 044949f6-9d9a-40f4-9b6e-a33bd1d2269b starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:56:35,247 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:56:35,270 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:56:35,303 DEBUG awx.main.dispatch task 044949f6-9d9a-40f4-9b6e-a33bd1d2269b is finished 2021-11-02 10:56:44,643 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(b24ff675-6a0a-4d83-848b-d6eec8fa7df9, queue=awx_private_queue) [2021-11-02 10:56:44,643: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(b24ff675-6a0a-4d83-848b-d6eec8fa7df9, queue=awx_private_queue) 2021-11-02 10:56:44,930 DEBUG awx.main.dispatch delivered b24ff675-6a0a-4d83-848b-d6eec8fa7df9 to worker[183] qsize 0 2021-11-02 10:56:44,934 DEBUG awx.main.dispatch task b24ff675-6a0a-4d83-848b-d6eec8fa7df9 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:56:44,945 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:56:44,949 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:56:14.686147+00:00 2021-11-02 10:56:44,994 DEBUG awx.main.dispatch task b24ff675-6a0a-4d83-848b-d6eec8fa7df9 is finished 2021-11-02 10:56:55,218 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(62c41040-489f-440b-af2f-6b411ad7544d, queue=awx_private_queue) [2021-11-02 10:56:55,218: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(62c41040-489f-440b-af2f-6b411ad7544d, queue=awx_private_queue) 2021-11-02 10:56:55,237 DEBUG awx.main.dispatch delivered 62c41040-489f-440b-af2f-6b411ad7544d to worker[176] qsize 0 2021-11-02 10:56:55,239 DEBUG awx.main.dispatch task 62c41040-489f-440b-af2f-6b411ad7544d starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:56:55,241 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:56:55,261 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:56:55,291 DEBUG awx.main.dispatch task 62c41040-489f-440b-af2f-6b411ad7544d is finished RESULT 2 OKREADY 2021-11-02 10:57:14,403 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(0da6768b-0564-43cf-94d3-d336aa1b2bbd, queue=dev-awx-0) [2021-11-02 10:57:14,403: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(0da6768b-0564-43cf-94d3-d336aa1b2bbd, queue=dev-awx-0) 2021-11-02 10:57:14,431 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(7b3c1b5a-f796-4771-911f-ef10cb210c92, queue=dev-awx-0) [2021-11-02 10:57:14,431: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(7b3c1b5a-f796-4771-911f-ef10cb210c92, queue=dev-awx-0) 2021-11-02 10:57:14,446 DEBUG awx.main.dispatch delivered 0da6768b-0564-43cf-94d3-d336aa1b2bbd to worker[176] qsize 0 2021-11-02 10:57:14,449 DEBUG awx.main.dispatch task 0da6768b-0564-43cf-94d3-d336aa1b2bbd starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:57:14,451 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:57:14,454 DEBUG awx.main.dispatch delivered 7b3c1b5a-f796-4771-911f-ef10cb210c92 to worker[183] qsize 0 2021-11-02 10:57:14,457 DEBUG awx.main.dispatch task 7b3c1b5a-f796-4771-911f-ef10cb210c92 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:57:14,473 DEBUG awx.main.dispatch task 7b3c1b5a-f796-4771-911f-ef10cb210c92 is finished 2021-11-02 10:57:14,495 DEBUG awx.main.dispatch task 0da6768b-0564-43cf-94d3-d336aa1b2bbd is finished 2021-11-02 10:57:14,643 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(e28ca151-42e1-47c7-ba5d-f33b32e54bd4, queue=awx_private_queue) [2021-11-02 10:57:14,643: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(e28ca151-42e1-47c7-ba5d-f33b32e54bd4, queue=awx_private_queue) 2021-11-02 10:57:14,666 DEBUG awx.main.dispatch delivered e28ca151-42e1-47c7-ba5d-f33b32e54bd4 to worker[176] qsize 0 2021-11-02 10:57:14,669 DEBUG awx.main.dispatch task e28ca151-42e1-47c7-ba5d-f33b32e54bd4 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:57:14,679 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:57:14,683 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:56:44.945872+00:00 2021-11-02 10:57:14,699 DEBUG awx.main.dispatch task e28ca151-42e1-47c7-ba5d-f33b32e54bd4 is finished 2021-11-02 10:57:15,218 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e816ca41-b670-4f3a-b58d-6e3b4e6fc0da, queue=awx_private_queue) [2021-11-02 10:57:15,218: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e816ca41-b670-4f3a-b58d-6e3b4e6fc0da, queue=awx_private_queue) 2021-11-02 10:57:15,241 DEBUG awx.main.dispatch delivered e816ca41-b670-4f3a-b58d-6e3b4e6fc0da to worker[183] qsize 0 2021-11-02 10:57:15,244 DEBUG awx.main.dispatch task e816ca41-b670-4f3a-b58d-6e3b4e6fc0da starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:57:15,246 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:57:15,267 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:57:15,302 DEBUG awx.main.dispatch task e816ca41-b670-4f3a-b58d-6e3b4e6fc0da is finished 2021-11-02 10:57:35,236 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b7c331fb-c61a-4ac5-8d96-03894662505c, queue=awx_private_queue) [2021-11-02 10:57:35,236: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b7c331fb-c61a-4ac5-8d96-03894662505c, queue=awx_private_queue) 2021-11-02 10:57:35,272 DEBUG awx.main.dispatch delivered b7c331fb-c61a-4ac5-8d96-03894662505c to worker[183] qsize 0 2021-11-02 10:57:35,282 DEBUG awx.main.dispatch task b7c331fb-c61a-4ac5-8d96-03894662505c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:57:35,287 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:57:35,312 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:57:35,345 DEBUG awx.main.dispatch task b7c331fb-c61a-4ac5-8d96-03894662505c is finished 2021-11-02 10:57:44,645 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(ccab1cb3-a87e-4029-9769-1323d3e01648, queue=awx_private_queue) [2021-11-02 10:57:44,645: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(ccab1cb3-a87e-4029-9769-1323d3e01648, queue=awx_private_queue) 2021-11-02 10:57:44,866 DEBUG awx.main.dispatch delivered ccab1cb3-a87e-4029-9769-1323d3e01648 to worker[181] qsize 0 2021-11-02 10:57:44,871 DEBUG awx.main.dispatch task ccab1cb3-a87e-4029-9769-1323d3e01648 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:57:44,886 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:57:44,893 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:57:14.680035+00:00 2021-11-02 10:57:44,941 DEBUG awx.main.dispatch task ccab1cb3-a87e-4029-9769-1323d3e01648 is finished 2021-11-02 10:57:55,231 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(17d46bfe-5b18-4122-815f-c28e98e3c3a6, queue=awx_private_queue) [2021-11-02 10:57:55,231: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(17d46bfe-5b18-4122-815f-c28e98e3c3a6, queue=awx_private_queue) 2021-11-02 10:57:55,254 DEBUG awx.main.dispatch delivered 17d46bfe-5b18-4122-815f-c28e98e3c3a6 to worker[183] qsize 0 2021-11-02 10:57:55,259 DEBUG awx.main.dispatch task 17d46bfe-5b18-4122-815f-c28e98e3c3a6 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:57:55,261 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:57:55,280 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:57:55,313 DEBUG awx.main.dispatch task 17d46bfe-5b18-4122-815f-c28e98e3c3a6 is finished RESULT 2 OKREADY 2021-11-02 10:58:14,004 DEBUG awx.main.dispatch publish awx.main.tasks.awx_isolated_heartbeat(d6374a46-3661-4865-872d-8bf98c93865c, queue=dev-awx-0) [2021-11-02 10:58:14,004: DEBUG/Process-1] publish awx.main.tasks.awx_isolated_heartbeat(d6374a46-3661-4865-872d-8bf98c93865c, queue=dev-awx-0) 2021-11-02 10:58:14,028 DEBUG awx.main.dispatch delivered d6374a46-3661-4865-872d-8bf98c93865c to worker[176] qsize 0 2021-11-02 10:58:14,033 DEBUG awx.main.dispatch task d6374a46-3661-4865-872d-8bf98c93865c starting awx.main.tasks.awx_isolated_heartbeat(*[]) 2021-11-02 10:58:14,038 DEBUG awx.main.tasks Controlling node checking for any isolated management tasks. 2021-11-02 10:58:14,060 DEBUG awx.main.dispatch task d6374a46-3661-4865-872d-8bf98c93865c is finished 2021-11-02 10:58:14,402 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(b0dfa206-abce-4760-9425-2cd27b8bd964, queue=dev-awx-0) [2021-11-02 10:58:14,402: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(b0dfa206-abce-4760-9425-2cd27b8bd964, queue=dev-awx-0) 2021-11-02 10:58:14,435 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(7b4e9a81-66fd-4ba4-9dc2-cd824caa6778, queue=dev-awx-0) [2021-11-02 10:58:14,435: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(7b4e9a81-66fd-4ba4-9dc2-cd824caa6778, queue=dev-awx-0) 2021-11-02 10:58:14,450 DEBUG awx.main.dispatch delivered b0dfa206-abce-4760-9425-2cd27b8bd964 to worker[183] qsize 0 2021-11-02 10:58:14,452 DEBUG awx.main.dispatch delivered 7b4e9a81-66fd-4ba4-9dc2-cd824caa6778 to worker[181] qsize 0 2021-11-02 10:58:14,454 DEBUG awx.main.dispatch task 7b4e9a81-66fd-4ba4-9dc2-cd824caa6778 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:58:14,453 DEBUG awx.main.dispatch task b0dfa206-abce-4760-9425-2cd27b8bd964 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:58:14,456 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:58:14,466 DEBUG awx.main.dispatch task 7b4e9a81-66fd-4ba4-9dc2-cd824caa6778 is finished 2021-11-02 10:58:14,502 DEBUG awx.main.dispatch task b0dfa206-abce-4760-9425-2cd27b8bd964 is finished 2021-11-02 10:58:14,644 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(0297e9c6-7bfe-4517-b7b0-a445a3ebeb34, queue=awx_private_queue) [2021-11-02 10:58:14,644: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(0297e9c6-7bfe-4517-b7b0-a445a3ebeb34, queue=awx_private_queue) 2021-11-02 10:58:14,666 DEBUG awx.main.dispatch delivered 0297e9c6-7bfe-4517-b7b0-a445a3ebeb34 to worker[181] qsize 0 2021-11-02 10:58:14,669 DEBUG awx.main.dispatch task 0297e9c6-7bfe-4517-b7b0-a445a3ebeb34 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:58:14,678 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:58:14,681 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:57:44.887090+00:00 2021-11-02 10:58:14,695 DEBUG awx.main.dispatch task 0297e9c6-7bfe-4517-b7b0-a445a3ebeb34 is finished 2021-11-02 10:58:15,230 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(78816e8d-1106-4f0d-8d40-e1bc308b325e, queue=awx_private_queue) [2021-11-02 10:58:15,230: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(78816e8d-1106-4f0d-8d40-e1bc308b325e, queue=awx_private_queue) 2021-11-02 10:58:15,248 DEBUG awx.main.dispatch delivered 78816e8d-1106-4f0d-8d40-e1bc308b325e to worker[176] qsize 0 2021-11-02 10:58:15,251 DEBUG awx.main.dispatch task 78816e8d-1106-4f0d-8d40-e1bc308b325e starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:58:15,252 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:58:15,269 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:58:15,299 DEBUG awx.main.dispatch task 78816e8d-1106-4f0d-8d40-e1bc308b325e is finished 2021-11-02 10:58:35,230 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f151ebf6-b8f5-4dea-bc20-b6734a2e0a2c, queue=awx_private_queue) [2021-11-02 10:58:35,230: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f151ebf6-b8f5-4dea-bc20-b6734a2e0a2c, queue=awx_private_queue) 2021-11-02 10:58:35,253 DEBUG awx.main.dispatch delivered f151ebf6-b8f5-4dea-bc20-b6734a2e0a2c to worker[178] qsize 0 2021-11-02 10:58:35,257 DEBUG awx.main.dispatch task f151ebf6-b8f5-4dea-bc20-b6734a2e0a2c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:58:35,262 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:58:35,292 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:58:35,335 DEBUG awx.main.dispatch task f151ebf6-b8f5-4dea-bc20-b6734a2e0a2c is finished 2021-11-02 10:58:44,643 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(a80da712-5946-488b-8f02-fa13a279dad2, queue=awx_private_queue) [2021-11-02 10:58:44,643: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(a80da712-5946-488b-8f02-fa13a279dad2, queue=awx_private_queue) 2021-11-02 10:58:44,672 DEBUG awx.main.dispatch delivered a80da712-5946-488b-8f02-fa13a279dad2 to worker[181] qsize 0 2021-11-02 10:58:44,674 DEBUG awx.main.dispatch task a80da712-5946-488b-8f02-fa13a279dad2 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:58:44,684 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:58:44,687 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:58:14.678411+00:00 2021-11-02 10:58:44,721 DEBUG awx.main.dispatch task a80da712-5946-488b-8f02-fa13a279dad2 is finished 2021-11-02 10:58:55,231 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a8976f60-0251-4627-9254-400a8e7cedc5, queue=awx_private_queue) [2021-11-02 10:58:55,231: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a8976f60-0251-4627-9254-400a8e7cedc5, queue=awx_private_queue) 2021-11-02 10:58:55,429 DEBUG awx.main.dispatch delivered a8976f60-0251-4627-9254-400a8e7cedc5 to worker[178] qsize 0 2021-11-02 10:58:55,434 DEBUG awx.main.dispatch task a8976f60-0251-4627-9254-400a8e7cedc5 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:58:55,435 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:58:55,452 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:58:55,479 DEBUG awx.main.dispatch task a8976f60-0251-4627-9254-400a8e7cedc5 is finished RESULT 2 OKREADY 2021-11-02 10:59:14,410 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(583a667d-1c93-4482-b8ba-141a51351632, queue=dev-awx-0) [2021-11-02 10:59:14,410: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(583a667d-1c93-4482-b8ba-141a51351632, queue=dev-awx-0) 2021-11-02 10:59:14,445 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(0e75c2ac-41ef-4ab0-b53b-f382759cbe7e, queue=dev-awx-0) [2021-11-02 10:59:14,445: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(0e75c2ac-41ef-4ab0-b53b-f382759cbe7e, queue=dev-awx-0) 2021-11-02 10:59:14,468 DEBUG awx.main.dispatch delivered 583a667d-1c93-4482-b8ba-141a51351632 to worker[183] qsize 0 2021-11-02 10:59:14,472 DEBUG awx.main.dispatch delivered 0e75c2ac-41ef-4ab0-b53b-f382759cbe7e to worker[181] qsize 0 2021-11-02 10:59:14,473 DEBUG awx.main.dispatch task 583a667d-1c93-4482-b8ba-141a51351632 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 10:59:14,477 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 10:59:14,475 DEBUG awx.main.dispatch task 0e75c2ac-41ef-4ab0-b53b-f382759cbe7e starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 10:59:14,493 DEBUG awx.main.dispatch task 0e75c2ac-41ef-4ab0-b53b-f382759cbe7e is finished 2021-11-02 10:59:14,508 DEBUG awx.main.dispatch task 583a667d-1c93-4482-b8ba-141a51351632 is finished 2021-11-02 10:59:14,643 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(af0a5150-eea2-498f-b5b1-7f3f46dc2d1b, queue=awx_private_queue) [2021-11-02 10:59:14,643: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(af0a5150-eea2-498f-b5b1-7f3f46dc2d1b, queue=awx_private_queue) 2021-11-02 10:59:14,659 DEBUG awx.main.dispatch delivered af0a5150-eea2-498f-b5b1-7f3f46dc2d1b to worker[183] qsize 0 2021-11-02 10:59:14,662 DEBUG awx.main.dispatch task af0a5150-eea2-498f-b5b1-7f3f46dc2d1b starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:59:14,673 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:59:14,676 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:58:44.684434+00:00 2021-11-02 10:59:14,712 DEBUG awx.main.dispatch task af0a5150-eea2-498f-b5b1-7f3f46dc2d1b is finished 2021-11-02 10:59:15,231 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(302bc327-ea00-4e30-9509-53135bafd814, queue=awx_private_queue) [2021-11-02 10:59:15,231: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(302bc327-ea00-4e30-9509-53135bafd814, queue=awx_private_queue) 2021-11-02 10:59:15,247 DEBUG awx.main.dispatch delivered 302bc327-ea00-4e30-9509-53135bafd814 to worker[181] qsize 0 2021-11-02 10:59:15,250 DEBUG awx.main.dispatch task 302bc327-ea00-4e30-9509-53135bafd814 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:59:15,251 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:59:15,268 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:59:15,297 DEBUG awx.main.dispatch task 302bc327-ea00-4e30-9509-53135bafd814 is finished 2021-11-02 10:59:35,243 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c4c1f8a6-f91f-4c92-8c03-ca69589b0df2, queue=awx_private_queue) [2021-11-02 10:59:35,243: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c4c1f8a6-f91f-4c92-8c03-ca69589b0df2, queue=awx_private_queue) 2021-11-02 10:59:35,261 DEBUG awx.main.dispatch delivered c4c1f8a6-f91f-4c92-8c03-ca69589b0df2 to worker[183] qsize 0 2021-11-02 10:59:35,263 DEBUG awx.main.dispatch task c4c1f8a6-f91f-4c92-8c03-ca69589b0df2 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:59:35,265 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:59:35,284 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:59:35,312 DEBUG awx.main.dispatch task c4c1f8a6-f91f-4c92-8c03-ca69589b0df2 is finished 2021-11-02 10:59:44,643 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(7b0f5a7b-cff5-460f-a8b6-17fa0d919541, queue=awx_private_queue) [2021-11-02 10:59:44,643: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(7b0f5a7b-cff5-460f-a8b6-17fa0d919541, queue=awx_private_queue) 2021-11-02 10:59:44,661 DEBUG awx.main.dispatch delivered 7b0f5a7b-cff5-460f-a8b6-17fa0d919541 to worker[176] qsize 0 2021-11-02 10:59:44,665 DEBUG awx.main.dispatch task 7b0f5a7b-cff5-460f-a8b6-17fa0d919541 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 10:59:44,681 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 10:59:44,686 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:59:14.673588+00:00 2021-11-02 10:59:44,700 DEBUG awx.main.dispatch task 7b0f5a7b-cff5-460f-a8b6-17fa0d919541 is finished 2021-11-02 10:59:55,242 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(48689bc9-e398-4941-bed2-8339f8e641df, queue=awx_private_queue) [2021-11-02 10:59:55,242: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(48689bc9-e398-4941-bed2-8339f8e641df, queue=awx_private_queue) 2021-11-02 10:59:55,277 DEBUG awx.main.dispatch delivered 48689bc9-e398-4941-bed2-8339f8e641df to worker[181] qsize 0 2021-11-02 10:59:55,279 DEBUG awx.main.dispatch task 48689bc9-e398-4941-bed2-8339f8e641df starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 10:59:55,282 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 10:59:55,305 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 10:59:55,338 DEBUG awx.main.dispatch task 48689bc9-e398-4941-bed2-8339f8e641df is finished RESULT 2 OKREADY 2021-11-02 11:00:14,403 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(96b9dd62-d839-4113-8570-60575f814d8d, queue=dev-awx-0) [2021-11-02 11:00:14,403: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(96b9dd62-d839-4113-8570-60575f814d8d, queue=dev-awx-0) 2021-11-02 11:00:14,445 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(26370fe1-d7dc-4bd6-8c5c-fdb1995e493a, queue=dev-awx-0) [2021-11-02 11:00:14,445: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(26370fe1-d7dc-4bd6-8c5c-fdb1995e493a, queue=dev-awx-0) 2021-11-02 11:00:14,644 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(259a3852-7dc5-4947-995a-fc64ea0c0676, queue=awx_private_queue) [2021-11-02 11:00:14,644: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(259a3852-7dc5-4947-995a-fc64ea0c0676, queue=awx_private_queue) 2021-11-02 11:00:14,447 DEBUG awx.main.dispatch delivered 96b9dd62-d839-4113-8570-60575f814d8d to worker[183] qsize 0 2021-11-02 11:00:14,684 DEBUG awx.main.dispatch delivered 26370fe1-d7dc-4bd6-8c5c-fdb1995e493a to worker[176] qsize 0 2021-11-02 11:00:14,686 DEBUG awx.main.dispatch delivered 259a3852-7dc5-4947-995a-fc64ea0c0676 to worker[178] qsize 0 2021-11-02 11:00:14,684 DEBUG awx.main.dispatch task 96b9dd62-d839-4113-8570-60575f814d8d starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 11:00:14,687 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 11:00:14,686 DEBUG awx.main.dispatch task 26370fe1-d7dc-4bd6-8c5c-fdb1995e493a starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 11:00:14,690 DEBUG awx.main.dispatch task 259a3852-7dc5-4947-995a-fc64ea0c0676 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:00:14,703 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:00:14,702 DEBUG awx.main.dispatch task 26370fe1-d7dc-4bd6-8c5c-fdb1995e493a is finished 2021-11-02 11:00:14,707 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 10:59:44.681851+00:00 2021-11-02 11:00:14,739 DEBUG awx.main.dispatch task 96b9dd62-d839-4113-8570-60575f814d8d is finished 2021-11-02 11:00:14,741 DEBUG awx.main.dispatch task 259a3852-7dc5-4947-995a-fc64ea0c0676 is finished 2021-11-02 11:00:15,242 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7feaf834-502c-4a0d-8db8-620287768676, queue=awx_private_queue) [2021-11-02 11:00:15,242: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7feaf834-502c-4a0d-8db8-620287768676, queue=awx_private_queue) 2021-11-02 11:00:15,263 DEBUG awx.main.dispatch delivered 7feaf834-502c-4a0d-8db8-620287768676 to worker[183] qsize 0 2021-11-02 11:00:15,266 DEBUG awx.main.dispatch task 7feaf834-502c-4a0d-8db8-620287768676 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:00:15,268 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:00:15,286 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:00:15,318 DEBUG awx.main.dispatch task 7feaf834-502c-4a0d-8db8-620287768676 is finished 2021-11-02 11:00:35,253 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7a243864-e521-4b87-9a11-c24201cdb2a3, queue=awx_private_queue) [2021-11-02 11:00:35,253: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7a243864-e521-4b87-9a11-c24201cdb2a3, queue=awx_private_queue) 2021-11-02 11:00:35,294 DEBUG awx.main.dispatch delivered 7a243864-e521-4b87-9a11-c24201cdb2a3 to worker[178] qsize 0 2021-11-02 11:00:35,297 DEBUG awx.main.dispatch task 7a243864-e521-4b87-9a11-c24201cdb2a3 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:00:35,299 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:00:35,321 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:00:35,358 DEBUG awx.main.dispatch task 7a243864-e521-4b87-9a11-c24201cdb2a3 is finished 2021-11-02 11:00:44,653 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(b7922905-c80f-41cd-9f0a-a02cc5d8f37f, queue=awx_private_queue) [2021-11-02 11:00:44,653: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(b7922905-c80f-41cd-9f0a-a02cc5d8f37f, queue=awx_private_queue) 2021-11-02 11:00:44,696 DEBUG awx.main.dispatch delivered b7922905-c80f-41cd-9f0a-a02cc5d8f37f to worker[178] qsize 0 2021-11-02 11:00:44,706 DEBUG awx.main.dispatch task b7922905-c80f-41cd-9f0a-a02cc5d8f37f starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:00:44,721 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:00:44,726 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 11:00:14.703597+00:00 2021-11-02 11:00:44,764 DEBUG awx.main.dispatch task b7922905-c80f-41cd-9f0a-a02cc5d8f37f is finished 2021-11-02 11:00:55,260 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(8f30f558-92e2-43c5-b8fc-466a91cd79a7, queue=awx_private_queue) [2021-11-02 11:00:55,260: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(8f30f558-92e2-43c5-b8fc-466a91cd79a7, queue=awx_private_queue) 2021-11-02 11:00:55,280 DEBUG awx.main.dispatch delivered 8f30f558-92e2-43c5-b8fc-466a91cd79a7 to worker[176] qsize 0 2021-11-02 11:00:55,284 DEBUG awx.main.dispatch task 8f30f558-92e2-43c5-b8fc-466a91cd79a7 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:00:55,289 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:00:55,309 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:00:55,335 DEBUG awx.main.dispatch task 8f30f558-92e2-43c5-b8fc-466a91cd79a7 is finished RESULT 2 OKREADY 2021-11-02 11:01:14,403 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(7aa9af62-8f02-47d4-be5e-51c0e2609a79, queue=dev-awx-0) [2021-11-02 11:01:14,403: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(7aa9af62-8f02-47d4-be5e-51c0e2609a79, queue=dev-awx-0) 2021-11-02 11:01:14,445 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(fbd79e9c-0927-4450-ac79-b361427bd838, queue=dev-awx-0) [2021-11-02 11:01:14,445: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(fbd79e9c-0927-4450-ac79-b361427bd838, queue=dev-awx-0) 2021-11-02 11:01:14,455 DEBUG awx.main.dispatch delivered 7aa9af62-8f02-47d4-be5e-51c0e2609a79 to worker[181] qsize 0 2021-11-02 11:01:14,463 DEBUG awx.main.dispatch delivered fbd79e9c-0927-4450-ac79-b361427bd838 to worker[178] qsize 0 2021-11-02 11:01:14,466 DEBUG awx.main.dispatch task fbd79e9c-0927-4450-ac79-b361427bd838 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 11:01:14,462 DEBUG awx.main.dispatch task 7aa9af62-8f02-47d4-be5e-51c0e2609a79 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 11:01:14,472 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 11:01:14,484 DEBUG awx.main.dispatch task fbd79e9c-0927-4450-ac79-b361427bd838 is finished 2021-11-02 11:01:14,529 DEBUG awx.main.dispatch task 7aa9af62-8f02-47d4-be5e-51c0e2609a79 is finished 2021-11-02 11:01:14,646 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(58fad754-e6dc-487a-bae0-fc4f84c49478, queue=awx_private_queue) [2021-11-02 11:01:14,646: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(58fad754-e6dc-487a-bae0-fc4f84c49478, queue=awx_private_queue) 2021-11-02 11:01:14,683 DEBUG awx.main.dispatch delivered 58fad754-e6dc-487a-bae0-fc4f84c49478 to worker[178] qsize 0 2021-11-02 11:01:14,685 DEBUG awx.main.dispatch task 58fad754-e6dc-487a-bae0-fc4f84c49478 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:01:14,696 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:01:14,699 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 11:00:44.721477+00:00 2021-11-02 11:01:14,714 DEBUG awx.main.dispatch task 58fad754-e6dc-487a-bae0-fc4f84c49478 is finished 2021-11-02 11:01:15,259 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(950623e2-035d-4686-b4e3-a2cfed3d87fd, queue=awx_private_queue) [2021-11-02 11:01:15,259: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(950623e2-035d-4686-b4e3-a2cfed3d87fd, queue=awx_private_queue) 2021-11-02 11:01:15,277 DEBUG awx.main.dispatch delivered 950623e2-035d-4686-b4e3-a2cfed3d87fd to worker[178] qsize 0 2021-11-02 11:01:15,280 DEBUG awx.main.dispatch task 950623e2-035d-4686-b4e3-a2cfed3d87fd starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:01:15,282 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:01:15,301 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:01:15,346 DEBUG awx.main.dispatch task 950623e2-035d-4686-b4e3-a2cfed3d87fd is finished 2021-11-02 11:01:35,270 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5347c5cf-a155-4ea2-9112-c7b3cf8a866f, queue=awx_private_queue) [2021-11-02 11:01:35,270: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5347c5cf-a155-4ea2-9112-c7b3cf8a866f, queue=awx_private_queue) 2021-11-02 11:01:35,309 DEBUG awx.main.dispatch delivered 5347c5cf-a155-4ea2-9112-c7b3cf8a866f to worker[176] qsize 0 2021-11-02 11:01:35,313 DEBUG awx.main.dispatch task 5347c5cf-a155-4ea2-9112-c7b3cf8a866f starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:01:35,314 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:01:35,333 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:01:35,369 DEBUG awx.main.dispatch task 5347c5cf-a155-4ea2-9112-c7b3cf8a866f is finished 2021-11-02 11:01:44,647 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(49e1483d-cc1c-4c41-b7cd-9a8c050c7677, queue=awx_private_queue) [2021-11-02 11:01:44,647: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(49e1483d-cc1c-4c41-b7cd-9a8c050c7677, queue=awx_private_queue) 2021-11-02 11:01:44,672 DEBUG awx.main.dispatch delivered 49e1483d-cc1c-4c41-b7cd-9a8c050c7677 to worker[183] qsize 0 2021-11-02 11:01:44,677 DEBUG awx.main.dispatch task 49e1483d-cc1c-4c41-b7cd-9a8c050c7677 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:01:44,692 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:01:44,696 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 11:01:14.696281+00:00 2021-11-02 11:01:44,767 DEBUG awx.main.dispatch task 49e1483d-cc1c-4c41-b7cd-9a8c050c7677 is finished 2021-11-02 11:01:55,270 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5049a9c7-a8be-4b80-b72c-1ba7d7162c8a, queue=awx_private_queue) [2021-11-02 11:01:55,270: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5049a9c7-a8be-4b80-b72c-1ba7d7162c8a, queue=awx_private_queue) 2021-11-02 11:01:55,288 DEBUG awx.main.dispatch delivered 5049a9c7-a8be-4b80-b72c-1ba7d7162c8a to worker[178] qsize 0 2021-11-02 11:01:55,291 DEBUG awx.main.dispatch task 5049a9c7-a8be-4b80-b72c-1ba7d7162c8a starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:01:55,292 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:01:55,308 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:01:55,335 DEBUG awx.main.dispatch task 5049a9c7-a8be-4b80-b72c-1ba7d7162c8a is finished RESULT 2 OKREADY 2021-11-02 11:02:14,419 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(f1042570-060c-4a13-82d9-f6acdbcea572, queue=dev-awx-0) [2021-11-02 11:02:14,419: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(f1042570-060c-4a13-82d9-f6acdbcea572, queue=dev-awx-0) 2021-11-02 11:02:14,450 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(121416be-f124-4261-9f02-e600eceaa3a0, queue=dev-awx-0) [2021-11-02 11:02:14,450: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(121416be-f124-4261-9f02-e600eceaa3a0, queue=dev-awx-0) 2021-11-02 11:02:14,482 DEBUG awx.main.dispatch delivered f1042570-060c-4a13-82d9-f6acdbcea572 to worker[176] qsize 0 2021-11-02 11:02:14,489 DEBUG awx.main.dispatch delivered 121416be-f124-4261-9f02-e600eceaa3a0 to worker[181] qsize 0 2021-11-02 11:02:14,491 DEBUG awx.main.dispatch task f1042570-060c-4a13-82d9-f6acdbcea572 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 11:02:14,498 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 11:02:14,495 DEBUG awx.main.dispatch task 121416be-f124-4261-9f02-e600eceaa3a0 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 11:02:14,523 DEBUG awx.main.dispatch task 121416be-f124-4261-9f02-e600eceaa3a0 is finished 2021-11-02 11:02:14,556 DEBUG awx.main.dispatch task f1042570-060c-4a13-82d9-f6acdbcea572 is finished 2021-11-02 11:02:14,646 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(6b4cb684-517a-49a8-882e-bb33e2f148f1, queue=awx_private_queue) [2021-11-02 11:02:14,646: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(6b4cb684-517a-49a8-882e-bb33e2f148f1, queue=awx_private_queue) 2021-11-02 11:02:14,680 DEBUG awx.main.dispatch delivered 6b4cb684-517a-49a8-882e-bb33e2f148f1 to worker[176] qsize 0 2021-11-02 11:02:14,683 DEBUG awx.main.dispatch task 6b4cb684-517a-49a8-882e-bb33e2f148f1 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:02:14,694 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:02:14,697 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 11:01:44.692737+00:00 2021-11-02 11:02:14,725 DEBUG awx.main.dispatch task 6b4cb684-517a-49a8-882e-bb33e2f148f1 is finished 2021-11-02 11:02:15,271 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a778057f-f789-40e1-95c6-f6d69dbce289, queue=awx_private_queue) [2021-11-02 11:02:15,271: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a778057f-f789-40e1-95c6-f6d69dbce289, queue=awx_private_queue) 2021-11-02 11:02:15,292 DEBUG awx.main.dispatch delivered a778057f-f789-40e1-95c6-f6d69dbce289 to worker[176] qsize 0 2021-11-02 11:02:15,295 DEBUG awx.main.dispatch task a778057f-f789-40e1-95c6-f6d69dbce289 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:02:15,297 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:02:15,315 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:02:15,352 DEBUG awx.main.dispatch task a778057f-f789-40e1-95c6-f6d69dbce289 is finished 2021-11-02 11:02:35,273 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d1c768d9-fa71-4b4a-a26c-a3fd9ed4a3f3, queue=awx_private_queue) [2021-11-02 11:02:35,273: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d1c768d9-fa71-4b4a-a26c-a3fd9ed4a3f3, queue=awx_private_queue) 2021-11-02 11:02:35,302 DEBUG awx.main.dispatch delivered d1c768d9-fa71-4b4a-a26c-a3fd9ed4a3f3 to worker[176] qsize 0 2021-11-02 11:02:35,306 DEBUG awx.main.dispatch task d1c768d9-fa71-4b4a-a26c-a3fd9ed4a3f3 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:02:35,309 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:02:35,338 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:02:35,371 DEBUG awx.main.dispatch task d1c768d9-fa71-4b4a-a26c-a3fd9ed4a3f3 is finished 2021-11-02 11:02:44,646 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(2b4e17ae-4d70-4a89-ba21-63853055d9e3, queue=awx_private_queue) [2021-11-02 11:02:44,646: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(2b4e17ae-4d70-4a89-ba21-63853055d9e3, queue=awx_private_queue) 2021-11-02 11:02:44,665 DEBUG awx.main.dispatch delivered 2b4e17ae-4d70-4a89-ba21-63853055d9e3 to worker[178] qsize 0 2021-11-02 11:02:44,670 DEBUG awx.main.dispatch task 2b4e17ae-4d70-4a89-ba21-63853055d9e3 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:02:44,879 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:02:44,885 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 11:02:14.694310+00:00 2021-11-02 11:02:44,977 DEBUG awx.main.dispatch task 2b4e17ae-4d70-4a89-ba21-63853055d9e3 is finished 2021-11-02 11:02:55,271 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a4e5943d-a8d4-4fad-b14c-683512a03b6c, queue=awx_private_queue) [2021-11-02 11:02:55,271: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a4e5943d-a8d4-4fad-b14c-683512a03b6c, queue=awx_private_queue) 2021-11-02 11:02:55,292 DEBUG awx.main.dispatch delivered a4e5943d-a8d4-4fad-b14c-683512a03b6c to worker[176] qsize 0 2021-11-02 11:02:55,295 DEBUG awx.main.dispatch task a4e5943d-a8d4-4fad-b14c-683512a03b6c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:02:55,297 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:02:55,313 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:02:55,342 DEBUG awx.main.dispatch task a4e5943d-a8d4-4fad-b14c-683512a03b6c is finished RESULT 2 OKREADY 2021-11-02 11:03:14,425 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(98e7d776-bbe6-491b-8213-dfd1a4211652, queue=dev-awx-0) [2021-11-02 11:03:14,425: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(98e7d776-bbe6-491b-8213-dfd1a4211652, queue=dev-awx-0) 2021-11-02 11:03:14,450 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(48a85503-e87f-4d32-9c56-5d4644d67e05, queue=dev-awx-0) [2021-11-02 11:03:14,450: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(48a85503-e87f-4d32-9c56-5d4644d67e05, queue=dev-awx-0) 2021-11-02 11:03:14,462 DEBUG awx.main.dispatch delivered 98e7d776-bbe6-491b-8213-dfd1a4211652 to worker[183] qsize 0 2021-11-02 11:03:14,466 DEBUG awx.main.dispatch task 98e7d776-bbe6-491b-8213-dfd1a4211652 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 11:03:14,472 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 11:03:14,487 DEBUG awx.main.dispatch delivered 48a85503-e87f-4d32-9c56-5d4644d67e05 to worker[176] qsize 0 2021-11-02 11:03:14,490 DEBUG awx.main.dispatch task 48a85503-e87f-4d32-9c56-5d4644d67e05 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 11:03:14,505 DEBUG awx.main.dispatch task 48a85503-e87f-4d32-9c56-5d4644d67e05 is finished 2021-11-02 11:03:14,523 DEBUG awx.main.dispatch task 98e7d776-bbe6-491b-8213-dfd1a4211652 is finished 2021-11-02 11:03:14,646 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(700e02c2-12ea-4d09-8ec3-f9dae914b01e, queue=awx_private_queue) [2021-11-02 11:03:14,646: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(700e02c2-12ea-4d09-8ec3-f9dae914b01e, queue=awx_private_queue) 2021-11-02 11:03:14,679 DEBUG awx.main.dispatch delivered 700e02c2-12ea-4d09-8ec3-f9dae914b01e to worker[176] qsize 0 2021-11-02 11:03:14,682 DEBUG awx.main.dispatch task 700e02c2-12ea-4d09-8ec3-f9dae914b01e starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:03:14,691 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:03:14,694 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 11:02:44.879730+00:00 2021-11-02 11:03:14,707 DEBUG awx.main.dispatch task 700e02c2-12ea-4d09-8ec3-f9dae914b01e is finished 2021-11-02 11:03:15,271 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(9bacbea3-c0ea-4005-9fcf-42cb7719c864, queue=awx_private_queue) [2021-11-02 11:03:15,271: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(9bacbea3-c0ea-4005-9fcf-42cb7719c864, queue=awx_private_queue) 2021-11-02 11:03:15,292 DEBUG awx.main.dispatch delivered 9bacbea3-c0ea-4005-9fcf-42cb7719c864 to worker[181] qsize 0 2021-11-02 11:03:15,295 DEBUG awx.main.dispatch task 9bacbea3-c0ea-4005-9fcf-42cb7719c864 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:03:15,297 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:03:15,316 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:03:15,342 DEBUG awx.main.dispatch task 9bacbea3-c0ea-4005-9fcf-42cb7719c864 is finished 2021-11-02 11:03:35,273 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(61b65b3a-1e1f-478f-b03f-9a678bf0aa36, queue=awx_private_queue) [2021-11-02 11:03:35,273: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(61b65b3a-1e1f-478f-b03f-9a678bf0aa36, queue=awx_private_queue) 2021-11-02 11:03:35,297 DEBUG awx.main.dispatch delivered 61b65b3a-1e1f-478f-b03f-9a678bf0aa36 to worker[183] qsize 0 2021-11-02 11:03:35,300 DEBUG awx.main.dispatch task 61b65b3a-1e1f-478f-b03f-9a678bf0aa36 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:03:35,301 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:03:35,318 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:03:35,347 DEBUG awx.main.dispatch task 61b65b3a-1e1f-478f-b03f-9a678bf0aa36 is finished 2021-11-02 11:03:44,646 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(b707a0f4-72b3-4d39-9558-d7439f843915, queue=awx_private_queue) [2021-11-02 11:03:44,646: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(b707a0f4-72b3-4d39-9558-d7439f843915, queue=awx_private_queue) 2021-11-02 11:03:44,669 DEBUG awx.main.dispatch delivered b707a0f4-72b3-4d39-9558-d7439f843915 to worker[178] qsize 0 2021-11-02 11:03:44,674 DEBUG awx.main.dispatch task b707a0f4-72b3-4d39-9558-d7439f843915 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:03:44,687 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:03:44,692 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 11:03:14.691754+00:00 2021-11-02 11:03:44,779 DEBUG awx.main.dispatch task b707a0f4-72b3-4d39-9558-d7439f843915 is finished 2021-11-02 11:03:55,277 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(346f68ed-0c35-46d4-aa71-800d03ebaf12, queue=awx_private_queue) [2021-11-02 11:03:55,277: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(346f68ed-0c35-46d4-aa71-800d03ebaf12, queue=awx_private_queue) 2021-11-02 11:03:55,572 DEBUG awx.main.dispatch delivered 346f68ed-0c35-46d4-aa71-800d03ebaf12 to worker[176] qsize 0 2021-11-02 11:03:55,587 DEBUG awx.main.dispatch task 346f68ed-0c35-46d4-aa71-800d03ebaf12 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:03:55,594 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:03:55,632 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:03:55,683 DEBUG awx.main.dispatch task 346f68ed-0c35-46d4-aa71-800d03ebaf12 is finished RESULT 2 OKREADY 2021-11-02 11:04:14,437 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(cd7b30b8-fa50-40f4-89f8-6efda88bd121, queue=dev-awx-0) [2021-11-02 11:04:14,437: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(cd7b30b8-fa50-40f4-89f8-6efda88bd121, queue=dev-awx-0) 2021-11-02 11:04:14,468 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(fc11a8fc-ecf7-48c9-8ca9-49ec5a4b5e3b, queue=dev-awx-0) [2021-11-02 11:04:14,468: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(fc11a8fc-ecf7-48c9-8ca9-49ec5a4b5e3b, queue=dev-awx-0) 2021-11-02 11:04:14,492 DEBUG awx.main.dispatch delivered cd7b30b8-fa50-40f4-89f8-6efda88bd121 to worker[183] qsize 0 2021-11-02 11:04:14,499 DEBUG awx.main.dispatch delivered fc11a8fc-ecf7-48c9-8ca9-49ec5a4b5e3b to worker[176] qsize 0 2021-11-02 11:04:14,501 DEBUG awx.main.dispatch task fc11a8fc-ecf7-48c9-8ca9-49ec5a4b5e3b starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 11:04:14,501 DEBUG awx.main.dispatch task cd7b30b8-fa50-40f4-89f8-6efda88bd121 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 11:04:14,510 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 11:04:14,517 DEBUG awx.main.dispatch task fc11a8fc-ecf7-48c9-8ca9-49ec5a4b5e3b is finished 2021-11-02 11:04:14,553 DEBUG awx.main.dispatch task cd7b30b8-fa50-40f4-89f8-6efda88bd121 is finished 2021-11-02 11:04:14,647 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(56df5e2a-63ab-46bd-9817-436dda5a8d28, queue=awx_private_queue) [2021-11-02 11:04:14,647: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(56df5e2a-63ab-46bd-9817-436dda5a8d28, queue=awx_private_queue) 2021-11-02 11:04:14,671 DEBUG awx.main.dispatch delivered 56df5e2a-63ab-46bd-9817-436dda5a8d28 to worker[178] qsize 0 2021-11-02 11:04:14,677 DEBUG awx.main.dispatch task 56df5e2a-63ab-46bd-9817-436dda5a8d28 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:04:14,697 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:04:14,705 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 11:03:44.687912+00:00 2021-11-02 11:04:14,724 DEBUG awx.main.dispatch task 56df5e2a-63ab-46bd-9817-436dda5a8d28 is finished 2021-11-02 11:04:15,273 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e39842b5-7605-42f6-84c0-3c47b1e64908, queue=awx_private_queue) [2021-11-02 11:04:15,273: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e39842b5-7605-42f6-84c0-3c47b1e64908, queue=awx_private_queue) 2021-11-02 11:04:15,293 DEBUG awx.main.dispatch delivered e39842b5-7605-42f6-84c0-3c47b1e64908 to worker[176] qsize 0 2021-11-02 11:04:15,296 DEBUG awx.main.dispatch task e39842b5-7605-42f6-84c0-3c47b1e64908 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:04:15,297 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:04:15,313 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:04:15,340 DEBUG awx.main.dispatch task e39842b5-7605-42f6-84c0-3c47b1e64908 is finished 2021-11-02 11:04:35,283 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f3f449f2-3b62-48d6-a18c-960eb1424f50, queue=awx_private_queue) [2021-11-02 11:04:35,283: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f3f449f2-3b62-48d6-a18c-960eb1424f50, queue=awx_private_queue) 2021-11-02 11:04:35,307 DEBUG awx.main.dispatch delivered f3f449f2-3b62-48d6-a18c-960eb1424f50 to worker[176] qsize 0 2021-11-02 11:04:35,310 DEBUG awx.main.dispatch task f3f449f2-3b62-48d6-a18c-960eb1424f50 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:04:35,311 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:04:35,328 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:04:35,358 DEBUG awx.main.dispatch task f3f449f2-3b62-48d6-a18c-960eb1424f50 is finished 2021-11-02 11:04:44,646 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(07d3285b-42a0-47c2-b0ea-d7450c52a752, queue=awx_private_queue) [2021-11-02 11:04:44,646: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(07d3285b-42a0-47c2-b0ea-d7450c52a752, queue=awx_private_queue) 2021-11-02 11:04:44,672 DEBUG awx.main.dispatch delivered 07d3285b-42a0-47c2-b0ea-d7450c52a752 to worker[178] qsize 0 2021-11-02 11:04:44,675 DEBUG awx.main.dispatch task 07d3285b-42a0-47c2-b0ea-d7450c52a752 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:04:44,685 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:04:44,687 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 11:04:14.698169+00:00 2021-11-02 11:04:44,700 DEBUG awx.main.dispatch task 07d3285b-42a0-47c2-b0ea-d7450c52a752 is finished 2021-11-02 11:04:55,283 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(4e28f92b-dcf0-4d96-b017-3dc29fe1edbb, queue=awx_private_queue) [2021-11-02 11:04:55,283: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(4e28f92b-dcf0-4d96-b017-3dc29fe1edbb, queue=awx_private_queue) 2021-11-02 11:04:55,483 DEBUG awx.main.dispatch delivered 4e28f92b-dcf0-4d96-b017-3dc29fe1edbb to worker[183] qsize 0 2021-11-02 11:04:55,486 DEBUG awx.main.dispatch task 4e28f92b-dcf0-4d96-b017-3dc29fe1edbb starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:04:55,488 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:04:55,512 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:04:55,547 DEBUG awx.main.dispatch task 4e28f92b-dcf0-4d96-b017-3dc29fe1edbb is finished RESULT 2 OKREADY 2021-11-02 11:05:14,435 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(1a941a2b-16b0-4922-bf1f-20b48da82829, queue=dev-awx-0) [2021-11-02 11:05:14,435: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(1a941a2b-16b0-4922-bf1f-20b48da82829, queue=dev-awx-0) 2021-11-02 11:05:14,468 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(51478c4d-a00b-48d4-9297-c3905e8f9e2e, queue=dev-awx-0) [2021-11-02 11:05:14,468: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(51478c4d-a00b-48d4-9297-c3905e8f9e2e, queue=dev-awx-0) 2021-11-02 11:05:14,478 DEBUG awx.main.dispatch delivered 1a941a2b-16b0-4922-bf1f-20b48da82829 to worker[178] qsize 0 2021-11-02 11:05:14,481 DEBUG awx.main.dispatch task 1a941a2b-16b0-4922-bf1f-20b48da82829 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 11:05:14,484 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 11:05:14,492 DEBUG awx.main.dispatch delivered 51478c4d-a00b-48d4-9297-c3905e8f9e2e to worker[176] qsize 0 2021-11-02 11:05:14,494 DEBUG awx.main.dispatch task 51478c4d-a00b-48d4-9297-c3905e8f9e2e starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 11:05:14,509 DEBUG awx.main.dispatch task 51478c4d-a00b-48d4-9297-c3905e8f9e2e is finished 2021-11-02 11:05:14,529 DEBUG awx.main.dispatch task 1a941a2b-16b0-4922-bf1f-20b48da82829 is finished 2021-11-02 11:05:14,646 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(cff597b5-4c8d-43a2-b5c6-4ecd7ed3eafb, queue=awx_private_queue) [2021-11-02 11:05:14,646: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(cff597b5-4c8d-43a2-b5c6-4ecd7ed3eafb, queue=awx_private_queue) 2021-11-02 11:05:14,665 DEBUG awx.main.dispatch delivered cff597b5-4c8d-43a2-b5c6-4ecd7ed3eafb to worker[181] qsize 0 2021-11-02 11:05:14,673 DEBUG awx.main.dispatch task cff597b5-4c8d-43a2-b5c6-4ecd7ed3eafb starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:05:14,694 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:05:14,701 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 11:04:44.685572+00:00 2021-11-02 11:05:14,720 DEBUG awx.main.dispatch task cff597b5-4c8d-43a2-b5c6-4ecd7ed3eafb is finished 2021-11-02 11:05:15,283 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(55d0d7d7-e696-4747-9830-6b982c9543c4, queue=awx_private_queue) [2021-11-02 11:05:15,283: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(55d0d7d7-e696-4747-9830-6b982c9543c4, queue=awx_private_queue) 2021-11-02 11:05:15,301 DEBUG awx.main.dispatch delivered 55d0d7d7-e696-4747-9830-6b982c9543c4 to worker[178] qsize 0 2021-11-02 11:05:15,304 DEBUG awx.main.dispatch task 55d0d7d7-e696-4747-9830-6b982c9543c4 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:05:15,305 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:05:15,323 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:05:15,352 DEBUG awx.main.dispatch task 55d0d7d7-e696-4747-9830-6b982c9543c4 is finished 2021-11-02 11:05:35,290 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(11dcea98-881d-4e2d-9456-7a765d04cf66, queue=awx_private_queue) [2021-11-02 11:05:35,290: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(11dcea98-881d-4e2d-9456-7a765d04cf66, queue=awx_private_queue) 2021-11-02 11:05:35,326 DEBUG awx.main.dispatch delivered 11dcea98-881d-4e2d-9456-7a765d04cf66 to worker[178] qsize 0 2021-11-02 11:05:35,336 DEBUG awx.main.dispatch task 11dcea98-881d-4e2d-9456-7a765d04cf66 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:05:35,340 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:05:35,364 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:05:35,400 DEBUG awx.main.dispatch task 11dcea98-881d-4e2d-9456-7a765d04cf66 is finished 2021-11-02 11:05:44,648 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(9d1f911c-907f-4ea5-91a4-25599e9e6bb5, queue=awx_private_queue) [2021-11-02 11:05:44,648: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(9d1f911c-907f-4ea5-91a4-25599e9e6bb5, queue=awx_private_queue) 2021-11-02 11:05:44,677 DEBUG awx.main.dispatch delivered 9d1f911c-907f-4ea5-91a4-25599e9e6bb5 to worker[176] qsize 0 2021-11-02 11:05:44,683 DEBUG awx.main.dispatch task 9d1f911c-907f-4ea5-91a4-25599e9e6bb5 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:05:44,699 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:05:44,705 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 11:05:14.694823+00:00 2021-11-02 11:05:44,751 DEBUG awx.main.dispatch task 9d1f911c-907f-4ea5-91a4-25599e9e6bb5 is finished 2021-11-02 11:05:55,288 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(faa11061-ce97-4f58-accf-47e365f005d9, queue=awx_private_queue) [2021-11-02 11:05:55,288: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(faa11061-ce97-4f58-accf-47e365f005d9, queue=awx_private_queue) 2021-11-02 11:05:55,522 DEBUG awx.main.dispatch delivered faa11061-ce97-4f58-accf-47e365f005d9 to worker[181] qsize 0 2021-11-02 11:05:55,527 DEBUG awx.main.dispatch task faa11061-ce97-4f58-accf-47e365f005d9 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:05:55,533 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:05:55,560 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:05:55,590 DEBUG awx.main.dispatch task faa11061-ce97-4f58-accf-47e365f005d9 is finished RESULT 2 OKREADY 2021-11-02 11:06:14,445 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(c505915f-433a-49fc-9e88-6dd3ff3760dd, queue=dev-awx-0) [2021-11-02 11:06:14,445: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(c505915f-433a-49fc-9e88-6dd3ff3760dd, queue=dev-awx-0) 2021-11-02 11:06:14,469 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(8909d72c-f084-4e65-a837-0f8908ff93d5, queue=dev-awx-0) [2021-11-02 11:06:14,469: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(8909d72c-f084-4e65-a837-0f8908ff93d5, queue=dev-awx-0) 2021-11-02 11:06:14,490 DEBUG awx.main.dispatch delivered c505915f-433a-49fc-9e88-6dd3ff3760dd to worker[181] qsize 0 2021-11-02 11:06:14,493 DEBUG awx.main.dispatch task c505915f-433a-49fc-9e88-6dd3ff3760dd starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 11:06:14,493 DEBUG awx.main.dispatch delivered 8909d72c-f084-4e65-a837-0f8908ff93d5 to worker[183] qsize 0 2021-11-02 11:06:14,495 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 11:06:14,499 DEBUG awx.main.dispatch task 8909d72c-f084-4e65-a837-0f8908ff93d5 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 11:06:14,522 DEBUG awx.main.dispatch task 8909d72c-f084-4e65-a837-0f8908ff93d5 is finished 2021-11-02 11:06:14,553 DEBUG awx.main.dispatch task c505915f-433a-49fc-9e88-6dd3ff3760dd is finished 2021-11-02 11:06:14,647 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(78ee4578-e732-44c6-8ea6-0e6006981e74, queue=awx_private_queue) [2021-11-02 11:06:14,647: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(78ee4578-e732-44c6-8ea6-0e6006981e74, queue=awx_private_queue) 2021-11-02 11:06:14,674 DEBUG awx.main.dispatch delivered 78ee4578-e732-44c6-8ea6-0e6006981e74 to worker[178] qsize 0 2021-11-02 11:06:14,678 DEBUG awx.main.dispatch task 78ee4578-e732-44c6-8ea6-0e6006981e74 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:06:14,693 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:06:14,697 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 11:05:44.699502+00:00 2021-11-02 11:06:14,716 DEBUG awx.main.dispatch task 78ee4578-e732-44c6-8ea6-0e6006981e74 is finished 2021-11-02 11:06:15,287 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(78aec906-e738-48c5-bc4e-f8d44c9f4523, queue=awx_private_queue) [2021-11-02 11:06:15,287: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(78aec906-e738-48c5-bc4e-f8d44c9f4523, queue=awx_private_queue) 2021-11-02 11:06:15,308 DEBUG awx.main.dispatch delivered 78aec906-e738-48c5-bc4e-f8d44c9f4523 to worker[181] qsize 0 2021-11-02 11:06:15,311 DEBUG awx.main.dispatch task 78aec906-e738-48c5-bc4e-f8d44c9f4523 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:06:15,314 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:06:15,330 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:06:15,357 DEBUG awx.main.dispatch task 78aec906-e738-48c5-bc4e-f8d44c9f4523 is finished 2021-11-02 11:06:35,287 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(fa16504d-e6f1-4152-9241-46d848444c61, queue=awx_private_queue) [2021-11-02 11:06:35,287: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(fa16504d-e6f1-4152-9241-46d848444c61, queue=awx_private_queue) 2021-11-02 11:06:35,303 DEBUG awx.main.dispatch delivered fa16504d-e6f1-4152-9241-46d848444c61 to worker[178] qsize 0 2021-11-02 11:06:35,305 DEBUG awx.main.dispatch task fa16504d-e6f1-4152-9241-46d848444c61 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:06:35,307 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:06:35,323 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:06:35,351 DEBUG awx.main.dispatch task fa16504d-e6f1-4152-9241-46d848444c61 is finished 2021-11-02 11:06:44,647 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(31bd037d-5747-4096-863e-06e7989ae3f8, queue=awx_private_queue) [2021-11-02 11:06:44,647: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(31bd037d-5747-4096-863e-06e7989ae3f8, queue=awx_private_queue) 2021-11-02 11:06:44,669 DEBUG awx.main.dispatch delivered 31bd037d-5747-4096-863e-06e7989ae3f8 to worker[178] qsize 0 2021-11-02 11:06:44,672 DEBUG awx.main.dispatch task 31bd037d-5747-4096-863e-06e7989ae3f8 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:06:44,683 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:06:44,687 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 11:06:14.694145+00:00 2021-11-02 11:06:44,732 DEBUG awx.main.dispatch task 31bd037d-5747-4096-863e-06e7989ae3f8 is finished 2021-11-02 11:06:55,290 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c842b321-a983-49f5-8ef3-4f3ce2fab292, queue=awx_private_queue) [2021-11-02 11:06:55,290: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c842b321-a983-49f5-8ef3-4f3ce2fab292, queue=awx_private_queue) 2021-11-02 11:06:55,492 DEBUG awx.main.dispatch delivered c842b321-a983-49f5-8ef3-4f3ce2fab292 to worker[183] qsize 0 2021-11-02 11:06:55,494 DEBUG awx.main.dispatch task c842b321-a983-49f5-8ef3-4f3ce2fab292 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:06:55,495 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:06:55,513 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:06:55,542 DEBUG awx.main.dispatch task c842b321-a983-49f5-8ef3-4f3ce2fab292 is finished RESULT 2 OKREADY 2021-11-02 11:07:14,457 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(72049f5b-92db-415a-bc69-8b909c42b88d, queue=dev-awx-0) [2021-11-02 11:07:14,457: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(72049f5b-92db-415a-bc69-8b909c42b88d, queue=dev-awx-0) 2021-11-02 11:07:14,499 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(fb5862d3-7357-439c-87ea-29599d536af9, queue=dev-awx-0) [2021-11-02 11:07:14,499: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(fb5862d3-7357-439c-87ea-29599d536af9, queue=dev-awx-0) 2021-11-02 11:07:14,516 DEBUG awx.main.dispatch delivered 72049f5b-92db-415a-bc69-8b909c42b88d to worker[176] qsize 0 2021-11-02 11:07:14,523 DEBUG awx.main.dispatch delivered fb5862d3-7357-439c-87ea-29599d536af9 to worker[181] qsize 0 2021-11-02 11:07:14,526 DEBUG awx.main.dispatch task 72049f5b-92db-415a-bc69-8b909c42b88d starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 11:07:14,537 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 11:07:14,537 DEBUG awx.main.dispatch task fb5862d3-7357-439c-87ea-29599d536af9 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 11:07:14,571 DEBUG awx.main.dispatch task fb5862d3-7357-439c-87ea-29599d536af9 is finished 2021-11-02 11:07:14,598 DEBUG awx.main.dispatch task 72049f5b-92db-415a-bc69-8b909c42b88d is finished 2021-11-02 11:07:14,648 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(febcac4b-1ef6-4b42-961d-eeebeb7962d4, queue=awx_private_queue) [2021-11-02 11:07:14,648: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(febcac4b-1ef6-4b42-961d-eeebeb7962d4, queue=awx_private_queue) 2021-11-02 11:07:14,672 DEBUG awx.main.dispatch delivered febcac4b-1ef6-4b42-961d-eeebeb7962d4 to worker[176] qsize 0 2021-11-02 11:07:14,676 DEBUG awx.main.dispatch task febcac4b-1ef6-4b42-961d-eeebeb7962d4 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:07:14,688 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:07:14,691 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 11:06:44.684096+00:00 2021-11-02 11:07:14,710 DEBUG awx.main.dispatch task febcac4b-1ef6-4b42-961d-eeebeb7962d4 is finished 2021-11-02 11:07:15,290 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(9701b0ac-2a13-4d1d-8419-896bed851048, queue=awx_private_queue) [2021-11-02 11:07:15,290: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(9701b0ac-2a13-4d1d-8419-896bed851048, queue=awx_private_queue) 2021-11-02 11:07:15,311 DEBUG awx.main.dispatch delivered 9701b0ac-2a13-4d1d-8419-896bed851048 to worker[181] qsize 0 2021-11-02 11:07:15,316 DEBUG awx.main.dispatch task 9701b0ac-2a13-4d1d-8419-896bed851048 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:07:15,319 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:07:15,337 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:07:15,370 DEBUG awx.main.dispatch task 9701b0ac-2a13-4d1d-8419-896bed851048 is finished 2021-11-02 11:07:35,302 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(fe42577c-1381-4127-94ab-0e0660f425fb, queue=awx_private_queue) [2021-11-02 11:07:35,302: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(fe42577c-1381-4127-94ab-0e0660f425fb, queue=awx_private_queue) 2021-11-02 11:07:35,348 DEBUG awx.main.dispatch delivered fe42577c-1381-4127-94ab-0e0660f425fb to worker[178] qsize 0 2021-11-02 11:07:35,353 DEBUG awx.main.dispatch task fe42577c-1381-4127-94ab-0e0660f425fb starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:07:35,360 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:07:35,388 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:07:35,419 DEBUG awx.main.dispatch task fe42577c-1381-4127-94ab-0e0660f425fb is finished 2021-11-02 11:07:44,648 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(4ef1835a-a67f-46c3-bfcb-916e2230fcc8, queue=awx_private_queue) [2021-11-02 11:07:44,648: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(4ef1835a-a67f-46c3-bfcb-916e2230fcc8, queue=awx_private_queue) 2021-11-02 11:07:44,674 DEBUG awx.main.dispatch delivered 4ef1835a-a67f-46c3-bfcb-916e2230fcc8 to worker[176] qsize 0 2021-11-02 11:07:44,677 DEBUG awx.main.dispatch task 4ef1835a-a67f-46c3-bfcb-916e2230fcc8 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:07:44,688 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:07:44,692 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 11:07:14.688242+00:00 2021-11-02 11:07:44,730 DEBUG awx.main.dispatch task 4ef1835a-a67f-46c3-bfcb-916e2230fcc8 is finished 2021-11-02 11:07:55,303 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(736d9261-e562-4c47-91ac-24b079262117, queue=awx_private_queue) [2021-11-02 11:07:55,303: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(736d9261-e562-4c47-91ac-24b079262117, queue=awx_private_queue) 2021-11-02 11:07:55,539 DEBUG awx.main.dispatch delivered 736d9261-e562-4c47-91ac-24b079262117 to worker[183] qsize 0 2021-11-02 11:07:55,543 DEBUG awx.main.dispatch task 736d9261-e562-4c47-91ac-24b079262117 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:07:55,549 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:07:55,569 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:07:55,597 DEBUG awx.main.dispatch task 736d9261-e562-4c47-91ac-24b079262117 is finished RESULT 2 OKREADY 2021-11-02 11:08:14,013 DEBUG awx.main.dispatch publish awx.main.tasks.awx_isolated_heartbeat(f86de3ba-a2ba-4186-85ed-08111e3df2b4, queue=dev-awx-0) [2021-11-02 11:08:14,013: DEBUG/Process-1] publish awx.main.tasks.awx_isolated_heartbeat(f86de3ba-a2ba-4186-85ed-08111e3df2b4, queue=dev-awx-0) 2021-11-02 11:08:14,037 DEBUG awx.main.dispatch delivered f86de3ba-a2ba-4186-85ed-08111e3df2b4 to worker[181] qsize 0 2021-11-02 11:08:14,040 DEBUG awx.main.dispatch task f86de3ba-a2ba-4186-85ed-08111e3df2b4 starting awx.main.tasks.awx_isolated_heartbeat(*[]) 2021-11-02 11:08:14,042 DEBUG awx.main.tasks Controlling node checking for any isolated management tasks. 2021-11-02 11:08:14,067 DEBUG awx.main.dispatch task f86de3ba-a2ba-4186-85ed-08111e3df2b4 is finished 2021-11-02 11:08:14,450 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(67bb64cd-775a-4013-9808-563a257a7f8d, queue=dev-awx-0) [2021-11-02 11:08:14,450: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(67bb64cd-775a-4013-9808-563a257a7f8d, queue=dev-awx-0) 2021-11-02 11:08:14,488 DEBUG awx.main.dispatch delivered 67bb64cd-775a-4013-9808-563a257a7f8d to worker[183] qsize 0 2021-11-02 11:08:14,491 DEBUG awx.main.dispatch task 67bb64cd-775a-4013-9808-563a257a7f8d starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 11:08:14,493 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 11:08:14,500 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(b634d791-6197-42c5-8458-a9b2ceb3d74e, queue=dev-awx-0) [2021-11-02 11:08:14,500: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(b634d791-6197-42c5-8458-a9b2ceb3d74e, queue=dev-awx-0) 2021-11-02 11:08:14,517 DEBUG awx.main.dispatch delivered b634d791-6197-42c5-8458-a9b2ceb3d74e to worker[178] qsize 0 2021-11-02 11:08:14,520 DEBUG awx.main.dispatch task b634d791-6197-42c5-8458-a9b2ceb3d74e starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 11:08:14,535 DEBUG awx.main.dispatch task b634d791-6197-42c5-8458-a9b2ceb3d74e is finished 2021-11-02 11:08:14,543 DEBUG awx.main.dispatch task 67bb64cd-775a-4013-9808-563a257a7f8d is finished 2021-11-02 11:08:14,648 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(a9318c20-65b3-43a9-8e49-c9ee89ec2d04, queue=awx_private_queue) [2021-11-02 11:08:14,648: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(a9318c20-65b3-43a9-8e49-c9ee89ec2d04, queue=awx_private_queue) 2021-11-02 11:08:14,672 DEBUG awx.main.dispatch delivered a9318c20-65b3-43a9-8e49-c9ee89ec2d04 to worker[183] qsize 0 2021-11-02 11:08:14,675 DEBUG awx.main.dispatch task a9318c20-65b3-43a9-8e49-c9ee89ec2d04 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:08:14,686 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:08:14,689 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 11:07:44.688715+00:00 2021-11-02 11:08:14,705 DEBUG awx.main.dispatch task a9318c20-65b3-43a9-8e49-c9ee89ec2d04 is finished 2021-11-02 11:08:15,303 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(60dfd286-9858-40a8-8112-89180c863c0a, queue=awx_private_queue) [2021-11-02 11:08:15,303: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(60dfd286-9858-40a8-8112-89180c863c0a, queue=awx_private_queue) 2021-11-02 11:08:15,325 DEBUG awx.main.dispatch delivered 60dfd286-9858-40a8-8112-89180c863c0a to worker[178] qsize 0 2021-11-02 11:08:15,329 DEBUG awx.main.dispatch task 60dfd286-9858-40a8-8112-89180c863c0a starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:08:15,331 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:08:15,353 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:08:15,393 DEBUG awx.main.dispatch task 60dfd286-9858-40a8-8112-89180c863c0a is finished 2021-11-02 11:08:35,310 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(1b65b82b-c5b8-43ab-928c-b69b6d8da98c, queue=awx_private_queue) [2021-11-02 11:08:35,310: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(1b65b82b-c5b8-43ab-928c-b69b6d8da98c, queue=awx_private_queue) 2021-11-02 11:08:35,334 DEBUG awx.main.dispatch delivered 1b65b82b-c5b8-43ab-928c-b69b6d8da98c to worker[178] qsize 0 2021-11-02 11:08:35,338 DEBUG awx.main.dispatch task 1b65b82b-c5b8-43ab-928c-b69b6d8da98c starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:08:35,340 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:08:35,359 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:08:35,390 DEBUG awx.main.dispatch task 1b65b82b-c5b8-43ab-928c-b69b6d8da98c is finished 2021-11-02 11:08:44,661 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(53c026f0-b97d-4543-8b90-71fc051f6b79, queue=awx_private_queue) [2021-11-02 11:08:44,661: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(53c026f0-b97d-4543-8b90-71fc051f6b79, queue=awx_private_queue) 2021-11-02 11:08:44,702 DEBUG awx.main.dispatch delivered 53c026f0-b97d-4543-8b90-71fc051f6b79 to worker[176] qsize 0 2021-11-02 11:08:44,718 DEBUG awx.main.dispatch task 53c026f0-b97d-4543-8b90-71fc051f6b79 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:08:44,740 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:08:44,747 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 11:08:14.686714+00:00 2021-11-02 11:08:44,790 DEBUG awx.main.dispatch task 53c026f0-b97d-4543-8b90-71fc051f6b79 is finished 2021-11-02 11:08:55,311 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c5193ce4-e88f-409a-937e-1e198a011277, queue=awx_private_queue) [2021-11-02 11:08:55,311: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c5193ce4-e88f-409a-937e-1e198a011277, queue=awx_private_queue) 2021-11-02 11:08:55,514 DEBUG awx.main.dispatch delivered c5193ce4-e88f-409a-937e-1e198a011277 to worker[183] qsize 0 2021-11-02 11:08:55,518 DEBUG awx.main.dispatch task c5193ce4-e88f-409a-937e-1e198a011277 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:08:55,521 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:08:55,547 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:08:55,585 DEBUG awx.main.dispatch task c5193ce4-e88f-409a-937e-1e198a011277 is finished RESULT 2 OKREADY 2021-11-02 11:09:14,451 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(a81924e6-b73c-4eb3-b537-87bdd3a6963a, queue=dev-awx-0) [2021-11-02 11:09:14,451: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(a81924e6-b73c-4eb3-b537-87bdd3a6963a, queue=dev-awx-0) 2021-11-02 11:09:14,500 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(a3cc8ed0-f4b3-42a6-bcbe-ec8818a2c744, queue=dev-awx-0) [2021-11-02 11:09:14,500: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(a3cc8ed0-f4b3-42a6-bcbe-ec8818a2c744, queue=dev-awx-0) 2021-11-02 11:09:14,503 DEBUG awx.main.dispatch delivered a81924e6-b73c-4eb3-b537-87bdd3a6963a to worker[178] qsize 0 2021-11-02 11:09:14,509 DEBUG awx.main.dispatch task a81924e6-b73c-4eb3-b537-87bdd3a6963a starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 11:09:14,515 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 11:09:14,520 DEBUG awx.main.dispatch delivered a3cc8ed0-f4b3-42a6-bcbe-ec8818a2c744 to worker[176] qsize 0 2021-11-02 11:09:14,522 DEBUG awx.main.dispatch task a3cc8ed0-f4b3-42a6-bcbe-ec8818a2c744 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 11:09:14,537 DEBUG awx.main.dispatch task a3cc8ed0-f4b3-42a6-bcbe-ec8818a2c744 is finished 2021-11-02 11:09:14,553 DEBUG awx.main.dispatch task a81924e6-b73c-4eb3-b537-87bdd3a6963a is finished 2021-11-02 11:09:14,652 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d29ea1c9-4147-41b5-8e1f-686eef92f65d, queue=awx_private_queue) [2021-11-02 11:09:14,652: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d29ea1c9-4147-41b5-8e1f-686eef92f65d, queue=awx_private_queue) 2021-11-02 11:09:14,669 DEBUG awx.main.dispatch delivered d29ea1c9-4147-41b5-8e1f-686eef92f65d to worker[183] qsize 0 2021-11-02 11:09:14,672 DEBUG awx.main.dispatch task d29ea1c9-4147-41b5-8e1f-686eef92f65d starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:09:14,681 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:09:14,684 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 11:08:44.740464+00:00 2021-11-02 11:09:14,699 DEBUG awx.main.dispatch task d29ea1c9-4147-41b5-8e1f-686eef92f65d is finished 2021-11-02 11:09:15,311 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(fe1b633f-d1c2-4a39-8258-a0e51ace7eb2, queue=awx_private_queue) [2021-11-02 11:09:15,311: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(fe1b633f-d1c2-4a39-8258-a0e51ace7eb2, queue=awx_private_queue) 2021-11-02 11:09:15,335 DEBUG awx.main.dispatch delivered fe1b633f-d1c2-4a39-8258-a0e51ace7eb2 to worker[181] qsize 0 2021-11-02 11:09:15,342 DEBUG awx.main.dispatch task fe1b633f-d1c2-4a39-8258-a0e51ace7eb2 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:09:15,347 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:09:15,377 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:09:15,414 DEBUG awx.main.dispatch task fe1b633f-d1c2-4a39-8258-a0e51ace7eb2 is finished 2021-11-02 11:09:35,317 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0d407f25-674b-4173-a0d2-daba74c24f8e, queue=awx_private_queue) [2021-11-02 11:09:35,317: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0d407f25-674b-4173-a0d2-daba74c24f8e, queue=awx_private_queue) 2021-11-02 11:09:35,334 DEBUG awx.main.dispatch delivered 0d407f25-674b-4173-a0d2-daba74c24f8e to worker[176] qsize 0 2021-11-02 11:09:35,337 DEBUG awx.main.dispatch task 0d407f25-674b-4173-a0d2-daba74c24f8e starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:09:35,338 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:09:35,356 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:09:35,392 DEBUG awx.main.dispatch task 0d407f25-674b-4173-a0d2-daba74c24f8e is finished 2021-11-02 11:09:44,652 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(a8c903d4-b179-48a9-9794-ef8592feb816, queue=awx_private_queue) [2021-11-02 11:09:44,652: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(a8c903d4-b179-48a9-9794-ef8592feb816, queue=awx_private_queue) 2021-11-02 11:09:44,675 DEBUG awx.main.dispatch delivered a8c903d4-b179-48a9-9794-ef8592feb816 to worker[183] qsize 0 2021-11-02 11:09:44,679 DEBUG awx.main.dispatch task a8c903d4-b179-48a9-9794-ef8592feb816 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:09:44,690 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:09:44,693 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 11:09:14.681551+00:00 2021-11-02 11:09:44,729 DEBUG awx.main.dispatch task a8c903d4-b179-48a9-9794-ef8592feb816 is finished 2021-11-02 11:09:55,324 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(866b227a-1b48-48c3-be3c-344855e7b24e, queue=awx_private_queue) [2021-11-02 11:09:55,324: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(866b227a-1b48-48c3-be3c-344855e7b24e, queue=awx_private_queue) 2021-11-02 11:09:55,562 DEBUG awx.main.dispatch delivered 866b227a-1b48-48c3-be3c-344855e7b24e to worker[176] qsize 0 2021-11-02 11:09:55,565 DEBUG awx.main.dispatch task 866b227a-1b48-48c3-be3c-344855e7b24e starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:09:55,569 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:09:55,589 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:09:55,623 DEBUG awx.main.dispatch task 866b227a-1b48-48c3-be3c-344855e7b24e is finished RESULT 2 OKREADY 2021-11-02 11:10:14,468 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(c3b7ff77-2541-4fdc-86a4-9dc60b53492c, queue=dev-awx-0) [2021-11-02 11:10:14,468: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(c3b7ff77-2541-4fdc-86a4-9dc60b53492c, queue=dev-awx-0) 2021-11-02 11:10:14,500 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(d38386b7-adad-403c-a4d0-4540fb89d308, queue=dev-awx-0) [2021-11-02 11:10:14,500: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(d38386b7-adad-403c-a4d0-4540fb89d308, queue=dev-awx-0) 2021-11-02 11:10:14,517 DEBUG awx.main.dispatch delivered c3b7ff77-2541-4fdc-86a4-9dc60b53492c to worker[178] qsize 0 2021-11-02 11:10:14,523 DEBUG awx.main.dispatch delivered d38386b7-adad-403c-a4d0-4540fb89d308 to worker[183] qsize 0 2021-11-02 11:10:14,522 DEBUG awx.main.dispatch task c3b7ff77-2541-4fdc-86a4-9dc60b53492c starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 11:10:14,527 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 11:10:14,528 DEBUG awx.main.dispatch task d38386b7-adad-403c-a4d0-4540fb89d308 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 11:10:14,555 DEBUG awx.main.dispatch task d38386b7-adad-403c-a4d0-4540fb89d308 is finished 2021-11-02 11:10:14,608 DEBUG awx.main.dispatch task c3b7ff77-2541-4fdc-86a4-9dc60b53492c is finished 2021-11-02 11:10:14,652 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(0a022aaa-43c3-453a-8072-f314f437e645, queue=awx_private_queue) [2021-11-02 11:10:14,652: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(0a022aaa-43c3-453a-8072-f314f437e645, queue=awx_private_queue) 2021-11-02 11:10:14,676 DEBUG awx.main.dispatch delivered 0a022aaa-43c3-453a-8072-f314f437e645 to worker[183] qsize 0 2021-11-02 11:10:14,679 DEBUG awx.main.dispatch task 0a022aaa-43c3-453a-8072-f314f437e645 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:10:14,688 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:10:14,691 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 11:09:44.690527+00:00 2021-11-02 11:10:14,710 DEBUG awx.main.dispatch task 0a022aaa-43c3-453a-8072-f314f437e645 is finished 2021-11-02 11:10:15,323 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(30c1aeb0-631a-4147-864d-c4ad21bc01af, queue=awx_private_queue) [2021-11-02 11:10:15,323: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(30c1aeb0-631a-4147-864d-c4ad21bc01af, queue=awx_private_queue) 2021-11-02 11:10:15,340 DEBUG awx.main.dispatch delivered 30c1aeb0-631a-4147-864d-c4ad21bc01af to worker[178] qsize 0 2021-11-02 11:10:15,344 DEBUG awx.main.dispatch task 30c1aeb0-631a-4147-864d-c4ad21bc01af starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:10:15,346 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:10:15,365 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:10:15,400 DEBUG awx.main.dispatch task 30c1aeb0-631a-4147-864d-c4ad21bc01af is finished 2021-11-02 11:10:35,335 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(db5820d1-f48f-4d01-9fd6-1d1c9fe6dacb, queue=awx_private_queue) [2021-11-02 11:10:35,335: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(db5820d1-f48f-4d01-9fd6-1d1c9fe6dacb, queue=awx_private_queue) 2021-11-02 11:10:35,369 DEBUG awx.main.dispatch delivered db5820d1-f48f-4d01-9fd6-1d1c9fe6dacb to worker[181] qsize 0 2021-11-02 11:10:35,374 DEBUG awx.main.dispatch task db5820d1-f48f-4d01-9fd6-1d1c9fe6dacb starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:10:35,380 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:10:35,410 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:10:35,445 DEBUG awx.main.dispatch task db5820d1-f48f-4d01-9fd6-1d1c9fe6dacb is finished 2021-11-02 11:10:44,653 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(c5db85c6-c330-4e98-ab03-eee62b6b8876, queue=awx_private_queue) [2021-11-02 11:10:44,653: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(c5db85c6-c330-4e98-ab03-eee62b6b8876, queue=awx_private_queue) 2021-11-02 11:10:44,677 DEBUG awx.main.dispatch delivered c5db85c6-c330-4e98-ab03-eee62b6b8876 to worker[176] qsize 0 2021-11-02 11:10:44,682 DEBUG awx.main.dispatch task c5db85c6-c330-4e98-ab03-eee62b6b8876 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:10:44,699 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:10:44,705 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 11:10:14.688614+00:00 2021-11-02 11:10:44,762 DEBUG awx.main.dispatch task c5db85c6-c330-4e98-ab03-eee62b6b8876 is finished 2021-11-02 11:10:55,332 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(521459ba-5fe3-4535-a948-0038dd7f44c6, queue=awx_private_queue) [2021-11-02 11:10:55,332: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(521459ba-5fe3-4535-a948-0038dd7f44c6, queue=awx_private_queue) 2021-11-02 11:10:55,561 DEBUG awx.main.dispatch delivered 521459ba-5fe3-4535-a948-0038dd7f44c6 to worker[176] qsize 0 2021-11-02 11:10:55,564 DEBUG awx.main.dispatch task 521459ba-5fe3-4535-a948-0038dd7f44c6 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:10:55,565 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:10:55,585 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:10:55,618 DEBUG awx.main.dispatch task 521459ba-5fe3-4535-a948-0038dd7f44c6 is finished RESULT 2 OKREADY 2021-11-02 11:11:14,463 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(c1d6ac4c-9538-438b-b58a-a595802a0440, queue=dev-awx-0) [2021-11-02 11:11:14,463: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(c1d6ac4c-9538-438b-b58a-a595802a0440, queue=dev-awx-0) 2021-11-02 11:11:14,500 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(ff779fc2-5998-49fa-a5ed-3ffb69992081, queue=dev-awx-0) [2021-11-02 11:11:14,500: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(ff779fc2-5998-49fa-a5ed-3ffb69992081, queue=dev-awx-0) 2021-11-02 11:11:14,502 DEBUG awx.main.dispatch delivered c1d6ac4c-9538-438b-b58a-a595802a0440 to worker[181] qsize 0 2021-11-02 11:11:14,505 DEBUG awx.main.dispatch task c1d6ac4c-9538-438b-b58a-a595802a0440 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 11:11:14,507 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 11:11:14,518 DEBUG awx.main.dispatch delivered ff779fc2-5998-49fa-a5ed-3ffb69992081 to worker[178] qsize 0 2021-11-02 11:11:14,520 DEBUG awx.main.dispatch task ff779fc2-5998-49fa-a5ed-3ffb69992081 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 11:11:14,537 DEBUG awx.main.dispatch task ff779fc2-5998-49fa-a5ed-3ffb69992081 is finished 2021-11-02 11:11:14,589 DEBUG awx.main.dispatch task c1d6ac4c-9538-438b-b58a-a595802a0440 is finished 2021-11-02 11:11:14,653 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(7e7e602f-4667-449a-b44a-5b8375315fa8, queue=awx_private_queue) [2021-11-02 11:11:14,653: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(7e7e602f-4667-449a-b44a-5b8375315fa8, queue=awx_private_queue) 2021-11-02 11:11:14,672 DEBUG awx.main.dispatch delivered 7e7e602f-4667-449a-b44a-5b8375315fa8 to worker[178] qsize 0 2021-11-02 11:11:14,675 DEBUG awx.main.dispatch task 7e7e602f-4667-449a-b44a-5b8375315fa8 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:11:14,687 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:11:14,690 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 11:10:44.699669+00:00 2021-11-02 11:11:14,708 DEBUG awx.main.dispatch task 7e7e602f-4667-449a-b44a-5b8375315fa8 is finished 2021-11-02 11:11:15,332 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(30b71bba-9111-429a-b8a7-e616cd567682, queue=awx_private_queue) [2021-11-02 11:11:15,332: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(30b71bba-9111-429a-b8a7-e616cd567682, queue=awx_private_queue) 2021-11-02 11:11:15,354 DEBUG awx.main.dispatch delivered 30b71bba-9111-429a-b8a7-e616cd567682 to worker[183] qsize 0 2021-11-02 11:11:15,359 DEBUG awx.main.dispatch task 30b71bba-9111-429a-b8a7-e616cd567682 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:11:15,362 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:11:15,386 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:11:15,423 DEBUG awx.main.dispatch task 30b71bba-9111-429a-b8a7-e616cd567682 is finished 2021-11-02 11:11:35,343 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7fb761aa-cbf3-4146-b786-d74a01f86f50, queue=awx_private_queue) [2021-11-02 11:11:35,343: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7fb761aa-cbf3-4146-b786-d74a01f86f50, queue=awx_private_queue) 2021-11-02 11:11:35,366 DEBUG awx.main.dispatch delivered 7fb761aa-cbf3-4146-b786-d74a01f86f50 to worker[183] qsize 0 2021-11-02 11:11:35,369 DEBUG awx.main.dispatch task 7fb761aa-cbf3-4146-b786-d74a01f86f50 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:11:35,371 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:11:35,389 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:11:35,417 DEBUG awx.main.dispatch task 7fb761aa-cbf3-4146-b786-d74a01f86f50 is finished 2021-11-02 11:11:44,653 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(6d3572c1-b533-40b9-acfb-8b920e28142b, queue=awx_private_queue) [2021-11-02 11:11:44,653: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(6d3572c1-b533-40b9-acfb-8b920e28142b, queue=awx_private_queue) 2021-11-02 11:11:44,679 DEBUG awx.main.dispatch delivered 6d3572c1-b533-40b9-acfb-8b920e28142b to worker[181] qsize 0 2021-11-02 11:11:44,682 DEBUG awx.main.dispatch task 6d3572c1-b533-40b9-acfb-8b920e28142b starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:11:44,694 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:11:44,699 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 11:11:14.687247+00:00 2021-11-02 11:11:44,749 DEBUG awx.main.dispatch task 6d3572c1-b533-40b9-acfb-8b920e28142b is finished 2021-11-02 11:11:55,346 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ffb4f039-08d8-4207-bb98-01db6dab64f4, queue=awx_private_queue) [2021-11-02 11:11:55,346: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ffb4f039-08d8-4207-bb98-01db6dab64f4, queue=awx_private_queue) 2021-11-02 11:11:55,571 DEBUG awx.main.dispatch delivered ffb4f039-08d8-4207-bb98-01db6dab64f4 to worker[183] qsize 0 2021-11-02 11:11:55,579 DEBUG awx.main.dispatch task ffb4f039-08d8-4207-bb98-01db6dab64f4 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:11:55,585 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:11:55,609 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:11:55,639 DEBUG awx.main.dispatch task ffb4f039-08d8-4207-bb98-01db6dab64f4 is finished RESULT 2 OKREADY 2021-11-02 11:12:14,475 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(bc43e5a3-9a7a-4138-842e-95cd3d4a9f99, queue=dev-awx-0) [2021-11-02 11:12:14,475: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(bc43e5a3-9a7a-4138-842e-95cd3d4a9f99, queue=dev-awx-0) 2021-11-02 11:12:14,506 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(5ff9798e-039a-4122-8ed5-98c6c1e14592, queue=dev-awx-0) [2021-11-02 11:12:14,506: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(5ff9798e-039a-4122-8ed5-98c6c1e14592, queue=dev-awx-0) 2021-11-02 11:12:14,531 DEBUG awx.main.dispatch delivered bc43e5a3-9a7a-4138-842e-95cd3d4a9f99 to worker[178] qsize 0 2021-11-02 11:12:14,534 DEBUG awx.main.dispatch delivered 5ff9798e-039a-4122-8ed5-98c6c1e14592 to worker[176] qsize 0 2021-11-02 11:12:14,537 DEBUG awx.main.dispatch task bc43e5a3-9a7a-4138-842e-95cd3d4a9f99 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 11:12:14,543 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 11:12:14,540 DEBUG awx.main.dispatch task 5ff9798e-039a-4122-8ed5-98c6c1e14592 starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 11:12:14,570 DEBUG awx.main.dispatch task 5ff9798e-039a-4122-8ed5-98c6c1e14592 is finished 2021-11-02 11:12:14,653 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(bfd56126-ecd4-4df7-bf08-8009020c7e97, queue=awx_private_queue) [2021-11-02 11:12:14,653: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(bfd56126-ecd4-4df7-bf08-8009020c7e97, queue=awx_private_queue) 2021-11-02 11:12:14,676 DEBUG awx.main.dispatch delivered bfd56126-ecd4-4df7-bf08-8009020c7e97 to worker[176] qsize 0 2021-11-02 11:12:14,679 DEBUG awx.main.dispatch task bfd56126-ecd4-4df7-bf08-8009020c7e97 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:12:14,690 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:12:14,694 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 11:11:44.695119+00:00 2021-11-02 11:12:14,756 DEBUG awx.main.dispatch task bc43e5a3-9a7a-4138-842e-95cd3d4a9f99 is finished 2021-11-02 11:12:14,774 DEBUG awx.main.dispatch task bfd56126-ecd4-4df7-bf08-8009020c7e97 is finished 2021-11-02 11:12:15,344 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(1db5a2f2-16b8-460c-9de0-0dce4b8a9d93, queue=awx_private_queue) [2021-11-02 11:12:15,344: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(1db5a2f2-16b8-460c-9de0-0dce4b8a9d93, queue=awx_private_queue) 2021-11-02 11:12:15,369 DEBUG awx.main.dispatch delivered 1db5a2f2-16b8-460c-9de0-0dce4b8a9d93 to worker[181] qsize 0 2021-11-02 11:12:15,376 DEBUG awx.main.dispatch task 1db5a2f2-16b8-460c-9de0-0dce4b8a9d93 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:12:15,382 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:12:15,407 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:12:15,443 DEBUG awx.main.dispatch task 1db5a2f2-16b8-460c-9de0-0dce4b8a9d93 is finished 2021-11-02 11:12:35,344 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(4e86e0a4-6315-4030-854a-3261c24b2b77, queue=awx_private_queue) [2021-11-02 11:12:35,344: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(4e86e0a4-6315-4030-854a-3261c24b2b77, queue=awx_private_queue) 2021-11-02 11:12:35,377 DEBUG awx.main.dispatch delivered 4e86e0a4-6315-4030-854a-3261c24b2b77 to worker[176] qsize 0 2021-11-02 11:12:35,381 DEBUG awx.main.dispatch task 4e86e0a4-6315-4030-854a-3261c24b2b77 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:12:35,382 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:12:35,400 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:12:35,429 DEBUG awx.main.dispatch task 4e86e0a4-6315-4030-854a-3261c24b2b77 is finished 2021-11-02 11:12:44,653 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(556b5459-7014-4cb5-be11-8de637429ebb, queue=awx_private_queue) [2021-11-02 11:12:44,653: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(556b5459-7014-4cb5-be11-8de637429ebb, queue=awx_private_queue) 2021-11-02 11:12:44,679 DEBUG awx.main.dispatch delivered 556b5459-7014-4cb5-be11-8de637429ebb to worker[176] qsize 0 2021-11-02 11:12:44,682 DEBUG awx.main.dispatch task 556b5459-7014-4cb5-be11-8de637429ebb starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:12:44,692 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:12:44,696 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 11:12:14.690456+00:00 2021-11-02 11:12:44,744 DEBUG awx.main.dispatch task 556b5459-7014-4cb5-be11-8de637429ebb is finished 2021-11-02 11:12:55,347 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(76e5d157-108a-4fdc-b426-e7593b5b94b2, queue=awx_private_queue) [2021-11-02 11:12:55,347: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(76e5d157-108a-4fdc-b426-e7593b5b94b2, queue=awx_private_queue) 2021-11-02 11:12:55,363 DEBUG awx.main.dispatch delivered 76e5d157-108a-4fdc-b426-e7593b5b94b2 to worker[183] qsize 0 2021-11-02 11:12:55,365 DEBUG awx.main.dispatch task 76e5d157-108a-4fdc-b426-e7593b5b94b2 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:12:55,368 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:12:55,388 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:12:55,422 DEBUG awx.main.dispatch task 76e5d157-108a-4fdc-b426-e7593b5b94b2 is finished RESULT 2 OKREADY 2021-11-02 11:13:14,473 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(3fbef9ba-ae93-486a-b005-9bc83240c9f3, queue=dev-awx-0) [2021-11-02 11:13:14,473: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(3fbef9ba-ae93-486a-b005-9bc83240c9f3, queue=dev-awx-0) 2021-11-02 11:13:14,686 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(f33af07f-018c-4ac1-9990-c8df2247aa1e, queue=dev-awx-0) [2021-11-02 11:13:14,686: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(f33af07f-018c-4ac1-9990-c8df2247aa1e, queue=dev-awx-0) 2021-11-02 11:13:14,701 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(415c65c2-75ec-4231-84fa-c14d573f76d9, queue=awx_private_queue) [2021-11-02 11:13:14,701: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(415c65c2-75ec-4231-84fa-c14d573f76d9, queue=awx_private_queue) 2021-11-02 11:13:14,701 DEBUG awx.main.dispatch delivered 3fbef9ba-ae93-486a-b005-9bc83240c9f3 to worker[183] qsize 0 2021-11-02 11:13:14,704 DEBUG awx.main.dispatch task 3fbef9ba-ae93-486a-b005-9bc83240c9f3 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 11:13:14,706 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 11:13:14,705 DEBUG awx.main.dispatch delivered f33af07f-018c-4ac1-9990-c8df2247aa1e to worker[178] qsize 0 2021-11-02 11:13:14,707 DEBUG awx.main.dispatch task f33af07f-018c-4ac1-9990-c8df2247aa1e starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 11:13:14,719 DEBUG awx.main.dispatch delivered 415c65c2-75ec-4231-84fa-c14d573f76d9 to worker[181] qsize 0 2021-11-02 11:13:14,720 DEBUG awx.main.dispatch task f33af07f-018c-4ac1-9990-c8df2247aa1e is finished 2021-11-02 11:13:14,721 DEBUG awx.main.dispatch task 415c65c2-75ec-4231-84fa-c14d573f76d9 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:13:14,732 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:13:14,735 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 11:12:44.693084+00:00 2021-11-02 11:13:14,751 DEBUG awx.main.dispatch task 3fbef9ba-ae93-486a-b005-9bc83240c9f3 is finished 2021-11-02 11:13:14,772 DEBUG awx.main.dispatch task 415c65c2-75ec-4231-84fa-c14d573f76d9 is finished 2021-11-02 11:13:15,348 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(9e8987af-5f78-4859-ade1-7bc5720ede9a, queue=awx_private_queue) [2021-11-02 11:13:15,348: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(9e8987af-5f78-4859-ade1-7bc5720ede9a, queue=awx_private_queue) 2021-11-02 11:13:15,371 DEBUG awx.main.dispatch delivered 9e8987af-5f78-4859-ade1-7bc5720ede9a to worker[178] qsize 0 2021-11-02 11:13:15,375 DEBUG awx.main.dispatch task 9e8987af-5f78-4859-ade1-7bc5720ede9a starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:13:15,376 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:13:15,393 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:13:15,420 DEBUG awx.main.dispatch task 9e8987af-5f78-4859-ade1-7bc5720ede9a is finished 2021-11-02 11:13:35,364 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b993e823-6811-4da4-89d4-23493fd99b0d, queue=awx_private_queue) [2021-11-02 11:13:35,364: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b993e823-6811-4da4-89d4-23493fd99b0d, queue=awx_private_queue) 2021-11-02 11:13:35,395 DEBUG awx.main.dispatch delivered b993e823-6811-4da4-89d4-23493fd99b0d to worker[181] qsize 0 2021-11-02 11:13:35,405 DEBUG awx.main.dispatch task b993e823-6811-4da4-89d4-23493fd99b0d starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:13:35,409 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:13:35,430 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:13:35,459 DEBUG awx.main.dispatch task b993e823-6811-4da4-89d4-23493fd99b0d is finished 2021-11-02 11:13:44,703 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(924b9722-9dea-41d6-ae64-8eea98589129, queue=awx_private_queue) [2021-11-02 11:13:44,703: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(924b9722-9dea-41d6-ae64-8eea98589129, queue=awx_private_queue) 2021-11-02 11:13:44,729 DEBUG awx.main.dispatch delivered 924b9722-9dea-41d6-ae64-8eea98589129 to worker[178] qsize 0 2021-11-02 11:13:44,735 DEBUG awx.main.dispatch task 924b9722-9dea-41d6-ae64-8eea98589129 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:13:44,751 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:13:44,756 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 11:13:14.732458+00:00 2021-11-02 11:13:44,858 DEBUG awx.main.dispatch task 924b9722-9dea-41d6-ae64-8eea98589129 is finished 2021-11-02 11:13:55,362 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ee18cf11-d540-4da6-8daa-0b347451b5f5, queue=awx_private_queue) [2021-11-02 11:13:55,362: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ee18cf11-d540-4da6-8daa-0b347451b5f5, queue=awx_private_queue) 2021-11-02 11:13:55,383 DEBUG awx.main.dispatch delivered ee18cf11-d540-4da6-8daa-0b347451b5f5 to worker[181] qsize 0 2021-11-02 11:13:55,386 DEBUG awx.main.dispatch task ee18cf11-d540-4da6-8daa-0b347451b5f5 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:13:55,387 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:13:55,405 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:13:55,436 DEBUG awx.main.dispatch task ee18cf11-d540-4da6-8daa-0b347451b5f5 is finished RESULT 2 OKREADY 2021-11-02 11:14:14,474 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(9e06122b-7834-4630-9713-8e0f6e180be3, queue=dev-awx-0) [2021-11-02 11:14:14,474: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(9e06122b-7834-4630-9713-8e0f6e180be3, queue=dev-awx-0) 2021-11-02 11:14:14,542 DEBUG awx.main.dispatch delivered 9e06122b-7834-4630-9713-8e0f6e180be3 to worker[176] qsize 0 2021-11-02 11:14:14,687 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(814fc4ba-4f62-4d0f-9448-55462218885c, queue=dev-awx-0) [2021-11-02 11:14:14,687: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(814fc4ba-4f62-4d0f-9448-55462218885c, queue=dev-awx-0) 2021-11-02 11:14:14,709 DEBUG awx.main.dispatch delivered 814fc4ba-4f62-4d0f-9448-55462218885c to worker[178] qsize 0 2021-11-02 11:14:14,711 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(92617e55-3fbc-4c9f-8b76-ec36219f2ea2, queue=awx_private_queue) [2021-11-02 11:14:14,711: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(92617e55-3fbc-4c9f-8b76-ec36219f2ea2, queue=awx_private_queue) 2021-11-02 11:14:14,740 DEBUG awx.main.dispatch delivered 92617e55-3fbc-4c9f-8b76-ec36219f2ea2 to worker[181] qsize 0 2021-11-02 11:14:14,553 DEBUG awx.main.dispatch task 9e06122b-7834-4630-9713-8e0f6e180be3 starting awx.main.tasks.cluster_node_heartbeat(*[]) 2021-11-02 11:14:14,780 DEBUG awx.main.tasks Cluster node heartbeat task. 2021-11-02 11:14:14,858 DEBUG awx.main.dispatch task 9e06122b-7834-4630-9713-8e0f6e180be3 is finished 2021-11-02 11:14:14,712 DEBUG awx.main.dispatch task 814fc4ba-4f62-4d0f-9448-55462218885c starting awx.main.tasks.awx_k8s_reaper(*[]) 2021-11-02 11:14:14,927 DEBUG awx.main.dispatch task 814fc4ba-4f62-4d0f-9448-55462218885c is finished 2021-11-02 11:14:14,742 DEBUG awx.main.dispatch task 92617e55-3fbc-4c9f-8b76-ec36219f2ea2 starting awx.main.tasks.awx_periodic_scheduler(*[]) 2021-11-02 11:14:14,978 DEBUG awx.main.tasks Starting periodic scheduler 2021-11-02 11:14:14,981 DEBUG awx.main.tasks Last scheduler run was: 2021-11-02 11:13:44.751673+00:00 2021-11-02 11:14:15,013 DEBUG awx.main.dispatch task 92617e55-3fbc-4c9f-8b76-ec36219f2ea2 is finished 2021-11-02 11:14:15,362 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3dbe75c9-55b3-4aeb-985e-44f8950dfe27, queue=awx_private_queue) [2021-11-02 11:14:15,362: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3dbe75c9-55b3-4aeb-985e-44f8950dfe27, queue=awx_private_queue) 2021-11-02 11:14:15,384 DEBUG awx.main.dispatch delivered 3dbe75c9-55b3-4aeb-985e-44f8950dfe27 to worker[183] qsize 0 2021-11-02 11:14:15,391 DEBUG awx.main.dispatch task 3dbe75c9-55b3-4aeb-985e-44f8950dfe27 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:14:15,398 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:14:15,423 DEBUG awx.main.scheduler Starting Scheduler 2021-11-02 11:14:15,461 DEBUG awx.main.dispatch task 3dbe75c9-55b3-4aeb-985e-44f8950dfe27 is finished 2021-11-02 11:14:35,372 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(367b3b94-f619-4cd5-ba38-66b6200fb629, queue=awx_private_queue) [2021-11-02 11:14:35,372: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(367b3b94-f619-4cd5-ba38-66b6200fb629, queue=awx_private_queue) 2021-11-02 11:14:35,397 DEBUG awx.main.dispatch delivered 367b3b94-f619-4cd5-ba38-66b6200fb629 to worker[176] qsize 0 2021-11-02 11:14:35,400 DEBUG awx.main.dispatch task 367b3b94-f619-4cd5-ba38-66b6200fb629 starting awx.main.scheduler.tasks.run_task_manager(*[]) 2021-11-02 11:14:35,402 DEBUG awx.main.scheduler Running Tower task manager. 2021-11-02 11:14:35,423 DEBUG awx.main.scheduler Starting Sch