By type
Using /etc/ansible/ansible.cfg as config file
127.0.0.1 | SUCCESS => {
"ansible_facts": {
"discovered_interpreter_python": "/usr/libexec/platform-python"
},
"changed": false,
"elapsed": 0,
"match_groupdict": {},
"match_groups": [],
"path": null,
"port": 5432,
"search_regex": null,
"state": "started"
}
Using /etc/ansible/ansible.cfg as config file
127.0.0.1 | FAILED! => {
"ansible_facts": {
"discovered_interpreter_python": "/usr/libexec/platform-python"
},
"changed": false,
"msg": "argument port is of type and we were unable to convert to int: cannot be converted to an int"
}
Using /etc/ansible/ansible.cfg as config file
127.0.0.1 | FAILED! => {
"ansible_facts": {
"discovered_interpreter_python": "/usr/libexec/platform-python"
},
"changed": false,
"msg": "argument port is of type and we were unable to convert to int: cannot be converted to an int"
}
Using /etc/ansible/ansible.cfg as config file
127.0.0.1 | SUCCESS => {
"ansible_facts": {
"discovered_interpreter_python": "/usr/libexec/platform-python"
},
"changed": false,
"db": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER"
}
Default organization added.
Demo Credential, Inventory, and Job Template added.
(changed: True)
2023-02-18 02:54:41,722 DEBUG awx.main.dispatch publish awx.main.tasks.apply_cluster_membership_policies(6b0863c6-c480-4c5d-b892-ecfe3dab2336, queue=awx_private_queue)
Successfully registered instance onap-awx-0
(changed: True)
2023-02-18 02:54:45,808 DEBUG awx.main.dispatch publish awx.main.tasks.apply_cluster_membership_policies(94a51cbb-c942-4073-8da1-64a65704e203, queue=awx_private_queue)
2023-02-18 02:54:45,911 DEBUG awx.main.dispatch publish awx.main.tasks.apply_cluster_membership_policies(cf095ca5-7e61-4728-8c61-cc42b41ffc57, queue=awx_private_queue)
Creating instance group tower
(changed: True)
/usr/bin/launch_awx_task.sh: line 27: unset: `#!/bin/sh': not a valid identifier
2023-02-18 02:54:46,782 INFO RPC interface 'supervisor' initialized
2023-02-18 02:54:46,782 CRIT Server 'unix_http_server' running without any HTTP authentication checking
2023-02-18 02:54:46,783 INFO supervisord started with pid 150
2023-02-18 02:54:47,787 INFO spawned: 'awx-config-watcher' with pid 153
2023-02-18 02:54:47,790 INFO spawned: 'dispatcher' with pid 154
2023-02-18 02:54:47,794 INFO spawned: 'callback-receiver' with pid 155
2023-02-18 02:54:47,798 INFO spawned: 'channels-worker' with pid 156
READY
2023-02-18 02:54:48,932 INFO success: awx-config-watcher entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-02-18 02:54:48,932 INFO success: dispatcher entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-02-18 02:54:48,932 INFO success: callback-receiver entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-02-18 02:54:48,932 INFO success: channels-worker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-02-18 02:54:51,297 ERROR celery.beat Removing corrupted schedule file '/var/lib/awx/beat.db': error(11, 'Resource temporarily unavailable')
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/celery/beat.py", line 485, in setup_schedule
self._store = self._open_schedule()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/celery/beat.py", line 475, in _open_schedule
return self.persistence.open(self.schedule_filename, writeback=True)
File "/usr/lib64/python3.6/shelve.py", line 243, in open
return DbfilenameShelf(filename, flag, protocol, writeback)
File "/usr/lib64/python3.6/shelve.py", line 227, in __init__
Shelf.__init__(self, dbm.open(filename, flag), protocol, writeback)
File "/usr/lib64/python3.6/dbm/__init__.py", line 94, in open
return mod.open(file, flag, mode)
_gdbm.error: [Errno 11] Resource temporarily unavailable
2023-02-18 02:54:51,353 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:176
2023-02-18 02:54:51,353 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:176
2023-02-18 02:54:51,359 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:177
2023-02-18 02:54:51,359 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:177
2023-02-18 02:54:51,365 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:178
2023-02-18 02:54:51,365 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:178
2023-02-18 02:54:51,371 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:179
2023-02-18 02:54:51,371 WARNING awx.main.commands.run_callback_receiver scaling up worker pid:179
2023-02-18 02:54:51,379 - INFO - runworker - Using single-threaded worker.
2023-02-18 02:54:51,379 - INFO - runworker - Running worker against channel layer default (asgi_amqp.core.AMQPChannelLayer)
2023-02-18 02:54:51,380 - INFO - worker - Listening on channels websocket.connect, websocket.disconnect, websocket.receive
2023-02-18 02:54:51,490 WARNING awx.main.dispatch scaling up worker pid:180
2023-02-18 02:54:51,505 WARNING awx.main.dispatch scaling up worker pid:181
2023-02-18 02:54:51,517 WARNING awx.main.dispatch scaling up worker pid:182
2023-02-18 02:54:51,532 WARNING awx.main.dispatch scaling up worker pid:183
2023-02-18 02:54:51,540 DEBUG awx.main.tasks Syncing Schedules
2023-02-18 02:54:52,322 DEBUG awx.main.tasks Waited 0.010642290115356445 seconds to obtain lock name: cluster_policy_lock
2023-02-18 02:54:52,343 DEBUG awx.main.tasks Total non-isolated instances:1 available for policy: 1
2023-02-18 02:54:52,343 DEBUG awx.main.tasks Policy percentage, adding Instances [1] to Group tower
2023-02-18 02:54:52,344 DEBUG awx.main.tasks Adding instances [1] to group tower
2023-02-18 02:54:52,405 DEBUG awx.main.tasks Cluster policy computation finished in 0.08295226097106934 seconds
2023-02-18 02:54:52,412 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 02:54:52,470 DEBUG awx.main.dispatch listening on ['awx_private_queue [direct]', 'onap-awx-0 [direct]', 'tower_broadcast_all_onap-awx-0 [fanout]']
RESULT 2
OKREADY
2023-02-18 02:55:11,476 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(497028db-66f9-4d42-bd52-15e665c03957, queue=awx_private_queue)
[2023-02-18 02:55:11,476: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(497028db-66f9-4d42-bd52-15e665c03957, queue=awx_private_queue)
2023-02-18 02:55:11,494 DEBUG awx.main.dispatch delivered 497028db-66f9-4d42-bd52-15e665c03957 to worker[182] qsize 0
2023-02-18 02:55:11,500 DEBUG awx.main.dispatch task 497028db-66f9-4d42-bd52-15e665c03957 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 02:55:11,503 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 02:55:11,620 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 02:55:11,874 DEBUG awx.main.dispatch task 497028db-66f9-4d42-bd52-15e665c03957 is finished
2023-02-18 02:55:21,463 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(0638b8ae-686a-47c9-b231-e230e6910e9b, queue=awx_private_queue)
[2023-02-18 02:55:21,463: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(0638b8ae-686a-47c9-b231-e230e6910e9b, queue=awx_private_queue)
2023-02-18 02:55:21,478 DEBUG awx.main.dispatch delivered 0638b8ae-686a-47c9-b231-e230e6910e9b to worker[180] qsize 0
2023-02-18 02:55:21,482 DEBUG awx.main.dispatch task 0638b8ae-686a-47c9-b231-e230e6910e9b starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 02:55:21,536 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 02:55:21,580 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 02:55:21.550854+00:00
2023-02-18 02:55:21,660 DEBUG awx.main.dispatch task 0638b8ae-686a-47c9-b231-e230e6910e9b is finished
2023-02-18 02:55:31,463 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a6b0db86-0d30-4cd5-9e65-56d5d056373a, queue=awx_private_queue)
[2023-02-18 02:55:31,463: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a6b0db86-0d30-4cd5-9e65-56d5d056373a, queue=awx_private_queue)
2023-02-18 02:55:31,532 DEBUG awx.main.dispatch delivered a6b0db86-0d30-4cd5-9e65-56d5d056373a to worker[182] qsize 0
2023-02-18 02:55:31,535 DEBUG awx.main.dispatch task a6b0db86-0d30-4cd5-9e65-56d5d056373a starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 02:55:31,537 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 02:55:31,635 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 02:55:31,713 DEBUG awx.main.dispatch task a6b0db86-0d30-4cd5-9e65-56d5d056373a is finished
2023-02-18 02:55:51,465 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(a779445b-98c8-43a1-b860-6052cc5ee399, queue=onap-awx-0)
[2023-02-18 02:55:51,465: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(a779445b-98c8-43a1-b860-6052cc5ee399, queue=onap-awx-0)
2023-02-18 02:55:51,749 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(daef6da2-767c-4f2f-890d-a265226bc60d, queue=onap-awx-0)
[2023-02-18 02:55:51,749: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(daef6da2-767c-4f2f-890d-a265226bc60d, queue=onap-awx-0)
2023-02-18 02:55:51,764 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(a70ee703-3b2b-4956-9382-118a1f2a7fe5, queue=awx_private_queue)
[2023-02-18 02:55:51,764: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(a70ee703-3b2b-4956-9382-118a1f2a7fe5, queue=awx_private_queue)
2023-02-18 02:55:51,780 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d5fb9c7a-0eab-48f5-b78d-fc4cfffe5f81, queue=awx_private_queue)
[2023-02-18 02:55:51,780: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d5fb9c7a-0eab-48f5-b78d-fc4cfffe5f81, queue=awx_private_queue)
2023-02-18 02:55:51,805 DEBUG awx.main.dispatch delivered a779445b-98c8-43a1-b860-6052cc5ee399 to worker[183] qsize 0
2023-02-18 02:55:51,809 DEBUG awx.main.dispatch delivered daef6da2-767c-4f2f-890d-a265226bc60d to worker[180] qsize 0
2023-02-18 02:55:51,811 DEBUG awx.main.dispatch delivered a70ee703-3b2b-4956-9382-118a1f2a7fe5 to worker[182] qsize 0
2023-02-18 02:55:51,809 DEBUG awx.main.dispatch task a779445b-98c8-43a1-b860-6052cc5ee399 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 02:55:51,813 DEBUG awx.main.dispatch delivered d5fb9c7a-0eab-48f5-b78d-fc4cfffe5f81 to worker[181] qsize 0
2023-02-18 02:55:51,811 DEBUG awx.main.dispatch task daef6da2-767c-4f2f-890d-a265226bc60d starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 02:55:51,813 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 02:55:51,813 DEBUG awx.main.dispatch task a70ee703-3b2b-4956-9382-118a1f2a7fe5 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 02:55:51,817 DEBUG awx.main.dispatch task d5fb9c7a-0eab-48f5-b78d-fc4cfffe5f81 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 02:55:51,821 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 02:55:51,862 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 02:55:51,880 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 02:55:21.537028+00:00
2023-02-18 02:55:51,893 DEBUG awx.main.dispatch task daef6da2-767c-4f2f-890d-a265226bc60d is finished
2023-02-18 02:55:51,898 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 02:55:51,931 DEBUG awx.main.dispatch task a779445b-98c8-43a1-b860-6052cc5ee399 is finished
2023-02-18 02:55:52,041 DEBUG awx.main.dispatch task a70ee703-3b2b-4956-9382-118a1f2a7fe5 is finished
2023-02-18 02:55:52,048 DEBUG awx.main.dispatch task d5fb9c7a-0eab-48f5-b78d-fc4cfffe5f81 is finished
RESULT 2
OKREADY
2023-02-18 02:56:11,781 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a4d9edff-a2e8-4f5b-9a51-7819a40170d3, queue=awx_private_queue)
[2023-02-18 02:56:11,781: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a4d9edff-a2e8-4f5b-9a51-7819a40170d3, queue=awx_private_queue)
2023-02-18 02:56:11,802 DEBUG awx.main.dispatch delivered a4d9edff-a2e8-4f5b-9a51-7819a40170d3 to worker[181] qsize 0
2023-02-18 02:56:11,805 DEBUG awx.main.dispatch task a4d9edff-a2e8-4f5b-9a51-7819a40170d3 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 02:56:11,807 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 02:56:11,842 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 02:56:11,895 DEBUG awx.main.dispatch task a4d9edff-a2e8-4f5b-9a51-7819a40170d3 is finished
2023-02-18 02:56:21,765 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(461fdd86-5487-42bd-9b4e-1645c41c3ed0, queue=awx_private_queue)
[2023-02-18 02:56:21,765: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(461fdd86-5487-42bd-9b4e-1645c41c3ed0, queue=awx_private_queue)
2023-02-18 02:56:21,781 DEBUG awx.main.dispatch delivered 461fdd86-5487-42bd-9b4e-1645c41c3ed0 to worker[180] qsize 0
2023-02-18 02:56:21,783 DEBUG awx.main.dispatch task 461fdd86-5487-42bd-9b4e-1645c41c3ed0 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 02:56:21,816 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 02:56:21,865 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 02:55:51.863144+00:00
2023-02-18 02:56:21,944 DEBUG awx.main.dispatch task 461fdd86-5487-42bd-9b4e-1645c41c3ed0 is finished
2023-02-18 02:56:31,781 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ae658580-1807-4c43-9003-99517033da30, queue=awx_private_queue)
[2023-02-18 02:56:31,781: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ae658580-1807-4c43-9003-99517033da30, queue=awx_private_queue)
2023-02-18 02:56:31,797 DEBUG awx.main.dispatch delivered ae658580-1807-4c43-9003-99517033da30 to worker[181] qsize 0
2023-02-18 02:56:31,799 DEBUG awx.main.dispatch task ae658580-1807-4c43-9003-99517033da30 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 02:56:31,801 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 02:56:31,904 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 02:56:32,001 DEBUG awx.main.dispatch task ae658580-1807-4c43-9003-99517033da30 is finished
2023-02-18 02:56:51,473 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(c9708004-8114-44b7-9c82-b07e25546788, queue=onap-awx-0)
[2023-02-18 02:56:51,473: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(c9708004-8114-44b7-9c82-b07e25546788, queue=onap-awx-0)
2023-02-18 02:56:51,645 DEBUG awx.main.dispatch delivered c9708004-8114-44b7-9c82-b07e25546788 to worker[181] qsize 0
2023-02-18 02:56:51,648 DEBUG awx.main.dispatch task c9708004-8114-44b7-9c82-b07e25546788 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 02:56:51,652 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 02:56:51,750 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(62854431-ef06-4230-a65e-52491667bf1b, queue=onap-awx-0)
[2023-02-18 02:56:51,750: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(62854431-ef06-4230-a65e-52491667bf1b, queue=onap-awx-0)
2023-02-18 02:56:51,769 DEBUG awx.main.dispatch delivered 62854431-ef06-4230-a65e-52491667bf1b to worker[180] qsize 0
2023-02-18 02:56:51,770 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(4e4b7468-c370-4d86-b5ff-89e2e72e8868, queue=awx_private_queue)
[2023-02-18 02:56:51,770: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(4e4b7468-c370-4d86-b5ff-89e2e72e8868, queue=awx_private_queue)
2023-02-18 02:56:51,771 DEBUG awx.main.dispatch task 62854431-ef06-4230-a65e-52491667bf1b starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 02:56:51,780 DEBUG awx.main.dispatch task c9708004-8114-44b7-9c82-b07e25546788 is finished
2023-02-18 02:56:51,786 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3ae69b08-5d94-4f16-b391-b3ad3dd3fefb, queue=awx_private_queue)
2023-02-18 02:56:51,786 DEBUG awx.main.dispatch delivered 4e4b7468-c370-4d86-b5ff-89e2e72e8868 to worker[181] qsize 0
[2023-02-18 02:56:51,786: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3ae69b08-5d94-4f16-b391-b3ad3dd3fefb, queue=awx_private_queue)
2023-02-18 02:56:51,788 DEBUG awx.main.dispatch task 4e4b7468-c370-4d86-b5ff-89e2e72e8868 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 02:56:51,800 DEBUG awx.main.dispatch delivered 3ae69b08-5d94-4f16-b391-b3ad3dd3fefb to worker[183] qsize 0
2023-02-18 02:56:51,804 DEBUG awx.main.dispatch task 3ae69b08-5d94-4f16-b391-b3ad3dd3fefb starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 02:56:51,805 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 02:56:51,864 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 02:56:51,888 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 02:56:21.816571+00:00
2023-02-18 02:56:51,943 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 02:56:51,839 DEBUG awx.main.dispatch task 62854431-ef06-4230-a65e-52491667bf1b is finished
2023-02-18 02:56:52,044 DEBUG awx.main.dispatch task 4e4b7468-c370-4d86-b5ff-89e2e72e8868 is finished
2023-02-18 02:56:52,157 DEBUG awx.main.dispatch task 3ae69b08-5d94-4f16-b391-b3ad3dd3fefb is finished
RESULT 2
OKREADY
2023-02-18 02:57:11,795 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7279d978-3e12-4151-a469-2366e680d015, queue=awx_private_queue)
[2023-02-18 02:57:11,795: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7279d978-3e12-4151-a469-2366e680d015, queue=awx_private_queue)
2023-02-18 02:57:11,814 DEBUG awx.main.dispatch delivered 7279d978-3e12-4151-a469-2366e680d015 to worker[182] qsize 0
2023-02-18 02:57:11,818 DEBUG awx.main.dispatch task 7279d978-3e12-4151-a469-2366e680d015 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 02:57:11,821 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 02:57:11,894 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 02:57:12,018 DEBUG awx.main.dispatch task 7279d978-3e12-4151-a469-2366e680d015 is finished
2023-02-18 02:57:21,770 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(ef6be382-b342-4da9-9c4d-5ed7e9092f4b, queue=awx_private_queue)
[2023-02-18 02:57:21,770: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(ef6be382-b342-4da9-9c4d-5ed7e9092f4b, queue=awx_private_queue)
2023-02-18 02:57:21,787 DEBUG awx.main.dispatch delivered ef6be382-b342-4da9-9c4d-5ed7e9092f4b to worker[183] qsize 0
2023-02-18 02:57:21,790 DEBUG awx.main.dispatch task ef6be382-b342-4da9-9c4d-5ed7e9092f4b starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 02:57:21,852 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 02:57:21,858 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 02:56:51.864869+00:00
2023-02-18 02:57:21,901 DEBUG awx.main.dispatch task ef6be382-b342-4da9-9c4d-5ed7e9092f4b is finished
2023-02-18 02:57:31,795 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(fde2b1e4-c074-4400-b7ca-9c6266f77da2, queue=awx_private_queue)
[2023-02-18 02:57:31,795: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(fde2b1e4-c074-4400-b7ca-9c6266f77da2, queue=awx_private_queue)
2023-02-18 02:57:31,823 DEBUG awx.main.dispatch delivered fde2b1e4-c074-4400-b7ca-9c6266f77da2 to worker[181] qsize 0
2023-02-18 02:57:31,826 DEBUG awx.main.dispatch task fde2b1e4-c074-4400-b7ca-9c6266f77da2 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 02:57:31,828 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 02:57:31,875 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 02:57:31,964 DEBUG awx.main.dispatch task fde2b1e4-c074-4400-b7ca-9c6266f77da2 is finished
2023-02-18 02:57:51,473 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(d4b2f267-5fe2-4ade-9619-4f6608a24c74, queue=onap-awx-0)
[2023-02-18 02:57:51,473: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(d4b2f267-5fe2-4ade-9619-4f6608a24c74, queue=onap-awx-0)
2023-02-18 02:57:51,524 DEBUG awx.main.dispatch delivered d4b2f267-5fe2-4ade-9619-4f6608a24c74 to worker[181] qsize 0
2023-02-18 02:57:51,525 DEBUG awx.main.dispatch task d4b2f267-5fe2-4ade-9619-4f6608a24c74 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 02:57:51,527 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 02:57:51,629 DEBUG awx.main.dispatch task d4b2f267-5fe2-4ade-9619-4f6608a24c74 is finished
2023-02-18 02:57:51,749 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(07297022-b5d5-4f1e-b05e-5132d6e08499, queue=onap-awx-0)
[2023-02-18 02:57:51,749: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(07297022-b5d5-4f1e-b05e-5132d6e08499, queue=onap-awx-0)
2023-02-18 02:57:51,766 DEBUG awx.main.dispatch delivered 07297022-b5d5-4f1e-b05e-5132d6e08499 to worker[183] qsize 0
2023-02-18 02:57:51,768 DEBUG awx.main.dispatch task 07297022-b5d5-4f1e-b05e-5132d6e08499 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 02:57:51,770 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(81e4faae-eadd-480d-b9fa-d3a99bfeabb6, queue=awx_private_queue)
[2023-02-18 02:57:51,770: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(81e4faae-eadd-480d-b9fa-d3a99bfeabb6, queue=awx_private_queue)
2023-02-18 02:57:51,799 DEBUG awx.main.dispatch delivered 81e4faae-eadd-480d-b9fa-d3a99bfeabb6 to worker[182] qsize 0
2023-02-18 02:57:51,826 DEBUG awx.main.dispatch task 81e4faae-eadd-480d-b9fa-d3a99bfeabb6 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 02:57:51,822 DEBUG awx.main.dispatch task 07297022-b5d5-4f1e-b05e-5132d6e08499 is finished
2023-02-18 02:57:51,880 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 02:57:51,883 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 02:57:21.852482+00:00
2023-02-18 02:57:51,800 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(559968e5-ce5b-4a74-b16a-8ce36e01e5d5, queue=awx_private_queue)
[2023-02-18 02:57:51,800: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(559968e5-ce5b-4a74-b16a-8ce36e01e5d5, queue=awx_private_queue)
2023-02-18 02:57:51,912 DEBUG awx.main.dispatch task 81e4faae-eadd-480d-b9fa-d3a99bfeabb6 is finished
2023-02-18 02:57:51,915 DEBUG awx.main.dispatch delivered 559968e5-ce5b-4a74-b16a-8ce36e01e5d5 to worker[180] qsize 0
2023-02-18 02:57:51,920 DEBUG awx.main.dispatch task 559968e5-ce5b-4a74-b16a-8ce36e01e5d5 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 02:57:52,167 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 02:57:52,202 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 02:57:52,422 DEBUG awx.main.dispatch task 559968e5-ce5b-4a74-b16a-8ce36e01e5d5 is finished
RESULT 2
OKREADY
2023-02-18 02:58:11,800 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(1a87fabd-d309-4a73-8b3f-775005d64048, queue=awx_private_queue)
[2023-02-18 02:58:11,800: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(1a87fabd-d309-4a73-8b3f-775005d64048, queue=awx_private_queue)
2023-02-18 02:58:11,817 DEBUG awx.main.dispatch delivered 1a87fabd-d309-4a73-8b3f-775005d64048 to worker[181] qsize 0
2023-02-18 02:58:11,820 DEBUG awx.main.dispatch task 1a87fabd-d309-4a73-8b3f-775005d64048 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 02:58:11,822 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 02:58:11,852 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 02:58:11,903 DEBUG awx.main.dispatch task 1a87fabd-d309-4a73-8b3f-775005d64048 is finished
2023-02-18 02:58:21,770 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(afc30543-0410-43cf-bb60-c69c58d2945a, queue=awx_private_queue)
[2023-02-18 02:58:21,770: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(afc30543-0410-43cf-bb60-c69c58d2945a, queue=awx_private_queue)
2023-02-18 02:58:21,785 DEBUG awx.main.dispatch delivered afc30543-0410-43cf-bb60-c69c58d2945a to worker[180] qsize 0
2023-02-18 02:58:21,787 DEBUG awx.main.dispatch task afc30543-0410-43cf-bb60-c69c58d2945a starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 02:58:21,816 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 02:58:21,826 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 02:57:51.880204+00:00
2023-02-18 02:58:21,878 DEBUG awx.main.dispatch task afc30543-0410-43cf-bb60-c69c58d2945a is finished
2023-02-18 02:58:31,801 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e04dd016-f535-4f52-914f-9b32308f1d27, queue=awx_private_queue)
[2023-02-18 02:58:31,801: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e04dd016-f535-4f52-914f-9b32308f1d27, queue=awx_private_queue)
2023-02-18 02:58:31,817 DEBUG awx.main.dispatch delivered e04dd016-f535-4f52-914f-9b32308f1d27 to worker[183] qsize 0
2023-02-18 02:58:31,820 DEBUG awx.main.dispatch task e04dd016-f535-4f52-914f-9b32308f1d27 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 02:58:31,822 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 02:58:31,878 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 02:58:31,927 DEBUG awx.main.dispatch task e04dd016-f535-4f52-914f-9b32308f1d27 is finished
2023-02-18 02:58:51,483 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(b7fef21a-4a1c-4cf9-ad47-9b23326f0739, queue=onap-awx-0)
[2023-02-18 02:58:51,483: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(b7fef21a-4a1c-4cf9-ad47-9b23326f0739, queue=onap-awx-0)
2023-02-18 02:58:51,537 DEBUG awx.main.dispatch delivered b7fef21a-4a1c-4cf9-ad47-9b23326f0739 to worker[183] qsize 0
2023-02-18 02:58:51,540 DEBUG awx.main.dispatch task b7fef21a-4a1c-4cf9-ad47-9b23326f0739 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 02:58:51,541 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 02:58:51,669 DEBUG awx.main.dispatch task b7fef21a-4a1c-4cf9-ad47-9b23326f0739 is finished
2023-02-18 02:58:51,750 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(f0b70483-ea9e-4083-a2ca-d7b6bdb6a6ac, queue=onap-awx-0)
[2023-02-18 02:58:51,750: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(f0b70483-ea9e-4083-a2ca-d7b6bdb6a6ac, queue=onap-awx-0)
2023-02-18 02:58:51,767 DEBUG awx.main.dispatch delivered f0b70483-ea9e-4083-a2ca-d7b6bdb6a6ac to worker[183] qsize 0
2023-02-18 02:58:51,769 DEBUG awx.main.dispatch task f0b70483-ea9e-4083-a2ca-d7b6bdb6a6ac starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 02:58:51,771 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(9de68af6-aba2-41c4-9e7a-94332dba50b7, queue=awx_private_queue)
[2023-02-18 02:58:51,771: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(9de68af6-aba2-41c4-9e7a-94332dba50b7, queue=awx_private_queue)
2023-02-18 02:58:51,799 DEBUG awx.main.dispatch delivered 9de68af6-aba2-41c4-9e7a-94332dba50b7 to worker[180] qsize 0
2023-02-18 02:58:51,800 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(05120df6-abb3-4dec-aeee-be44a031d1eb, queue=awx_private_queue)
[2023-02-18 02:58:51,800: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(05120df6-abb3-4dec-aeee-be44a031d1eb, queue=awx_private_queue)
2023-02-18 02:58:51,802 DEBUG awx.main.dispatch task 9de68af6-aba2-41c4-9e7a-94332dba50b7 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 02:58:51,814 DEBUG awx.main.dispatch delivered 05120df6-abb3-4dec-aeee-be44a031d1eb to worker[182] qsize 0
2023-02-18 02:58:51,816 DEBUG awx.main.dispatch task 05120df6-abb3-4dec-aeee-be44a031d1eb starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 02:58:51,818 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 02:58:51,833 DEBUG awx.main.dispatch task f0b70483-ea9e-4083-a2ca-d7b6bdb6a6ac is finished
2023-02-18 02:58:51,881 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 02:58:51,891 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 02:58:21.816736+00:00
2023-02-18 02:58:51,927 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 02:58:52,066 DEBUG awx.main.dispatch task 05120df6-abb3-4dec-aeee-be44a031d1eb is finished
2023-02-18 02:58:51,967 DEBUG awx.main.dispatch task 9de68af6-aba2-41c4-9e7a-94332dba50b7 is finished
RESULT 2
OKREADY
2023-02-18 02:59:11,811 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f8d3170f-7f0f-4c0a-b08f-b9c88e4c4ee8, queue=awx_private_queue)
[2023-02-18 02:59:11,811: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f8d3170f-7f0f-4c0a-b08f-b9c88e4c4ee8, queue=awx_private_queue)
2023-02-18 02:59:11,827 DEBUG awx.main.dispatch delivered f8d3170f-7f0f-4c0a-b08f-b9c88e4c4ee8 to worker[180] qsize 0
2023-02-18 02:59:11,830 DEBUG awx.main.dispatch task f8d3170f-7f0f-4c0a-b08f-b9c88e4c4ee8 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 02:59:11,831 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 02:59:11,857 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 02:59:11,906 DEBUG awx.main.dispatch task f8d3170f-7f0f-4c0a-b08f-b9c88e4c4ee8 is finished
2023-02-18 02:59:21,771 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(ca70676b-5915-4fb9-a361-f611cf5dd8eb, queue=awx_private_queue)
[2023-02-18 02:59:21,771: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(ca70676b-5915-4fb9-a361-f611cf5dd8eb, queue=awx_private_queue)
2023-02-18 02:59:21,787 DEBUG awx.main.dispatch delivered ca70676b-5915-4fb9-a361-f611cf5dd8eb to worker[182] qsize 0
2023-02-18 02:59:21,790 DEBUG awx.main.dispatch task ca70676b-5915-4fb9-a361-f611cf5dd8eb starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 02:59:21,806 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 02:59:21,817 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 02:58:51.881724+00:00
2023-02-18 02:59:21,899 DEBUG awx.main.dispatch task ca70676b-5915-4fb9-a361-f611cf5dd8eb is finished
2023-02-18 02:59:31,811 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(4d2a55b2-9c55-4cb8-b575-c4578790f191, queue=awx_private_queue)
[2023-02-18 02:59:31,811: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(4d2a55b2-9c55-4cb8-b575-c4578790f191, queue=awx_private_queue)
2023-02-18 02:59:31,827 DEBUG awx.main.dispatch delivered 4d2a55b2-9c55-4cb8-b575-c4578790f191 to worker[181] qsize 0
2023-02-18 02:59:31,830 DEBUG awx.main.dispatch task 4d2a55b2-9c55-4cb8-b575-c4578790f191 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 02:59:31,832 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 02:59:31,867 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 02:59:31,920 DEBUG awx.main.dispatch task 4d2a55b2-9c55-4cb8-b575-c4578790f191 is finished
2023-02-18 02:59:51,483 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(2c252813-e91c-4ebb-943a-d9f81cf283a2, queue=onap-awx-0)
[2023-02-18 02:59:51,483: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(2c252813-e91c-4ebb-943a-d9f81cf283a2, queue=onap-awx-0)
2023-02-18 02:59:51,585 DEBUG awx.main.dispatch delivered 2c252813-e91c-4ebb-943a-d9f81cf283a2 to worker[180] qsize 0
2023-02-18 02:59:51,587 DEBUG awx.main.dispatch task 2c252813-e91c-4ebb-943a-d9f81cf283a2 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 02:59:51,588 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 02:59:51,749 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(0c14e5a4-3398-4fbc-956d-af63a0251b8b, queue=onap-awx-0)
[2023-02-18 02:59:51,749: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(0c14e5a4-3398-4fbc-956d-af63a0251b8b, queue=onap-awx-0)
2023-02-18 02:59:51,765 DEBUG awx.main.dispatch delivered 0c14e5a4-3398-4fbc-956d-af63a0251b8b to worker[183] qsize 0
2023-02-18 02:59:51,768 DEBUG awx.main.dispatch task 0c14e5a4-3398-4fbc-956d-af63a0251b8b starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 02:59:51,771 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(bef0654c-06d2-4baa-b024-53d7f7b03072, queue=awx_private_queue)
[2023-02-18 02:59:51,771: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(bef0654c-06d2-4baa-b024-53d7f7b03072, queue=awx_private_queue)
2023-02-18 02:59:51,786 DEBUG awx.main.dispatch delivered bef0654c-06d2-4baa-b024-53d7f7b03072 to worker[181] qsize 0
2023-02-18 02:59:51,788 DEBUG awx.main.dispatch task bef0654c-06d2-4baa-b024-53d7f7b03072 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 02:59:51,811 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(2eb3ccec-c54e-48d7-abc6-d4052b57f237, queue=awx_private_queue)
[2023-02-18 02:59:51,811: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(2eb3ccec-c54e-48d7-abc6-d4052b57f237, queue=awx_private_queue)
2023-02-18 02:59:51,825 DEBUG awx.main.dispatch delivered 2eb3ccec-c54e-48d7-abc6-d4052b57f237 to worker[182] qsize 0
2023-02-18 02:59:51,827 DEBUG awx.main.dispatch task 2eb3ccec-c54e-48d7-abc6-d4052b57f237 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 02:59:51,829 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 02:59:51,877 DEBUG awx.main.dispatch task 2c252813-e91c-4ebb-943a-d9f81cf283a2 is finished
2023-02-18 02:59:51,963 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 02:59:51,987 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 02:59:21.806586+00:00
2023-02-18 02:59:52,004 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 02:59:52,001 DEBUG awx.main.dispatch task 0c14e5a4-3398-4fbc-956d-af63a0251b8b is finished
2023-02-18 02:59:52,198 DEBUG awx.main.dispatch task bef0654c-06d2-4baa-b024-53d7f7b03072 is finished
2023-02-18 02:59:52,244 DEBUG awx.main.dispatch task 2eb3ccec-c54e-48d7-abc6-d4052b57f237 is finished
RESULT 2
OKREADY
2023-02-18 03:00:11,822 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(984985c1-8f2b-4462-9b42-20001b24a217, queue=awx_private_queue)
[2023-02-18 03:00:11,822: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(984985c1-8f2b-4462-9b42-20001b24a217, queue=awx_private_queue)
2023-02-18 03:00:11,838 DEBUG awx.main.dispatch delivered 984985c1-8f2b-4462-9b42-20001b24a217 to worker[182] qsize 0
2023-02-18 03:00:12,046 DEBUG awx.main.dispatch task 984985c1-8f2b-4462-9b42-20001b24a217 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:00:12,047 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:00:12,133 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:00:12,281 DEBUG awx.main.dispatch task 984985c1-8f2b-4462-9b42-20001b24a217 is finished
2023-02-18 03:00:21,772 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(903e0feb-3e13-427f-b271-c54fa63661bb, queue=awx_private_queue)
[2023-02-18 03:00:21,772: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(903e0feb-3e13-427f-b271-c54fa63661bb, queue=awx_private_queue)
2023-02-18 03:00:21,786 DEBUG awx.main.dispatch delivered 903e0feb-3e13-427f-b271-c54fa63661bb to worker[180] qsize 0
2023-02-18 03:00:21,789 DEBUG awx.main.dispatch task 903e0feb-3e13-427f-b271-c54fa63661bb starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:00:21,955 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:00:21,981 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 02:59:51.964153+00:00
2023-02-18 03:00:22,069 DEBUG awx.main.dispatch task 903e0feb-3e13-427f-b271-c54fa63661bb is finished
2023-02-18 03:00:31,822 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c3dfe5b6-d88c-4a3d-a5bc-ffdc4faef8e5, queue=awx_private_queue)
[2023-02-18 03:00:31,822: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c3dfe5b6-d88c-4a3d-a5bc-ffdc4faef8e5, queue=awx_private_queue)
2023-02-18 03:00:31,837 DEBUG awx.main.dispatch delivered c3dfe5b6-d88c-4a3d-a5bc-ffdc4faef8e5 to worker[180] qsize 0
2023-02-18 03:00:31,839 DEBUG awx.main.dispatch task c3dfe5b6-d88c-4a3d-a5bc-ffdc4faef8e5 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:00:31,840 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:00:31,956 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:00:32,063 DEBUG awx.main.dispatch task c3dfe5b6-d88c-4a3d-a5bc-ffdc4faef8e5 is finished
2023-02-18 03:00:51,483 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(8e341d75-0468-41f1-97c6-e120e56e1daf, queue=onap-awx-0)
[2023-02-18 03:00:51,483: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(8e341d75-0468-41f1-97c6-e120e56e1daf, queue=onap-awx-0)
2023-02-18 03:00:51,533 DEBUG awx.main.dispatch delivered 8e341d75-0468-41f1-97c6-e120e56e1daf to worker[183] qsize 0
2023-02-18 03:00:51,535 DEBUG awx.main.dispatch task 8e341d75-0468-41f1-97c6-e120e56e1daf starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:00:51,537 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:00:51,747 DEBUG awx.main.dispatch task 8e341d75-0468-41f1-97c6-e120e56e1daf is finished
2023-02-18 03:00:51,750 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(b358e1fd-cc14-4446-8c58-4ee4955844f8, queue=onap-awx-0)
[2023-02-18 03:00:51,750: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(b358e1fd-cc14-4446-8c58-4ee4955844f8, queue=onap-awx-0)
2023-02-18 03:00:51,767 DEBUG awx.main.dispatch delivered b358e1fd-cc14-4446-8c58-4ee4955844f8 to worker[180] qsize 0
2023-02-18 03:00:51,769 DEBUG awx.main.dispatch task b358e1fd-cc14-4446-8c58-4ee4955844f8 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:00:51,771 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(83c98ac3-417a-4b12-a05e-85310e1c5b70, queue=awx_private_queue)
[2023-02-18 03:00:51,771: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(83c98ac3-417a-4b12-a05e-85310e1c5b70, queue=awx_private_queue)
2023-02-18 03:00:51,793 DEBUG awx.main.dispatch delivered 83c98ac3-417a-4b12-a05e-85310e1c5b70 to worker[183] qsize 0
2023-02-18 03:00:51,796 DEBUG awx.main.dispatch task 83c98ac3-417a-4b12-a05e-85310e1c5b70 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:00:51,821 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:00:51,823 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(9b7b2a0f-e31f-40d6-9238-f9b2681f70c7, queue=awx_private_queue)
[2023-02-18 03:00:51,823: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(9b7b2a0f-e31f-40d6-9238-f9b2681f70c7, queue=awx_private_queue)
2023-02-18 03:00:51,826 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:00:21.955311+00:00
2023-02-18 03:00:51,835 DEBUG awx.main.dispatch task b358e1fd-cc14-4446-8c58-4ee4955844f8 is finished
2023-02-18 03:00:51,850 DEBUG awx.main.dispatch delivered 9b7b2a0f-e31f-40d6-9238-f9b2681f70c7 to worker[182] qsize 0
2023-02-18 03:00:51,853 DEBUG awx.main.dispatch task 9b7b2a0f-e31f-40d6-9238-f9b2681f70c7 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:00:51,855 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:00:51,880 DEBUG awx.main.dispatch task 83c98ac3-417a-4b12-a05e-85310e1c5b70 is finished
2023-02-18 03:00:51,942 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:00:52,098 DEBUG awx.main.dispatch task 9b7b2a0f-e31f-40d6-9238-f9b2681f70c7 is finished
RESULT 2
OKREADY
2023-02-18 03:01:11,833 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d6cb724e-c6b6-4969-8596-8622fe3f1fcd, queue=awx_private_queue)
[2023-02-18 03:01:11,833: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d6cb724e-c6b6-4969-8596-8622fe3f1fcd, queue=awx_private_queue)
2023-02-18 03:01:11,883 DEBUG awx.main.dispatch delivered d6cb724e-c6b6-4969-8596-8622fe3f1fcd to worker[183] qsize 0
2023-02-18 03:01:11,886 DEBUG awx.main.dispatch task d6cb724e-c6b6-4969-8596-8622fe3f1fcd starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:01:11,888 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:01:11,934 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:01:11,998 DEBUG awx.main.dispatch task d6cb724e-c6b6-4969-8596-8622fe3f1fcd is finished
2023-02-18 03:01:21,772 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(f24c248b-5e28-4870-a78c-c5d12b1f8a79, queue=awx_private_queue)
[2023-02-18 03:01:21,772: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(f24c248b-5e28-4870-a78c-c5d12b1f8a79, queue=awx_private_queue)
2023-02-18 03:01:21,789 DEBUG awx.main.dispatch delivered f24c248b-5e28-4870-a78c-c5d12b1f8a79 to worker[180] qsize 0
2023-02-18 03:01:21,792 DEBUG awx.main.dispatch task f24c248b-5e28-4870-a78c-c5d12b1f8a79 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:01:22,053 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:01:22,057 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:00:51.821877+00:00
2023-02-18 03:01:22,113 DEBUG awx.main.dispatch task f24c248b-5e28-4870-a78c-c5d12b1f8a79 is finished
2023-02-18 03:01:31,833 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e98d428f-5d74-4a5f-8904-c240f831e4b9, queue=awx_private_queue)
[2023-02-18 03:01:31,833: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e98d428f-5d74-4a5f-8904-c240f831e4b9, queue=awx_private_queue)
2023-02-18 03:01:31,849 DEBUG awx.main.dispatch delivered e98d428f-5d74-4a5f-8904-c240f831e4b9 to worker[183] qsize 0
2023-02-18 03:01:31,851 DEBUG awx.main.dispatch task e98d428f-5d74-4a5f-8904-c240f831e4b9 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:01:31,852 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:01:31,911 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:01:31,981 DEBUG awx.main.dispatch task e98d428f-5d74-4a5f-8904-c240f831e4b9 is finished
2023-02-18 03:01:51,494 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(fccbd893-e7d9-4552-8469-86ad89e9b01b, queue=onap-awx-0)
[2023-02-18 03:01:51,494: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(fccbd893-e7d9-4552-8469-86ad89e9b01b, queue=onap-awx-0)
2023-02-18 03:01:51,596 DEBUG awx.main.dispatch delivered fccbd893-e7d9-4552-8469-86ad89e9b01b to worker[181] qsize 0
2023-02-18 03:01:51,599 DEBUG awx.main.dispatch task fccbd893-e7d9-4552-8469-86ad89e9b01b starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:01:51,602 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:01:51,736 DEBUG awx.main.dispatch task fccbd893-e7d9-4552-8469-86ad89e9b01b is finished
2023-02-18 03:01:51,749 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(0d780be7-467b-4e85-8285-9d64160ef466, queue=onap-awx-0)
[2023-02-18 03:01:51,749: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(0d780be7-467b-4e85-8285-9d64160ef466, queue=onap-awx-0)
2023-02-18 03:01:51,765 DEBUG awx.main.dispatch delivered 0d780be7-467b-4e85-8285-9d64160ef466 to worker[182] qsize 0
2023-02-18 03:01:51,768 DEBUG awx.main.dispatch task 0d780be7-467b-4e85-8285-9d64160ef466 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:01:51,772 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d944bba3-3cc2-4776-986f-0e31ccf07b2c, queue=awx_private_queue)
[2023-02-18 03:01:51,772: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d944bba3-3cc2-4776-986f-0e31ccf07b2c, queue=awx_private_queue)
2023-02-18 03:01:51,786 DEBUG awx.main.dispatch delivered d944bba3-3cc2-4776-986f-0e31ccf07b2c to worker[180] qsize 0
2023-02-18 03:01:51,788 DEBUG awx.main.dispatch task d944bba3-3cc2-4776-986f-0e31ccf07b2c starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:01:51,833 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6dbefe48-7d55-4de8-b097-fe1d62ed0326, queue=awx_private_queue)
[2023-02-18 03:01:51,833: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6dbefe48-7d55-4de8-b097-fe1d62ed0326, queue=awx_private_queue)
2023-02-18 03:01:51,851 DEBUG awx.main.dispatch delivered 6dbefe48-7d55-4de8-b097-fe1d62ed0326 to worker[183] qsize 0
2023-02-18 03:01:51,854 DEBUG awx.main.dispatch task 6dbefe48-7d55-4de8-b097-fe1d62ed0326 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:01:51,857 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:01:51,896 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:01:51,912 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:01:22.053675+00:00
2023-02-18 03:01:51,912 DEBUG awx.main.dispatch task 0d780be7-467b-4e85-8285-9d64160ef466 is finished
2023-02-18 03:01:52,039 DEBUG awx.main.dispatch task d944bba3-3cc2-4776-986f-0e31ccf07b2c is finished
2023-02-18 03:01:52,075 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:01:52,255 DEBUG awx.main.dispatch task 6dbefe48-7d55-4de8-b097-fe1d62ed0326 is finished
RESULT 2
OKREADY
2023-02-18 03:02:11,843 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(73d6780b-b354-460d-a5d9-a5e4c6c0fdaa, queue=awx_private_queue)
[2023-02-18 03:02:11,843: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(73d6780b-b354-460d-a5d9-a5e4c6c0fdaa, queue=awx_private_queue)
2023-02-18 03:02:11,869 DEBUG awx.main.dispatch delivered 73d6780b-b354-460d-a5d9-a5e4c6c0fdaa to worker[182] qsize 0
2023-02-18 03:02:11,872 DEBUG awx.main.dispatch task 73d6780b-b354-460d-a5d9-a5e4c6c0fdaa starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:02:11,873 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:02:11,935 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:02:12,001 DEBUG awx.main.dispatch task 73d6780b-b354-460d-a5d9-a5e4c6c0fdaa is finished
2023-02-18 03:02:21,772 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(f52e09f2-8f2a-4fc7-8e82-f1d345e31e6d, queue=awx_private_queue)
[2023-02-18 03:02:21,772: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(f52e09f2-8f2a-4fc7-8e82-f1d345e31e6d, queue=awx_private_queue)
2023-02-18 03:02:21,817 DEBUG awx.main.dispatch delivered f52e09f2-8f2a-4fc7-8e82-f1d345e31e6d to worker[183] qsize 0
2023-02-18 03:02:22,013 DEBUG awx.main.dispatch task f52e09f2-8f2a-4fc7-8e82-f1d345e31e6d starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:02:22,029 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:02:22,033 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:01:51.896248+00:00
2023-02-18 03:02:22,063 DEBUG awx.main.dispatch task f52e09f2-8f2a-4fc7-8e82-f1d345e31e6d is finished
2023-02-18 03:02:31,843 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(263aa994-ad2d-44c5-a342-7315b4008d51, queue=awx_private_queue)
[2023-02-18 03:02:31,843: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(263aa994-ad2d-44c5-a342-7315b4008d51, queue=awx_private_queue)
2023-02-18 03:02:31,858 DEBUG awx.main.dispatch delivered 263aa994-ad2d-44c5-a342-7315b4008d51 to worker[181] qsize 0
2023-02-18 03:02:31,861 DEBUG awx.main.dispatch task 263aa994-ad2d-44c5-a342-7315b4008d51 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:02:31,863 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:02:31,892 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:02:31,971 DEBUG awx.main.dispatch task 263aa994-ad2d-44c5-a342-7315b4008d51 is finished
2023-02-18 03:02:51,493 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(8f60d9e4-4231-45fd-8d51-ebcc78995804, queue=onap-awx-0)
[2023-02-18 03:02:51,493: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(8f60d9e4-4231-45fd-8d51-ebcc78995804, queue=onap-awx-0)
2023-02-18 03:02:51,554 DEBUG awx.main.dispatch delivered 8f60d9e4-4231-45fd-8d51-ebcc78995804 to worker[181] qsize 0
2023-02-18 03:02:51,556 DEBUG awx.main.dispatch task 8f60d9e4-4231-45fd-8d51-ebcc78995804 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:02:51,558 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:02:51,620 DEBUG awx.main.dispatch task 8f60d9e4-4231-45fd-8d51-ebcc78995804 is finished
2023-02-18 03:02:51,751 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(4ef080e7-20a0-428b-a7ee-d70d9560df7d, queue=onap-awx-0)
[2023-02-18 03:02:51,751: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(4ef080e7-20a0-428b-a7ee-d70d9560df7d, queue=onap-awx-0)
2023-02-18 03:02:51,766 DEBUG awx.main.dispatch delivered 4ef080e7-20a0-428b-a7ee-d70d9560df7d to worker[180] qsize 0
2023-02-18 03:02:51,769 DEBUG awx.main.dispatch task 4ef080e7-20a0-428b-a7ee-d70d9560df7d starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:02:51,771 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(9ca43959-a561-4ca8-b4b9-d8cdfa73fe53, queue=awx_private_queue)
[2023-02-18 03:02:51,771: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(9ca43959-a561-4ca8-b4b9-d8cdfa73fe53, queue=awx_private_queue)
2023-02-18 03:02:51,785 DEBUG awx.main.dispatch delivered 9ca43959-a561-4ca8-b4b9-d8cdfa73fe53 to worker[183] qsize 0
2023-02-18 03:02:51,787 DEBUG awx.main.dispatch task 9ca43959-a561-4ca8-b4b9-d8cdfa73fe53 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:02:51,802 DEBUG awx.main.dispatch task 4ef080e7-20a0-428b-a7ee-d70d9560df7d is finished
2023-02-18 03:02:51,826 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:02:51,832 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:02:22.029454+00:00
2023-02-18 03:02:51,843 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(24d8ecea-17b8-42fc-a6e8-b20d05d0a130, queue=awx_private_queue)
[2023-02-18 03:02:51,843: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(24d8ecea-17b8-42fc-a6e8-b20d05d0a130, queue=awx_private_queue)
2023-02-18 03:02:51,858 DEBUG awx.main.dispatch delivered 24d8ecea-17b8-42fc-a6e8-b20d05d0a130 to worker[182] qsize 0
2023-02-18 03:02:51,860 DEBUG awx.main.dispatch task 24d8ecea-17b8-42fc-a6e8-b20d05d0a130 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:02:51,861 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:02:51,911 DEBUG awx.main.dispatch task 9ca43959-a561-4ca8-b4b9-d8cdfa73fe53 is finished
2023-02-18 03:02:51,958 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:02:52,039 DEBUG awx.main.dispatch task 24d8ecea-17b8-42fc-a6e8-b20d05d0a130 is finished
RESULT 2
OKREADY
2023-02-18 03:03:11,853 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(471ca587-8683-426d-a64b-fb3f67e9b8d5, queue=awx_private_queue)
[2023-02-18 03:03:11,853: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(471ca587-8683-426d-a64b-fb3f67e9b8d5, queue=awx_private_queue)
2023-02-18 03:03:11,869 DEBUG awx.main.dispatch delivered 471ca587-8683-426d-a64b-fb3f67e9b8d5 to worker[180] qsize 0
2023-02-18 03:03:11,871 DEBUG awx.main.dispatch task 471ca587-8683-426d-a64b-fb3f67e9b8d5 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:03:11,873 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:03:11,908 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:03:11,954 DEBUG awx.main.dispatch task 471ca587-8683-426d-a64b-fb3f67e9b8d5 is finished
2023-02-18 03:03:21,772 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(66115c0e-f320-4884-9bc9-c0f7de1d9ef7, queue=awx_private_queue)
[2023-02-18 03:03:21,772: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(66115c0e-f320-4884-9bc9-c0f7de1d9ef7, queue=awx_private_queue)
2023-02-18 03:03:21,856 DEBUG awx.main.dispatch delivered 66115c0e-f320-4884-9bc9-c0f7de1d9ef7 to worker[183] qsize 0
2023-02-18 03:03:22,058 DEBUG awx.main.dispatch task 66115c0e-f320-4884-9bc9-c0f7de1d9ef7 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:03:22,089 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:03:22,094 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:02:51.826332+00:00
2023-02-18 03:03:22,147 DEBUG awx.main.dispatch task 66115c0e-f320-4884-9bc9-c0f7de1d9ef7 is finished
2023-02-18 03:03:31,854 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ae1bb608-40f3-4bda-aa7c-373f2c6b9b0a, queue=awx_private_queue)
[2023-02-18 03:03:31,854: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ae1bb608-40f3-4bda-aa7c-373f2c6b9b0a, queue=awx_private_queue)
2023-02-18 03:03:31,872 DEBUG awx.main.dispatch delivered ae1bb608-40f3-4bda-aa7c-373f2c6b9b0a to worker[180] qsize 0
2023-02-18 03:03:31,874 DEBUG awx.main.dispatch task ae1bb608-40f3-4bda-aa7c-373f2c6b9b0a starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:03:31,876 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:03:31,923 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:03:31,972 DEBUG awx.main.dispatch task ae1bb608-40f3-4bda-aa7c-373f2c6b9b0a is finished
2023-02-18 03:03:51,501 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(a5b775f3-d3fc-4d6c-b8da-a6625c0b55c4, queue=onap-awx-0)
[2023-02-18 03:03:51,501: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(a5b775f3-d3fc-4d6c-b8da-a6625c0b55c4, queue=onap-awx-0)
2023-02-18 03:03:51,571 DEBUG awx.main.dispatch delivered a5b775f3-d3fc-4d6c-b8da-a6625c0b55c4 to worker[182] qsize 0
2023-02-18 03:03:51,573 DEBUG awx.main.dispatch task a5b775f3-d3fc-4d6c-b8da-a6625c0b55c4 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:03:51,574 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:03:51,727 DEBUG awx.main.dispatch task a5b775f3-d3fc-4d6c-b8da-a6625c0b55c4 is finished
2023-02-18 03:03:51,750 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(f7778299-40ff-4d79-9950-551bc7160227, queue=onap-awx-0)
[2023-02-18 03:03:51,750: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(f7778299-40ff-4d79-9950-551bc7160227, queue=onap-awx-0)
2023-02-18 03:03:51,767 DEBUG awx.main.dispatch delivered f7778299-40ff-4d79-9950-551bc7160227 to worker[183] qsize 0
2023-02-18 03:03:51,769 DEBUG awx.main.dispatch task f7778299-40ff-4d79-9950-551bc7160227 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:03:51,772 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d61e0b5f-94ef-4100-ae3f-ce1fb0aa7f3a, queue=awx_private_queue)
[2023-02-18 03:03:51,772: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d61e0b5f-94ef-4100-ae3f-ce1fb0aa7f3a, queue=awx_private_queue)
2023-02-18 03:03:51,785 DEBUG awx.main.dispatch delivered d61e0b5f-94ef-4100-ae3f-ce1fb0aa7f3a to worker[180] qsize 0
2023-02-18 03:03:51,787 DEBUG awx.main.dispatch task d61e0b5f-94ef-4100-ae3f-ce1fb0aa7f3a starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:03:51,836 DEBUG awx.main.dispatch task f7778299-40ff-4d79-9950-551bc7160227 is finished
2023-02-18 03:03:51,854 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(dc26174f-efb8-4d3e-8890-d60e29d4fe8c, queue=awx_private_queue)
[2023-02-18 03:03:51,854: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(dc26174f-efb8-4d3e-8890-d60e29d4fe8c, queue=awx_private_queue)
2023-02-18 03:03:51,872 DEBUG awx.main.dispatch delivered dc26174f-efb8-4d3e-8890-d60e29d4fe8c to worker[181] qsize 0
2023-02-18 03:03:51,874 DEBUG awx.main.dispatch task dc26174f-efb8-4d3e-8890-d60e29d4fe8c starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:03:51,876 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:03:51,884 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:03:51,891 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:03:22.089211+00:00
2023-02-18 03:03:51,943 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:03:52,037 DEBUG awx.main.dispatch task d61e0b5f-94ef-4100-ae3f-ce1fb0aa7f3a is finished
2023-02-18 03:03:52,080 DEBUG awx.main.dispatch task dc26174f-efb8-4d3e-8890-d60e29d4fe8c is finished
RESULT 2
OKREADY
2023-02-18 03:04:11,868 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(557076d6-706b-4f19-bc98-7e8344cb2212, queue=awx_private_queue)
[2023-02-18 03:04:11,868: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(557076d6-706b-4f19-bc98-7e8344cb2212, queue=awx_private_queue)
2023-02-18 03:04:11,884 DEBUG awx.main.dispatch delivered 557076d6-706b-4f19-bc98-7e8344cb2212 to worker[180] qsize 0
2023-02-18 03:04:11,886 DEBUG awx.main.dispatch task 557076d6-706b-4f19-bc98-7e8344cb2212 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:04:11,887 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:04:11,951 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:04:12,065 DEBUG awx.main.dispatch task 557076d6-706b-4f19-bc98-7e8344cb2212 is finished
2023-02-18 03:04:21,772 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(5f43350a-249d-4fff-9011-502879102d4b, queue=awx_private_queue)
[2023-02-18 03:04:21,772: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(5f43350a-249d-4fff-9011-502879102d4b, queue=awx_private_queue)
2023-02-18 03:04:21,874 DEBUG awx.main.dispatch delivered 5f43350a-249d-4fff-9011-502879102d4b to worker[183] qsize 0
2023-02-18 03:04:22,073 DEBUG awx.main.dispatch task 5f43350a-249d-4fff-9011-502879102d4b starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:04:22,147 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:04:22,153 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:03:51.884671+00:00
2023-02-18 03:04:22,272 DEBUG awx.main.dispatch task 5f43350a-249d-4fff-9011-502879102d4b is finished
2023-02-18 03:04:31,869 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b992b379-35af-4b9e-a466-768eacdfa91a, queue=awx_private_queue)
[2023-02-18 03:04:31,869: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b992b379-35af-4b9e-a466-768eacdfa91a, queue=awx_private_queue)
2023-02-18 03:04:31,886 DEBUG awx.main.dispatch delivered b992b379-35af-4b9e-a466-768eacdfa91a to worker[182] qsize 0
2023-02-18 03:04:31,889 DEBUG awx.main.dispatch task b992b379-35af-4b9e-a466-768eacdfa91a starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:04:31,891 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:04:31,918 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:04:31,965 DEBUG awx.main.dispatch task b992b379-35af-4b9e-a466-768eacdfa91a is finished
2023-02-18 03:04:51,464 DEBUG awx.main.dispatch publish awx.main.tasks.awx_isolated_heartbeat(294afc42-54d8-43db-b86d-f296acd9d637, queue=onap-awx-0)
[2023-02-18 03:04:51,464: DEBUG/Process-1] publish awx.main.tasks.awx_isolated_heartbeat(294afc42-54d8-43db-b86d-f296acd9d637, queue=onap-awx-0)
2023-02-18 03:04:51,481 DEBUG awx.main.dispatch delivered 294afc42-54d8-43db-b86d-f296acd9d637 to worker[181] qsize 0
2023-02-18 03:04:51,483 DEBUG awx.main.dispatch task 294afc42-54d8-43db-b86d-f296acd9d637 starting awx.main.tasks.awx_isolated_heartbeat(*[])
2023-02-18 03:04:51,484 DEBUG awx.main.tasks Controlling node checking for any isolated management tasks.
2023-02-18 03:04:51,501 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(b1266005-fc4e-4cef-8a94-7c42f417c759, queue=onap-awx-0)
[2023-02-18 03:04:51,501: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(b1266005-fc4e-4cef-8a94-7c42f417c759, queue=onap-awx-0)
2023-02-18 03:04:51,545 DEBUG awx.main.dispatch delivered b1266005-fc4e-4cef-8a94-7c42f417c759 to worker[183] qsize 0
2023-02-18 03:04:51,547 DEBUG awx.main.dispatch task b1266005-fc4e-4cef-8a94-7c42f417c759 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:04:51,548 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:04:51,549 DEBUG awx.main.dispatch task 294afc42-54d8-43db-b86d-f296acd9d637 is finished
2023-02-18 03:04:51,630 DEBUG awx.main.dispatch task b1266005-fc4e-4cef-8a94-7c42f417c759 is finished
2023-02-18 03:04:51,751 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(0b038ffb-1fda-41de-877f-2a121472d41a, queue=onap-awx-0)
[2023-02-18 03:04:51,751: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(0b038ffb-1fda-41de-877f-2a121472d41a, queue=onap-awx-0)
2023-02-18 03:04:51,772 DEBUG awx.main.dispatch delivered 0b038ffb-1fda-41de-877f-2a121472d41a to worker[180] qsize 0
2023-02-18 03:04:51,773 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(7f0e4bd9-9c42-4ea7-81ab-0299aa0dd8fb, queue=awx_private_queue)
[2023-02-18 03:04:51,773: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(7f0e4bd9-9c42-4ea7-81ab-0299aa0dd8fb, queue=awx_private_queue)
2023-02-18 03:04:51,774 DEBUG awx.main.dispatch task 0b038ffb-1fda-41de-877f-2a121472d41a starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:04:51,788 DEBUG awx.main.dispatch delivered 7f0e4bd9-9c42-4ea7-81ab-0299aa0dd8fb to worker[181] qsize 0
2023-02-18 03:04:51,789 DEBUG awx.main.dispatch task 7f0e4bd9-9c42-4ea7-81ab-0299aa0dd8fb starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:04:51,800 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:04:51,800 DEBUG awx.main.dispatch task 0b038ffb-1fda-41de-877f-2a121472d41a is finished
2023-02-18 03:04:51,804 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:04:22.147284+00:00
2023-02-18 03:04:51,839 DEBUG awx.main.dispatch task 7f0e4bd9-9c42-4ea7-81ab-0299aa0dd8fb is finished
2023-02-18 03:04:51,869 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5400ed09-ea01-44fd-8035-24b1ee9520a0, queue=awx_private_queue)
[2023-02-18 03:04:51,869: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5400ed09-ea01-44fd-8035-24b1ee9520a0, queue=awx_private_queue)
2023-02-18 03:04:51,886 DEBUG awx.main.dispatch delivered 5400ed09-ea01-44fd-8035-24b1ee9520a0 to worker[182] qsize 0
2023-02-18 03:04:51,888 DEBUG awx.main.dispatch task 5400ed09-ea01-44fd-8035-24b1ee9520a0 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:04:51,889 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:04:51,921 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:04:51,977 DEBUG awx.main.dispatch task 5400ed09-ea01-44fd-8035-24b1ee9520a0 is finished
RESULT 2
OKREADY
2023-02-18 03:05:11,879 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(2939c0f7-01e0-4760-9e4b-e3f556fcf764, queue=awx_private_queue)
[2023-02-18 03:05:11,879: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(2939c0f7-01e0-4760-9e4b-e3f556fcf764, queue=awx_private_queue)
2023-02-18 03:05:11,897 DEBUG awx.main.dispatch delivered 2939c0f7-01e0-4760-9e4b-e3f556fcf764 to worker[182] qsize 0
2023-02-18 03:05:11,900 DEBUG awx.main.dispatch task 2939c0f7-01e0-4760-9e4b-e3f556fcf764 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:05:11,902 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:05:11,938 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:05:11,988 DEBUG awx.main.dispatch task 2939c0f7-01e0-4760-9e4b-e3f556fcf764 is finished
2023-02-18 03:05:21,777 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(91d007cc-3728-4899-a884-533282302c8b, queue=awx_private_queue)
[2023-02-18 03:05:21,777: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(91d007cc-3728-4899-a884-533282302c8b, queue=awx_private_queue)
2023-02-18 03:05:21,860 DEBUG awx.main.dispatch delivered 91d007cc-3728-4899-a884-533282302c8b to worker[181] qsize 0
2023-02-18 03:05:21,865 DEBUG awx.main.dispatch task 91d007cc-3728-4899-a884-533282302c8b starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:05:22,143 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:05:22,147 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:04:51.801038+00:00
2023-02-18 03:05:22,216 DEBUG awx.main.dispatch task 91d007cc-3728-4899-a884-533282302c8b is finished
2023-02-18 03:05:31,881 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(cd72e0ef-c761-442e-97ba-b46b0f1a1f77, queue=awx_private_queue)
[2023-02-18 03:05:31,881: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(cd72e0ef-c761-442e-97ba-b46b0f1a1f77, queue=awx_private_queue)
2023-02-18 03:05:31,899 DEBUG awx.main.dispatch delivered cd72e0ef-c761-442e-97ba-b46b0f1a1f77 to worker[180] qsize 0
2023-02-18 03:05:31,903 DEBUG awx.main.dispatch task cd72e0ef-c761-442e-97ba-b46b0f1a1f77 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:05:31,906 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:05:32,079 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:05:32,297 DEBUG awx.main.dispatch task cd72e0ef-c761-442e-97ba-b46b0f1a1f77 is finished
2023-02-18 03:05:51,512 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(897c9ae4-b376-4bde-b2c0-8a2719af3500, queue=onap-awx-0)
[2023-02-18 03:05:51,512: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(897c9ae4-b376-4bde-b2c0-8a2719af3500, queue=onap-awx-0)
2023-02-18 03:05:51,559 DEBUG awx.main.dispatch delivered 897c9ae4-b376-4bde-b2c0-8a2719af3500 to worker[182] qsize 0
2023-02-18 03:05:51,562 DEBUG awx.main.dispatch task 897c9ae4-b376-4bde-b2c0-8a2719af3500 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:05:51,566 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:05:51,640 DEBUG awx.main.dispatch task 897c9ae4-b376-4bde-b2c0-8a2719af3500 is finished
2023-02-18 03:05:51,750 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(fd725a39-f605-4e6d-b6f3-fd63ffa11d40, queue=onap-awx-0)
[2023-02-18 03:05:51,750: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(fd725a39-f605-4e6d-b6f3-fd63ffa11d40, queue=onap-awx-0)
2023-02-18 03:05:51,767 DEBUG awx.main.dispatch delivered fd725a39-f605-4e6d-b6f3-fd63ffa11d40 to worker[181] qsize 0
2023-02-18 03:05:51,769 DEBUG awx.main.dispatch task fd725a39-f605-4e6d-b6f3-fd63ffa11d40 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:05:51,775 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(8ef4d4f4-d246-4d84-8f53-e2e8c113326b, queue=awx_private_queue)
[2023-02-18 03:05:51,775: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(8ef4d4f4-d246-4d84-8f53-e2e8c113326b, queue=awx_private_queue)
2023-02-18 03:05:51,790 DEBUG awx.main.dispatch delivered 8ef4d4f4-d246-4d84-8f53-e2e8c113326b to worker[182] qsize 0
2023-02-18 03:05:51,792 DEBUG awx.main.dispatch task 8ef4d4f4-d246-4d84-8f53-e2e8c113326b starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:05:51,832 DEBUG awx.main.dispatch task fd725a39-f605-4e6d-b6f3-fd63ffa11d40 is finished
2023-02-18 03:05:51,852 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:05:51,857 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:05:22.143511+00:00
2023-02-18 03:05:51,880 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(4901b264-8377-4e6f-b702-2d2815ae708b, queue=awx_private_queue)
[2023-02-18 03:05:51,880: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(4901b264-8377-4e6f-b702-2d2815ae708b, queue=awx_private_queue)
2023-02-18 03:05:51,897 DEBUG awx.main.dispatch delivered 4901b264-8377-4e6f-b702-2d2815ae708b to worker[183] qsize 0
2023-02-18 03:05:51,898 DEBUG awx.main.dispatch task 8ef4d4f4-d246-4d84-8f53-e2e8c113326b is finished
2023-02-18 03:05:51,900 DEBUG awx.main.dispatch task 4901b264-8377-4e6f-b702-2d2815ae708b starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:05:51,903 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:05:51,998 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:05:52,088 DEBUG awx.main.dispatch task 4901b264-8377-4e6f-b702-2d2815ae708b is finished
RESULT 2
OKREADY
2023-02-18 03:06:11,880 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(97e2172a-4ac8-42f0-8718-70974c8e4ed1, queue=awx_private_queue)
[2023-02-18 03:06:11,880: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(97e2172a-4ac8-42f0-8718-70974c8e4ed1, queue=awx_private_queue)
2023-02-18 03:06:11,897 DEBUG awx.main.dispatch delivered 97e2172a-4ac8-42f0-8718-70974c8e4ed1 to worker[182] qsize 0
2023-02-18 03:06:11,899 DEBUG awx.main.dispatch task 97e2172a-4ac8-42f0-8718-70974c8e4ed1 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:06:11,901 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:06:11,972 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:06:12,198 DEBUG awx.main.dispatch task 97e2172a-4ac8-42f0-8718-70974c8e4ed1 is finished
2023-02-18 03:06:21,775 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(e4018fda-6b66-4e13-bf65-0bcc0bbf755a, queue=awx_private_queue)
[2023-02-18 03:06:21,775: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(e4018fda-6b66-4e13-bf65-0bcc0bbf755a, queue=awx_private_queue)
2023-02-18 03:06:21,887 DEBUG awx.main.dispatch delivered e4018fda-6b66-4e13-bf65-0bcc0bbf755a to worker[183] qsize 0
2023-02-18 03:06:21,890 DEBUG awx.main.dispatch task e4018fda-6b66-4e13-bf65-0bcc0bbf755a starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:06:22,001 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:06:22,060 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:05:51.853200+00:00
2023-02-18 03:06:22,208 DEBUG awx.main.dispatch task e4018fda-6b66-4e13-bf65-0bcc0bbf755a is finished
2023-02-18 03:06:31,881 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6ee05839-e1e8-4dbf-b1f8-619c709d739e, queue=awx_private_queue)
[2023-02-18 03:06:31,881: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6ee05839-e1e8-4dbf-b1f8-619c709d739e, queue=awx_private_queue)
2023-02-18 03:06:31,898 DEBUG awx.main.dispatch delivered 6ee05839-e1e8-4dbf-b1f8-619c709d739e to worker[182] qsize 0
2023-02-18 03:06:31,900 DEBUG awx.main.dispatch task 6ee05839-e1e8-4dbf-b1f8-619c709d739e starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:06:31,901 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:06:31,993 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:06:32,327 DEBUG awx.main.dispatch task 6ee05839-e1e8-4dbf-b1f8-619c709d739e is finished
2023-02-18 03:06:51,517 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(51b40082-00fc-4562-b614-5627add7cdf6, queue=onap-awx-0)
[2023-02-18 03:06:51,517: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(51b40082-00fc-4562-b614-5627add7cdf6, queue=onap-awx-0)
2023-02-18 03:06:51,750 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(afb6cced-9228-4741-9891-70da47764a2b, queue=onap-awx-0)
[2023-02-18 03:06:51,750: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(afb6cced-9228-4741-9891-70da47764a2b, queue=onap-awx-0)
2023-02-18 03:06:51,774 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(72ec929e-055c-4f57-9726-89b5654ea5e6, queue=awx_private_queue)
[2023-02-18 03:06:51,774: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(72ec929e-055c-4f57-9726-89b5654ea5e6, queue=awx_private_queue)
2023-02-18 03:06:51,585 DEBUG awx.main.dispatch delivered 51b40082-00fc-4562-b614-5627add7cdf6 to worker[180] qsize 0
2023-02-18 03:06:51,800 DEBUG awx.main.dispatch delivered afb6cced-9228-4741-9891-70da47764a2b to worker[182] qsize 0
2023-02-18 03:06:51,800 DEBUG awx.main.dispatch task 51b40082-00fc-4562-b614-5627add7cdf6 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:06:51,803 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:06:51,802 DEBUG awx.main.dispatch task afb6cced-9228-4741-9891-70da47764a2b starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:06:51,803 DEBUG awx.main.dispatch delivered 72ec929e-055c-4f57-9726-89b5654ea5e6 to worker[181] qsize 0
2023-02-18 03:06:51,805 DEBUG awx.main.dispatch task 72ec929e-055c-4f57-9726-89b5654ea5e6 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:06:51,862 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:06:51,880 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6b0f16b2-04df-479d-bbbf-aa042c75a04d, queue=awx_private_queue)
[2023-02-18 03:06:51,880: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6b0f16b2-04df-479d-bbbf-aa042c75a04d, queue=awx_private_queue)
2023-02-18 03:06:51,883 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:06:22.001717+00:00
2023-02-18 03:06:51,897 DEBUG awx.main.dispatch delivered 6b0f16b2-04df-479d-bbbf-aa042c75a04d to worker[183] qsize 0
2023-02-18 03:06:51,900 DEBUG awx.main.dispatch task 6b0f16b2-04df-479d-bbbf-aa042c75a04d starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:06:51,902 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:06:51,930 DEBUG awx.main.dispatch task afb6cced-9228-4741-9891-70da47764a2b is finished
2023-02-18 03:06:52,000 DEBUG awx.main.dispatch task 51b40082-00fc-4562-b614-5627add7cdf6 is finished
2023-02-18 03:06:52,017 DEBUG awx.main.dispatch task 72ec929e-055c-4f57-9726-89b5654ea5e6 is finished
2023-02-18 03:06:52,074 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:06:52,278 DEBUG awx.main.dispatch task 6b0f16b2-04df-479d-bbbf-aa042c75a04d is finished
RESULT 2
OKREADY
2023-02-18 03:07:11,880 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e74a6d81-f213-47e0-b87c-f2a061c2ed39, queue=awx_private_queue)
[2023-02-18 03:07:11,880: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e74a6d81-f213-47e0-b87c-f2a061c2ed39, queue=awx_private_queue)
2023-02-18 03:07:11,913 DEBUG awx.main.dispatch delivered e74a6d81-f213-47e0-b87c-f2a061c2ed39 to worker[180] qsize 0
2023-02-18 03:07:11,915 DEBUG awx.main.dispatch task e74a6d81-f213-47e0-b87c-f2a061c2ed39 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:07:11,916 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:07:11,986 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:07:12,258 DEBUG awx.main.dispatch task e74a6d81-f213-47e0-b87c-f2a061c2ed39 is finished
2023-02-18 03:07:21,775 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(ccb728fa-9401-4c3a-b6c7-0b8ad73ffd3f, queue=awx_private_queue)
[2023-02-18 03:07:21,775: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(ccb728fa-9401-4c3a-b6c7-0b8ad73ffd3f, queue=awx_private_queue)
2023-02-18 03:07:21,791 DEBUG awx.main.dispatch delivered ccb728fa-9401-4c3a-b6c7-0b8ad73ffd3f to worker[182] qsize 0
2023-02-18 03:07:21,793 DEBUG awx.main.dispatch task ccb728fa-9401-4c3a-b6c7-0b8ad73ffd3f starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:07:21,931 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:07:21,950 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:06:51.862338+00:00
2023-02-18 03:07:22,198 DEBUG awx.main.dispatch task ccb728fa-9401-4c3a-b6c7-0b8ad73ffd3f is finished
2023-02-18 03:07:31,881 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(9d1c41b5-0abc-49ef-baa8-4cb1d16030ec, queue=awx_private_queue)
[2023-02-18 03:07:31,881: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(9d1c41b5-0abc-49ef-baa8-4cb1d16030ec, queue=awx_private_queue)
2023-02-18 03:07:31,897 DEBUG awx.main.dispatch delivered 9d1c41b5-0abc-49ef-baa8-4cb1d16030ec to worker[181] qsize 0
2023-02-18 03:07:31,899 DEBUG awx.main.dispatch task 9d1c41b5-0abc-49ef-baa8-4cb1d16030ec starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:07:31,901 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:07:32,921 ERROR awx.main.dispatch Worker failed to run task awx.main.scheduler.tasks.run_task_manager(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/tasks.py", line 15, in run_task_manager
TaskManager().schedule()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/task_manager.py", line 45, in __init__
for rampart_group in InstanceGroup.objects.prefetch_related('instances'):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 274, in __iter__
self._fetch_all()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 1242, in _fetch_all
self._result_cache = list(self._iterable_class(self))
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 55, in __iter__
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1098, in execute_sql
cursor = self.connection.cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor
return self._cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:07:32,928 DEBUG awx.main.dispatch task 9d1c41b5-0abc-49ef-baa8-4cb1d16030ec is finished
2023-02-18 03:07:51,526 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(2b6703b4-fca7-4e31-9447-e868d69e3ea5, queue=onap-awx-0)
[2023-02-18 03:07:51,526: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(2b6703b4-fca7-4e31-9447-e868d69e3ea5, queue=onap-awx-0)
2023-02-18 03:07:51,750 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(4ab51850-1621-4966-98ff-081c703816a9, queue=onap-awx-0)
[2023-02-18 03:07:51,750: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(4ab51850-1621-4966-98ff-081c703816a9, queue=onap-awx-0)
2023-02-18 03:07:51,776 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(aeca50e0-930c-41a1-aedc-fc8cfdc644bd, queue=awx_private_queue)
[2023-02-18 03:07:51,776: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(aeca50e0-930c-41a1-aedc-fc8cfdc644bd, queue=awx_private_queue)
2023-02-18 03:07:51,601 DEBUG awx.main.dispatch delivered 2b6703b4-fca7-4e31-9447-e868d69e3ea5 to worker[182] qsize 0
2023-02-18 03:07:51,810 DEBUG awx.main.dispatch delivered 4ab51850-1621-4966-98ff-081c703816a9 to worker[181] qsize 0
2023-02-18 03:07:51,810 DEBUG awx.main.dispatch task 2b6703b4-fca7-4e31-9447-e868d69e3ea5 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:07:51,812 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:07:51,812 DEBUG awx.main.dispatch delivered aeca50e0-930c-41a1-aedc-fc8cfdc644bd to worker[183] qsize 0
2023-02-18 03:07:51,812 DEBUG awx.main.dispatch task 4ab51850-1621-4966-98ff-081c703816a9 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:07:51,815 DEBUG awx.main.dispatch task aeca50e0-930c-41a1-aedc-fc8cfdc644bd starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:07:51,874 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:07:51,881 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(10bb76df-e093-49b6-8896-70f3bf1b30a5, queue=awx_private_queue)
[2023-02-18 03:07:51,881: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(10bb76df-e093-49b6-8896-70f3bf1b30a5, queue=awx_private_queue)
2023-02-18 03:07:51,883 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:07:21.931389+00:00
2023-02-18 03:07:51,895 DEBUG awx.main.dispatch delivered 10bb76df-e093-49b6-8896-70f3bf1b30a5 to worker[180] qsize 0
2023-02-18 03:07:51,898 DEBUG awx.main.dispatch task 10bb76df-e093-49b6-8896-70f3bf1b30a5 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:07:51,900 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:07:51,968 DEBUG awx.main.dispatch task 4ab51850-1621-4966-98ff-081c703816a9 is finished
2023-02-18 03:07:52,017 DEBUG awx.main.dispatch task aeca50e0-930c-41a1-aedc-fc8cfdc644bd is finished
2023-02-18 03:07:52,065 DEBUG awx.main.dispatch task 2b6703b4-fca7-4e31-9447-e868d69e3ea5 is finished
2023-02-18 03:07:52,107 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:07:52,258 DEBUG awx.main.dispatch task 10bb76df-e093-49b6-8896-70f3bf1b30a5 is finished
RESULT 2
OKREADY
2023-02-18 03:08:11,890 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6a13ab77-4892-4df7-b2a4-99e291d5c705, queue=awx_private_queue)
[2023-02-18 03:08:11,890: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6a13ab77-4892-4df7-b2a4-99e291d5c705, queue=awx_private_queue)
2023-02-18 03:08:11,909 DEBUG awx.main.dispatch delivered 6a13ab77-4892-4df7-b2a4-99e291d5c705 to worker[181] qsize 0
2023-02-18 03:08:11,911 DEBUG awx.main.dispatch task 6a13ab77-4892-4df7-b2a4-99e291d5c705 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:08:11,912 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:08:11,955 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:08:12,111 DEBUG awx.main.dispatch task 6a13ab77-4892-4df7-b2a4-99e291d5c705 is finished
2023-02-18 03:08:21,775 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(43ed35e0-5bef-4fab-8216-aa55dd8ba5db, queue=awx_private_queue)
[2023-02-18 03:08:21,775: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(43ed35e0-5bef-4fab-8216-aa55dd8ba5db, queue=awx_private_queue)
2023-02-18 03:08:21,791 DEBUG awx.main.dispatch delivered 43ed35e0-5bef-4fab-8216-aa55dd8ba5db to worker[180] qsize 0
2023-02-18 03:08:21,793 DEBUG awx.main.dispatch task 43ed35e0-5bef-4fab-8216-aa55dd8ba5db starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:08:21,926 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:08:21,943 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:07:51.874276+00:00
2023-02-18 03:08:22,068 DEBUG awx.main.dispatch task 43ed35e0-5bef-4fab-8216-aa55dd8ba5db is finished
2023-02-18 03:08:31,888 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(cfd72737-e622-4c10-aee7-3379f8d1cf8c, queue=awx_private_queue)
[2023-02-18 03:08:31,888: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(cfd72737-e622-4c10-aee7-3379f8d1cf8c, queue=awx_private_queue)
2023-02-18 03:08:31,904 DEBUG awx.main.dispatch delivered cfd72737-e622-4c10-aee7-3379f8d1cf8c to worker[183] qsize 0
2023-02-18 03:08:31,907 DEBUG awx.main.dispatch task cfd72737-e622-4c10-aee7-3379f8d1cf8c starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:08:31,908 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:08:32,076 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:08:32,178 DEBUG awx.main.dispatch task cfd72737-e622-4c10-aee7-3379f8d1cf8c is finished
2023-02-18 03:08:51,536 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(00f5be4d-bfb4-4ec0-a1da-b769b3e838bd, queue=onap-awx-0)
[2023-02-18 03:08:51,536: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(00f5be4d-bfb4-4ec0-a1da-b769b3e838bd, queue=onap-awx-0)
2023-02-18 03:08:51,616 DEBUG awx.main.dispatch delivered 00f5be4d-bfb4-4ec0-a1da-b769b3e838bd to worker[183] qsize 0
2023-02-18 03:08:51,619 DEBUG awx.main.dispatch task 00f5be4d-bfb4-4ec0-a1da-b769b3e838bd starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:08:51,621 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:08:51,776 DEBUG awx.main.dispatch task 00f5be4d-bfb4-4ec0-a1da-b769b3e838bd is finished
2023-02-18 03:08:51,750 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(03ab6cf5-3e4f-45de-b44d-d89eb8105c82, queue=onap-awx-0)
[2023-02-18 03:08:51,750: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(03ab6cf5-3e4f-45de-b44d-d89eb8105c82, queue=onap-awx-0)
2023-02-18 03:08:51,903 DEBUG awx.main.dispatch delivered 03ab6cf5-3e4f-45de-b44d-d89eb8105c82 to worker[181] qsize 0
2023-02-18 03:08:51,904 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(1003c805-8386-4c4f-a43d-d27b9ebbae23, queue=awx_private_queue)
[2023-02-18 03:08:51,904: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(1003c805-8386-4c4f-a43d-d27b9ebbae23, queue=awx_private_queue)
2023-02-18 03:08:51,919 DEBUG awx.main.dispatch delivered 1003c805-8386-4c4f-a43d-d27b9ebbae23 to worker[180] qsize 0
2023-02-18 03:08:51,920 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(2ca2542b-3d9c-4240-900a-52eca23b50ff, queue=awx_private_queue)
[2023-02-18 03:08:51,920: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(2ca2542b-3d9c-4240-900a-52eca23b50ff, queue=awx_private_queue)
2023-02-18 03:08:51,933 DEBUG awx.main.dispatch delivered 2ca2542b-3d9c-4240-900a-52eca23b50ff to worker[182] qsize 0
2023-02-18 03:08:51,920 DEBUG awx.main.dispatch task 1003c805-8386-4c4f-a43d-d27b9ebbae23 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:08:52,166 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:08:51,906 DEBUG awx.main.dispatch task 03ab6cf5-3e4f-45de-b44d-d89eb8105c82 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:08:52,179 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:08:21.926724+00:00
2023-02-18 03:08:51,935 DEBUG awx.main.dispatch task 2ca2542b-3d9c-4240-900a-52eca23b50ff starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:08:52,215 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:08:52,230 DEBUG awx.main.dispatch task 03ab6cf5-3e4f-45de-b44d-d89eb8105c82 is finished
2023-02-18 03:08:52,241 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:08:52,334 DEBUG awx.main.dispatch task 1003c805-8386-4c4f-a43d-d27b9ebbae23 is finished
2023-02-18 03:08:52,364 DEBUG awx.main.dispatch task 2ca2542b-3d9c-4240-900a-52eca23b50ff is finished
RESULT 2
OKREADY
2023-02-18 03:09:11,929 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(cfe912b2-e1ab-43cf-a800-6413faf4ca34, queue=awx_private_queue)
[2023-02-18 03:09:11,929: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(cfe912b2-e1ab-43cf-a800-6413faf4ca34, queue=awx_private_queue)
2023-02-18 03:09:11,951 DEBUG awx.main.dispatch delivered cfe912b2-e1ab-43cf-a800-6413faf4ca34 to worker[181] qsize 0
2023-02-18 03:09:11,953 DEBUG awx.main.dispatch task cfe912b2-e1ab-43cf-a800-6413faf4ca34 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:09:11,954 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:09:12,127 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:09:12,302 DEBUG awx.main.dispatch task cfe912b2-e1ab-43cf-a800-6413faf4ca34 is finished
2023-02-18 03:09:21,906 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(700f183c-d95e-46a3-aa2e-f809bc1c9000, queue=awx_private_queue)
[2023-02-18 03:09:21,906: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(700f183c-d95e-46a3-aa2e-f809bc1c9000, queue=awx_private_queue)
2023-02-18 03:09:21,925 DEBUG awx.main.dispatch delivered 700f183c-d95e-46a3-aa2e-f809bc1c9000 to worker[181] qsize 0
2023-02-18 03:09:21,930 DEBUG awx.main.dispatch task 700f183c-d95e-46a3-aa2e-f809bc1c9000 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:09:22,049 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:09:22,098 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:08:52.166878+00:00
2023-02-18 03:09:22,353 DEBUG awx.main.dispatch task 700f183c-d95e-46a3-aa2e-f809bc1c9000 is finished
2023-02-18 03:09:31,929 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6c427528-25a7-4c23-8f95-b417a7baf88b, queue=awx_private_queue)
[2023-02-18 03:09:31,929: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6c427528-25a7-4c23-8f95-b417a7baf88b, queue=awx_private_queue)
2023-02-18 03:09:31,948 DEBUG awx.main.dispatch delivered 6c427528-25a7-4c23-8f95-b417a7baf88b to worker[181] qsize 0
2023-02-18 03:09:31,951 DEBUG awx.main.dispatch task 6c427528-25a7-4c23-8f95-b417a7baf88b starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:09:31,953 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:09:32,032 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:09:32,177 DEBUG awx.main.dispatch task 6c427528-25a7-4c23-8f95-b417a7baf88b is finished
2023-02-18 03:09:51,545 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(90f35aac-c687-44b5-b4ae-381eb9218333, queue=onap-awx-0)
[2023-02-18 03:09:51,545: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(90f35aac-c687-44b5-b4ae-381eb9218333, queue=onap-awx-0)
2023-02-18 03:09:51,620 DEBUG awx.main.dispatch delivered 90f35aac-c687-44b5-b4ae-381eb9218333 to worker[180] qsize 0
2023-02-18 03:09:51,626 DEBUG awx.main.dispatch task 90f35aac-c687-44b5-b4ae-381eb9218333 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:09:51,630 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:09:51,784 DEBUG awx.main.dispatch task 90f35aac-c687-44b5-b4ae-381eb9218333 is finished
2023-02-18 03:09:51,751 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(b1b64495-6b03-498d-9e14-334fae2b13ce, queue=onap-awx-0)
[2023-02-18 03:09:51,751: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(b1b64495-6b03-498d-9e14-334fae2b13ce, queue=onap-awx-0)
2023-02-18 03:09:51,873 DEBUG awx.main.dispatch delivered b1b64495-6b03-498d-9e14-334fae2b13ce to worker[182] qsize 0
2023-02-18 03:09:51,877 DEBUG awx.main.dispatch task b1b64495-6b03-498d-9e14-334fae2b13ce starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:09:51,904 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(a486c5b3-9e3c-42bb-98fe-05a6b207a2ed, queue=awx_private_queue)
[2023-02-18 03:09:51,904: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(a486c5b3-9e3c-42bb-98fe-05a6b207a2ed, queue=awx_private_queue)
2023-02-18 03:09:51,919 DEBUG awx.main.dispatch delivered a486c5b3-9e3c-42bb-98fe-05a6b207a2ed to worker[181] qsize 0
2023-02-18 03:09:51,929 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6b5a2c50-01fe-498b-9e67-d5aed0de1f9f, queue=awx_private_queue)
[2023-02-18 03:09:51,929: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6b5a2c50-01fe-498b-9e67-d5aed0de1f9f, queue=awx_private_queue)
2023-02-18 03:09:51,943 DEBUG awx.main.dispatch delivered 6b5a2c50-01fe-498b-9e67-d5aed0de1f9f to worker[183] qsize 0
2023-02-18 03:09:51,921 DEBUG awx.main.dispatch task a486c5b3-9e3c-42bb-98fe-05a6b207a2ed starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:09:51,946 DEBUG awx.main.dispatch task 6b5a2c50-01fe-498b-9e67-d5aed0de1f9f starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:09:52,216 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:09:52,233 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:09:52,009 DEBUG awx.main.dispatch task b1b64495-6b03-498d-9e14-334fae2b13ce is finished
2023-02-18 03:09:52,249 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:09:22.049235+00:00
2023-02-18 03:09:52,282 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:09:52,352 DEBUG awx.main.dispatch task a486c5b3-9e3c-42bb-98fe-05a6b207a2ed is finished
2023-02-18 03:09:52,533 DEBUG awx.main.dispatch task 6b5a2c50-01fe-498b-9e67-d5aed0de1f9f is finished
RESULT 2
OKREADY
2023-02-18 03:10:11,961 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7265c44c-ef87-49ec-80e4-23566174d830, queue=awx_private_queue)
[2023-02-18 03:10:11,961: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7265c44c-ef87-49ec-80e4-23566174d830, queue=awx_private_queue)
2023-02-18 03:10:11,979 DEBUG awx.main.dispatch delivered 7265c44c-ef87-49ec-80e4-23566174d830 to worker[180] qsize 0
2023-02-18 03:10:11,982 DEBUG awx.main.dispatch task 7265c44c-ef87-49ec-80e4-23566174d830 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:10:11,984 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:10:12,085 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:10:12,166 DEBUG awx.main.dispatch task 7265c44c-ef87-49ec-80e4-23566174d830 is finished
2023-02-18 03:10:21,904 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(87c6cc19-a423-425e-a0aa-13d9f4b5906d, queue=awx_private_queue)
[2023-02-18 03:10:21,904: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(87c6cc19-a423-425e-a0aa-13d9f4b5906d, queue=awx_private_queue)
2023-02-18 03:10:21,939 DEBUG awx.main.dispatch delivered 87c6cc19-a423-425e-a0aa-13d9f4b5906d to worker[183] qsize 0
2023-02-18 03:10:21,941 DEBUG awx.main.dispatch task 87c6cc19-a423-425e-a0aa-13d9f4b5906d starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:10:22,020 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:10:22,034 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:09:52.233854+00:00
2023-02-18 03:10:22,160 DEBUG awx.main.dispatch task 87c6cc19-a423-425e-a0aa-13d9f4b5906d is finished
2023-02-18 03:10:31,961 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(2bb8a727-5c53-4aca-a1b9-47415fd8589c, queue=awx_private_queue)
[2023-02-18 03:10:31,961: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(2bb8a727-5c53-4aca-a1b9-47415fd8589c, queue=awx_private_queue)
2023-02-18 03:10:31,978 DEBUG awx.main.dispatch delivered 2bb8a727-5c53-4aca-a1b9-47415fd8589c to worker[181] qsize 0
2023-02-18 03:10:31,981 DEBUG awx.main.dispatch task 2bb8a727-5c53-4aca-a1b9-47415fd8589c starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:10:31,982 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:10:32,140 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:10:32,485 DEBUG awx.main.dispatch task 2bb8a727-5c53-4aca-a1b9-47415fd8589c is finished
2023-02-18 03:10:51,555 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(8d701e56-3c0b-4fee-9125-b3b8bf93bd7e, queue=onap-awx-0)
[2023-02-18 03:10:51,555: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(8d701e56-3c0b-4fee-9125-b3b8bf93bd7e, queue=onap-awx-0)
2023-02-18 03:10:51,622 DEBUG awx.main.dispatch delivered 8d701e56-3c0b-4fee-9125-b3b8bf93bd7e to worker[180] qsize 0
2023-02-18 03:10:51,626 DEBUG awx.main.dispatch task 8d701e56-3c0b-4fee-9125-b3b8bf93bd7e starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:10:51,628 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:10:51,750 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(e104e873-62cf-45d2-96b5-7489d330fc28, queue=onap-awx-0)
[2023-02-18 03:10:51,750: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(e104e873-62cf-45d2-96b5-7489d330fc28, queue=onap-awx-0)
2023-02-18 03:10:51,773 DEBUG awx.main.dispatch task 8d701e56-3c0b-4fee-9125-b3b8bf93bd7e is finished
2023-02-18 03:10:51,768 DEBUG awx.main.dispatch delivered e104e873-62cf-45d2-96b5-7489d330fc28 to worker[182] qsize 0
2023-02-18 03:10:51,784 DEBUG awx.main.dispatch task e104e873-62cf-45d2-96b5-7489d330fc28 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:10:51,895 DEBUG awx.main.dispatch task e104e873-62cf-45d2-96b5-7489d330fc28 is finished
2023-02-18 03:10:51,905 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(25b82a8a-e9ff-4b5a-a89f-e447281b3da9, queue=awx_private_queue)
[2023-02-18 03:10:51,905: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(25b82a8a-e9ff-4b5a-a89f-e447281b3da9, queue=awx_private_queue)
2023-02-18 03:10:51,919 DEBUG awx.main.dispatch delivered 25b82a8a-e9ff-4b5a-a89f-e447281b3da9 to worker[182] qsize 0
2023-02-18 03:10:51,921 DEBUG awx.main.dispatch task 25b82a8a-e9ff-4b5a-a89f-e447281b3da9 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:10:51,952 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:10:51,963 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(73e8394b-a3ba-4d81-8d74-c1105d2288bb, queue=awx_private_queue)
[2023-02-18 03:10:51,963: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(73e8394b-a3ba-4d81-8d74-c1105d2288bb, queue=awx_private_queue)
2023-02-18 03:10:51,979 DEBUG awx.main.dispatch delivered 73e8394b-a3ba-4d81-8d74-c1105d2288bb to worker[181] qsize 0
2023-02-18 03:10:52,000 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:10:22.020970+00:00
2023-02-18 03:10:51,981 DEBUG awx.main.dispatch task 73e8394b-a3ba-4d81-8d74-c1105d2288bb starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:10:52,288 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:10:52,331 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:10:52,152 DEBUG awx.main.dispatch task 25b82a8a-e9ff-4b5a-a89f-e447281b3da9 is finished
2023-02-18 03:10:52,406 DEBUG awx.main.dispatch task 73e8394b-a3ba-4d81-8d74-c1105d2288bb is finished
RESULT 2
OKREADY
2023-02-18 03:11:11,963 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(57499784-5639-4fb1-b16e-299699fa3612, queue=awx_private_queue)
[2023-02-18 03:11:11,963: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(57499784-5639-4fb1-b16e-299699fa3612, queue=awx_private_queue)
2023-02-18 03:11:11,981 DEBUG awx.main.dispatch delivered 57499784-5639-4fb1-b16e-299699fa3612 to worker[182] qsize 0
2023-02-18 03:11:11,983 DEBUG awx.main.dispatch task 57499784-5639-4fb1-b16e-299699fa3612 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:11:11,985 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:11:12,156 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:11:12,342 DEBUG awx.main.dispatch task 57499784-5639-4fb1-b16e-299699fa3612 is finished
2023-02-18 03:11:21,906 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(1d601ead-e7a1-4948-92c1-c3a3ab85427a, queue=awx_private_queue)
[2023-02-18 03:11:21,906: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(1d601ead-e7a1-4948-92c1-c3a3ab85427a, queue=awx_private_queue)
2023-02-18 03:11:21,922 DEBUG awx.main.dispatch delivered 1d601ead-e7a1-4948-92c1-c3a3ab85427a to worker[180] qsize 0
2023-02-18 03:11:21,924 DEBUG awx.main.dispatch task 1d601ead-e7a1-4948-92c1-c3a3ab85427a starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:11:21,979 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:11:21,990 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:10:51.953628+00:00
2023-02-18 03:11:22,126 DEBUG awx.main.dispatch task 1d601ead-e7a1-4948-92c1-c3a3ab85427a is finished
2023-02-18 03:11:31,964 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f6de89a0-b8c4-4125-b1af-f70a811b254f, queue=awx_private_queue)
[2023-02-18 03:11:31,964: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f6de89a0-b8c4-4125-b1af-f70a811b254f, queue=awx_private_queue)
2023-02-18 03:11:31,989 DEBUG awx.main.dispatch delivered f6de89a0-b8c4-4125-b1af-f70a811b254f to worker[183] qsize 0
2023-02-18 03:11:31,993 DEBUG awx.main.dispatch task f6de89a0-b8c4-4125-b1af-f70a811b254f starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:11:31,995 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:11:32,066 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:11:32,253 DEBUG awx.main.dispatch task f6de89a0-b8c4-4125-b1af-f70a811b254f is finished
2023-02-18 03:11:51,555 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(008717e0-47f4-4780-aa18-d2eebdc3a758, queue=onap-awx-0)
[2023-02-18 03:11:51,555: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(008717e0-47f4-4780-aa18-d2eebdc3a758, queue=onap-awx-0)
2023-02-18 03:11:51,594 DEBUG awx.main.dispatch delivered 008717e0-47f4-4780-aa18-d2eebdc3a758 to worker[182] qsize 0
2023-02-18 03:11:51,596 DEBUG awx.main.dispatch task 008717e0-47f4-4780-aa18-d2eebdc3a758 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:11:51,598 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:11:51,710 DEBUG awx.main.dispatch task 008717e0-47f4-4780-aa18-d2eebdc3a758 is finished
2023-02-18 03:11:51,751 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(2943cb3b-caf8-41d8-8dbc-be25b02da3ef, queue=onap-awx-0)
[2023-02-18 03:11:51,751: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(2943cb3b-caf8-41d8-8dbc-be25b02da3ef, queue=onap-awx-0)
2023-02-18 03:11:51,767 DEBUG awx.main.dispatch delivered 2943cb3b-caf8-41d8-8dbc-be25b02da3ef to worker[183] qsize 0
2023-02-18 03:11:51,771 DEBUG awx.main.dispatch task 2943cb3b-caf8-41d8-8dbc-be25b02da3ef starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:11:51,874 DEBUG awx.main.dispatch task 2943cb3b-caf8-41d8-8dbc-be25b02da3ef is finished
2023-02-18 03:11:51,905 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(2af651fc-cc70-43e7-910b-8a77889f31b4, queue=awx_private_queue)
[2023-02-18 03:11:51,905: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(2af651fc-cc70-43e7-910b-8a77889f31b4, queue=awx_private_queue)
2023-02-18 03:11:51,920 DEBUG awx.main.dispatch delivered 2af651fc-cc70-43e7-910b-8a77889f31b4 to worker[183] qsize 0
2023-02-18 03:11:51,922 DEBUG awx.main.dispatch task 2af651fc-cc70-43e7-910b-8a77889f31b4 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:11:51,963 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(91109dbc-f46c-4e68-9096-9f40c6446236, queue=awx_private_queue)
[2023-02-18 03:11:51,963: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(91109dbc-f46c-4e68-9096-9f40c6446236, queue=awx_private_queue)
2023-02-18 03:11:51,971 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:11:51,978 DEBUG awx.main.dispatch delivered 91109dbc-f46c-4e68-9096-9f40c6446236 to worker[180] qsize 0
2023-02-18 03:11:51,980 DEBUG awx.main.dispatch task 91109dbc-f46c-4e68-9096-9f40c6446236 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:11:51,982 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:11:51,985 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:11:21.979658+00:00
2023-02-18 03:11:52,056 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:11:52,087 DEBUG awx.main.dispatch task 2af651fc-cc70-43e7-910b-8a77889f31b4 is finished
2023-02-18 03:11:52,181 DEBUG awx.main.dispatch task 91109dbc-f46c-4e68-9096-9f40c6446236 is finished
RESULT 2
OKREADY
2023-02-18 03:12:11,974 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b3e18120-cb9d-4f2c-a3a7-1599a3d7f1ef, queue=awx_private_queue)
[2023-02-18 03:12:11,974: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b3e18120-cb9d-4f2c-a3a7-1599a3d7f1ef, queue=awx_private_queue)
2023-02-18 03:12:12,304 DEBUG awx.main.dispatch delivered b3e18120-cb9d-4f2c-a3a7-1599a3d7f1ef to worker[183] qsize 0
2023-02-18 03:12:12,306 DEBUG awx.main.dispatch task b3e18120-cb9d-4f2c-a3a7-1599a3d7f1ef starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:12:12,307 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:12:12,344 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:12:12,447 DEBUG awx.main.dispatch task b3e18120-cb9d-4f2c-a3a7-1599a3d7f1ef is finished
2023-02-18 03:12:21,906 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d8722703-8b4a-4273-8a19-b71c9e484071, queue=awx_private_queue)
[2023-02-18 03:12:21,906: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d8722703-8b4a-4273-8a19-b71c9e484071, queue=awx_private_queue)
2023-02-18 03:12:21,924 DEBUG awx.main.dispatch delivered d8722703-8b4a-4273-8a19-b71c9e484071 to worker[181] qsize 0
2023-02-18 03:12:21,926 DEBUG awx.main.dispatch task d8722703-8b4a-4273-8a19-b71c9e484071 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:12:21,995 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:12:22,004 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:11:51.971318+00:00
2023-02-18 03:12:22,042 DEBUG awx.main.dispatch task d8722703-8b4a-4273-8a19-b71c9e484071 is finished
2023-02-18 03:12:31,974 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c57e7877-c46a-465c-84f8-950e40bf470a, queue=awx_private_queue)
[2023-02-18 03:12:31,974: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c57e7877-c46a-465c-84f8-950e40bf470a, queue=awx_private_queue)
2023-02-18 03:12:31,989 DEBUG awx.main.dispatch delivered c57e7877-c46a-465c-84f8-950e40bf470a to worker[182] qsize 0
2023-02-18 03:12:31,991 DEBUG awx.main.dispatch task c57e7877-c46a-465c-84f8-950e40bf470a starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:12:31,993 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:12:32,024 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:12:32,065 DEBUG awx.main.dispatch task c57e7877-c46a-465c-84f8-950e40bf470a is finished
2023-02-18 03:12:51,565 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(9db945a0-de00-4ec3-a7f2-51cbbce81826, queue=onap-awx-0)
[2023-02-18 03:12:51,565: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(9db945a0-de00-4ec3-a7f2-51cbbce81826, queue=onap-awx-0)
2023-02-18 03:12:51,615 DEBUG awx.main.dispatch delivered 9db945a0-de00-4ec3-a7f2-51cbbce81826 to worker[183] qsize 0
2023-02-18 03:12:51,618 DEBUG awx.main.dispatch task 9db945a0-de00-4ec3-a7f2-51cbbce81826 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:12:51,620 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:12:51,751 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(c7eabc1f-25ad-48eb-a3bd-2da86e1f2d5b, queue=onap-awx-0)
[2023-02-18 03:12:51,751: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(c7eabc1f-25ad-48eb-a3bd-2da86e1f2d5b, queue=onap-awx-0)
2023-02-18 03:12:51,767 DEBUG awx.main.dispatch delivered c7eabc1f-25ad-48eb-a3bd-2da86e1f2d5b to worker[181] qsize 0
2023-02-18 03:12:51,770 DEBUG awx.main.dispatch task c7eabc1f-25ad-48eb-a3bd-2da86e1f2d5b starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:12:51,822 DEBUG awx.main.dispatch task 9db945a0-de00-4ec3-a7f2-51cbbce81826 is finished
2023-02-18 03:12:51,879 DEBUG awx.main.dispatch task c7eabc1f-25ad-48eb-a3bd-2da86e1f2d5b is finished
2023-02-18 03:12:51,905 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(fe55d064-45b2-46c7-88f4-4a1eb72a8ecf, queue=awx_private_queue)
[2023-02-18 03:12:51,905: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(fe55d064-45b2-46c7-88f4-4a1eb72a8ecf, queue=awx_private_queue)
2023-02-18 03:12:51,922 DEBUG awx.main.dispatch delivered fe55d064-45b2-46c7-88f4-4a1eb72a8ecf to worker[183] qsize 0
2023-02-18 03:12:51,926 DEBUG awx.main.dispatch task fe55d064-45b2-46c7-88f4-4a1eb72a8ecf starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:12:51,973 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(faaa38ca-0fe0-49a5-a1bf-af5996d8fca0, queue=awx_private_queue)
[2023-02-18 03:12:51,973: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(faaa38ca-0fe0-49a5-a1bf-af5996d8fca0, queue=awx_private_queue)
2023-02-18 03:12:51,988 DEBUG awx.main.dispatch delivered faaa38ca-0fe0-49a5-a1bf-af5996d8fca0 to worker[181] qsize 0
2023-02-18 03:12:51,991 DEBUG awx.main.dispatch task faaa38ca-0fe0-49a5-a1bf-af5996d8fca0 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:12:51,992 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:12:52,024 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:12:52,038 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:12:21.995291+00:00
2023-02-18 03:12:52,120 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:12:52,262 DEBUG awx.main.dispatch task fe55d064-45b2-46c7-88f4-4a1eb72a8ecf is finished
2023-02-18 03:12:52,318 DEBUG awx.main.dispatch task faaa38ca-0fe0-49a5-a1bf-af5996d8fca0 is finished
RESULT 2
OKREADY
2023-02-18 03:13:11,995 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7d802791-3d1c-468b-a7de-ea1f23016075, queue=awx_private_queue)
[2023-02-18 03:13:11,995: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7d802791-3d1c-468b-a7de-ea1f23016075, queue=awx_private_queue)
2023-02-18 03:13:12,344 DEBUG awx.main.dispatch delivered 7d802791-3d1c-468b-a7de-ea1f23016075 to worker[181] qsize 0
2023-02-18 03:13:12,348 DEBUG awx.main.dispatch task 7d802791-3d1c-468b-a7de-ea1f23016075 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:13:12,350 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:13:12,545 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:13:12,844 DEBUG awx.main.dispatch task 7d802791-3d1c-468b-a7de-ea1f23016075 is finished
2023-02-18 03:13:21,907 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(b089db3c-75eb-44a6-bb09-687af7bf75c3, queue=awx_private_queue)
[2023-02-18 03:13:21,907: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(b089db3c-75eb-44a6-bb09-687af7bf75c3, queue=awx_private_queue)
2023-02-18 03:13:21,926 DEBUG awx.main.dispatch delivered b089db3c-75eb-44a6-bb09-687af7bf75c3 to worker[180] qsize 0
2023-02-18 03:13:21,929 DEBUG awx.main.dispatch task b089db3c-75eb-44a6-bb09-687af7bf75c3 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:13:21,994 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:13:22,027 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:12:52.024359+00:00
2023-02-18 03:13:22,192 DEBUG awx.main.dispatch task b089db3c-75eb-44a6-bb09-687af7bf75c3 is finished
2023-02-18 03:13:31,992 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0e6aa12f-61f8-49b2-9b8a-5764b640bca5, queue=awx_private_queue)
[2023-02-18 03:13:31,992: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0e6aa12f-61f8-49b2-9b8a-5764b640bca5, queue=awx_private_queue)
2023-02-18 03:13:32,010 DEBUG awx.main.dispatch delivered 0e6aa12f-61f8-49b2-9b8a-5764b640bca5 to worker[180] qsize 0
2023-02-18 03:13:32,012 DEBUG awx.main.dispatch task 0e6aa12f-61f8-49b2-9b8a-5764b640bca5 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:13:32,014 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:13:32,064 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:13:32,164 DEBUG awx.main.dispatch task 0e6aa12f-61f8-49b2-9b8a-5764b640bca5 is finished
2023-02-18 03:13:51,574 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(cafe9245-2fa7-4ece-a67b-88a7b45fff30, queue=onap-awx-0)
[2023-02-18 03:13:51,574: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(cafe9245-2fa7-4ece-a67b-88a7b45fff30, queue=onap-awx-0)
2023-02-18 03:13:51,651 DEBUG awx.main.dispatch delivered cafe9245-2fa7-4ece-a67b-88a7b45fff30 to worker[182] qsize 0
2023-02-18 03:13:51,655 DEBUG awx.main.dispatch task cafe9245-2fa7-4ece-a67b-88a7b45fff30 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:13:51,659 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:13:51,751 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(5e874a6b-f4c7-44b7-b9af-d76de86dfba6, queue=onap-awx-0)
[2023-02-18 03:13:51,751: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(5e874a6b-f4c7-44b7-b9af-d76de86dfba6, queue=onap-awx-0)
2023-02-18 03:13:51,783 DEBUG awx.main.dispatch delivered 5e874a6b-f4c7-44b7-b9af-d76de86dfba6 to worker[180] qsize 0
2023-02-18 03:13:51,786 DEBUG awx.main.dispatch task 5e874a6b-f4c7-44b7-b9af-d76de86dfba6 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:13:51,826 DEBUG awx.main.dispatch task cafe9245-2fa7-4ece-a67b-88a7b45fff30 is finished
2023-02-18 03:13:51,886 DEBUG awx.main.dispatch task 5e874a6b-f4c7-44b7-b9af-d76de86dfba6 is finished
2023-02-18 03:13:51,906 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d8b5d2b4-760e-4f9e-aeca-2b346b83bec8, queue=awx_private_queue)
[2023-02-18 03:13:51,906: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d8b5d2b4-760e-4f9e-aeca-2b346b83bec8, queue=awx_private_queue)
2023-02-18 03:13:51,921 DEBUG awx.main.dispatch delivered d8b5d2b4-760e-4f9e-aeca-2b346b83bec8 to worker[182] qsize 0
2023-02-18 03:13:51,923 DEBUG awx.main.dispatch task d8b5d2b4-760e-4f9e-aeca-2b346b83bec8 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:13:51,993 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(401ab5ed-a6cd-4f09-bc2c-908da1e69394, queue=awx_private_queue)
[2023-02-18 03:13:51,993: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(401ab5ed-a6cd-4f09-bc2c-908da1e69394, queue=awx_private_queue)
2023-02-18 03:13:52,008 DEBUG awx.main.dispatch delivered 401ab5ed-a6cd-4f09-bc2c-908da1e69394 to worker[180] qsize 0
2023-02-18 03:13:52,011 DEBUG awx.main.dispatch task 401ab5ed-a6cd-4f09-bc2c-908da1e69394 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:13:52,012 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:13:52,022 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:13:52,026 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:13:21.994261+00:00
2023-02-18 03:13:52,161 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:13:52,222 DEBUG awx.main.dispatch task d8b5d2b4-760e-4f9e-aeca-2b346b83bec8 is finished
2023-02-18 03:13:52,369 DEBUG awx.main.dispatch task 401ab5ed-a6cd-4f09-bc2c-908da1e69394 is finished
RESULT 2
OKREADY
2023-02-18 03:14:11,999 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d53dcae7-0849-48c4-8879-6b85f9bcf215, queue=awx_private_queue)
[2023-02-18 03:14:11,999: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d53dcae7-0849-48c4-8879-6b85f9bcf215, queue=awx_private_queue)
2023-02-18 03:14:12,290 DEBUG awx.main.dispatch delivered d53dcae7-0849-48c4-8879-6b85f9bcf215 to worker[182] qsize 0
2023-02-18 03:14:12,294 DEBUG awx.main.dispatch task d53dcae7-0849-48c4-8879-6b85f9bcf215 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:14:12,296 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:14:12,469 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:14:12,708 DEBUG awx.main.dispatch task d53dcae7-0849-48c4-8879-6b85f9bcf215 is finished
2023-02-18 03:14:21,908 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(ceefe370-9860-4891-aa21-55c688c6b640, queue=awx_private_queue)
[2023-02-18 03:14:21,908: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(ceefe370-9860-4891-aa21-55c688c6b640, queue=awx_private_queue)
2023-02-18 03:14:21,948 DEBUG awx.main.dispatch delivered ceefe370-9860-4891-aa21-55c688c6b640 to worker[180] qsize 0
2023-02-18 03:14:21,950 DEBUG awx.main.dispatch task ceefe370-9860-4891-aa21-55c688c6b640 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:14:22,045 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:14:22,074 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:13:52.022587+00:00
2023-02-18 03:14:22,274 DEBUG awx.main.dispatch task ceefe370-9860-4891-aa21-55c688c6b640 is finished
2023-02-18 03:14:31,999 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(02e1d6ec-42a0-4059-9534-e776d4641927, queue=awx_private_queue)
[2023-02-18 03:14:31,999: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(02e1d6ec-42a0-4059-9534-e776d4641927, queue=awx_private_queue)
2023-02-18 03:14:32,029 DEBUG awx.main.dispatch delivered 02e1d6ec-42a0-4059-9534-e776d4641927 to worker[183] qsize 0
2023-02-18 03:14:32,033 DEBUG awx.main.dispatch task 02e1d6ec-42a0-4059-9534-e776d4641927 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:14:32,037 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:14:32,100 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:14:32,267 DEBUG awx.main.dispatch task 02e1d6ec-42a0-4059-9534-e776d4641927 is finished
2023-02-18 03:14:51,472 DEBUG awx.main.dispatch publish awx.main.tasks.awx_isolated_heartbeat(a7bf7f0e-0adf-409d-aae5-3ed06254afd4, queue=onap-awx-0)
[2023-02-18 03:14:51,472: DEBUG/Process-1] publish awx.main.tasks.awx_isolated_heartbeat(a7bf7f0e-0adf-409d-aae5-3ed06254afd4, queue=onap-awx-0)
2023-02-18 03:14:51,489 DEBUG awx.main.dispatch delivered a7bf7f0e-0adf-409d-aae5-3ed06254afd4 to worker[180] qsize 0
2023-02-18 03:14:51,491 DEBUG awx.main.dispatch task a7bf7f0e-0adf-409d-aae5-3ed06254afd4 starting awx.main.tasks.awx_isolated_heartbeat(*[])
2023-02-18 03:14:51,492 DEBUG awx.main.tasks Controlling node checking for any isolated management tasks.
2023-02-18 03:14:51,574 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(d271a324-605c-41f2-99ab-d47568337764, queue=onap-awx-0)
[2023-02-18 03:14:51,574: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(d271a324-605c-41f2-99ab-d47568337764, queue=onap-awx-0)
2023-02-18 03:14:51,656 DEBUG awx.main.dispatch delivered d271a324-605c-41f2-99ab-d47568337764 to worker[183] qsize 0
2023-02-18 03:14:51,658 DEBUG awx.main.dispatch task d271a324-605c-41f2-99ab-d47568337764 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:14:51,659 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:14:51,708 DEBUG awx.main.dispatch task a7bf7f0e-0adf-409d-aae5-3ed06254afd4 is finished
2023-02-18 03:14:51,751 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(fdc05be0-e833-4073-985d-07be58d1fda9, queue=onap-awx-0)
[2023-02-18 03:14:51,751: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(fdc05be0-e833-4073-985d-07be58d1fda9, queue=onap-awx-0)
2023-02-18 03:14:51,766 DEBUG awx.main.dispatch delivered fdc05be0-e833-4073-985d-07be58d1fda9 to worker[181] qsize 0
2023-02-18 03:14:51,768 DEBUG awx.main.dispatch task fdc05be0-e833-4073-985d-07be58d1fda9 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:14:51,906 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(01fa02dc-29c7-42cb-b7a0-5cd2a2c604bf, queue=awx_private_queue)
[2023-02-18 03:14:51,906: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(01fa02dc-29c7-42cb-b7a0-5cd2a2c604bf, queue=awx_private_queue)
2023-02-18 03:14:51,921 DEBUG awx.main.dispatch delivered 01fa02dc-29c7-42cb-b7a0-5cd2a2c604bf to worker[180] qsize 0
2023-02-18 03:14:51,923 DEBUG awx.main.dispatch task 01fa02dc-29c7-42cb-b7a0-5cd2a2c604bf starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:14:52,000 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:14:51,999 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d5d9495d-9be7-4958-b85b-d21e8c568f59, queue=awx_private_queue)
[2023-02-18 03:14:51,999: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d5d9495d-9be7-4958-b85b-d21e8c568f59, queue=awx_private_queue)
2023-02-18 03:14:52,016 DEBUG awx.main.dispatch delivered d5d9495d-9be7-4958-b85b-d21e8c568f59 to worker[182] qsize 0
2023-02-18 03:14:52,019 DEBUG awx.main.dispatch task d5d9495d-9be7-4958-b85b-d21e8c568f59 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:14:52,021 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:14:52,029 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:14:22.045544+00:00
2023-02-18 03:14:52,052 DEBUG awx.main.dispatch task d271a324-605c-41f2-99ab-d47568337764 is finished
2023-02-18 03:14:52,052 DEBUG awx.main.dispatch task fdc05be0-e833-4073-985d-07be58d1fda9 is finished
2023-02-18 03:14:52,113 DEBUG awx.main.dispatch task 01fa02dc-29c7-42cb-b7a0-5cd2a2c604bf is finished
2023-02-18 03:14:52,129 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:14:52,296 DEBUG awx.main.dispatch task d5d9495d-9be7-4958-b85b-d21e8c568f59 is finished
RESULT 2
OKREADY
2023-02-18 03:15:12,008 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b96b9572-2dd7-4eb3-90a3-1cd4d25b3d9b, queue=awx_private_queue)
[2023-02-18 03:15:12,008: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b96b9572-2dd7-4eb3-90a3-1cd4d25b3d9b, queue=awx_private_queue)
2023-02-18 03:15:12,025 DEBUG awx.main.dispatch delivered b96b9572-2dd7-4eb3-90a3-1cd4d25b3d9b to worker[182] qsize 0
2023-02-18 03:15:12,027 DEBUG awx.main.dispatch task b96b9572-2dd7-4eb3-90a3-1cd4d25b3d9b starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:15:12,028 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:15:12,200 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:15:12,484 DEBUG awx.main.dispatch task b96b9572-2dd7-4eb3-90a3-1cd4d25b3d9b is finished
2023-02-18 03:15:21,906 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(22a53992-8f7d-4753-ba5c-0b55e1ce089b, queue=awx_private_queue)
[2023-02-18 03:15:21,906: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(22a53992-8f7d-4753-ba5c-0b55e1ce089b, queue=awx_private_queue)
2023-02-18 03:15:21,924 DEBUG awx.main.dispatch delivered 22a53992-8f7d-4753-ba5c-0b55e1ce089b to worker[181] qsize 0
2023-02-18 03:15:21,926 DEBUG awx.main.dispatch task 22a53992-8f7d-4753-ba5c-0b55e1ce089b starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:15:22,035 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:15:22,067 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:14:52.000807+00:00
2023-02-18 03:15:22,144 DEBUG awx.main.dispatch task 22a53992-8f7d-4753-ba5c-0b55e1ce089b is finished
2023-02-18 03:15:32,009 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7adc4810-4496-4d96-80d0-b18a84369ee7, queue=awx_private_queue)
[2023-02-18 03:15:32,009: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7adc4810-4496-4d96-80d0-b18a84369ee7, queue=awx_private_queue)
2023-02-18 03:15:32,035 DEBUG awx.main.dispatch delivered 7adc4810-4496-4d96-80d0-b18a84369ee7 to worker[182] qsize 0
2023-02-18 03:15:32,037 DEBUG awx.main.dispatch task 7adc4810-4496-4d96-80d0-b18a84369ee7 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:15:32,039 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:15:32,126 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:15:32,198 DEBUG awx.main.dispatch task 7adc4810-4496-4d96-80d0-b18a84369ee7 is finished
2023-02-18 03:15:51,582 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(5fcc9f4a-9c36-4d73-9942-11fb1df64e5f, queue=onap-awx-0)
[2023-02-18 03:15:51,582: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(5fcc9f4a-9c36-4d73-9942-11fb1df64e5f, queue=onap-awx-0)
2023-02-18 03:15:51,639 DEBUG awx.main.dispatch delivered 5fcc9f4a-9c36-4d73-9942-11fb1df64e5f to worker[180] qsize 0
2023-02-18 03:15:51,751 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(b6c8b663-e175-438d-9779-c151359b46da, queue=onap-awx-0)
[2023-02-18 03:15:51,751: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(b6c8b663-e175-438d-9779-c151359b46da, queue=onap-awx-0)
2023-02-18 03:15:51,785 DEBUG awx.main.dispatch delivered b6c8b663-e175-438d-9779-c151359b46da to worker[183] qsize 0
2023-02-18 03:15:51,641 DEBUG awx.main.dispatch task 5fcc9f4a-9c36-4d73-9942-11fb1df64e5f starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:15:51,881 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:15:51,907 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(da33bea7-7cee-4d72-975f-df77a4410fb8, queue=awx_private_queue)
[2023-02-18 03:15:51,907: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(da33bea7-7cee-4d72-975f-df77a4410fb8, queue=awx_private_queue)
2023-02-18 03:15:51,925 DEBUG awx.main.dispatch delivered da33bea7-7cee-4d72-975f-df77a4410fb8 to worker[181] qsize 0
2023-02-18 03:15:51,927 DEBUG awx.main.dispatch task da33bea7-7cee-4d72-975f-df77a4410fb8 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:15:51,930 DEBUG awx.main.dispatch task 5fcc9f4a-9c36-4d73-9942-11fb1df64e5f is finished
2023-02-18 03:15:51,947 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:15:51,954 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:15:22.036063+00:00
2023-02-18 03:15:52,000 DEBUG awx.main.dispatch task da33bea7-7cee-4d72-975f-df77a4410fb8 is finished
2023-02-18 03:15:51,787 DEBUG awx.main.dispatch task b6c8b663-e175-438d-9779-c151359b46da starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:15:52,009 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7a741105-510e-43ee-9061-3670fe4d9b2f, queue=awx_private_queue)
[2023-02-18 03:15:52,009: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7a741105-510e-43ee-9061-3670fe4d9b2f, queue=awx_private_queue)
2023-02-18 03:15:52,024 DEBUG awx.main.dispatch delivered 7a741105-510e-43ee-9061-3670fe4d9b2f to worker[182] qsize 0
2023-02-18 03:15:52,027 DEBUG awx.main.dispatch task 7a741105-510e-43ee-9061-3670fe4d9b2f starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:15:52,030 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:15:52,031 DEBUG awx.main.dispatch task b6c8b663-e175-438d-9779-c151359b46da is finished
2023-02-18 03:15:52,081 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:15:52,171 DEBUG awx.main.dispatch task 7a741105-510e-43ee-9061-3670fe4d9b2f is finished
RESULT 2
OKREADY
2023-02-18 03:16:12,018 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3e28623f-80c7-4e04-b469-bc9c5f67b5b1, queue=awx_private_queue)
[2023-02-18 03:16:12,018: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3e28623f-80c7-4e04-b469-bc9c5f67b5b1, queue=awx_private_queue)
2023-02-18 03:16:12,036 DEBUG awx.main.dispatch delivered 3e28623f-80c7-4e04-b469-bc9c5f67b5b1 to worker[182] qsize 0
2023-02-18 03:16:12,038 DEBUG awx.main.dispatch task 3e28623f-80c7-4e04-b469-bc9c5f67b5b1 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:16:12,040 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:16:12,128 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:16:12,252 DEBUG awx.main.dispatch task 3e28623f-80c7-4e04-b469-bc9c5f67b5b1 is finished
2023-02-18 03:16:21,907 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(f04531b1-b182-4788-994e-b3f3e57c495a, queue=awx_private_queue)
[2023-02-18 03:16:21,907: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(f04531b1-b182-4788-994e-b3f3e57c495a, queue=awx_private_queue)
2023-02-18 03:16:21,943 DEBUG awx.main.dispatch delivered f04531b1-b182-4788-994e-b3f3e57c495a to worker[181] qsize 0
2023-02-18 03:16:21,946 DEBUG awx.main.dispatch task f04531b1-b182-4788-994e-b3f3e57c495a starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:16:22,039 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:16:22,045 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:15:51.947601+00:00
2023-02-18 03:16:22,143 DEBUG awx.main.dispatch task f04531b1-b182-4788-994e-b3f3e57c495a is finished
2023-02-18 03:16:32,018 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6410180b-ca51-4bde-a981-9709a8f3d5cb, queue=awx_private_queue)
[2023-02-18 03:16:32,018: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6410180b-ca51-4bde-a981-9709a8f3d5cb, queue=awx_private_queue)
2023-02-18 03:16:32,035 DEBUG awx.main.dispatch delivered 6410180b-ca51-4bde-a981-9709a8f3d5cb to worker[181] qsize 0
2023-02-18 03:16:32,037 DEBUG awx.main.dispatch task 6410180b-ca51-4bde-a981-9709a8f3d5cb starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:16:32,038 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:16:32,079 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:16:32,164 DEBUG awx.main.dispatch task 6410180b-ca51-4bde-a981-9709a8f3d5cb is finished
2023-02-18 03:16:51,582 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(5520598e-d99e-4d9c-bc5d-8207f6067a60, queue=onap-awx-0)
[2023-02-18 03:16:51,582: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(5520598e-d99e-4d9c-bc5d-8207f6067a60, queue=onap-awx-0)
2023-02-18 03:16:51,751 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(9fedd40c-a83d-4c5d-85ba-099ce1056497, queue=onap-awx-0)
[2023-02-18 03:16:51,751: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(9fedd40c-a83d-4c5d-85ba-099ce1056497, queue=onap-awx-0)
2023-02-18 03:16:51,844 DEBUG awx.main.dispatch delivered 5520598e-d99e-4d9c-bc5d-8207f6067a60 to worker[180] qsize 0
2023-02-18 03:16:51,847 DEBUG awx.main.dispatch delivered 9fedd40c-a83d-4c5d-85ba-099ce1056497 to worker[183] qsize 0
2023-02-18 03:16:51,907 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d481235d-67ed-4894-8814-b21dc85c5387, queue=awx_private_queue)
[2023-02-18 03:16:51,907: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d481235d-67ed-4894-8814-b21dc85c5387, queue=awx_private_queue)
2023-02-18 03:16:51,923 DEBUG awx.main.dispatch delivered d481235d-67ed-4894-8814-b21dc85c5387 to worker[182] qsize 0
2023-02-18 03:16:51,925 DEBUG awx.main.dispatch task d481235d-67ed-4894-8814-b21dc85c5387 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:16:52,018 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(472a58e7-0634-4689-a84a-43a8cabfff6e, queue=awx_private_queue)
[2023-02-18 03:16:52,018: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(472a58e7-0634-4689-a84a-43a8cabfff6e, queue=awx_private_queue)
2023-02-18 03:16:52,036 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:16:52,054 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:16:22.039913+00:00
2023-02-18 03:16:51,847 DEBUG awx.main.dispatch task 5520598e-d99e-4d9c-bc5d-8207f6067a60 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:16:52,088 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:16:51,849 DEBUG awx.main.dispatch task 9fedd40c-a83d-4c5d-85ba-099ce1056497 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:16:52,127 DEBUG awx.main.dispatch task 9fedd40c-a83d-4c5d-85ba-099ce1056497 is finished
2023-02-18 03:16:52,128 DEBUG awx.main.dispatch task d481235d-67ed-4894-8814-b21dc85c5387 is finished
2023-02-18 03:16:52,191 DEBUG awx.main.dispatch task 5520598e-d99e-4d9c-bc5d-8207f6067a60 is finished
2023-02-18 03:16:52,034 DEBUG awx.main.dispatch delivered 472a58e7-0634-4689-a84a-43a8cabfff6e to worker[181] qsize 0
2023-02-18 03:16:52,235 DEBUG awx.main.dispatch task 472a58e7-0634-4689-a84a-43a8cabfff6e starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:16:52,237 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:16:52,316 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:16:52,437 DEBUG awx.main.dispatch task 472a58e7-0634-4689-a84a-43a8cabfff6e is finished
RESULT 2
OKREADY
2023-02-18 03:17:12,029 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(8cc5a2f8-5fc3-4a7c-a8b3-cf015893cbbb, queue=awx_private_queue)
[2023-02-18 03:17:12,029: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(8cc5a2f8-5fc3-4a7c-a8b3-cf015893cbbb, queue=awx_private_queue)
2023-02-18 03:17:12,048 DEBUG awx.main.dispatch delivered 8cc5a2f8-5fc3-4a7c-a8b3-cf015893cbbb to worker[180] qsize 0
2023-02-18 03:17:12,051 DEBUG awx.main.dispatch task 8cc5a2f8-5fc3-4a7c-a8b3-cf015893cbbb starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:17:12,052 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:17:12,176 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:17:12,345 DEBUG awx.main.dispatch task 8cc5a2f8-5fc3-4a7c-a8b3-cf015893cbbb is finished
2023-02-18 03:17:21,910 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(3e4c60d2-eed4-423a-8c80-9ba7c6fe20c7, queue=awx_private_queue)
[2023-02-18 03:17:21,910: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(3e4c60d2-eed4-423a-8c80-9ba7c6fe20c7, queue=awx_private_queue)
2023-02-18 03:17:21,932 DEBUG awx.main.dispatch delivered 3e4c60d2-eed4-423a-8c80-9ba7c6fe20c7 to worker[182] qsize 0
2023-02-18 03:17:21,937 DEBUG awx.main.dispatch task 3e4c60d2-eed4-423a-8c80-9ba7c6fe20c7 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:17:22,019 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:17:22,038 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:16:52.036360+00:00
2023-02-18 03:17:22,171 DEBUG awx.main.dispatch task 3e4c60d2-eed4-423a-8c80-9ba7c6fe20c7 is finished
2023-02-18 03:17:32,029 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e01ab6e1-7449-4b57-8915-dd3d1d26d0c1, queue=awx_private_queue)
[2023-02-18 03:17:32,029: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e01ab6e1-7449-4b57-8915-dd3d1d26d0c1, queue=awx_private_queue)
2023-02-18 03:17:32,046 DEBUG awx.main.dispatch delivered e01ab6e1-7449-4b57-8915-dd3d1d26d0c1 to worker[182] qsize 0
2023-02-18 03:17:32,048 DEBUG awx.main.dispatch task e01ab6e1-7449-4b57-8915-dd3d1d26d0c1 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:17:32,050 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:17:32,128 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:17:32,228 DEBUG awx.main.dispatch task e01ab6e1-7449-4b57-8915-dd3d1d26d0c1 is finished
2023-02-18 03:17:51,583 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(863355c0-9cd0-4a29-8c50-2fd4ac9ae3c1, queue=onap-awx-0)
[2023-02-18 03:17:51,583: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(863355c0-9cd0-4a29-8c50-2fd4ac9ae3c1, queue=onap-awx-0)
2023-02-18 03:17:51,659 DEBUG awx.main.dispatch delivered 863355c0-9cd0-4a29-8c50-2fd4ac9ae3c1 to worker[183] qsize 0
2023-02-18 03:17:51,663 DEBUG awx.main.dispatch task 863355c0-9cd0-4a29-8c50-2fd4ac9ae3c1 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:17:51,666 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:17:51,718 DEBUG awx.main.dispatch task 863355c0-9cd0-4a29-8c50-2fd4ac9ae3c1 is finished
2023-02-18 03:17:51,751 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(454cad67-5c8c-40cc-8d03-0b66ea092c8a, queue=onap-awx-0)
[2023-02-18 03:17:51,751: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(454cad67-5c8c-40cc-8d03-0b66ea092c8a, queue=onap-awx-0)
2023-02-18 03:17:51,769 DEBUG awx.main.dispatch delivered 454cad67-5c8c-40cc-8d03-0b66ea092c8a to worker[183] qsize 0
2023-02-18 03:17:51,772 DEBUG awx.main.dispatch task 454cad67-5c8c-40cc-8d03-0b66ea092c8a starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:17:51,792 DEBUG awx.main.dispatch task 454cad67-5c8c-40cc-8d03-0b66ea092c8a is finished
2023-02-18 03:17:51,907 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(85077785-9d52-44b1-9c20-1de9582a1d0c, queue=awx_private_queue)
[2023-02-18 03:17:51,907: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(85077785-9d52-44b1-9c20-1de9582a1d0c, queue=awx_private_queue)
2023-02-18 03:17:51,923 DEBUG awx.main.dispatch delivered 85077785-9d52-44b1-9c20-1de9582a1d0c to worker[180] qsize 0
2023-02-18 03:17:51,927 DEBUG awx.main.dispatch task 85077785-9d52-44b1-9c20-1de9582a1d0c starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:17:51,980 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:17:51,990 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:17:22.019949+00:00
2023-02-18 03:17:52,027 DEBUG awx.main.dispatch task 85077785-9d52-44b1-9c20-1de9582a1d0c is finished
2023-02-18 03:17:52,028 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(701c258f-7c56-45b5-9d44-f7e10231e9a3, queue=awx_private_queue)
[2023-02-18 03:17:52,028: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(701c258f-7c56-45b5-9d44-f7e10231e9a3, queue=awx_private_queue)
2023-02-18 03:17:52,044 DEBUG awx.main.dispatch delivered 701c258f-7c56-45b5-9d44-f7e10231e9a3 to worker[180] qsize 0
2023-02-18 03:17:52,048 DEBUG awx.main.dispatch task 701c258f-7c56-45b5-9d44-f7e10231e9a3 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:17:52,049 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:17:52,099 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:17:52,154 DEBUG awx.main.dispatch task 701c258f-7c56-45b5-9d44-f7e10231e9a3 is finished
RESULT 2
OKREADY
2023-02-18 03:18:12,039 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(eb386466-1abc-4011-8cf9-580a221b660f, queue=awx_private_queue)
[2023-02-18 03:18:12,039: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(eb386466-1abc-4011-8cf9-580a221b660f, queue=awx_private_queue)
2023-02-18 03:18:12,321 DEBUG awx.main.dispatch delivered eb386466-1abc-4011-8cf9-580a221b660f to worker[182] qsize 0
2023-02-18 03:18:12,324 DEBUG awx.main.dispatch task eb386466-1abc-4011-8cf9-580a221b660f starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:18:12,327 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:18:12,404 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:18:12,554 DEBUG awx.main.dispatch task eb386466-1abc-4011-8cf9-580a221b660f is finished
2023-02-18 03:18:21,908 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(41593bf1-0c6b-4997-bb84-d661fd54f6bc, queue=awx_private_queue)
[2023-02-18 03:18:21,908: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(41593bf1-0c6b-4997-bb84-d661fd54f6bc, queue=awx_private_queue)
2023-02-18 03:18:21,924 DEBUG awx.main.dispatch delivered 41593bf1-0c6b-4997-bb84-d661fd54f6bc to worker[183] qsize 0
2023-02-18 03:18:21,927 DEBUG awx.main.dispatch task 41593bf1-0c6b-4997-bb84-d661fd54f6bc starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:18:21,955 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:18:21,958 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:17:51.980526+00:00
2023-02-18 03:18:21,997 DEBUG awx.main.dispatch task 41593bf1-0c6b-4997-bb84-d661fd54f6bc is finished
2023-02-18 03:18:32,040 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(fbf93768-0858-4f0d-948c-f45ac504ad73, queue=awx_private_queue)
[2023-02-18 03:18:32,040: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(fbf93768-0858-4f0d-948c-f45ac504ad73, queue=awx_private_queue)
2023-02-18 03:18:32,057 DEBUG awx.main.dispatch delivered fbf93768-0858-4f0d-948c-f45ac504ad73 to worker[180] qsize 0
2023-02-18 03:18:32,060 DEBUG awx.main.dispatch task fbf93768-0858-4f0d-948c-f45ac504ad73 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:18:32,061 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:18:32,138 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:18:32,241 DEBUG awx.main.dispatch task fbf93768-0858-4f0d-948c-f45ac504ad73 is finished
2023-02-18 03:18:51,592 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(1b59ed60-f076-4090-a65c-69d1e23d14fb, queue=onap-awx-0)
[2023-02-18 03:18:51,592: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(1b59ed60-f076-4090-a65c-69d1e23d14fb, queue=onap-awx-0)
2023-02-18 03:18:51,633 DEBUG awx.main.dispatch delivered 1b59ed60-f076-4090-a65c-69d1e23d14fb to worker[182] qsize 0
2023-02-18 03:18:51,636 DEBUG awx.main.dispatch task 1b59ed60-f076-4090-a65c-69d1e23d14fb starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:18:51,637 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:18:51,746 DEBUG awx.main.dispatch task 1b59ed60-f076-4090-a65c-69d1e23d14fb is finished
2023-02-18 03:18:51,751 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(b71fd541-3487-4d1a-be5a-1956be67f024, queue=onap-awx-0)
[2023-02-18 03:18:51,751: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(b71fd541-3487-4d1a-be5a-1956be67f024, queue=onap-awx-0)
2023-02-18 03:18:51,767 DEBUG awx.main.dispatch delivered b71fd541-3487-4d1a-be5a-1956be67f024 to worker[180] qsize 0
2023-02-18 03:18:51,769 DEBUG awx.main.dispatch task b71fd541-3487-4d1a-be5a-1956be67f024 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:18:51,853 DEBUG awx.main.dispatch task b71fd541-3487-4d1a-be5a-1956be67f024 is finished
2023-02-18 03:18:51,907 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(66dd5210-0f0f-44c6-a2f3-5f3319eb7a77, queue=awx_private_queue)
[2023-02-18 03:18:51,907: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(66dd5210-0f0f-44c6-a2f3-5f3319eb7a77, queue=awx_private_queue)
2023-02-18 03:18:51,925 DEBUG awx.main.dispatch delivered 66dd5210-0f0f-44c6-a2f3-5f3319eb7a77 to worker[183] qsize 0
2023-02-18 03:18:51,928 DEBUG awx.main.dispatch task 66dd5210-0f0f-44c6-a2f3-5f3319eb7a77 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:18:51,983 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:18:51,997 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:18:21.955459+00:00
2023-02-18 03:18:52,040 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e22d9c04-32be-4e17-9ba2-017b89d463a5, queue=awx_private_queue)
[2023-02-18 03:18:52,040: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e22d9c04-32be-4e17-9ba2-017b89d463a5, queue=awx_private_queue)
2023-02-18 03:18:52,055 DEBUG awx.main.dispatch delivered e22d9c04-32be-4e17-9ba2-017b89d463a5 to worker[180] qsize 0
2023-02-18 03:18:52,058 DEBUG awx.main.dispatch task e22d9c04-32be-4e17-9ba2-017b89d463a5 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:18:52,060 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:18:52,077 DEBUG awx.main.dispatch task 66dd5210-0f0f-44c6-a2f3-5f3319eb7a77 is finished
2023-02-18 03:18:52,131 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:18:52,250 DEBUG awx.main.dispatch task e22d9c04-32be-4e17-9ba2-017b89d463a5 is finished
RESULT 2
OKREADY
2023-02-18 03:19:12,053 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0d47ed05-fcd0-428f-918d-00fcbfa66d9c, queue=awx_private_queue)
[2023-02-18 03:19:12,053: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0d47ed05-fcd0-428f-918d-00fcbfa66d9c, queue=awx_private_queue)
2023-02-18 03:19:12,158 DEBUG awx.main.dispatch delivered 0d47ed05-fcd0-428f-918d-00fcbfa66d9c to worker[183] qsize 0
2023-02-18 03:19:12,161 DEBUG awx.main.dispatch task 0d47ed05-fcd0-428f-918d-00fcbfa66d9c starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:19:12,162 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:19:12,231 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:19:12,302 DEBUG awx.main.dispatch task 0d47ed05-fcd0-428f-918d-00fcbfa66d9c is finished
2023-02-18 03:19:21,908 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(7989e651-f9d8-4780-99dc-89b6345c94e7, queue=awx_private_queue)
[2023-02-18 03:19:21,908: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(7989e651-f9d8-4780-99dc-89b6345c94e7, queue=awx_private_queue)
2023-02-18 03:19:21,925 DEBUG awx.main.dispatch delivered 7989e651-f9d8-4780-99dc-89b6345c94e7 to worker[181] qsize 0
2023-02-18 03:19:21,928 DEBUG awx.main.dispatch task 7989e651-f9d8-4780-99dc-89b6345c94e7 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:19:22,484 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:19:22,500 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:18:51.983233+00:00
2023-02-18 03:19:22,673 DEBUG awx.main.dispatch task 7989e651-f9d8-4780-99dc-89b6345c94e7 is finished
2023-02-18 03:19:32,053 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e6cdcf12-7d8b-46f2-9b33-0fd3dd8257e1, queue=awx_private_queue)
[2023-02-18 03:19:32,053: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e6cdcf12-7d8b-46f2-9b33-0fd3dd8257e1, queue=awx_private_queue)
2023-02-18 03:19:32,069 DEBUG awx.main.dispatch delivered e6cdcf12-7d8b-46f2-9b33-0fd3dd8257e1 to worker[181] qsize 0
2023-02-18 03:19:32,072 DEBUG awx.main.dispatch task e6cdcf12-7d8b-46f2-9b33-0fd3dd8257e1 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:19:32,074 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:19:32,368 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:19:32,624 DEBUG awx.main.dispatch task e6cdcf12-7d8b-46f2-9b33-0fd3dd8257e1 is finished
2023-02-18 03:19:51,602 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(2ebb777d-edbf-4faa-ba73-0c45e4f144d2, queue=onap-awx-0)
[2023-02-18 03:19:51,602: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(2ebb777d-edbf-4faa-ba73-0c45e4f144d2, queue=onap-awx-0)
2023-02-18 03:19:51,725 DEBUG awx.main.dispatch delivered 2ebb777d-edbf-4faa-ba73-0c45e4f144d2 to worker[183] qsize 0
2023-02-18 03:19:51,728 DEBUG awx.main.dispatch task 2ebb777d-edbf-4faa-ba73-0c45e4f144d2 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:19:51,730 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:19:51,751 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(48f8aef1-e024-46f2-873e-3f314b20937a, queue=onap-awx-0)
[2023-02-18 03:19:51,751: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(48f8aef1-e024-46f2-873e-3f314b20937a, queue=onap-awx-0)
2023-02-18 03:19:51,768 DEBUG awx.main.dispatch delivered 48f8aef1-e024-46f2-873e-3f314b20937a to worker[181] qsize 0
2023-02-18 03:19:51,771 DEBUG awx.main.dispatch task 48f8aef1-e024-46f2-873e-3f314b20937a starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:19:51,908 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(e66a66a2-48c8-47d1-8595-24920c8f4213, queue=awx_private_queue)
[2023-02-18 03:19:51,908: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(e66a66a2-48c8-47d1-8595-24920c8f4213, queue=awx_private_queue)
2023-02-18 03:19:51,944 DEBUG awx.main.dispatch delivered e66a66a2-48c8-47d1-8595-24920c8f4213 to worker[180] qsize 0
2023-02-18 03:19:51,947 DEBUG awx.main.dispatch task e66a66a2-48c8-47d1-8595-24920c8f4213 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:19:52,053 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(050a9233-235e-4106-95bc-a45fce38208a, queue=awx_private_queue)
[2023-02-18 03:19:52,053: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(050a9233-235e-4106-95bc-a45fce38208a, queue=awx_private_queue)
2023-02-18 03:19:52,069 DEBUG awx.main.dispatch delivered 050a9233-235e-4106-95bc-a45fce38208a to worker[182] qsize 0
2023-02-18 03:19:52,073 DEBUG awx.main.dispatch task 050a9233-235e-4106-95bc-a45fce38208a starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:19:52,075 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:19:52,761 ERROR awx.main.dispatch Worker failed to run task awx.main.tasks.cluster_node_heartbeat(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/tasks.py", line 366, in cluster_node_heartbeat
instance_list = list(Instance.objects.all_non_isolated())
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 274, in __iter__
self._fetch_all()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 1242, in _fetch_all
self._result_cache = list(self._iterable_class(self))
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 55, in __iter__
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1098, in execute_sql
cursor = self.connection.cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor
return self._cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:19:52,769 DEBUG awx.main.dispatch task 2ebb777d-edbf-4faa-ba73-0c45e4f144d2 is finished
2023-02-18 03:19:52,793 ERROR awx.main.dispatch Worker failed to run task awx.main.tasks.awx_k8s_reaper(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/tasks.py", line 436, in awx_k8s_reaper
for group in InstanceGroup.objects.filter(credential__isnull=False).iterator():
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 341, in _iterator
yield from self._iterable_class(self, chunked_fetch=use_chunked_fetch, chunk_size=chunk_size)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 55, in __iter__
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1096, in execute_sql
cursor = self.connection.chunked_cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 233, in chunked_cursor
self._named_cursor_idx,
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:19:52,798 DEBUG awx.main.dispatch task 48f8aef1-e024-46f2-873e-3f314b20937a is finished
2023-02-18 03:19:52,985 ERROR awx.main.dispatch Worker failed to run task awx.main.tasks.awx_periodic_scheduler(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/tasks.py", line 482, in awx_periodic_scheduler
with advisory_lock('awx_periodic_scheduler_lock', wait=False) as acquired:
File "/usr/lib64/python3.6/contextlib.py", line 81, in __enter__
return next(self.gen)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/utils/pglock.py", line 13, in advisory_lock
with django_pglocks_advisory_lock(*args, **kwargs) as internal_lock:
File "/usr/lib64/python3.6/contextlib.py", line 81, in __enter__
return next(self.gen)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django_pglocks/__init__.py", line 64, in advisory_lock
cursor = connections[using].cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor
return self._cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:19:52,992 DEBUG awx.main.dispatch task e66a66a2-48c8-47d1-8595-24920c8f4213 is finished
RESULT 2
OKREADY
2023-02-18 03:20:12,061 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(af3de657-69fb-4b8b-a0bd-e73d89b1d755, queue=awx_private_queue)
[2023-02-18 03:20:12,061: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(af3de657-69fb-4b8b-a0bd-e73d89b1d755, queue=awx_private_queue)
2023-02-18 03:20:12,091 DEBUG awx.main.dispatch delivered af3de657-69fb-4b8b-a0bd-e73d89b1d755 to worker[183] qsize 0
2023-02-18 03:20:12,093 DEBUG awx.main.dispatch task af3de657-69fb-4b8b-a0bd-e73d89b1d755 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:20:12,095 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:20:12,170 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:20:12,267 DEBUG awx.main.dispatch task af3de657-69fb-4b8b-a0bd-e73d89b1d755 is finished
2023-02-18 03:20:21,908 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(3ec4e7cc-96b3-4e56-aec5-8506dcda815d, queue=awx_private_queue)
[2023-02-18 03:20:21,908: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(3ec4e7cc-96b3-4e56-aec5-8506dcda815d, queue=awx_private_queue)
2023-02-18 03:20:21,923 DEBUG awx.main.dispatch delivered 3ec4e7cc-96b3-4e56-aec5-8506dcda815d to worker[180] qsize 0
2023-02-18 03:20:21,925 DEBUG awx.main.dispatch task 3ec4e7cc-96b3-4e56-aec5-8506dcda815d starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:20:21,989 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:20:22,021 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:19:22.485041+00:00
2023-02-18 03:20:22,150 DEBUG awx.main.dispatch task 3ec4e7cc-96b3-4e56-aec5-8506dcda815d is finished
2023-02-18 03:20:32,061 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d6078794-eeb1-4c52-be86-172be1aab8f0, queue=awx_private_queue)
[2023-02-18 03:20:32,061: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d6078794-eeb1-4c52-be86-172be1aab8f0, queue=awx_private_queue)
2023-02-18 03:20:32,185 DEBUG awx.main.dispatch delivered d6078794-eeb1-4c52-be86-172be1aab8f0 to worker[181] qsize 0
2023-02-18 03:20:32,187 DEBUG awx.main.dispatch task d6078794-eeb1-4c52-be86-172be1aab8f0 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:20:32,463 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:20:32,578 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:20:32,813 DEBUG awx.main.dispatch task d6078794-eeb1-4c52-be86-172be1aab8f0 is finished
2023-02-18 03:20:51,609 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(ee1687c9-3aff-4fc6-8308-a9736d02cc6d, queue=onap-awx-0)
[2023-02-18 03:20:51,609: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(ee1687c9-3aff-4fc6-8308-a9736d02cc6d, queue=onap-awx-0)
2023-02-18 03:20:51,751 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(78f04261-8129-4175-951e-004900bc879e, queue=onap-awx-0)
[2023-02-18 03:20:51,751: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(78f04261-8129-4175-951e-004900bc879e, queue=onap-awx-0)
2023-02-18 03:20:51,779 DEBUG awx.main.dispatch delivered ee1687c9-3aff-4fc6-8308-a9736d02cc6d to worker[180] qsize 0
2023-02-18 03:20:51,781 DEBUG awx.main.dispatch delivered 78f04261-8129-4175-951e-004900bc879e to worker[181] qsize 0
2023-02-18 03:20:51,781 DEBUG awx.main.dispatch task ee1687c9-3aff-4fc6-8308-a9736d02cc6d starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:20:51,783 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:20:51,783 DEBUG awx.main.dispatch task 78f04261-8129-4175-951e-004900bc879e starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:20:51,908 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(e42b902f-fb08-4cc1-81c8-25eb473127e9, queue=awx_private_queue)
[2023-02-18 03:20:51,908: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(e42b902f-fb08-4cc1-81c8-25eb473127e9, queue=awx_private_queue)
2023-02-18 03:20:51,924 DEBUG awx.main.dispatch delivered e42b902f-fb08-4cc1-81c8-25eb473127e9 to worker[183] qsize 0
2023-02-18 03:20:51,927 DEBUG awx.main.dispatch task e42b902f-fb08-4cc1-81c8-25eb473127e9 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:20:52,061 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(bf67ef0e-17d6-436d-8686-d355441c8cf4, queue=awx_private_queue)
[2023-02-18 03:20:52,061: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(bf67ef0e-17d6-436d-8686-d355441c8cf4, queue=awx_private_queue)
2023-02-18 03:20:52,084 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:20:52,088 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:20:21.989477+00:00
2023-02-18 03:20:52,085 WARNING awx.main.dispatch scaling up worker pid:192
2023-02-18 03:20:52,093 DEBUG awx.main.dispatch delivered bf67ef0e-17d6-436d-8686-d355441c8cf4 to worker[192] qsize 0
2023-02-18 03:20:52,099 DEBUG awx.main.dispatch task bf67ef0e-17d6-436d-8686-d355441c8cf4 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:20:52,103 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:20:52,133 DEBUG awx.main.dispatch task 78f04261-8129-4175-951e-004900bc879e is finished
2023-02-18 03:20:52,333 DEBUG awx.main.dispatch task e42b902f-fb08-4cc1-81c8-25eb473127e9 is finished
2023-02-18 03:20:52,335 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:20:52,354 WARNING awx.main.tasks Rejoining the cluster as instance onap-awx-0.
2023-02-18 03:20:52,354 DEBUG awx.main.dispatch task ee1687c9-3aff-4fc6-8308-a9736d02cc6d is finished
2023-02-18 03:20:52,675 DEBUG awx.main.dispatch task bf67ef0e-17d6-436d-8686-d355441c8cf4 is finished
RESULT 2
OKREADY
2023-02-18 03:21:12,061 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(afa86ab5-119b-4bb7-8eb4-ff21cb37bc66, queue=awx_private_queue)
[2023-02-18 03:21:12,061: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(afa86ab5-119b-4bb7-8eb4-ff21cb37bc66, queue=awx_private_queue)
2023-02-18 03:21:12,081 DEBUG awx.main.dispatch delivered afa86ab5-119b-4bb7-8eb4-ff21cb37bc66 to worker[192] qsize 0
2023-02-18 03:21:12,084 DEBUG awx.main.dispatch task afa86ab5-119b-4bb7-8eb4-ff21cb37bc66 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:21:12,086 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:21:12,331 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:21:12,430 DEBUG awx.main.dispatch task afa86ab5-119b-4bb7-8eb4-ff21cb37bc66 is finished
2023-02-18 03:21:21,908 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(1a305e93-bc09-40ee-b998-40aae9954215, queue=awx_private_queue)
[2023-02-18 03:21:21,908: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(1a305e93-bc09-40ee-b998-40aae9954215, queue=awx_private_queue)
2023-02-18 03:21:21,926 DEBUG awx.main.dispatch delivered 1a305e93-bc09-40ee-b998-40aae9954215 to worker[180] qsize 0
2023-02-18 03:21:21,928 DEBUG awx.main.dispatch task 1a305e93-bc09-40ee-b998-40aae9954215 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:21:22,116 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:21:22,145 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:20:52.085000+00:00
2023-02-18 03:21:22,439 DEBUG awx.main.dispatch task 1a305e93-bc09-40ee-b998-40aae9954215 is finished
2023-02-18 03:21:32,062 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e08fb38e-6a2c-4dcb-a672-ca08c1fd6804, queue=awx_private_queue)
[2023-02-18 03:21:32,062: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e08fb38e-6a2c-4dcb-a672-ca08c1fd6804, queue=awx_private_queue)
2023-02-18 03:21:33,117 DEBUG awx.main.dispatch delivered e08fb38e-6a2c-4dcb-a672-ca08c1fd6804 to worker[192] qsize 0
2023-02-18 03:21:51,620 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(134e6e8e-1fe5-4178-9d93-fcfba9d93683, queue=onap-awx-0)
[2023-02-18 03:21:51,620: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(134e6e8e-1fe5-4178-9d93-fcfba9d93683, queue=onap-awx-0)
2023-02-18 03:21:51,728 WARNING awx.main.dispatch scaling down worker pid:180
2023-02-18 03:21:51,732 WARNING awx.main.dispatch worker exiting gracefully pid:180
2023-02-18 03:21:51,752 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(ec2f4a2e-895a-4566-9a19-16a1fda50524, queue=onap-awx-0)
[2023-02-18 03:21:51,752: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(ec2f4a2e-895a-4566-9a19-16a1fda50524, queue=onap-awx-0)
2023-02-18 03:21:51,883 DEBUG awx.main.dispatch delivered 134e6e8e-1fe5-4178-9d93-fcfba9d93683 to worker[183] qsize 0
2023-02-18 03:21:51,886 DEBUG awx.main.dispatch delivered ec2f4a2e-895a-4566-9a19-16a1fda50524 to worker[181] qsize 0
2023-02-18 03:21:51,887 DEBUG awx.main.dispatch task 134e6e8e-1fe5-4178-9d93-fcfba9d93683 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:21:51,890 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:21:51,908 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(616407a4-fe83-4824-ae5d-297ad414629a, queue=awx_private_queue)
[2023-02-18 03:21:51,908: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(616407a4-fe83-4824-ae5d-297ad414629a, queue=awx_private_queue)
2023-02-18 03:21:51,930 WARNING awx.main.dispatch scaling up worker pid:195
2023-02-18 03:21:51,939 DEBUG awx.main.dispatch delivered 616407a4-fe83-4824-ae5d-297ad414629a to worker[195] qsize 0
2023-02-18 03:21:51,946 DEBUG awx.main.dispatch task 616407a4-fe83-4824-ae5d-297ad414629a starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:21:51,980 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:21:51,994 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:21:22.117176+00:00
2023-02-18 03:21:52,063 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3ff4ba3e-dec8-4878-ae27-76b9c643ecf8, queue=awx_private_queue)
[2023-02-18 03:21:52,063: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3ff4ba3e-dec8-4878-ae27-76b9c643ecf8, queue=awx_private_queue)
2023-02-18 03:21:51,889 DEBUG awx.main.dispatch task ec2f4a2e-895a-4566-9a19-16a1fda50524 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:21:52,200 DEBUG awx.main.dispatch task ec2f4a2e-895a-4566-9a19-16a1fda50524 is finished
2023-02-18 03:21:51,986 DEBUG awx.main.dispatch task 134e6e8e-1fe5-4178-9d93-fcfba9d93683 is finished
2023-02-18 03:21:52,087 DEBUG awx.main.dispatch task 616407a4-fe83-4824-ae5d-297ad414629a is finished
2023-02-18 03:21:52,090 WARNING awx.main.dispatch scaling up worker pid:197
2023-02-18 03:21:52,439 DEBUG awx.main.dispatch delivered 3ff4ba3e-dec8-4878-ae27-76b9c643ecf8 to worker[197] qsize 0
2023-02-18 03:21:52,444 DEBUG awx.main.dispatch task 3ff4ba3e-dec8-4878-ae27-76b9c643ecf8 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:21:52,448 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:21:52,508 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:21:52,661 DEBUG awx.main.dispatch task 3ff4ba3e-dec8-4878-ae27-76b9c643ecf8 is finished
RESULT 2
OKREADY
2023-02-18 03:22:02,521 ERROR awx.main.dispatch Worker failed to run task awx.main.scheduler.tasks.run_task_manager(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/tasks.py", line 15, in run_task_manager
TaskManager().schedule()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/task_manager.py", line 45, in __init__
for rampart_group in InstanceGroup.objects.prefetch_related('instances'):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 274, in __iter__
self._fetch_all()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 1242, in _fetch_all
self._result_cache = list(self._iterable_class(self))
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 55, in __iter__
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1098, in execute_sql
cursor = self.connection.cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor
return self._cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:22:02,532 DEBUG awx.main.dispatch task 050a9233-235e-4106-95bc-a45fce38208a is finished
2023-02-18 03:22:12,077 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(171b4fbb-c6d7-429a-a70e-feb1e720aec9, queue=awx_private_queue)
[2023-02-18 03:22:12,077: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(171b4fbb-c6d7-429a-a70e-feb1e720aec9, queue=awx_private_queue)
2023-02-18 03:22:12,095 DEBUG awx.main.dispatch delivered 171b4fbb-c6d7-429a-a70e-feb1e720aec9 to worker[197] qsize 0
2023-02-18 03:22:12,098 DEBUG awx.main.dispatch task 171b4fbb-c6d7-429a-a70e-feb1e720aec9 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:22:12,099 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:22:12,166 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:22:12,261 DEBUG awx.main.dispatch task 171b4fbb-c6d7-429a-a70e-feb1e720aec9 is finished
2023-02-18 03:22:21,908 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(7a5d59e8-2c68-4e51-a42f-0f4e1b2e4800, queue=awx_private_queue)
[2023-02-18 03:22:21,908: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(7a5d59e8-2c68-4e51-a42f-0f4e1b2e4800, queue=awx_private_queue)
2023-02-18 03:22:21,924 DEBUG awx.main.dispatch delivered 7a5d59e8-2c68-4e51-a42f-0f4e1b2e4800 to worker[181] qsize 0
2023-02-18 03:22:21,927 DEBUG awx.main.dispatch task 7a5d59e8-2c68-4e51-a42f-0f4e1b2e4800 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:22:21,945 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:22:21,949 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:21:51.980471+00:00
2023-02-18 03:22:21,980 DEBUG awx.main.dispatch task 7a5d59e8-2c68-4e51-a42f-0f4e1b2e4800 is finished
2023-02-18 03:22:32,077 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ea7b9a44-ad87-497b-bc1e-bc5f699deb55, queue=awx_private_queue)
[2023-02-18 03:22:32,077: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ea7b9a44-ad87-497b-bc1e-bc5f699deb55, queue=awx_private_queue)
2023-02-18 03:22:32,093 DEBUG awx.main.dispatch delivered ea7b9a44-ad87-497b-bc1e-bc5f699deb55 to worker[197] qsize 0
2023-02-18 03:22:32,096 DEBUG awx.main.dispatch task ea7b9a44-ad87-497b-bc1e-bc5f699deb55 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:22:32,098 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:22:32,125 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:22:32,201 DEBUG awx.main.dispatch task ea7b9a44-ad87-497b-bc1e-bc5f699deb55 is finished
2023-02-18 03:22:51,619 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(d0bdbfe7-ac83-4bf9-9801-43b4941f765b, queue=onap-awx-0)
[2023-02-18 03:22:51,619: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(d0bdbfe7-ac83-4bf9-9801-43b4941f765b, queue=onap-awx-0)
2023-02-18 03:22:51,695 WARNING awx.main.dispatch scaling down worker pid:181
2023-02-18 03:22:51,697 WARNING awx.main.dispatch scaling down worker pid:182
2023-02-18 03:22:51,697 WARNING awx.main.dispatch worker exiting gracefully pid:181
2023-02-18 03:22:51,699 WARNING awx.main.dispatch worker exiting gracefully pid:182
2023-02-18 03:22:51,752 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(5ad82057-659b-4828-b75c-ce2c9bdd04b2, queue=onap-awx-0)
[2023-02-18 03:22:51,752: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(5ad82057-659b-4828-b75c-ce2c9bdd04b2, queue=onap-awx-0)
2023-02-18 03:22:51,756 DEBUG awx.main.dispatch delivered d0bdbfe7-ac83-4bf9-9801-43b4941f765b to worker[195] qsize 0
2023-02-18 03:22:51,759 DEBUG awx.main.dispatch task d0bdbfe7-ac83-4bf9-9801-43b4941f765b starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:22:51,764 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:22:51,770 DEBUG awx.main.dispatch delivered 5ad82057-659b-4828-b75c-ce2c9bdd04b2 to worker[183] qsize 0
2023-02-18 03:22:51,772 DEBUG awx.main.dispatch task 5ad82057-659b-4828-b75c-ce2c9bdd04b2 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:22:51,831 DEBUG awx.main.dispatch task 5ad82057-659b-4828-b75c-ce2c9bdd04b2 is finished
2023-02-18 03:22:51,909 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(714deb9e-08c9-4271-a8d5-51af9cacf248, queue=awx_private_queue)
[2023-02-18 03:22:51,909: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(714deb9e-08c9-4271-a8d5-51af9cacf248, queue=awx_private_queue)
2023-02-18 03:22:51,916 DEBUG awx.main.dispatch task d0bdbfe7-ac83-4bf9-9801-43b4941f765b is finished
2023-02-18 03:22:51,925 DEBUG awx.main.dispatch delivered 714deb9e-08c9-4271-a8d5-51af9cacf248 to worker[183] qsize 0
2023-02-18 03:22:51,927 DEBUG awx.main.dispatch task 714deb9e-08c9-4271-a8d5-51af9cacf248 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:22:51,961 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:22:51,970 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:22:21.945461+00:00
2023-02-18 03:22:52,077 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3b546004-cb37-408f-9909-14b5a87fe2eb, queue=awx_private_queue)
[2023-02-18 03:22:52,077: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3b546004-cb37-408f-9909-14b5a87fe2eb, queue=awx_private_queue)
2023-02-18 03:22:52,057 DEBUG awx.main.dispatch task 714deb9e-08c9-4271-a8d5-51af9cacf248 is finished
2023-02-18 03:22:52,093 DEBUG awx.main.dispatch delivered 3b546004-cb37-408f-9909-14b5a87fe2eb to worker[195] qsize 0
2023-02-18 03:22:52,288 DEBUG awx.main.dispatch task 3b546004-cb37-408f-9909-14b5a87fe2eb starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:22:52,290 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:22:52,312 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:22:52,385 DEBUG awx.main.dispatch task 3b546004-cb37-408f-9909-14b5a87fe2eb is finished
RESULT 2
OKREADY
2023-02-18 03:23:12,077 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(9d1fcb62-3798-4c9a-a3c9-c34bb7e225b0, queue=awx_private_queue)
[2023-02-18 03:23:12,077: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(9d1fcb62-3798-4c9a-a3c9-c34bb7e225b0, queue=awx_private_queue)
2023-02-18 03:23:12,094 DEBUG awx.main.dispatch delivered 9d1fcb62-3798-4c9a-a3c9-c34bb7e225b0 to worker[183] qsize 0
2023-02-18 03:23:12,096 DEBUG awx.main.dispatch task 9d1fcb62-3798-4c9a-a3c9-c34bb7e225b0 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:23:12,098 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:23:12,194 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:23:12,393 DEBUG awx.main.dispatch task 9d1fcb62-3798-4c9a-a3c9-c34bb7e225b0 is finished
2023-02-18 03:23:21,909 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(c7036619-e1d9-4d08-ad22-df4ea455280b, queue=awx_private_queue)
[2023-02-18 03:23:21,909: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(c7036619-e1d9-4d08-ad22-df4ea455280b, queue=awx_private_queue)
2023-02-18 03:23:21,926 DEBUG awx.main.dispatch delivered c7036619-e1d9-4d08-ad22-df4ea455280b to worker[183] qsize 0
2023-02-18 03:23:21,928 DEBUG awx.main.dispatch task c7036619-e1d9-4d08-ad22-df4ea455280b starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:23:22,016 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:23:22,037 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:22:51.961739+00:00
2023-02-18 03:23:22,180 DEBUG awx.main.dispatch task c7036619-e1d9-4d08-ad22-df4ea455280b is finished
2023-02-18 03:23:32,077 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(4ad7de9b-755b-47da-96e1-e76fd5529f9c, queue=awx_private_queue)
[2023-02-18 03:23:32,077: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(4ad7de9b-755b-47da-96e1-e76fd5529f9c, queue=awx_private_queue)
2023-02-18 03:23:32,094 DEBUG awx.main.dispatch delivered 4ad7de9b-755b-47da-96e1-e76fd5529f9c to worker[195] qsize 0
2023-02-18 03:23:32,096 DEBUG awx.main.dispatch task 4ad7de9b-755b-47da-96e1-e76fd5529f9c starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:23:32,098 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:23:32,224 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:23:32,313 DEBUG awx.main.dispatch task 4ad7de9b-755b-47da-96e1-e76fd5529f9c is finished
2023-02-18 03:21:34,159 DEBUG awx.main.dispatch task e08fb38e-6a2c-4dcb-a672-ca08c1fd6804 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:23:44,934 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:23:45,108 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:23:45,364 DEBUG awx.main.dispatch task e08fb38e-6a2c-4dcb-a672-ca08c1fd6804 is finished
2023-02-18 03:23:51,629 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(83d8311e-ba02-43e2-ab39-432b950703f7, queue=onap-awx-0)
[2023-02-18 03:23:51,629: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(83d8311e-ba02-43e2-ab39-432b950703f7, queue=onap-awx-0)
2023-02-18 03:23:51,741 DEBUG awx.main.dispatch delivered 83d8311e-ba02-43e2-ab39-432b950703f7 to worker[183] qsize 0
2023-02-18 03:23:51,744 DEBUG awx.main.dispatch task 83d8311e-ba02-43e2-ab39-432b950703f7 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:23:51,746 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:23:51,752 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(84f5e181-0a27-41fc-9525-906844a3b7a2, queue=onap-awx-0)
[2023-02-18 03:23:51,752: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(84f5e181-0a27-41fc-9525-906844a3b7a2, queue=onap-awx-0)
2023-02-18 03:23:51,767 DEBUG awx.main.dispatch delivered 84f5e181-0a27-41fc-9525-906844a3b7a2 to worker[197] qsize 0
2023-02-18 03:23:51,909 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(edc3db3d-2f3d-499a-82ac-632f7f2e1def, queue=awx_private_queue)
[2023-02-18 03:23:51,909: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(edc3db3d-2f3d-499a-82ac-632f7f2e1def, queue=awx_private_queue)
2023-02-18 03:23:51,914 DEBUG awx.main.dispatch task 83d8311e-ba02-43e2-ab39-432b950703f7 is finished
2023-02-18 03:23:51,930 DEBUG awx.main.dispatch delivered edc3db3d-2f3d-499a-82ac-632f7f2e1def to worker[183] qsize 0
2023-02-18 03:23:51,933 DEBUG awx.main.dispatch task edc3db3d-2f3d-499a-82ac-632f7f2e1def starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:23:51,996 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:23:52,004 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:23:22.016344+00:00
2023-02-18 03:23:52,077 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(011f7718-91de-4a8e-847f-0ebf80522d4d, queue=awx_private_queue)
[2023-02-18 03:23:52,077: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(011f7718-91de-4a8e-847f-0ebf80522d4d, queue=awx_private_queue)
2023-02-18 03:23:51,770 DEBUG awx.main.dispatch task 84f5e181-0a27-41fc-9525-906844a3b7a2 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:23:52,115 DEBUG awx.main.dispatch task 84f5e181-0a27-41fc-9525-906844a3b7a2 is finished
2023-02-18 03:23:52,064 DEBUG awx.main.dispatch task edc3db3d-2f3d-499a-82ac-632f7f2e1def is finished
2023-02-18 03:23:52,093 DEBUG awx.main.dispatch delivered 011f7718-91de-4a8e-847f-0ebf80522d4d to worker[192] qsize 0
2023-02-18 03:23:52,291 DEBUG awx.main.dispatch task 011f7718-91de-4a8e-847f-0ebf80522d4d starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:23:52,292 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:23:52,354 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:23:52,478 DEBUG awx.main.dispatch task 011f7718-91de-4a8e-847f-0ebf80522d4d is finished
RESULT 2
OKREADY
2023-02-18 03:24:12,077 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b530aef7-49bb-4d5f-b96b-c5955c3a9307, queue=awx_private_queue)
[2023-02-18 03:24:12,077: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b530aef7-49bb-4d5f-b96b-c5955c3a9307, queue=awx_private_queue)
2023-02-18 03:24:12,093 DEBUG awx.main.dispatch delivered b530aef7-49bb-4d5f-b96b-c5955c3a9307 to worker[192] qsize 0
2023-02-18 03:24:12,095 DEBUG awx.main.dispatch task b530aef7-49bb-4d5f-b96b-c5955c3a9307 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:24:12,096 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:24:12,196 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:24:12,338 DEBUG awx.main.dispatch task b530aef7-49bb-4d5f-b96b-c5955c3a9307 is finished
2023-02-18 03:24:21,908 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(f31343a6-bd10-41a4-a0f1-26d35e4dfa4c, queue=awx_private_queue)
[2023-02-18 03:24:21,908: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(f31343a6-bd10-41a4-a0f1-26d35e4dfa4c, queue=awx_private_queue)
2023-02-18 03:24:21,925 DEBUG awx.main.dispatch delivered f31343a6-bd10-41a4-a0f1-26d35e4dfa4c to worker[197] qsize 0
2023-02-18 03:24:21,928 DEBUG awx.main.dispatch task f31343a6-bd10-41a4-a0f1-26d35e4dfa4c starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:24:21,988 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:24:22,011 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:23:51.996766+00:00
2023-02-18 03:24:22,151 DEBUG awx.main.dispatch task f31343a6-bd10-41a4-a0f1-26d35e4dfa4c is finished
2023-02-18 03:24:32,078 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(45150b05-ff8c-4159-b99f-4090ebbc1fd4, queue=awx_private_queue)
[2023-02-18 03:24:32,078: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(45150b05-ff8c-4159-b99f-4090ebbc1fd4, queue=awx_private_queue)
2023-02-18 03:24:32,098 DEBUG awx.main.dispatch delivered 45150b05-ff8c-4159-b99f-4090ebbc1fd4 to worker[183] qsize 0
2023-02-18 03:24:32,100 DEBUG awx.main.dispatch task 45150b05-ff8c-4159-b99f-4090ebbc1fd4 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:24:32,102 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:24:32,147 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:24:32,214 DEBUG awx.main.dispatch task 45150b05-ff8c-4159-b99f-4090ebbc1fd4 is finished
2023-02-18 03:24:51,477 DEBUG awx.main.dispatch publish awx.main.tasks.awx_isolated_heartbeat(7b538950-53a5-422c-bed1-5077c3d23d8d, queue=onap-awx-0)
[2023-02-18 03:24:51,477: DEBUG/Process-1] publish awx.main.tasks.awx_isolated_heartbeat(7b538950-53a5-422c-bed1-5077c3d23d8d, queue=onap-awx-0)
2023-02-18 03:24:51,497 DEBUG awx.main.dispatch delivered 7b538950-53a5-422c-bed1-5077c3d23d8d to worker[183] qsize 0
2023-02-18 03:24:51,503 DEBUG awx.main.dispatch task 7b538950-53a5-422c-bed1-5077c3d23d8d starting awx.main.tasks.awx_isolated_heartbeat(*[])
2023-02-18 03:24:51,505 DEBUG awx.main.tasks Controlling node checking for any isolated management tasks.
2023-02-18 03:24:51,582 DEBUG awx.main.dispatch task 7b538950-53a5-422c-bed1-5077c3d23d8d is finished
2023-02-18 03:24:51,628 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(8ca1a6d6-bc41-48ca-a5e4-8ba37f66a0a8, queue=onap-awx-0)
[2023-02-18 03:24:51,628: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(8ca1a6d6-bc41-48ca-a5e4-8ba37f66a0a8, queue=onap-awx-0)
2023-02-18 03:24:51,697 DEBUG awx.main.dispatch delivered 8ca1a6d6-bc41-48ca-a5e4-8ba37f66a0a8 to worker[195] qsize 0
2023-02-18 03:24:51,752 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(9d384933-c128-4217-a41d-2e2ed8b41ca4, queue=onap-awx-0)
[2023-02-18 03:24:51,752: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(9d384933-c128-4217-a41d-2e2ed8b41ca4, queue=onap-awx-0)
2023-02-18 03:24:51,784 DEBUG awx.main.dispatch delivered 9d384933-c128-4217-a41d-2e2ed8b41ca4 to worker[197] qsize 0
2023-02-18 03:24:51,910 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d1404b34-9d81-481b-bc5c-e67a095126f6, queue=awx_private_queue)
[2023-02-18 03:24:51,910: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d1404b34-9d81-481b-bc5c-e67a095126f6, queue=awx_private_queue)
2023-02-18 03:24:51,932 DEBUG awx.main.dispatch delivered d1404b34-9d81-481b-bc5c-e67a095126f6 to worker[192] qsize 0
2023-02-18 03:24:51,704 DEBUG awx.main.dispatch task 8ca1a6d6-bc41-48ca-a5e4-8ba37f66a0a8 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:24:51,963 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:24:51,788 DEBUG awx.main.dispatch task 9d384933-c128-4217-a41d-2e2ed8b41ca4 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:24:52,058 DEBUG awx.main.dispatch task 8ca1a6d6-bc41-48ca-a5e4-8ba37f66a0a8 is finished
2023-02-18 03:24:52,066 DEBUG awx.main.dispatch task 9d384933-c128-4217-a41d-2e2ed8b41ca4 is finished
2023-02-18 03:24:52,077 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e39daec9-3ace-4f48-ba34-2de4b6968695, queue=awx_private_queue)
[2023-02-18 03:24:52,077: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e39daec9-3ace-4f48-ba34-2de4b6968695, queue=awx_private_queue)
2023-02-18 03:24:52,096 DEBUG awx.main.dispatch delivered e39daec9-3ace-4f48-ba34-2de4b6968695 to worker[183] qsize 0
2023-02-18 03:24:52,099 DEBUG awx.main.dispatch task e39daec9-3ace-4f48-ba34-2de4b6968695 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:24:52,101 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:24:52,160 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:24:51,935 DEBUG awx.main.dispatch task d1404b34-9d81-481b-bc5c-e67a095126f6 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:24:52,210 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:24:52,226 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:24:21.988486+00:00
2023-02-18 03:24:52,327 DEBUG awx.main.dispatch task e39daec9-3ace-4f48-ba34-2de4b6968695 is finished
2023-02-18 03:24:52,343 DEBUG awx.main.dispatch task d1404b34-9d81-481b-bc5c-e67a095126f6 is finished
RESULT 2
OKREADY
2023-02-18 03:25:12,090 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f7711457-375a-4798-9bb3-abd74a78f4ff, queue=awx_private_queue)
[2023-02-18 03:25:12,090: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f7711457-375a-4798-9bb3-abd74a78f4ff, queue=awx_private_queue)
2023-02-18 03:25:12,111 DEBUG awx.main.dispatch delivered f7711457-375a-4798-9bb3-abd74a78f4ff to worker[183] qsize 0
2023-02-18 03:25:12,115 DEBUG awx.main.dispatch task f7711457-375a-4798-9bb3-abd74a78f4ff starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:25:12,118 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:25:12,176 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:25:12,352 DEBUG awx.main.dispatch task f7711457-375a-4798-9bb3-abd74a78f4ff is finished
2023-02-18 03:25:21,909 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(95b43dc8-c07f-478e-aaaa-bad0d6157e9e, queue=awx_private_queue)
[2023-02-18 03:25:21,909: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(95b43dc8-c07f-478e-aaaa-bad0d6157e9e, queue=awx_private_queue)
2023-02-18 03:25:21,926 DEBUG awx.main.dispatch delivered 95b43dc8-c07f-478e-aaaa-bad0d6157e9e to worker[195] qsize 0
2023-02-18 03:25:21,930 DEBUG awx.main.dispatch task 95b43dc8-c07f-478e-aaaa-bad0d6157e9e starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:25:21,970 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:25:22,013 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:24:52.211122+00:00
2023-02-18 03:25:22,059 DEBUG awx.main.dispatch task 95b43dc8-c07f-478e-aaaa-bad0d6157e9e is finished
2023-02-18 03:25:32,088 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5800c4ad-75c9-49dc-a36a-fa40cbc0565b, queue=awx_private_queue)
[2023-02-18 03:25:32,088: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5800c4ad-75c9-49dc-a36a-fa40cbc0565b, queue=awx_private_queue)
2023-02-18 03:25:32,106 DEBUG awx.main.dispatch delivered 5800c4ad-75c9-49dc-a36a-fa40cbc0565b to worker[183] qsize 0
2023-02-18 03:25:32,109 DEBUG awx.main.dispatch task 5800c4ad-75c9-49dc-a36a-fa40cbc0565b starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:25:32,111 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:25:32,301 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:25:32,577 DEBUG awx.main.dispatch task 5800c4ad-75c9-49dc-a36a-fa40cbc0565b is finished
2023-02-18 03:25:51,629 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(567c8455-6601-4060-ac35-9a7c4c95e292, queue=onap-awx-0)
[2023-02-18 03:25:51,629: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(567c8455-6601-4060-ac35-9a7c4c95e292, queue=onap-awx-0)
2023-02-18 03:25:51,803 DEBUG awx.main.dispatch delivered 567c8455-6601-4060-ac35-9a7c4c95e292 to worker[183] qsize 0
2023-02-18 03:25:51,871 DEBUG awx.main.dispatch task 567c8455-6601-4060-ac35-9a7c4c95e292 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:25:51,872 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:25:51,752 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(b664640a-e713-411d-88ea-79e7f622780e, queue=onap-awx-0)
[2023-02-18 03:25:51,752: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(b664640a-e713-411d-88ea-79e7f622780e, queue=onap-awx-0)
2023-02-18 03:25:52,069 DEBUG awx.main.dispatch delivered b664640a-e713-411d-88ea-79e7f622780e to worker[195] qsize 0
2023-02-18 03:25:52,070 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(c900c45f-9d1e-48f8-9ed1-df28b6e58f5c, queue=awx_private_queue)
[2023-02-18 03:25:52,070: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(c900c45f-9d1e-48f8-9ed1-df28b6e58f5c, queue=awx_private_queue)
2023-02-18 03:25:52,084 DEBUG awx.main.dispatch delivered c900c45f-9d1e-48f8-9ed1-df28b6e58f5c to worker[197] qsize 0
2023-02-18 03:25:52,089 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f403d3dd-0684-4041-89ef-85f1c3b17d04, queue=awx_private_queue)
[2023-02-18 03:25:52,089: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f403d3dd-0684-4041-89ef-85f1c3b17d04, queue=awx_private_queue)
2023-02-18 03:25:52,104 DEBUG awx.main.dispatch delivered f403d3dd-0684-4041-89ef-85f1c3b17d04 to worker[192] qsize 0
2023-02-18 03:25:52,336 DEBUG awx.main.dispatch task f403d3dd-0684-4041-89ef-85f1c3b17d04 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:25:52,340 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:25:52,087 DEBUG awx.main.dispatch task c900c45f-9d1e-48f8-9ed1-df28b6e58f5c starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:25:52,071 DEBUG awx.main.dispatch task b664640a-e713-411d-88ea-79e7f622780e starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:25:52,462 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:25:52,483 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:25:21.970728+00:00
2023-02-18 03:25:52,508 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:25:52,513 DEBUG awx.main.dispatch task 567c8455-6601-4060-ac35-9a7c4c95e292 is finished
2023-02-18 03:25:52,529 DEBUG awx.main.dispatch task b664640a-e713-411d-88ea-79e7f622780e is finished
2023-02-18 03:25:52,913 DEBUG awx.main.dispatch task c900c45f-9d1e-48f8-9ed1-df28b6e58f5c is finished
2023-02-18 03:25:53,121 DEBUG awx.main.dispatch task f403d3dd-0684-4041-89ef-85f1c3b17d04 is finished
RESULT 2
OKREADY
2023-02-18 03:26:12,096 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(4c409839-5207-40b5-9fb7-87ecb84c3bd1, queue=awx_private_queue)
[2023-02-18 03:26:12,096: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(4c409839-5207-40b5-9fb7-87ecb84c3bd1, queue=awx_private_queue)
2023-02-18 03:26:12,133 DEBUG awx.main.dispatch delivered 4c409839-5207-40b5-9fb7-87ecb84c3bd1 to worker[183] qsize 0
2023-02-18 03:26:12,135 DEBUG awx.main.dispatch task 4c409839-5207-40b5-9fb7-87ecb84c3bd1 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:26:12,136 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:26:13,177 ERROR awx.main.dispatch Worker failed to run task awx.main.scheduler.tasks.run_task_manager(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/tasks.py", line 15, in run_task_manager
TaskManager().schedule()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/task_manager.py", line 45, in __init__
for rampart_group in InstanceGroup.objects.prefetch_related('instances'):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 274, in __iter__
self._fetch_all()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 1242, in _fetch_all
self._result_cache = list(self._iterable_class(self))
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 55, in __iter__
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1098, in execute_sql
cursor = self.connection.cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor
return self._cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:26:13,181 DEBUG awx.main.dispatch task 4c409839-5207-40b5-9fb7-87ecb84c3bd1 is finished
2023-02-18 03:26:22,071 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(21ebd4c5-ecef-45de-aabf-dd057891b899, queue=awx_private_queue)
[2023-02-18 03:26:22,071: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(21ebd4c5-ecef-45de-aabf-dd057891b899, queue=awx_private_queue)
2023-02-18 03:26:22,086 DEBUG awx.main.dispatch delivered 21ebd4c5-ecef-45de-aabf-dd057891b899 to worker[183] qsize 0
2023-02-18 03:26:22,088 DEBUG awx.main.dispatch task 21ebd4c5-ecef-45de-aabf-dd057891b899 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:26:23,130 ERROR awx.main.dispatch Worker failed to run task awx.main.tasks.awx_periodic_scheduler(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/tasks.py", line 482, in awx_periodic_scheduler
with advisory_lock('awx_periodic_scheduler_lock', wait=False) as acquired:
File "/usr/lib64/python3.6/contextlib.py", line 81, in __enter__
return next(self.gen)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/utils/pglock.py", line 13, in advisory_lock
with django_pglocks_advisory_lock(*args, **kwargs) as internal_lock:
File "/usr/lib64/python3.6/contextlib.py", line 81, in __enter__
return next(self.gen)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django_pglocks/__init__.py", line 64, in advisory_lock
cursor = connections[using].cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor
return self._cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:26:23,133 DEBUG awx.main.dispatch task 21ebd4c5-ecef-45de-aabf-dd057891b899 is finished
2023-02-18 03:26:32,097 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(8ee654b0-b9d8-4ed1-899e-3513dc77193c, queue=awx_private_queue)
[2023-02-18 03:26:32,097: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(8ee654b0-b9d8-4ed1-899e-3513dc77193c, queue=awx_private_queue)
2023-02-18 03:26:32,113 DEBUG awx.main.dispatch delivered 8ee654b0-b9d8-4ed1-899e-3513dc77193c to worker[197] qsize 0
2023-02-18 03:26:32,115 DEBUG awx.main.dispatch task 8ee654b0-b9d8-4ed1-899e-3513dc77193c starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:26:32,117 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:26:33,145 ERROR awx.main.dispatch Worker failed to run task awx.main.scheduler.tasks.run_task_manager(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/tasks.py", line 15, in run_task_manager
TaskManager().schedule()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/task_manager.py", line 45, in __init__
for rampart_group in InstanceGroup.objects.prefetch_related('instances'):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 274, in __iter__
self._fetch_all()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 1242, in _fetch_all
self._result_cache = list(self._iterable_class(self))
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 55, in __iter__
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1098, in execute_sql
cursor = self.connection.cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor
return self._cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:26:33,149 DEBUG awx.main.dispatch task 8ee654b0-b9d8-4ed1-899e-3513dc77193c is finished
2023-02-18 03:26:51,632 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(c03677a5-d606-428c-b48d-6fbffa5796a6, queue=onap-awx-0)
[2023-02-18 03:26:51,632: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(c03677a5-d606-428c-b48d-6fbffa5796a6, queue=onap-awx-0)
2023-02-18 03:26:51,752 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(3eab907d-0c06-4dff-a0f4-3e89787dc754, queue=onap-awx-0)
[2023-02-18 03:26:51,752: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(3eab907d-0c06-4dff-a0f4-3e89787dc754, queue=onap-awx-0)
2023-02-18 03:26:51,795 DEBUG awx.main.dispatch delivered c03677a5-d606-428c-b48d-6fbffa5796a6 to worker[183] qsize 0
2023-02-18 03:26:51,830 DEBUG awx.main.dispatch delivered 3eab907d-0c06-4dff-a0f4-3e89787dc754 to worker[192] qsize 0
2023-02-18 03:26:51,830 DEBUG awx.main.dispatch task c03677a5-d606-428c-b48d-6fbffa5796a6 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:26:51,831 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:26:51,832 DEBUG awx.main.dispatch task 3eab907d-0c06-4dff-a0f4-3e89787dc754 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:26:52,071 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(1a5db7f3-4616-4ec8-87b6-e9c7090d7e5b, queue=awx_private_queue)
[2023-02-18 03:26:52,071: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(1a5db7f3-4616-4ec8-87b6-e9c7090d7e5b, queue=awx_private_queue)
2023-02-18 03:26:52,089 DEBUG awx.main.dispatch delivered 1a5db7f3-4616-4ec8-87b6-e9c7090d7e5b to worker[195] qsize 0
2023-02-18 03:26:52,097 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(770a202d-a7ac-48e3-a186-ef20657ebef7, queue=awx_private_queue)
[2023-02-18 03:26:52,097: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(770a202d-a7ac-48e3-a186-ef20657ebef7, queue=awx_private_queue)
2023-02-18 03:26:52,112 DEBUG awx.main.dispatch delivered 770a202d-a7ac-48e3-a186-ef20657ebef7 to worker[197] qsize 0
2023-02-18 03:26:52,338 DEBUG awx.main.dispatch task 770a202d-a7ac-48e3-a186-ef20657ebef7 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:26:52,341 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:26:52,855 ERROR awx.main.dispatch Worker failed to run task awx.main.tasks.cluster_node_heartbeat(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/tasks.py", line 366, in cluster_node_heartbeat
instance_list = list(Instance.objects.all_non_isolated())
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 274, in __iter__
self._fetch_all()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 1242, in _fetch_all
self._result_cache = list(self._iterable_class(self))
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 55, in __iter__
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1098, in execute_sql
cursor = self.connection.cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor
return self._cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:26:52,858 DEBUG awx.main.dispatch task c03677a5-d606-428c-b48d-6fbffa5796a6 is finished
2023-02-18 03:26:52,857 ERROR awx.main.dispatch Worker failed to run task awx.main.tasks.awx_k8s_reaper(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/tasks.py", line 436, in awx_k8s_reaper
for group in InstanceGroup.objects.filter(credential__isnull=False).iterator():
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 341, in _iterator
yield from self._iterable_class(self, chunked_fetch=use_chunked_fetch, chunk_size=chunk_size)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 55, in __iter__
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1096, in execute_sql
cursor = self.connection.chunked_cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 233, in chunked_cursor
self._named_cursor_idx,
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:26:52,862 DEBUG awx.main.dispatch task 3eab907d-0c06-4dff-a0f4-3e89787dc754 is finished
2023-02-18 03:26:52,092 DEBUG awx.main.dispatch task 1a5db7f3-4616-4ec8-87b6-e9c7090d7e5b starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:26:54,146 ERROR awx.main.dispatch Worker failed to run task awx.main.tasks.awx_periodic_scheduler(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/tasks.py", line 482, in awx_periodic_scheduler
with advisory_lock('awx_periodic_scheduler_lock', wait=False) as acquired:
File "/usr/lib64/python3.6/contextlib.py", line 81, in __enter__
return next(self.gen)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/utils/pglock.py", line 13, in advisory_lock
with django_pglocks_advisory_lock(*args, **kwargs) as internal_lock:
File "/usr/lib64/python3.6/contextlib.py", line 81, in __enter__
return next(self.gen)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django_pglocks/__init__.py", line 64, in advisory_lock
cursor = connections[using].cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor
return self._cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:26:54,150 DEBUG awx.main.dispatch task 1a5db7f3-4616-4ec8-87b6-e9c7090d7e5b is finished
2023-02-18 03:26:55,390 ERROR awx.main.dispatch Worker failed to run task awx.main.scheduler.tasks.run_task_manager(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/tasks.py", line 15, in run_task_manager
TaskManager().schedule()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/task_manager.py", line 45, in __init__
for rampart_group in InstanceGroup.objects.prefetch_related('instances'):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 274, in __iter__
self._fetch_all()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 1242, in _fetch_all
self._result_cache = list(self._iterable_class(self))
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 55, in __iter__
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1098, in execute_sql
cursor = self.connection.cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor
return self._cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:26:55,393 DEBUG awx.main.dispatch task 770a202d-a7ac-48e3-a186-ef20657ebef7 is finished
RESULT 2
OKREADY
2023-02-18 03:27:12,097 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f294d7b1-c614-4531-aaa2-44d4bd2f7a88, queue=awx_private_queue)
[2023-02-18 03:27:12,097: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f294d7b1-c614-4531-aaa2-44d4bd2f7a88, queue=awx_private_queue)
2023-02-18 03:27:12,112 DEBUG awx.main.dispatch delivered f294d7b1-c614-4531-aaa2-44d4bd2f7a88 to worker[197] qsize 0
2023-02-18 03:27:12,115 DEBUG awx.main.dispatch task f294d7b1-c614-4531-aaa2-44d4bd2f7a88 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:27:12,117 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:27:13,154 ERROR awx.main.dispatch Worker failed to run task awx.main.scheduler.tasks.run_task_manager(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/tasks.py", line 15, in run_task_manager
TaskManager().schedule()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/task_manager.py", line 45, in __init__
for rampart_group in InstanceGroup.objects.prefetch_related('instances'):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 274, in __iter__
self._fetch_all()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 1242, in _fetch_all
self._result_cache = list(self._iterable_class(self))
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 55, in __iter__
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1098, in execute_sql
cursor = self.connection.cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor
return self._cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:27:13,157 DEBUG awx.main.dispatch task f294d7b1-c614-4531-aaa2-44d4bd2f7a88 is finished
2023-02-18 03:27:22,071 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(1f5fb29a-322c-4f54-af5b-a344459d11b4, queue=awx_private_queue)
[2023-02-18 03:27:22,071: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(1f5fb29a-322c-4f54-af5b-a344459d11b4, queue=awx_private_queue)
2023-02-18 03:27:22,088 DEBUG awx.main.dispatch delivered 1f5fb29a-322c-4f54-af5b-a344459d11b4 to worker[195] qsize 0
2023-02-18 03:27:22,090 DEBUG awx.main.dispatch task 1f5fb29a-322c-4f54-af5b-a344459d11b4 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:27:23,131 ERROR awx.main.dispatch Worker failed to run task awx.main.tasks.awx_periodic_scheduler(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/tasks.py", line 482, in awx_periodic_scheduler
with advisory_lock('awx_periodic_scheduler_lock', wait=False) as acquired:
File "/usr/lib64/python3.6/contextlib.py", line 81, in __enter__
return next(self.gen)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/utils/pglock.py", line 13, in advisory_lock
with django_pglocks_advisory_lock(*args, **kwargs) as internal_lock:
File "/usr/lib64/python3.6/contextlib.py", line 81, in __enter__
return next(self.gen)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django_pglocks/__init__.py", line 64, in advisory_lock
cursor = connections[using].cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor
return self._cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:27:23,133 DEBUG awx.main.dispatch task 1f5fb29a-322c-4f54-af5b-a344459d11b4 is finished
2023-02-18 03:27:32,098 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c71a86ec-ad3b-41f9-84ca-0e9454034570, queue=awx_private_queue)
[2023-02-18 03:27:32,098: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c71a86ec-ad3b-41f9-84ca-0e9454034570, queue=awx_private_queue)
2023-02-18 03:27:32,118 DEBUG awx.main.dispatch delivered c71a86ec-ad3b-41f9-84ca-0e9454034570 to worker[192] qsize 0
2023-02-18 03:27:32,121 DEBUG awx.main.dispatch task c71a86ec-ad3b-41f9-84ca-0e9454034570 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:27:32,122 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:27:33,145 ERROR awx.main.dispatch Worker failed to run task awx.main.scheduler.tasks.run_task_manager(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/tasks.py", line 15, in run_task_manager
TaskManager().schedule()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/task_manager.py", line 45, in __init__
for rampart_group in InstanceGroup.objects.prefetch_related('instances'):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 274, in __iter__
self._fetch_all()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 1242, in _fetch_all
self._result_cache = list(self._iterable_class(self))
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 55, in __iter__
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1098, in execute_sql
cursor = self.connection.cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor
return self._cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:27:33,149 DEBUG awx.main.dispatch task c71a86ec-ad3b-41f9-84ca-0e9454034570 is finished
2023-02-18 03:27:51,634 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(e9b7df4d-82af-4663-9fc6-457672089a52, queue=onap-awx-0)
[2023-02-18 03:27:51,634: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(e9b7df4d-82af-4663-9fc6-457672089a52, queue=onap-awx-0)
2023-02-18 03:27:51,752 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(eaa6272a-8353-4964-9458-e1f77b40d118, queue=onap-awx-0)
[2023-02-18 03:27:51,752: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(eaa6272a-8353-4964-9458-e1f77b40d118, queue=onap-awx-0)
2023-02-18 03:27:51,759 DEBUG awx.main.dispatch delivered e9b7df4d-82af-4663-9fc6-457672089a52 to worker[192] qsize 0
2023-02-18 03:27:51,761 DEBUG awx.main.dispatch task e9b7df4d-82af-4663-9fc6-457672089a52 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:27:51,762 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:27:51,770 DEBUG awx.main.dispatch delivered eaa6272a-8353-4964-9458-e1f77b40d118 to worker[183] qsize 0
2023-02-18 03:27:51,772 DEBUG awx.main.dispatch task eaa6272a-8353-4964-9458-e1f77b40d118 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:27:52,800 ERROR awx.main.dispatch Worker failed to run task awx.main.tasks.awx_k8s_reaper(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/tasks.py", line 436, in awx_k8s_reaper
for group in InstanceGroup.objects.filter(credential__isnull=False).iterator():
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 341, in _iterator
yield from self._iterable_class(self, chunked_fetch=use_chunked_fetch, chunk_size=chunk_size)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 55, in __iter__
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1096, in execute_sql
cursor = self.connection.chunked_cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 233, in chunked_cursor
self._named_cursor_idx,
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:27:53,824 DEBUG awx.main.dispatch task eaa6272a-8353-4964-9458-e1f77b40d118 is finished
2023-02-18 03:27:52,798 ERROR awx.main.dispatch Worker failed to run task awx.main.tasks.cluster_node_heartbeat(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/tasks.py", line 366, in cluster_node_heartbeat
instance_list = list(Instance.objects.all_non_isolated())
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 274, in __iter__
self._fetch_all()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 1242, in _fetch_all
self._result_cache = list(self._iterable_class(self))
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 55, in __iter__
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1098, in execute_sql
cursor = self.connection.cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor
return self._cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:27:55,839 DEBUG awx.main.dispatch task e9b7df4d-82af-4663-9fc6-457672089a52 is finished
2023-02-18 03:27:52,071 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(5a6d6f0c-fe8b-4b00-aa5b-7be14f97ab7a, queue=awx_private_queue)
[2023-02-18 03:27:52,071: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(5a6d6f0c-fe8b-4b00-aa5b-7be14f97ab7a, queue=awx_private_queue)
2023-02-18 03:27:59,155 DEBUG awx.main.dispatch delivered 5a6d6f0c-fe8b-4b00-aa5b-7be14f97ab7a to worker[195] qsize 0
2023-02-18 03:27:59,448 DEBUG awx.main.dispatch task 5a6d6f0c-fe8b-4b00-aa5b-7be14f97ab7a starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:27:59,156 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(95b42cf2-0c1a-41be-a5b1-a4cf6242790a, queue=awx_private_queue)
[2023-02-18 03:27:59,156: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(95b42cf2-0c1a-41be-a5b1-a4cf6242790a, queue=awx_private_queue)
RESULT 2
OKREADY
2023-02-18 03:28:00,203 DEBUG awx.main.dispatch delivered 95b42cf2-0c1a-41be-a5b1-a4cf6242790a to worker[197] qsize 0
2023-02-18 03:28:00,206 DEBUG awx.main.dispatch task 95b42cf2-0c1a-41be-a5b1-a4cf6242790a starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:28:00,210 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:28:01,245 ERROR awx.main.dispatch Worker failed to run task awx.main.scheduler.tasks.run_task_manager(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/tasks.py", line 15, in run_task_manager
TaskManager().schedule()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/task_manager.py", line 45, in __init__
for rampart_group in InstanceGroup.objects.prefetch_related('instances'):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 274, in __iter__
self._fetch_all()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 1242, in _fetch_all
self._result_cache = list(self._iterable_class(self))
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 55, in __iter__
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1098, in execute_sql
cursor = self.connection.cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor
return self._cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:28:01,248 DEBUG awx.main.dispatch task 95b42cf2-0c1a-41be-a5b1-a4cf6242790a is finished
2023-02-18 03:28:02,490 ERROR awx.main.dispatch Worker failed to run task awx.main.tasks.awx_periodic_scheduler(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/tasks.py", line 482, in awx_periodic_scheduler
with advisory_lock('awx_periodic_scheduler_lock', wait=False) as acquired:
File "/usr/lib64/python3.6/contextlib.py", line 81, in __enter__
return next(self.gen)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/utils/pglock.py", line 13, in advisory_lock
with django_pglocks_advisory_lock(*args, **kwargs) as internal_lock:
File "/usr/lib64/python3.6/contextlib.py", line 81, in __enter__
return next(self.gen)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django_pglocks/__init__.py", line 64, in advisory_lock
cursor = connections[using].cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor
return self._cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:28:02,493 DEBUG awx.main.dispatch task 5a6d6f0c-fe8b-4b00-aa5b-7be14f97ab7a is finished
2023-02-18 03:28:19,180 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e1bede4f-0675-4d64-8813-7dd8eefb0fad, queue=awx_private_queue)
[2023-02-18 03:28:19,180: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e1bede4f-0675-4d64-8813-7dd8eefb0fad, queue=awx_private_queue)
2023-02-18 03:28:19,199 DEBUG awx.main.dispatch delivered e1bede4f-0675-4d64-8813-7dd8eefb0fad to worker[197] qsize 0
2023-02-18 03:28:19,201 DEBUG awx.main.dispatch task e1bede4f-0675-4d64-8813-7dd8eefb0fad starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:28:19,203 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:28:19,303 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:28:19,496 DEBUG awx.main.dispatch task e1bede4f-0675-4d64-8813-7dd8eefb0fad is finished
2023-02-18 03:28:22,072 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(7ca835a7-3b0c-4f24-ae47-671bfce6ce6a, queue=awx_private_queue)
[2023-02-18 03:28:22,072: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(7ca835a7-3b0c-4f24-ae47-671bfce6ce6a, queue=awx_private_queue)
2023-02-18 03:28:22,089 DEBUG awx.main.dispatch delivered 7ca835a7-3b0c-4f24-ae47-671bfce6ce6a to worker[183] qsize 0
2023-02-18 03:28:22,092 DEBUG awx.main.dispatch task 7ca835a7-3b0c-4f24-ae47-671bfce6ce6a starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:28:22,158 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:28:22,188 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:25:52.462901+00:00
2023-02-18 03:28:22,312 DEBUG awx.main.dispatch task 7ca835a7-3b0c-4f24-ae47-671bfce6ce6a is finished
2023-02-18 03:28:39,184 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b7dd0e24-9251-4a82-a6b2-70898a19fd82, queue=awx_private_queue)
[2023-02-18 03:28:39,184: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b7dd0e24-9251-4a82-a6b2-70898a19fd82, queue=awx_private_queue)
2023-02-18 03:28:39,200 DEBUG awx.main.dispatch delivered b7dd0e24-9251-4a82-a6b2-70898a19fd82 to worker[197] qsize 0
2023-02-18 03:28:39,203 DEBUG awx.main.dispatch task b7dd0e24-9251-4a82-a6b2-70898a19fd82 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:28:39,204 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:28:39,333 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:28:39,471 DEBUG awx.main.dispatch task b7dd0e24-9251-4a82-a6b2-70898a19fd82 is finished
2023-02-18 03:28:51,634 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(b74e1d35-3148-4e2b-85db-8b77a14871a0, queue=onap-awx-0)
[2023-02-18 03:28:51,634: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(b74e1d35-3148-4e2b-85db-8b77a14871a0, queue=onap-awx-0)
2023-02-18 03:28:51,753 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(d5555a05-ad99-4809-bd99-82ca6eb81bf2, queue=onap-awx-0)
[2023-02-18 03:28:51,753: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(d5555a05-ad99-4809-bd99-82ca6eb81bf2, queue=onap-awx-0)
2023-02-18 03:28:51,936 DEBUG awx.main.dispatch delivered b74e1d35-3148-4e2b-85db-8b77a14871a0 to worker[195] qsize 0
2023-02-18 03:28:51,938 DEBUG awx.main.dispatch delivered d5555a05-ad99-4809-bd99-82ca6eb81bf2 to worker[197] qsize 0
2023-02-18 03:28:51,939 DEBUG awx.main.dispatch task b74e1d35-3148-4e2b-85db-8b77a14871a0 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:28:51,940 DEBUG awx.main.dispatch task d5555a05-ad99-4809-bd99-82ca6eb81bf2 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:28:51,942 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:28:52,043 DEBUG awx.main.dispatch task d5555a05-ad99-4809-bd99-82ca6eb81bf2 is finished
2023-02-18 03:28:52,072 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(f8305b1e-a81f-42c2-bd47-63f223a955d7, queue=awx_private_queue)
[2023-02-18 03:28:52,072: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(f8305b1e-a81f-42c2-bd47-63f223a955d7, queue=awx_private_queue)
2023-02-18 03:28:52,091 DEBUG awx.main.dispatch delivered f8305b1e-a81f-42c2-bd47-63f223a955d7 to worker[192] qsize 0
2023-02-18 03:28:52,095 DEBUG awx.main.dispatch task f8305b1e-a81f-42c2-bd47-63f223a955d7 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:28:52,228 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:28:52,253 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:28:22.159127+00:00
2023-02-18 03:28:52,714 WARNING awx.main.tasks Rejoining the cluster as instance onap-awx-0.
2023-02-18 03:28:52,715 DEBUG awx.main.dispatch task b74e1d35-3148-4e2b-85db-8b77a14871a0 is finished
2023-02-18 03:28:52,966 DEBUG awx.main.dispatch task f8305b1e-a81f-42c2-bd47-63f223a955d7 is finished
2023-02-18 03:28:59,184 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7d916382-154b-4657-928b-f8b743d8ff6c, queue=awx_private_queue)
[2023-02-18 03:28:59,184: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7d916382-154b-4657-928b-f8b743d8ff6c, queue=awx_private_queue)
2023-02-18 03:28:59,290 DEBUG awx.main.dispatch delivered 7d916382-154b-4657-928b-f8b743d8ff6c to worker[183] qsize 0
2023-02-18 03:28:59,500 DEBUG awx.main.dispatch task 7d916382-154b-4657-928b-f8b743d8ff6c starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:28:59,502 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:28:59,637 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:28:59,838 DEBUG awx.main.dispatch task 7d916382-154b-4657-928b-f8b743d8ff6c is finished
RESULT 2
OKREADY
2023-02-18 03:29:19,195 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(4814cf1f-81f2-4bd6-b3f5-72be9f541135, queue=awx_private_queue)
[2023-02-18 03:29:19,195: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(4814cf1f-81f2-4bd6-b3f5-72be9f541135, queue=awx_private_queue)
2023-02-18 03:29:19,211 DEBUG awx.main.dispatch delivered 4814cf1f-81f2-4bd6-b3f5-72be9f541135 to worker[195] qsize 0
2023-02-18 03:29:19,214 DEBUG awx.main.dispatch task 4814cf1f-81f2-4bd6-b3f5-72be9f541135 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:29:19,217 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:29:20,249 ERROR awx.main.dispatch Worker failed to run task awx.main.scheduler.tasks.run_task_manager(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/tasks.py", line 15, in run_task_manager
TaskManager().schedule()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/task_manager.py", line 45, in __init__
for rampart_group in InstanceGroup.objects.prefetch_related('instances'):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 274, in __iter__
self._fetch_all()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 1242, in _fetch_all
self._result_cache = list(self._iterable_class(self))
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 55, in __iter__
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1098, in execute_sql
cursor = self.connection.cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor
return self._cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:29:20,253 DEBUG awx.main.dispatch task 4814cf1f-81f2-4bd6-b3f5-72be9f541135 is finished
2023-02-18 03:29:22,072 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(219f9f7f-151e-4c12-9ef5-2f90e32af438, queue=awx_private_queue)
[2023-02-18 03:29:22,072: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(219f9f7f-151e-4c12-9ef5-2f90e32af438, queue=awx_private_queue)
2023-02-18 03:29:22,088 DEBUG awx.main.dispatch delivered 219f9f7f-151e-4c12-9ef5-2f90e32af438 to worker[192] qsize 0
2023-02-18 03:29:22,091 DEBUG awx.main.dispatch task 219f9f7f-151e-4c12-9ef5-2f90e32af438 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:29:23,148 ERROR awx.main.dispatch Worker failed to run task awx.main.tasks.awx_periodic_scheduler(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/tasks.py", line 482, in awx_periodic_scheduler
with advisory_lock('awx_periodic_scheduler_lock', wait=False) as acquired:
File "/usr/lib64/python3.6/contextlib.py", line 81, in __enter__
return next(self.gen)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/utils/pglock.py", line 13, in advisory_lock
with django_pglocks_advisory_lock(*args, **kwargs) as internal_lock:
File "/usr/lib64/python3.6/contextlib.py", line 81, in __enter__
return next(self.gen)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django_pglocks/__init__.py", line 64, in advisory_lock
cursor = connections[using].cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor
return self._cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:29:23,151 DEBUG awx.main.dispatch task 219f9f7f-151e-4c12-9ef5-2f90e32af438 is finished
2023-02-18 03:29:39,200 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e9a03d78-b615-454a-81d2-72d1eabc12bb, queue=awx_private_queue)
[2023-02-18 03:29:39,200: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e9a03d78-b615-454a-81d2-72d1eabc12bb, queue=awx_private_queue)
2023-02-18 03:29:39,217 DEBUG awx.main.dispatch delivered e9a03d78-b615-454a-81d2-72d1eabc12bb to worker[183] qsize 0
2023-02-18 03:29:39,220 DEBUG awx.main.dispatch task e9a03d78-b615-454a-81d2-72d1eabc12bb starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:29:39,221 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:29:40,249 ERROR awx.main.dispatch Worker failed to run task awx.main.scheduler.tasks.run_task_manager(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/tasks.py", line 15, in run_task_manager
TaskManager().schedule()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/task_manager.py", line 45, in __init__
for rampart_group in InstanceGroup.objects.prefetch_related('instances'):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 274, in __iter__
self._fetch_all()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 1242, in _fetch_all
self._result_cache = list(self._iterable_class(self))
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 55, in __iter__
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1098, in execute_sql
cursor = self.connection.cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor
return self._cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:29:40,252 DEBUG awx.main.dispatch task e9a03d78-b615-454a-81d2-72d1eabc12bb is finished
2023-02-18 03:29:51,636 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(a85514f6-b82a-4598-b5cb-ee05edff879a, queue=onap-awx-0)
[2023-02-18 03:29:51,636: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(a85514f6-b82a-4598-b5cb-ee05edff879a, queue=onap-awx-0)
2023-02-18 03:29:51,752 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(04983a04-cb3f-4a55-b124-357cd3be8e7f, queue=onap-awx-0)
[2023-02-18 03:29:51,752: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(04983a04-cb3f-4a55-b124-357cd3be8e7f, queue=onap-awx-0)
2023-02-18 03:29:51,774 DEBUG awx.main.dispatch delivered a85514f6-b82a-4598-b5cb-ee05edff879a to worker[197] qsize 0
2023-02-18 03:29:51,777 DEBUG awx.main.dispatch delivered 04983a04-cb3f-4a55-b124-357cd3be8e7f to worker[195] qsize 0
2023-02-18 03:29:51,777 DEBUG awx.main.dispatch task a85514f6-b82a-4598-b5cb-ee05edff879a starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:29:51,779 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:29:51,778 DEBUG awx.main.dispatch task 04983a04-cb3f-4a55-b124-357cd3be8e7f starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:29:52,071 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(c0ad61e7-a21a-416f-9649-64f83eb65bfb, queue=awx_private_queue)
[2023-02-18 03:29:52,071: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(c0ad61e7-a21a-416f-9649-64f83eb65bfb, queue=awx_private_queue)
2023-02-18 03:29:52,087 DEBUG awx.main.dispatch delivered c0ad61e7-a21a-416f-9649-64f83eb65bfb to worker[183] qsize 0
2023-02-18 03:29:52,089 DEBUG awx.main.dispatch task c0ad61e7-a21a-416f-9649-64f83eb65bfb starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:29:52,832 ERROR awx.main.dispatch Worker failed to run task awx.main.tasks.awx_k8s_reaper(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/tasks.py", line 436, in awx_k8s_reaper
for group in InstanceGroup.objects.filter(credential__isnull=False).iterator():
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 341, in _iterator
yield from self._iterable_class(self, chunked_fetch=use_chunked_fetch, chunk_size=chunk_size)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 55, in __iter__
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1096, in execute_sql
cursor = self.connection.chunked_cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 233, in chunked_cursor
self._named_cursor_idx,
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:29:52,834 DEBUG awx.main.dispatch task 04983a04-cb3f-4a55-b124-357cd3be8e7f is finished
2023-02-18 03:29:52,830 ERROR awx.main.dispatch Worker failed to run task awx.main.tasks.cluster_node_heartbeat(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/tasks.py", line 366, in cluster_node_heartbeat
instance_list = list(Instance.objects.all_non_isolated())
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 274, in __iter__
self._fetch_all()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 1242, in _fetch_all
self._result_cache = list(self._iterable_class(self))
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 55, in __iter__
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1098, in execute_sql
cursor = self.connection.cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor
return self._cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:29:52,837 DEBUG awx.main.dispatch task a85514f6-b82a-4598-b5cb-ee05edff879a is finished
2023-02-18 03:29:53,113 ERROR awx.main.dispatch Worker failed to run task awx.main.tasks.awx_periodic_scheduler(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/tasks.py", line 482, in awx_periodic_scheduler
with advisory_lock('awx_periodic_scheduler_lock', wait=False) as acquired:
File "/usr/lib64/python3.6/contextlib.py", line 81, in __enter__
return next(self.gen)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/utils/pglock.py", line 13, in advisory_lock
with django_pglocks_advisory_lock(*args, **kwargs) as internal_lock:
File "/usr/lib64/python3.6/contextlib.py", line 81, in __enter__
return next(self.gen)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django_pglocks/__init__.py", line 64, in advisory_lock
cursor = connections[using].cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor
return self._cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:29:53,116 DEBUG awx.main.dispatch task c0ad61e7-a21a-416f-9649-64f83eb65bfb is finished
2023-02-18 03:29:59,200 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7c5e9c20-11bd-4a49-a3ab-31f8887e0a89, queue=awx_private_queue)
[2023-02-18 03:29:59,200: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7c5e9c20-11bd-4a49-a3ab-31f8887e0a89, queue=awx_private_queue)
RESULT 2
OKREADY
2023-02-18 03:30:00,239 DEBUG awx.main.dispatch delivered 7c5e9c20-11bd-4a49-a3ab-31f8887e0a89 to worker[192] qsize 0
2023-02-18 03:30:00,549 DEBUG awx.main.dispatch task 7c5e9c20-11bd-4a49-a3ab-31f8887e0a89 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:30:00,551 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:30:01,565 ERROR awx.main.dispatch Worker failed to run task awx.main.scheduler.tasks.run_task_manager(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/tasks.py", line 15, in run_task_manager
TaskManager().schedule()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/task_manager.py", line 45, in __init__
for rampart_group in InstanceGroup.objects.prefetch_related('instances'):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 274, in __iter__
self._fetch_all()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 1242, in _fetch_all
self._result_cache = list(self._iterable_class(self))
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 55, in __iter__
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1098, in execute_sql
cursor = self.connection.cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor
return self._cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:30:01,568 DEBUG awx.main.dispatch task 7c5e9c20-11bd-4a49-a3ab-31f8887e0a89 is finished
2023-02-18 03:30:19,205 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6ff68b4a-239f-43d4-bf04-1131da226401, queue=awx_private_queue)
[2023-02-18 03:30:19,205: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6ff68b4a-239f-43d4-bf04-1131da226401, queue=awx_private_queue)
2023-02-18 03:30:19,226 DEBUG awx.main.dispatch delivered 6ff68b4a-239f-43d4-bf04-1131da226401 to worker[183] qsize 0
2023-02-18 03:30:19,229 DEBUG awx.main.dispatch task 6ff68b4a-239f-43d4-bf04-1131da226401 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:30:19,231 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:30:20,253 ERROR awx.main.dispatch Worker failed to run task awx.main.scheduler.tasks.run_task_manager(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/tasks.py", line 15, in run_task_manager
TaskManager().schedule()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/task_manager.py", line 45, in __init__
for rampart_group in InstanceGroup.objects.prefetch_related('instances'):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 274, in __iter__
self._fetch_all()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 1242, in _fetch_all
self._result_cache = list(self._iterable_class(self))
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 55, in __iter__
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1098, in execute_sql
cursor = self.connection.cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor
return self._cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:30:20,256 DEBUG awx.main.dispatch task 6ff68b4a-239f-43d4-bf04-1131da226401 is finished
2023-02-18 03:30:22,072 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(0bedb791-8e57-4711-a37e-95dcf0aa9126, queue=awx_private_queue)
[2023-02-18 03:30:22,072: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(0bedb791-8e57-4711-a37e-95dcf0aa9126, queue=awx_private_queue)
2023-02-18 03:30:22,090 DEBUG awx.main.dispatch delivered 0bedb791-8e57-4711-a37e-95dcf0aa9126 to worker[192] qsize 0
2023-02-18 03:30:22,092 DEBUG awx.main.dispatch task 0bedb791-8e57-4711-a37e-95dcf0aa9126 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:30:23,131 ERROR awx.main.dispatch Worker failed to run task awx.main.tasks.awx_periodic_scheduler(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/tasks.py", line 482, in awx_periodic_scheduler
with advisory_lock('awx_periodic_scheduler_lock', wait=False) as acquired:
File "/usr/lib64/python3.6/contextlib.py", line 81, in __enter__
return next(self.gen)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/utils/pglock.py", line 13, in advisory_lock
with django_pglocks_advisory_lock(*args, **kwargs) as internal_lock:
File "/usr/lib64/python3.6/contextlib.py", line 81, in __enter__
return next(self.gen)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django_pglocks/__init__.py", line 64, in advisory_lock
cursor = connections[using].cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor
return self._cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:30:23,133 DEBUG awx.main.dispatch task 0bedb791-8e57-4711-a37e-95dcf0aa9126 is finished
2023-02-18 03:30:39,204 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c6ab2747-e4dd-46d6-9414-fbc6cc707c5b, queue=awx_private_queue)
[2023-02-18 03:30:39,204: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c6ab2747-e4dd-46d6-9414-fbc6cc707c5b, queue=awx_private_queue)
2023-02-18 03:30:39,222 DEBUG awx.main.dispatch delivered c6ab2747-e4dd-46d6-9414-fbc6cc707c5b to worker[192] qsize 0
2023-02-18 03:30:39,224 DEBUG awx.main.dispatch task c6ab2747-e4dd-46d6-9414-fbc6cc707c5b starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:30:39,225 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:30:39,312 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:30:39,689 DEBUG awx.main.dispatch task c6ab2747-e4dd-46d6-9414-fbc6cc707c5b is finished
2023-02-18 03:30:51,637 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(13f8d392-ee23-4265-9415-41ad0f96ed6c, queue=onap-awx-0)
[2023-02-18 03:30:51,637: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(13f8d392-ee23-4265-9415-41ad0f96ed6c, queue=onap-awx-0)
2023-02-18 03:30:51,707 DEBUG awx.main.dispatch delivered 13f8d392-ee23-4265-9415-41ad0f96ed6c to worker[192] qsize 0
2023-02-18 03:30:51,709 DEBUG awx.main.dispatch task 13f8d392-ee23-4265-9415-41ad0f96ed6c starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:30:51,711 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:30:51,752 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(85ac0174-c5ce-4f60-aa5a-5bb9d4d64d73, queue=onap-awx-0)
[2023-02-18 03:30:51,752: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(85ac0174-c5ce-4f60-aa5a-5bb9d4d64d73, queue=onap-awx-0)
2023-02-18 03:30:51,767 DEBUG awx.main.dispatch delivered 85ac0174-c5ce-4f60-aa5a-5bb9d4d64d73 to worker[195] qsize 0
2023-02-18 03:30:51,770 DEBUG awx.main.dispatch task 85ac0174-c5ce-4f60-aa5a-5bb9d4d64d73 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:30:51,863 DEBUG awx.main.dispatch task 85ac0174-c5ce-4f60-aa5a-5bb9d4d64d73 is finished
2023-02-18 03:30:51,883 DEBUG awx.main.dispatch task 13f8d392-ee23-4265-9415-41ad0f96ed6c is finished
2023-02-18 03:30:52,072 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(7cc33d42-430e-4bc2-99bc-4d324974b134, queue=awx_private_queue)
[2023-02-18 03:30:52,072: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(7cc33d42-430e-4bc2-99bc-4d324974b134, queue=awx_private_queue)
2023-02-18 03:30:52,089 DEBUG awx.main.dispatch delivered 7cc33d42-430e-4bc2-99bc-4d324974b134 to worker[183] qsize 0
2023-02-18 03:30:52,091 DEBUG awx.main.dispatch task 7cc33d42-430e-4bc2-99bc-4d324974b134 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:30:52,188 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:30:52,195 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:28:52.229290+00:00
2023-02-18 03:30:52,310 DEBUG awx.main.dispatch task 7cc33d42-430e-4bc2-99bc-4d324974b134 is finished
2023-02-18 03:30:59,204 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(85b9995d-aa89-488d-a286-cd3fa7c99e7b, queue=awx_private_queue)
[2023-02-18 03:30:59,204: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(85b9995d-aa89-488d-a286-cd3fa7c99e7b, queue=awx_private_queue)
2023-02-18 03:30:59,221 DEBUG awx.main.dispatch delivered 85b9995d-aa89-488d-a286-cd3fa7c99e7b to worker[183] qsize 0
2023-02-18 03:30:59,223 DEBUG awx.main.dispatch task 85b9995d-aa89-488d-a286-cd3fa7c99e7b starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:30:59,224 DEBUG awx.main.scheduler Running Tower task manager.
RESULT 2
OKREADY
2023-02-18 03:31:00,258 ERROR awx.main.dispatch Worker failed to run task awx.main.scheduler.tasks.run_task_manager(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/tasks.py", line 15, in run_task_manager
TaskManager().schedule()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/task_manager.py", line 45, in __init__
for rampart_group in InstanceGroup.objects.prefetch_related('instances'):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 274, in __iter__
self._fetch_all()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 1242, in _fetch_all
self._result_cache = list(self._iterable_class(self))
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 55, in __iter__
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1098, in execute_sql
cursor = self.connection.cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor
return self._cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:31:01,283 DEBUG awx.main.dispatch task 85b9995d-aa89-488d-a286-cd3fa7c99e7b is finished
2023-02-18 03:31:19,222 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c8b2f98a-ddca-4845-8a57-21a5bd19009e, queue=awx_private_queue)
[2023-02-18 03:31:19,222: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c8b2f98a-ddca-4845-8a57-21a5bd19009e, queue=awx_private_queue)
2023-02-18 03:31:19,398 DEBUG awx.main.dispatch delivered c8b2f98a-ddca-4845-8a57-21a5bd19009e to worker[195] qsize 0
2023-02-18 03:31:19,642 DEBUG awx.main.dispatch task c8b2f98a-ddca-4845-8a57-21a5bd19009e starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:31:19,646 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:31:19,915 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:31:20,173 DEBUG awx.main.dispatch task c8b2f98a-ddca-4845-8a57-21a5bd19009e is finished
2023-02-18 03:31:22,072 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(f972782e-53ff-44c6-89b4-7cf27b952fe4, queue=awx_private_queue)
[2023-02-18 03:31:22,072: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(f972782e-53ff-44c6-89b4-7cf27b952fe4, queue=awx_private_queue)
2023-02-18 03:31:22,089 DEBUG awx.main.dispatch delivered f972782e-53ff-44c6-89b4-7cf27b952fe4 to worker[183] qsize 0
2023-02-18 03:31:22,092 DEBUG awx.main.dispatch task f972782e-53ff-44c6-89b4-7cf27b952fe4 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:31:22,224 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:31:22,265 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:30:52.189055+00:00
2023-02-18 03:31:22,409 DEBUG awx.main.dispatch task f972782e-53ff-44c6-89b4-7cf27b952fe4 is finished
2023-02-18 03:31:39,222 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(17f81102-f971-4986-bdcc-c654e07a443c, queue=awx_private_queue)
[2023-02-18 03:31:39,222: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(17f81102-f971-4986-bdcc-c654e07a443c, queue=awx_private_queue)
2023-02-18 03:31:39,241 DEBUG awx.main.dispatch delivered 17f81102-f971-4986-bdcc-c654e07a443c to worker[192] qsize 0
2023-02-18 03:31:39,245 DEBUG awx.main.dispatch task 17f81102-f971-4986-bdcc-c654e07a443c starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:31:39,249 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:31:39,452 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:31:39,575 DEBUG awx.main.dispatch task 17f81102-f971-4986-bdcc-c654e07a443c is finished
2023-02-18 03:31:51,637 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(923fd239-a6ef-44c5-9139-5bfea589b602, queue=onap-awx-0)
[2023-02-18 03:31:51,637: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(923fd239-a6ef-44c5-9139-5bfea589b602, queue=onap-awx-0)
2023-02-18 03:31:51,753 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(4b13ebb2-927e-4396-adff-afb9d6d5bb9f, queue=onap-awx-0)
[2023-02-18 03:31:51,753: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(4b13ebb2-927e-4396-adff-afb9d6d5bb9f, queue=onap-awx-0)
2023-02-18 03:31:51,804 DEBUG awx.main.dispatch delivered 923fd239-a6ef-44c5-9139-5bfea589b602 to worker[183] qsize 0
2023-02-18 03:31:51,807 DEBUG awx.main.dispatch delivered 4b13ebb2-927e-4396-adff-afb9d6d5bb9f to worker[197] qsize 0
2023-02-18 03:31:51,807 DEBUG awx.main.dispatch task 923fd239-a6ef-44c5-9139-5bfea589b602 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:31:51,809 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:31:51,809 DEBUG awx.main.dispatch task 4b13ebb2-927e-4396-adff-afb9d6d5bb9f starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:31:51,910 DEBUG awx.main.dispatch task 4b13ebb2-927e-4396-adff-afb9d6d5bb9f is finished
2023-02-18 03:31:52,072 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(20b164d5-97cc-4a07-bd2a-0e8416d64641, queue=awx_private_queue)
[2023-02-18 03:31:52,072: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(20b164d5-97cc-4a07-bd2a-0e8416d64641, queue=awx_private_queue)
2023-02-18 03:31:52,090 DEBUG awx.main.dispatch delivered 20b164d5-97cc-4a07-bd2a-0e8416d64641 to worker[192] qsize 0
2023-02-18 03:31:52,094 DEBUG awx.main.dispatch task 20b164d5-97cc-4a07-bd2a-0e8416d64641 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:31:52,098 DEBUG awx.main.dispatch task 923fd239-a6ef-44c5-9139-5bfea589b602 is finished
2023-02-18 03:31:52,184 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:31:52,222 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:31:22.224760+00:00
2023-02-18 03:31:52,341 DEBUG awx.main.dispatch task 20b164d5-97cc-4a07-bd2a-0e8416d64641 is finished
2023-02-18 03:31:59,221 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5141e9b1-8f4d-47dc-8305-a7fd0b4fa7c7, queue=awx_private_queue)
[2023-02-18 03:31:59,221: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5141e9b1-8f4d-47dc-8305-a7fd0b4fa7c7, queue=awx_private_queue)
2023-02-18 03:31:59,237 DEBUG awx.main.dispatch delivered 5141e9b1-8f4d-47dc-8305-a7fd0b4fa7c7 to worker[192] qsize 0
2023-02-18 03:31:59,240 DEBUG awx.main.dispatch task 5141e9b1-8f4d-47dc-8305-a7fd0b4fa7c7 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:31:59,242 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:31:59,316 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:31:59,497 DEBUG awx.main.dispatch task 5141e9b1-8f4d-47dc-8305-a7fd0b4fa7c7 is finished
RESULT 2
OKREADY
2023-02-18 03:32:19,226 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e38636df-1649-4383-8eb3-025a43e0da4c, queue=awx_private_queue)
[2023-02-18 03:32:19,226: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e38636df-1649-4383-8eb3-025a43e0da4c, queue=awx_private_queue)
2023-02-18 03:32:19,397 DEBUG awx.main.dispatch delivered e38636df-1649-4383-8eb3-025a43e0da4c to worker[183] qsize 0
2023-02-18 03:32:19,400 DEBUG awx.main.dispatch task e38636df-1649-4383-8eb3-025a43e0da4c starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:32:19,402 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:32:19,632 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:32:19,925 DEBUG awx.main.dispatch task e38636df-1649-4383-8eb3-025a43e0da4c is finished
2023-02-18 03:32:22,072 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(f3df94cf-4644-4be0-9eba-f417423f33cf, queue=awx_private_queue)
[2023-02-18 03:32:22,072: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(f3df94cf-4644-4be0-9eba-f417423f33cf, queue=awx_private_queue)
2023-02-18 03:32:22,088 DEBUG awx.main.dispatch delivered f3df94cf-4644-4be0-9eba-f417423f33cf to worker[192] qsize 0
2023-02-18 03:32:22,328 DEBUG awx.main.dispatch task f3df94cf-4644-4be0-9eba-f417423f33cf starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:32:22,399 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:32:22,422 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:31:52.185013+00:00
2023-02-18 03:32:22,611 DEBUG awx.main.dispatch task f3df94cf-4644-4be0-9eba-f417423f33cf is finished
2023-02-18 03:32:39,232 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(9a2b7c79-182b-4560-a5a7-be5749e2a689, queue=awx_private_queue)
[2023-02-18 03:32:39,232: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(9a2b7c79-182b-4560-a5a7-be5749e2a689, queue=awx_private_queue)
2023-02-18 03:32:39,250 DEBUG awx.main.dispatch delivered 9a2b7c79-182b-4560-a5a7-be5749e2a689 to worker[192] qsize 0
2023-02-18 03:32:39,253 DEBUG awx.main.dispatch task 9a2b7c79-182b-4560-a5a7-be5749e2a689 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:32:39,255 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:32:39,546 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:32:39,919 DEBUG awx.main.dispatch task 9a2b7c79-182b-4560-a5a7-be5749e2a689 is finished
2023-02-18 03:32:51,637 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(370b6c63-a696-40e0-85f8-b90cb5050229, queue=onap-awx-0)
[2023-02-18 03:32:51,637: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(370b6c63-a696-40e0-85f8-b90cb5050229, queue=onap-awx-0)
2023-02-18 03:32:51,753 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(f3a3f86d-688a-4390-ac63-f75f7eec3101, queue=onap-awx-0)
[2023-02-18 03:32:51,753: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(f3a3f86d-688a-4390-ac63-f75f7eec3101, queue=onap-awx-0)
2023-02-18 03:32:51,889 DEBUG awx.main.dispatch delivered 370b6c63-a696-40e0-85f8-b90cb5050229 to worker[197] qsize 0
2023-02-18 03:32:51,892 DEBUG awx.main.dispatch delivered f3a3f86d-688a-4390-ac63-f75f7eec3101 to worker[195] qsize 0
2023-02-18 03:32:51,894 DEBUG awx.main.dispatch task f3a3f86d-688a-4390-ac63-f75f7eec3101 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:32:51,892 DEBUG awx.main.dispatch task 370b6c63-a696-40e0-85f8-b90cb5050229 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:32:51,897 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:32:52,072 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(175abeb5-faa3-4574-bdea-89801e0538b5, queue=awx_private_queue)
[2023-02-18 03:32:52,072: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(175abeb5-faa3-4574-bdea-89801e0538b5, queue=awx_private_queue)
2023-02-18 03:32:52,097 DEBUG awx.main.dispatch delivered 175abeb5-faa3-4574-bdea-89801e0538b5 to worker[183] qsize 0
2023-02-18 03:32:52,101 DEBUG awx.main.dispatch task 175abeb5-faa3-4574-bdea-89801e0538b5 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:32:52,269 DEBUG awx.main.dispatch task 370b6c63-a696-40e0-85f8-b90cb5050229 is finished
2023-02-18 03:32:52,284 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:32:52,294 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:32:22.399282+00:00
2023-02-18 03:32:52,456 DEBUG awx.main.dispatch task 175abeb5-faa3-4574-bdea-89801e0538b5 is finished
2023-02-18 03:32:52,492 DEBUG awx.main.dispatch task f3a3f86d-688a-4390-ac63-f75f7eec3101 is finished
2023-02-18 03:32:59,233 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(dcb6c3e7-a920-461a-87fd-be876efbe8d4, queue=awx_private_queue)
[2023-02-18 03:32:59,233: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(dcb6c3e7-a920-461a-87fd-be876efbe8d4, queue=awx_private_queue)
2023-02-18 03:32:59,249 DEBUG awx.main.dispatch delivered dcb6c3e7-a920-461a-87fd-be876efbe8d4 to worker[197] qsize 0
2023-02-18 03:32:59,252 DEBUG awx.main.dispatch task dcb6c3e7-a920-461a-87fd-be876efbe8d4 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:32:59,253 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:33:00,287 ERROR awx.main.dispatch Worker failed to run task awx.main.scheduler.tasks.run_task_manager(*[], **{}
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 86, in perform_work
result = self.run_callable(body)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/dispatch/worker/task.py", line 62, in run_callable
return _call(*args, **kwargs)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/tasks.py", line 15, in run_task_manager
TaskManager().schedule()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/awx/main/scheduler/task_manager.py", line 45, in __init__
for rampart_group in InstanceGroup.objects.prefetch_related('instances'):
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 274, in __iter__
self._fetch_all()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 1242, in _fetch_all
self._result_cache = list(self._iterable_class(self))
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/query.py", line 55, in __iter__
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1098, in execute_sql
cursor = self.connection.cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 256, in cursor
return self._cursor()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 233, in _cursor
self.ensure_connection()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 217, in ensure_connection
self.connect()
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/base/base.py", line 195, in connect
self.connection = self.get_new_connection(conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/django/db/backends/postgresql/base.py", line 178, in get_new_connection
connection = Database.connect(**conn_params)
File "/var/lib/awx/venv/awx/lib64/python3.6/site-packages/psycopg2/__init__.py", line 126, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not connect to server: Connection refused
Is the server running on host "awx-postgresql" (10.233.30.144) and accepting
TCP/IP connections on port 5432?
2023-02-18 03:33:00,290 DEBUG awx.main.dispatch task dcb6c3e7-a920-461a-87fd-be876efbe8d4 is finished
RESULT 2
OKREADY
2023-02-18 03:33:19,233 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(898a83d2-9247-40f2-afd7-b496a70e634b, queue=awx_private_queue)
[2023-02-18 03:33:19,233: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(898a83d2-9247-40f2-afd7-b496a70e634b, queue=awx_private_queue)
2023-02-18 03:33:19,248 DEBUG awx.main.dispatch delivered 898a83d2-9247-40f2-afd7-b496a70e634b to worker[197] qsize 0
2023-02-18 03:33:19,250 DEBUG awx.main.dispatch task 898a83d2-9247-40f2-afd7-b496a70e634b starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:33:19,252 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:33:19,458 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:33:19,723 DEBUG awx.main.dispatch task 898a83d2-9247-40f2-afd7-b496a70e634b is finished
2023-02-18 03:33:22,072 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(5e5ebec5-f42c-435e-93c7-df34b2817810, queue=awx_private_queue)
[2023-02-18 03:33:22,072: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(5e5ebec5-f42c-435e-93c7-df34b2817810, queue=awx_private_queue)
2023-02-18 03:33:22,090 DEBUG awx.main.dispatch delivered 5e5ebec5-f42c-435e-93c7-df34b2817810 to worker[197] qsize 0
2023-02-18 03:33:22,093 DEBUG awx.main.dispatch task 5e5ebec5-f42c-435e-93c7-df34b2817810 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:33:22,219 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:33:22,267 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:32:52.284502+00:00
2023-02-18 03:33:22,396 DEBUG awx.main.dispatch task 5e5ebec5-f42c-435e-93c7-df34b2817810 is finished
2023-02-18 03:33:39,233 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(4d821e2c-f76d-4b25-8af2-ad8ff19bec9b, queue=awx_private_queue)
[2023-02-18 03:33:39,233: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(4d821e2c-f76d-4b25-8af2-ad8ff19bec9b, queue=awx_private_queue)
2023-02-18 03:33:39,659 DEBUG awx.main.dispatch delivered 4d821e2c-f76d-4b25-8af2-ad8ff19bec9b to worker[197] qsize 0
2023-02-18 03:33:39,661 DEBUG awx.main.dispatch task 4d821e2c-f76d-4b25-8af2-ad8ff19bec9b starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:33:39,662 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:33:39,749 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:33:39,912 DEBUG awx.main.dispatch task 4d821e2c-f76d-4b25-8af2-ad8ff19bec9b is finished
2023-02-18 03:33:51,638 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(51511303-a958-43ec-8225-cef458f9a407, queue=onap-awx-0)
[2023-02-18 03:33:51,638: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(51511303-a958-43ec-8225-cef458f9a407, queue=onap-awx-0)
2023-02-18 03:33:51,752 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(659b427c-bc8b-4f5a-893e-1f3929e51c4f, queue=onap-awx-0)
[2023-02-18 03:33:51,752: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(659b427c-bc8b-4f5a-893e-1f3929e51c4f, queue=onap-awx-0)
2023-02-18 03:33:51,770 DEBUG awx.main.dispatch delivered 51511303-a958-43ec-8225-cef458f9a407 to worker[183] qsize 0
2023-02-18 03:33:51,773 DEBUG awx.main.dispatch delivered 659b427c-bc8b-4f5a-893e-1f3929e51c4f to worker[195] qsize 0
2023-02-18 03:33:51,773 DEBUG awx.main.dispatch task 51511303-a958-43ec-8225-cef458f9a407 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:33:51,774 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:33:51,775 DEBUG awx.main.dispatch task 659b427c-bc8b-4f5a-893e-1f3929e51c4f starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:33:51,883 DEBUG awx.main.dispatch task 659b427c-bc8b-4f5a-893e-1f3929e51c4f is finished
2023-02-18 03:33:51,955 DEBUG awx.main.dispatch task 51511303-a958-43ec-8225-cef458f9a407 is finished
2023-02-18 03:33:52,072 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(81928e12-6d20-49b4-a197-13d07bff4b27, queue=awx_private_queue)
[2023-02-18 03:33:52,072: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(81928e12-6d20-49b4-a197-13d07bff4b27, queue=awx_private_queue)
2023-02-18 03:33:52,087 DEBUG awx.main.dispatch delivered 81928e12-6d20-49b4-a197-13d07bff4b27 to worker[197] qsize 0
2023-02-18 03:33:52,089 DEBUG awx.main.dispatch task 81928e12-6d20-49b4-a197-13d07bff4b27 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:33:52,158 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:33:52,169 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:33:22.220242+00:00
2023-02-18 03:33:52,203 DEBUG awx.main.dispatch task 81928e12-6d20-49b4-a197-13d07bff4b27 is finished
2023-02-18 03:33:59,233 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7d8aab45-1afa-4fcd-8cff-75b967ad63e6, queue=awx_private_queue)
[2023-02-18 03:33:59,233: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7d8aab45-1afa-4fcd-8cff-75b967ad63e6, queue=awx_private_queue)
2023-02-18 03:33:59,249 DEBUG awx.main.dispatch delivered 7d8aab45-1afa-4fcd-8cff-75b967ad63e6 to worker[192] qsize 0
2023-02-18 03:33:59,251 DEBUG awx.main.dispatch task 7d8aab45-1afa-4fcd-8cff-75b967ad63e6 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:33:59,254 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:33:59,510 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:33:59,958 DEBUG awx.main.dispatch task 7d8aab45-1afa-4fcd-8cff-75b967ad63e6 is finished
RESULT 2
OKREADY
2023-02-18 03:34:19,266 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ca2061dd-9b10-4156-92cd-201ed7924a8a, queue=awx_private_queue)
[2023-02-18 03:34:19,266: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ca2061dd-9b10-4156-92cd-201ed7924a8a, queue=awx_private_queue)
2023-02-18 03:34:19,282 DEBUG awx.main.dispatch delivered ca2061dd-9b10-4156-92cd-201ed7924a8a to worker[192] qsize 0
2023-02-18 03:34:19,285 DEBUG awx.main.dispatch task ca2061dd-9b10-4156-92cd-201ed7924a8a starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:34:19,286 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:34:19,335 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:34:19,490 DEBUG awx.main.dispatch task ca2061dd-9b10-4156-92cd-201ed7924a8a is finished
2023-02-18 03:34:22,072 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(ce60fae5-d782-4528-bd83-69a00b30ab1d, queue=awx_private_queue)
[2023-02-18 03:34:22,072: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(ce60fae5-d782-4528-bd83-69a00b30ab1d, queue=awx_private_queue)
2023-02-18 03:34:22,088 DEBUG awx.main.dispatch delivered ce60fae5-d782-4528-bd83-69a00b30ab1d to worker[195] qsize 0
2023-02-18 03:34:22,090 DEBUG awx.main.dispatch task ce60fae5-d782-4528-bd83-69a00b30ab1d starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:34:22,148 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:34:22,177 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:33:52.158530+00:00
2023-02-18 03:34:22,293 DEBUG awx.main.dispatch task ce60fae5-d782-4528-bd83-69a00b30ab1d is finished
2023-02-18 03:34:39,272 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5ae32253-6357-43d7-9071-fa8014ca6675, queue=awx_private_queue)
[2023-02-18 03:34:39,272: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5ae32253-6357-43d7-9071-fa8014ca6675, queue=awx_private_queue)
2023-02-18 03:34:39,287 DEBUG awx.main.dispatch delivered 5ae32253-6357-43d7-9071-fa8014ca6675 to worker[192] qsize 0
2023-02-18 03:34:39,290 DEBUG awx.main.dispatch task 5ae32253-6357-43d7-9071-fa8014ca6675 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:34:39,291 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:34:39,483 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:34:39,643 DEBUG awx.main.dispatch task 5ae32253-6357-43d7-9071-fa8014ca6675 is finished
2023-02-18 03:34:51,477 DEBUG awx.main.dispatch publish awx.main.tasks.awx_isolated_heartbeat(4b554a58-e2d6-4dbc-8e1a-a356b5b76d62, queue=onap-awx-0)
[2023-02-18 03:34:51,477: DEBUG/Process-1] publish awx.main.tasks.awx_isolated_heartbeat(4b554a58-e2d6-4dbc-8e1a-a356b5b76d62, queue=onap-awx-0)
2023-02-18 03:34:51,500 DEBUG awx.main.dispatch delivered 4b554a58-e2d6-4dbc-8e1a-a356b5b76d62 to worker[183] qsize 0
2023-02-18 03:34:51,637 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(6b401ea8-ab3d-453c-9094-3ad85111e22d, queue=onap-awx-0)
[2023-02-18 03:34:51,637: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(6b401ea8-ab3d-453c-9094-3ad85111e22d, queue=onap-awx-0)
2023-02-18 03:34:51,747 DEBUG awx.main.dispatch delivered 6b401ea8-ab3d-453c-9094-3ad85111e22d to worker[192] qsize 0
2023-02-18 03:34:51,749 DEBUG awx.main.dispatch task 6b401ea8-ab3d-453c-9094-3ad85111e22d starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:34:51,751 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:34:51,752 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(08b015ce-6490-4f76-b251-3c0e2ed0681b, queue=onap-awx-0)
[2023-02-18 03:34:51,752: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(08b015ce-6490-4f76-b251-3c0e2ed0681b, queue=onap-awx-0)
2023-02-18 03:34:51,502 DEBUG awx.main.dispatch task 4b554a58-e2d6-4dbc-8e1a-a356b5b76d62 starting awx.main.tasks.awx_isolated_heartbeat(*[])
2023-02-18 03:34:51,759 DEBUG awx.main.tasks Controlling node checking for any isolated management tasks.
2023-02-18 03:34:51,768 DEBUG awx.main.dispatch delivered 08b015ce-6490-4f76-b251-3c0e2ed0681b to worker[195] qsize 0
2023-02-18 03:34:51,770 DEBUG awx.main.dispatch task 08b015ce-6490-4f76-b251-3c0e2ed0681b starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:34:51,793 DEBUG awx.main.dispatch task 4b554a58-e2d6-4dbc-8e1a-a356b5b76d62 is finished
2023-02-18 03:34:51,826 DEBUG awx.main.dispatch task 08b015ce-6490-4f76-b251-3c0e2ed0681b is finished
2023-02-18 03:34:51,884 DEBUG awx.main.dispatch task 6b401ea8-ab3d-453c-9094-3ad85111e22d is finished
2023-02-18 03:34:52,072 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(c4cb28ef-fd2d-434b-bbbe-cc980670d759, queue=awx_private_queue)
[2023-02-18 03:34:52,072: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(c4cb28ef-fd2d-434b-bbbe-cc980670d759, queue=awx_private_queue)
2023-02-18 03:34:52,088 DEBUG awx.main.dispatch delivered c4cb28ef-fd2d-434b-bbbe-cc980670d759 to worker[195] qsize 0
2023-02-18 03:34:52,091 DEBUG awx.main.dispatch task c4cb28ef-fd2d-434b-bbbe-cc980670d759 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:34:52,190 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:34:52,213 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:34:22.148592+00:00
2023-02-18 03:34:52,300 DEBUG awx.main.dispatch task c4cb28ef-fd2d-434b-bbbe-cc980670d759 is finished
2023-02-18 03:34:59,273 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(414d4a76-debe-4baa-8d40-0b690f733be4, queue=awx_private_queue)
[2023-02-18 03:34:59,273: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(414d4a76-debe-4baa-8d40-0b690f733be4, queue=awx_private_queue)
2023-02-18 03:34:59,290 DEBUG awx.main.dispatch delivered 414d4a76-debe-4baa-8d40-0b690f733be4 to worker[192] qsize 0
2023-02-18 03:34:59,295 DEBUG awx.main.dispatch task 414d4a76-debe-4baa-8d40-0b690f733be4 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:34:59,298 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:34:59,438 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:34:59,638 DEBUG awx.main.dispatch task 414d4a76-debe-4baa-8d40-0b690f733be4 is finished
RESULT 2
OKREADY
2023-02-18 03:35:19,275 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(09d527cb-5fb4-4c53-88f3-871ed2a1a683, queue=awx_private_queue)
[2023-02-18 03:35:19,275: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(09d527cb-5fb4-4c53-88f3-871ed2a1a683, queue=awx_private_queue)
2023-02-18 03:35:19,296 DEBUG awx.main.dispatch delivered 09d527cb-5fb4-4c53-88f3-871ed2a1a683 to worker[197] qsize 0
2023-02-18 03:35:19,301 DEBUG awx.main.dispatch task 09d527cb-5fb4-4c53-88f3-871ed2a1a683 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:35:19,304 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:35:19,374 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:35:19,507 DEBUG awx.main.dispatch task 09d527cb-5fb4-4c53-88f3-871ed2a1a683 is finished
2023-02-18 03:35:22,072 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(7ca53db7-c77c-4184-b8a1-503a8d09f261, queue=awx_private_queue)
[2023-02-18 03:35:22,072: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(7ca53db7-c77c-4184-b8a1-503a8d09f261, queue=awx_private_queue)
2023-02-18 03:35:22,089 DEBUG awx.main.dispatch delivered 7ca53db7-c77c-4184-b8a1-503a8d09f261 to worker[192] qsize 0
2023-02-18 03:35:22,091 DEBUG awx.main.dispatch task 7ca53db7-c77c-4184-b8a1-503a8d09f261 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:35:22,248 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:35:22,257 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:34:52.191035+00:00
2023-02-18 03:35:22,392 DEBUG awx.main.dispatch task 7ca53db7-c77c-4184-b8a1-503a8d09f261 is finished
2023-02-18 03:35:39,281 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7953216a-ef06-4d17-88f6-a85b0a048af2, queue=awx_private_queue)
[2023-02-18 03:35:39,281: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7953216a-ef06-4d17-88f6-a85b0a048af2, queue=awx_private_queue)
2023-02-18 03:35:39,301 DEBUG awx.main.dispatch delivered 7953216a-ef06-4d17-88f6-a85b0a048af2 to worker[197] qsize 0
2023-02-18 03:35:39,304 DEBUG awx.main.dispatch task 7953216a-ef06-4d17-88f6-a85b0a048af2 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:35:39,306 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:35:39,445 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:35:39,687 DEBUG awx.main.dispatch task 7953216a-ef06-4d17-88f6-a85b0a048af2 is finished
2023-02-18 03:35:51,637 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(c55a0f04-2c0e-461c-9d78-914820241218, queue=onap-awx-0)
[2023-02-18 03:35:51,637: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(c55a0f04-2c0e-461c-9d78-914820241218, queue=onap-awx-0)
2023-02-18 03:35:51,753 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(81a2174d-61cf-4a4c-9945-08fad72f942f, queue=onap-awx-0)
[2023-02-18 03:35:51,753: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(81a2174d-61cf-4a4c-9945-08fad72f942f, queue=onap-awx-0)
2023-02-18 03:35:51,800 DEBUG awx.main.dispatch delivered c55a0f04-2c0e-461c-9d78-914820241218 to worker[195] qsize 0
2023-02-18 03:35:51,802 DEBUG awx.main.dispatch delivered 81a2174d-61cf-4a4c-9945-08fad72f942f to worker[197] qsize 0
2023-02-18 03:35:51,805 DEBUG awx.main.dispatch task 81a2174d-61cf-4a4c-9945-08fad72f942f starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:35:51,882 DEBUG awx.main.dispatch task 81a2174d-61cf-4a4c-9945-08fad72f942f is finished
2023-02-18 03:35:51,804 DEBUG awx.main.dispatch task c55a0f04-2c0e-461c-9d78-914820241218 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:35:52,056 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:35:52,072 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(6a85a00d-adef-429b-b8b4-efed514f7c59, queue=awx_private_queue)
[2023-02-18 03:35:52,072: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(6a85a00d-adef-429b-b8b4-efed514f7c59, queue=awx_private_queue)
2023-02-18 03:35:52,088 DEBUG awx.main.dispatch delivered 6a85a00d-adef-429b-b8b4-efed514f7c59 to worker[183] qsize 0
2023-02-18 03:35:52,091 DEBUG awx.main.dispatch task 6a85a00d-adef-429b-b8b4-efed514f7c59 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:35:52,108 DEBUG awx.main.dispatch task c55a0f04-2c0e-461c-9d78-914820241218 is finished
2023-02-18 03:35:52,123 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:35:52,128 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:35:22.248371+00:00
2023-02-18 03:35:52,194 DEBUG awx.main.dispatch task 6a85a00d-adef-429b-b8b4-efed514f7c59 is finished
2023-02-18 03:35:59,281 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c097b468-4964-4a29-9b6f-5d62ab0b2556, queue=awx_private_queue)
[2023-02-18 03:35:59,281: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c097b468-4964-4a29-9b6f-5d62ab0b2556, queue=awx_private_queue)
2023-02-18 03:35:59,297 DEBUG awx.main.dispatch delivered c097b468-4964-4a29-9b6f-5d62ab0b2556 to worker[183] qsize 0
2023-02-18 03:35:59,300 DEBUG awx.main.dispatch task c097b468-4964-4a29-9b6f-5d62ab0b2556 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:35:59,301 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:35:59,476 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:35:59,639 DEBUG awx.main.dispatch task c097b468-4964-4a29-9b6f-5d62ab0b2556 is finished
RESULT 2
OKREADY
2023-02-18 03:36:19,281 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(06922acf-ccd6-4522-ad5f-20ee60cd5bac, queue=awx_private_queue)
[2023-02-18 03:36:19,281: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(06922acf-ccd6-4522-ad5f-20ee60cd5bac, queue=awx_private_queue)
2023-02-18 03:36:19,297 DEBUG awx.main.dispatch delivered 06922acf-ccd6-4522-ad5f-20ee60cd5bac to worker[183] qsize 0
2023-02-18 03:36:19,300 DEBUG awx.main.dispatch task 06922acf-ccd6-4522-ad5f-20ee60cd5bac starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:36:19,303 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:36:19,399 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:36:19,529 DEBUG awx.main.dispatch task 06922acf-ccd6-4522-ad5f-20ee60cd5bac is finished
2023-02-18 03:36:22,073 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(ef4cdc6e-6096-4b0c-bd36-87bebd4e0c7c, queue=awx_private_queue)
[2023-02-18 03:36:22,073: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(ef4cdc6e-6096-4b0c-bd36-87bebd4e0c7c, queue=awx_private_queue)
2023-02-18 03:36:22,088 DEBUG awx.main.dispatch delivered ef4cdc6e-6096-4b0c-bd36-87bebd4e0c7c to worker[197] qsize 0
2023-02-18 03:36:22,090 DEBUG awx.main.dispatch task ef4cdc6e-6096-4b0c-bd36-87bebd4e0c7c starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:36:22,135 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:36:22,162 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:35:52.123657+00:00
2023-02-18 03:36:22,254 DEBUG awx.main.dispatch task ef4cdc6e-6096-4b0c-bd36-87bebd4e0c7c is finished
2023-02-18 03:36:39,286 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6d9280d0-6393-4511-a267-bdb20d841154, queue=awx_private_queue)
[2023-02-18 03:36:39,286: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6d9280d0-6393-4511-a267-bdb20d841154, queue=awx_private_queue)
2023-02-18 03:36:39,302 DEBUG awx.main.dispatch delivered 6d9280d0-6393-4511-a267-bdb20d841154 to worker[192] qsize 0
2023-02-18 03:36:39,306 DEBUG awx.main.dispatch task 6d9280d0-6393-4511-a267-bdb20d841154 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:36:39,308 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:36:39,528 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:36:39,648 DEBUG awx.main.dispatch task 6d9280d0-6393-4511-a267-bdb20d841154 is finished
2023-02-18 03:36:51,640 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(05e8d25c-b488-4bc0-9920-092be3d9a773, queue=onap-awx-0)
[2023-02-18 03:36:51,640: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(05e8d25c-b488-4bc0-9920-092be3d9a773, queue=onap-awx-0)
2023-02-18 03:36:51,753 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(ddde5cfb-5ee7-4217-85f4-343c141a5081, queue=onap-awx-0)
[2023-02-18 03:36:51,753: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(ddde5cfb-5ee7-4217-85f4-343c141a5081, queue=onap-awx-0)
2023-02-18 03:36:51,808 DEBUG awx.main.dispatch delivered 05e8d25c-b488-4bc0-9920-092be3d9a773 to worker[197] qsize 0
2023-02-18 03:36:51,810 DEBUG awx.main.dispatch delivered ddde5cfb-5ee7-4217-85f4-343c141a5081 to worker[192] qsize 0
2023-02-18 03:36:51,810 DEBUG awx.main.dispatch task 05e8d25c-b488-4bc0-9920-092be3d9a773 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:36:51,811 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:36:51,812 DEBUG awx.main.dispatch task ddde5cfb-5ee7-4217-85f4-343c141a5081 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:36:51,922 DEBUG awx.main.dispatch task ddde5cfb-5ee7-4217-85f4-343c141a5081 is finished
2023-02-18 03:36:51,958 DEBUG awx.main.dispatch task 05e8d25c-b488-4bc0-9920-092be3d9a773 is finished
2023-02-18 03:36:52,073 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(c5aab755-3a15-40de-8459-973f590a4a24, queue=awx_private_queue)
[2023-02-18 03:36:52,073: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(c5aab755-3a15-40de-8459-973f590a4a24, queue=awx_private_queue)
2023-02-18 03:36:52,087 DEBUG awx.main.dispatch delivered c5aab755-3a15-40de-8459-973f590a4a24 to worker[183] qsize 0
2023-02-18 03:36:52,089 DEBUG awx.main.dispatch task c5aab755-3a15-40de-8459-973f590a4a24 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:36:52,177 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:36:52,193 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:36:22.136015+00:00
2023-02-18 03:36:52,389 DEBUG awx.main.dispatch task c5aab755-3a15-40de-8459-973f590a4a24 is finished
2023-02-18 03:36:59,286 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b832670b-e4cc-4e47-8833-2d4d9c6abc6c, queue=awx_private_queue)
[2023-02-18 03:36:59,286: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b832670b-e4cc-4e47-8833-2d4d9c6abc6c, queue=awx_private_queue)
2023-02-18 03:36:59,307 DEBUG awx.main.dispatch delivered b832670b-e4cc-4e47-8833-2d4d9c6abc6c to worker[197] qsize 0
2023-02-18 03:36:59,310 DEBUG awx.main.dispatch task b832670b-e4cc-4e47-8833-2d4d9c6abc6c starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:36:59,311 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:36:59,360 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:36:59,524 DEBUG awx.main.dispatch task b832670b-e4cc-4e47-8833-2d4d9c6abc6c is finished
RESULT 2
OKREADY
2023-02-18 03:37:19,299 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a64f8de7-ed6a-4662-91ed-4eaa7699b0fe, queue=awx_private_queue)
[2023-02-18 03:37:19,299: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a64f8de7-ed6a-4662-91ed-4eaa7699b0fe, queue=awx_private_queue)
2023-02-18 03:37:19,315 DEBUG awx.main.dispatch delivered a64f8de7-ed6a-4662-91ed-4eaa7699b0fe to worker[183] qsize 0
2023-02-18 03:37:19,317 DEBUG awx.main.dispatch task a64f8de7-ed6a-4662-91ed-4eaa7699b0fe starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:37:19,319 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:37:19,388 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:37:19,512 DEBUG awx.main.dispatch task a64f8de7-ed6a-4662-91ed-4eaa7699b0fe is finished
2023-02-18 03:37:22,073 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(06f4dc18-fde4-4a45-ae44-b62a4828e55c, queue=awx_private_queue)
[2023-02-18 03:37:22,073: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(06f4dc18-fde4-4a45-ae44-b62a4828e55c, queue=awx_private_queue)
2023-02-18 03:37:22,088 DEBUG awx.main.dispatch delivered 06f4dc18-fde4-4a45-ae44-b62a4828e55c to worker[197] qsize 0
2023-02-18 03:37:22,091 DEBUG awx.main.dispatch task 06f4dc18-fde4-4a45-ae44-b62a4828e55c starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:37:22,126 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:37:22,130 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:36:52.177776+00:00
2023-02-18 03:37:22,173 DEBUG awx.main.dispatch task 06f4dc18-fde4-4a45-ae44-b62a4828e55c is finished
2023-02-18 03:37:39,304 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6263c6e7-e2cf-4e98-8f2d-74b1277390ce, queue=awx_private_queue)
[2023-02-18 03:37:39,304: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6263c6e7-e2cf-4e98-8f2d-74b1277390ce, queue=awx_private_queue)
2023-02-18 03:37:39,333 DEBUG awx.main.dispatch delivered 6263c6e7-e2cf-4e98-8f2d-74b1277390ce to worker[197] qsize 0
2023-02-18 03:37:39,336 DEBUG awx.main.dispatch task 6263c6e7-e2cf-4e98-8f2d-74b1277390ce starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:37:39,337 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:37:39,426 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:37:39,520 DEBUG awx.main.dispatch task 6263c6e7-e2cf-4e98-8f2d-74b1277390ce is finished
2023-02-18 03:37:51,640 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(e836eddb-b5b6-400d-b043-f643ae0f8bc1, queue=onap-awx-0)
[2023-02-18 03:37:51,640: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(e836eddb-b5b6-400d-b043-f643ae0f8bc1, queue=onap-awx-0)
2023-02-18 03:37:51,678 DEBUG awx.main.dispatch delivered e836eddb-b5b6-400d-b043-f643ae0f8bc1 to worker[192] qsize 0
2023-02-18 03:37:51,680 DEBUG awx.main.dispatch task e836eddb-b5b6-400d-b043-f643ae0f8bc1 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:37:51,682 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:37:51,729 DEBUG awx.main.dispatch task e836eddb-b5b6-400d-b043-f643ae0f8bc1 is finished
2023-02-18 03:37:51,753 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(b5c95066-b76d-42ae-b0c3-1df58416327b, queue=onap-awx-0)
[2023-02-18 03:37:51,753: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(b5c95066-b76d-42ae-b0c3-1df58416327b, queue=onap-awx-0)
2023-02-18 03:37:51,771 DEBUG awx.main.dispatch delivered b5c95066-b76d-42ae-b0c3-1df58416327b to worker[183] qsize 0
2023-02-18 03:37:51,773 DEBUG awx.main.dispatch task b5c95066-b76d-42ae-b0c3-1df58416327b starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:37:51,796 DEBUG awx.main.dispatch task b5c95066-b76d-42ae-b0c3-1df58416327b is finished
2023-02-18 03:37:52,073 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(c73d48e1-44ae-4e36-abc5-8fbee0450823, queue=awx_private_queue)
[2023-02-18 03:37:52,073: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(c73d48e1-44ae-4e36-abc5-8fbee0450823, queue=awx_private_queue)
2023-02-18 03:37:52,097 DEBUG awx.main.dispatch delivered c73d48e1-44ae-4e36-abc5-8fbee0450823 to worker[183] qsize 0
2023-02-18 03:37:52,099 DEBUG awx.main.dispatch task c73d48e1-44ae-4e36-abc5-8fbee0450823 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:37:52,119 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:37:52,135 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:37:22.126655+00:00
2023-02-18 03:37:52,212 DEBUG awx.main.dispatch task c73d48e1-44ae-4e36-abc5-8fbee0450823 is finished
2023-02-18 03:37:59,304 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(305fba17-bc43-4bfc-9361-2a2cb7389c73, queue=awx_private_queue)
[2023-02-18 03:37:59,304: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(305fba17-bc43-4bfc-9361-2a2cb7389c73, queue=awx_private_queue)
2023-02-18 03:37:59,403 DEBUG awx.main.dispatch delivered 305fba17-bc43-4bfc-9361-2a2cb7389c73 to worker[192] qsize 0
2023-02-18 03:37:59,406 DEBUG awx.main.dispatch task 305fba17-bc43-4bfc-9361-2a2cb7389c73 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:37:59,407 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:37:59,528 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:37:59,631 DEBUG awx.main.dispatch task 305fba17-bc43-4bfc-9361-2a2cb7389c73 is finished
RESULT 2
OKREADY
2023-02-18 03:38:19,315 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(1721580a-a7a9-4b47-b7ce-ad2cd17e0083, queue=awx_private_queue)
[2023-02-18 03:38:19,315: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(1721580a-a7a9-4b47-b7ce-ad2cd17e0083, queue=awx_private_queue)
2023-02-18 03:38:19,330 DEBUG awx.main.dispatch delivered 1721580a-a7a9-4b47-b7ce-ad2cd17e0083 to worker[192] qsize 0
2023-02-18 03:38:19,332 DEBUG awx.main.dispatch task 1721580a-a7a9-4b47-b7ce-ad2cd17e0083 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:38:19,333 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:38:19,401 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:38:19,530 DEBUG awx.main.dispatch task 1721580a-a7a9-4b47-b7ce-ad2cd17e0083 is finished
2023-02-18 03:38:22,073 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(aafc091e-6c0c-4401-934e-d57d0f597180, queue=awx_private_queue)
[2023-02-18 03:38:22,073: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(aafc091e-6c0c-4401-934e-d57d0f597180, queue=awx_private_queue)
2023-02-18 03:38:22,088 DEBUG awx.main.dispatch delivered aafc091e-6c0c-4401-934e-d57d0f597180 to worker[192] qsize 0
2023-02-18 03:38:22,091 DEBUG awx.main.dispatch task aafc091e-6c0c-4401-934e-d57d0f597180 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:38:22,108 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:38:22,114 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:37:52.119535+00:00
2023-02-18 03:38:22,157 DEBUG awx.main.dispatch task aafc091e-6c0c-4401-934e-d57d0f597180 is finished
2023-02-18 03:38:39,321 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f0019357-309e-4dbd-a5f7-af0a34c7e7d3, queue=awx_private_queue)
[2023-02-18 03:38:39,321: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f0019357-309e-4dbd-a5f7-af0a34c7e7d3, queue=awx_private_queue)
2023-02-18 03:38:39,555 DEBUG awx.main.dispatch delivered f0019357-309e-4dbd-a5f7-af0a34c7e7d3 to worker[183] qsize 0
2023-02-18 03:38:39,558 DEBUG awx.main.dispatch task f0019357-309e-4dbd-a5f7-af0a34c7e7d3 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:38:39,560 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:38:39,634 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:38:39,710 DEBUG awx.main.dispatch task f0019357-309e-4dbd-a5f7-af0a34c7e7d3 is finished
2023-02-18 03:38:51,641 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(a8b7aa2f-7023-4e92-9e09-a20191c7a8a7, queue=onap-awx-0)
[2023-02-18 03:38:51,641: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(a8b7aa2f-7023-4e92-9e09-a20191c7a8a7, queue=onap-awx-0)
2023-02-18 03:38:51,753 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(de54cb37-bf0c-4f61-af10-b3dd1d8a7316, queue=onap-awx-0)
[2023-02-18 03:38:51,753: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(de54cb37-bf0c-4f61-af10-b3dd1d8a7316, queue=onap-awx-0)
2023-02-18 03:38:51,780 DEBUG awx.main.dispatch delivered a8b7aa2f-7023-4e92-9e09-a20191c7a8a7 to worker[195] qsize 0
2023-02-18 03:38:51,782 DEBUG awx.main.dispatch delivered de54cb37-bf0c-4f61-af10-b3dd1d8a7316 to worker[192] qsize 0
2023-02-18 03:38:51,783 DEBUG awx.main.dispatch task a8b7aa2f-7023-4e92-9e09-a20191c7a8a7 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:38:51,784 DEBUG awx.main.dispatch task de54cb37-bf0c-4f61-af10-b3dd1d8a7316 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:38:51,786 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:38:51,914 DEBUG awx.main.dispatch task de54cb37-bf0c-4f61-af10-b3dd1d8a7316 is finished
2023-02-18 03:38:52,022 DEBUG awx.main.dispatch task a8b7aa2f-7023-4e92-9e09-a20191c7a8a7 is finished
2023-02-18 03:38:52,073 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(f589cb28-25b0-4979-9fa5-44cae9f40f4d, queue=awx_private_queue)
[2023-02-18 03:38:52,073: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(f589cb28-25b0-4979-9fa5-44cae9f40f4d, queue=awx_private_queue)
2023-02-18 03:38:52,089 DEBUG awx.main.dispatch delivered f589cb28-25b0-4979-9fa5-44cae9f40f4d to worker[197] qsize 0
2023-02-18 03:38:52,091 DEBUG awx.main.dispatch task f589cb28-25b0-4979-9fa5-44cae9f40f4d starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:38:52,133 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:38:52,144 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:38:22.108771+00:00
2023-02-18 03:38:52,237 DEBUG awx.main.dispatch task f589cb28-25b0-4979-9fa5-44cae9f40f4d is finished
2023-02-18 03:38:59,321 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(804c219e-4314-4098-8cbe-094be34ae665, queue=awx_private_queue)
[2023-02-18 03:38:59,321: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(804c219e-4314-4098-8cbe-094be34ae665, queue=awx_private_queue)
2023-02-18 03:38:59,337 DEBUG awx.main.dispatch delivered 804c219e-4314-4098-8cbe-094be34ae665 to worker[197] qsize 0
2023-02-18 03:38:59,339 DEBUG awx.main.dispatch task 804c219e-4314-4098-8cbe-094be34ae665 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:38:59,341 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:38:59,461 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:38:59,685 DEBUG awx.main.dispatch task 804c219e-4314-4098-8cbe-094be34ae665 is finished
RESULT 2
OKREADY
2023-02-18 03:39:19,332 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(67b0509c-298c-45b4-b50e-36576ace282c, queue=awx_private_queue)
[2023-02-18 03:39:19,332: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(67b0509c-298c-45b4-b50e-36576ace282c, queue=awx_private_queue)
2023-02-18 03:39:19,350 DEBUG awx.main.dispatch delivered 67b0509c-298c-45b4-b50e-36576ace282c to worker[197] qsize 0
2023-02-18 03:39:19,354 DEBUG awx.main.dispatch task 67b0509c-298c-45b4-b50e-36576ace282c starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:39:19,356 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:39:19,498 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:39:19,660 DEBUG awx.main.dispatch task 67b0509c-298c-45b4-b50e-36576ace282c is finished
2023-02-18 03:39:22,075 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(61b055c2-dd89-4815-a519-957e90005934, queue=awx_private_queue)
[2023-02-18 03:39:22,075: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(61b055c2-dd89-4815-a519-957e90005934, queue=awx_private_queue)
2023-02-18 03:39:22,092 DEBUG awx.main.dispatch delivered 61b055c2-dd89-4815-a519-957e90005934 to worker[192] qsize 0
2023-02-18 03:39:22,096 DEBUG awx.main.dispatch task 61b055c2-dd89-4815-a519-957e90005934 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:39:22,167 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:39:22,175 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:38:52.133354+00:00
2023-02-18 03:39:22,303 DEBUG awx.main.dispatch task 61b055c2-dd89-4815-a519-957e90005934 is finished
2023-02-18 03:39:39,341 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(69bf54ed-3ea1-4229-8b48-31a307803c2d, queue=awx_private_queue)
[2023-02-18 03:39:39,341: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(69bf54ed-3ea1-4229-8b48-31a307803c2d, queue=awx_private_queue)
2023-02-18 03:39:39,600 DEBUG awx.main.dispatch delivered 69bf54ed-3ea1-4229-8b48-31a307803c2d to worker[183] qsize 0
2023-02-18 03:39:39,605 DEBUG awx.main.dispatch task 69bf54ed-3ea1-4229-8b48-31a307803c2d starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:39:39,609 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:39:39,663 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:39:39,755 DEBUG awx.main.dispatch task 69bf54ed-3ea1-4229-8b48-31a307803c2d is finished
2023-02-18 03:39:51,641 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(e1aceab6-2fcd-4b4c-9840-d212f0d755ac, queue=onap-awx-0)
[2023-02-18 03:39:51,641: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(e1aceab6-2fcd-4b4c-9840-d212f0d755ac, queue=onap-awx-0)
2023-02-18 03:39:51,753 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(ac3d807d-d570-4d80-bd84-1eb1c4db2e85, queue=onap-awx-0)
[2023-02-18 03:39:51,753: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(ac3d807d-d570-4d80-bd84-1eb1c4db2e85, queue=onap-awx-0)
2023-02-18 03:39:51,768 DEBUG awx.main.dispatch delivered e1aceab6-2fcd-4b4c-9840-d212f0d755ac to worker[195] qsize 0
2023-02-18 03:39:51,771 DEBUG awx.main.dispatch delivered ac3d807d-d570-4d80-bd84-1eb1c4db2e85 to worker[183] qsize 0
2023-02-18 03:39:51,773 DEBUG awx.main.dispatch task ac3d807d-d570-4d80-bd84-1eb1c4db2e85 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:39:51,772 DEBUG awx.main.dispatch task e1aceab6-2fcd-4b4c-9840-d212f0d755ac starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:39:51,775 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:39:51,891 DEBUG awx.main.dispatch task ac3d807d-d570-4d80-bd84-1eb1c4db2e85 is finished
2023-02-18 03:39:51,926 DEBUG awx.main.dispatch task e1aceab6-2fcd-4b4c-9840-d212f0d755ac is finished
2023-02-18 03:39:52,073 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(e38f3107-7afe-4674-9b6d-187bd304b453, queue=awx_private_queue)
[2023-02-18 03:39:52,073: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(e38f3107-7afe-4674-9b6d-187bd304b453, queue=awx_private_queue)
2023-02-18 03:39:52,089 DEBUG awx.main.dispatch delivered e38f3107-7afe-4674-9b6d-187bd304b453 to worker[195] qsize 0
2023-02-18 03:39:52,092 DEBUG awx.main.dispatch task e38f3107-7afe-4674-9b6d-187bd304b453 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:39:52,153 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:39:52,187 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:39:22.167654+00:00
2023-02-18 03:39:52,229 DEBUG awx.main.dispatch task e38f3107-7afe-4674-9b6d-187bd304b453 is finished
2023-02-18 03:39:59,340 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(eafd6758-e782-477d-93f5-fb2a18a11c87, queue=awx_private_queue)
[2023-02-18 03:39:59,340: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(eafd6758-e782-477d-93f5-fb2a18a11c87, queue=awx_private_queue)
2023-02-18 03:39:59,355 DEBUG awx.main.dispatch delivered eafd6758-e782-477d-93f5-fb2a18a11c87 to worker[195] qsize 0
2023-02-18 03:39:59,358 DEBUG awx.main.dispatch task eafd6758-e782-477d-93f5-fb2a18a11c87 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:39:59,359 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:39:59,445 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:39:59,590 DEBUG awx.main.dispatch task eafd6758-e782-477d-93f5-fb2a18a11c87 is finished
RESULT 2
OKREADY
2023-02-18 03:40:19,354 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(39f6e63f-ecc7-43a4-84ae-d722ac6d035b, queue=awx_private_queue)
[2023-02-18 03:40:19,354: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(39f6e63f-ecc7-43a4-84ae-d722ac6d035b, queue=awx_private_queue)
2023-02-18 03:40:19,370 DEBUG awx.main.dispatch delivered 39f6e63f-ecc7-43a4-84ae-d722ac6d035b to worker[197] qsize 0
2023-02-18 03:40:19,374 DEBUG awx.main.dispatch task 39f6e63f-ecc7-43a4-84ae-d722ac6d035b starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:40:19,377 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:40:19,510 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:40:19,643 DEBUG awx.main.dispatch task 39f6e63f-ecc7-43a4-84ae-d722ac6d035b is finished
2023-02-18 03:40:22,073 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(a27efbd7-decf-4b80-aa26-41254a646eee, queue=awx_private_queue)
[2023-02-18 03:40:22,073: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(a27efbd7-decf-4b80-aa26-41254a646eee, queue=awx_private_queue)
2023-02-18 03:40:22,090 DEBUG awx.main.dispatch delivered a27efbd7-decf-4b80-aa26-41254a646eee to worker[192] qsize 0
2023-02-18 03:40:22,093 DEBUG awx.main.dispatch task a27efbd7-decf-4b80-aa26-41254a646eee starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:40:22,142 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:40:22,177 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:39:52.153406+00:00
2023-02-18 03:40:22,221 DEBUG awx.main.dispatch task a27efbd7-decf-4b80-aa26-41254a646eee is finished
2023-02-18 03:40:39,360 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(dec51195-86f8-489c-9779-acf4b0fb68f5, queue=awx_private_queue)
[2023-02-18 03:40:39,360: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(dec51195-86f8-489c-9779-acf4b0fb68f5, queue=awx_private_queue)
2023-02-18 03:40:39,621 DEBUG awx.main.dispatch delivered dec51195-86f8-489c-9779-acf4b0fb68f5 to worker[195] qsize 0
2023-02-18 03:40:39,626 DEBUG awx.main.dispatch task dec51195-86f8-489c-9779-acf4b0fb68f5 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:40:39,628 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:40:39,753 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:40:39,839 DEBUG awx.main.dispatch task dec51195-86f8-489c-9779-acf4b0fb68f5 is finished
2023-02-18 03:40:51,643 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(0a4e5135-2fda-4896-af08-82a21e94ce29, queue=onap-awx-0)
[2023-02-18 03:40:51,643: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(0a4e5135-2fda-4896-af08-82a21e94ce29, queue=onap-awx-0)
2023-02-18 03:40:51,696 DEBUG awx.main.dispatch delivered 0a4e5135-2fda-4896-af08-82a21e94ce29 to worker[192] qsize 0
2023-02-18 03:40:51,698 DEBUG awx.main.dispatch task 0a4e5135-2fda-4896-af08-82a21e94ce29 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:40:51,700 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:40:51,753 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(cae6e042-0cf9-4790-b331-42dac5d40994, queue=onap-awx-0)
[2023-02-18 03:40:51,753: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(cae6e042-0cf9-4790-b331-42dac5d40994, queue=onap-awx-0)
2023-02-18 03:40:51,768 DEBUG awx.main.dispatch delivered cae6e042-0cf9-4790-b331-42dac5d40994 to worker[195] qsize 0
2023-02-18 03:40:51,770 DEBUG awx.main.dispatch task cae6e042-0cf9-4790-b331-42dac5d40994 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:40:51,794 DEBUG awx.main.dispatch task 0a4e5135-2fda-4896-af08-82a21e94ce29 is finished
2023-02-18 03:40:51,857 DEBUG awx.main.dispatch task cae6e042-0cf9-4790-b331-42dac5d40994 is finished
2023-02-18 03:40:52,073 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(764e2a5e-acbe-4764-a933-e4fba2c77775, queue=awx_private_queue)
[2023-02-18 03:40:52,073: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(764e2a5e-acbe-4764-a933-e4fba2c77775, queue=awx_private_queue)
2023-02-18 03:40:52,089 DEBUG awx.main.dispatch delivered 764e2a5e-acbe-4764-a933-e4fba2c77775 to worker[195] qsize 0
2023-02-18 03:40:52,092 DEBUG awx.main.dispatch task 764e2a5e-acbe-4764-a933-e4fba2c77775 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:40:52,109 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:40:52,127 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:40:22.142946+00:00
2023-02-18 03:40:52,144 DEBUG awx.main.dispatch task 764e2a5e-acbe-4764-a933-e4fba2c77775 is finished
2023-02-18 03:40:59,360 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(58f727fb-e316-4f11-bbce-5f77743c72d0, queue=awx_private_queue)
[2023-02-18 03:40:59,360: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(58f727fb-e316-4f11-bbce-5f77743c72d0, queue=awx_private_queue)
2023-02-18 03:40:59,377 DEBUG awx.main.dispatch delivered 58f727fb-e316-4f11-bbce-5f77743c72d0 to worker[195] qsize 0
2023-02-18 03:40:59,379 DEBUG awx.main.dispatch task 58f727fb-e316-4f11-bbce-5f77743c72d0 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:40:59,380 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:40:59,434 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:40:59,584 DEBUG awx.main.dispatch task 58f727fb-e316-4f11-bbce-5f77743c72d0 is finished
RESULT 2
OKREADY
2023-02-18 03:41:19,360 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(bf824908-e548-48d1-853d-9cd77354aee8, queue=awx_private_queue)
[2023-02-18 03:41:19,360: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(bf824908-e548-48d1-853d-9cd77354aee8, queue=awx_private_queue)
2023-02-18 03:41:19,377 DEBUG awx.main.dispatch delivered bf824908-e548-48d1-853d-9cd77354aee8 to worker[183] qsize 0
2023-02-18 03:41:19,380 DEBUG awx.main.dispatch task bf824908-e548-48d1-853d-9cd77354aee8 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:41:19,383 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:41:19,476 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:41:19,569 DEBUG awx.main.dispatch task bf824908-e548-48d1-853d-9cd77354aee8 is finished
2023-02-18 03:41:22,073 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(e73f416b-ec37-4ccf-bdef-029539748d4c, queue=awx_private_queue)
[2023-02-18 03:41:22,073: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(e73f416b-ec37-4ccf-bdef-029539748d4c, queue=awx_private_queue)
2023-02-18 03:41:22,091 DEBUG awx.main.dispatch delivered e73f416b-ec37-4ccf-bdef-029539748d4c to worker[195] qsize 0
2023-02-18 03:41:22,093 DEBUG awx.main.dispatch task e73f416b-ec37-4ccf-bdef-029539748d4c starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:41:22,132 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:41:22,149 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:40:52.109710+00:00
2023-02-18 03:41:22,195 DEBUG awx.main.dispatch task e73f416b-ec37-4ccf-bdef-029539748d4c is finished
2023-02-18 03:41:39,367 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(cb39bd37-ad2c-45cd-bd19-d8c848ce5aeb, queue=awx_private_queue)
[2023-02-18 03:41:39,367: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(cb39bd37-ad2c-45cd-bd19-d8c848ce5aeb, queue=awx_private_queue)
2023-02-18 03:41:39,644 DEBUG awx.main.dispatch delivered cb39bd37-ad2c-45cd-bd19-d8c848ce5aeb to worker[192] qsize 0
2023-02-18 03:41:39,648 DEBUG awx.main.dispatch task cb39bd37-ad2c-45cd-bd19-d8c848ce5aeb starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:41:39,650 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:41:39,741 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:41:39,894 DEBUG awx.main.dispatch task cb39bd37-ad2c-45cd-bd19-d8c848ce5aeb is finished
2023-02-18 03:41:51,646 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(a91f5fb1-fe2e-45c5-aea8-c169cfa17a6d, queue=onap-awx-0)
[2023-02-18 03:41:51,646: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(a91f5fb1-fe2e-45c5-aea8-c169cfa17a6d, queue=onap-awx-0)
2023-02-18 03:41:51,726 DEBUG awx.main.dispatch delivered a91f5fb1-fe2e-45c5-aea8-c169cfa17a6d to worker[183] qsize 0
2023-02-18 03:41:51,728 DEBUG awx.main.dispatch task a91f5fb1-fe2e-45c5-aea8-c169cfa17a6d starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:41:51,730 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:41:51,753 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(fbe51d74-1332-4fd3-8071-8ac030d2ba78, queue=onap-awx-0)
[2023-02-18 03:41:51,753: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(fbe51d74-1332-4fd3-8071-8ac030d2ba78, queue=onap-awx-0)
2023-02-18 03:41:51,783 DEBUG awx.main.dispatch delivered fbe51d74-1332-4fd3-8071-8ac030d2ba78 to worker[195] qsize 0
2023-02-18 03:41:51,785 DEBUG awx.main.dispatch task fbe51d74-1332-4fd3-8071-8ac030d2ba78 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:41:51,806 DEBUG awx.main.dispatch task a91f5fb1-fe2e-45c5-aea8-c169cfa17a6d is finished
2023-02-18 03:41:51,839 DEBUG awx.main.dispatch task fbe51d74-1332-4fd3-8071-8ac030d2ba78 is finished
2023-02-18 03:41:52,073 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(dd1c3db7-b9a8-4e97-b0c7-676af16bff64, queue=awx_private_queue)
[2023-02-18 03:41:52,073: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(dd1c3db7-b9a8-4e97-b0c7-676af16bff64, queue=awx_private_queue)
2023-02-18 03:41:52,089 DEBUG awx.main.dispatch delivered dd1c3db7-b9a8-4e97-b0c7-676af16bff64 to worker[183] qsize 0
2023-02-18 03:41:52,092 DEBUG awx.main.dispatch task dd1c3db7-b9a8-4e97-b0c7-676af16bff64 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:41:52,139 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:41:52,146 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:41:22.133074+00:00
2023-02-18 03:41:52,188 DEBUG awx.main.dispatch task dd1c3db7-b9a8-4e97-b0c7-676af16bff64 is finished
2023-02-18 03:41:59,367 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(12de5e00-88cd-46f9-a47e-f1bcf72fa927, queue=awx_private_queue)
[2023-02-18 03:41:59,367: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(12de5e00-88cd-46f9-a47e-f1bcf72fa927, queue=awx_private_queue)
2023-02-18 03:41:59,383 DEBUG awx.main.dispatch delivered 12de5e00-88cd-46f9-a47e-f1bcf72fa927 to worker[195] qsize 0
2023-02-18 03:41:59,385 DEBUG awx.main.dispatch task 12de5e00-88cd-46f9-a47e-f1bcf72fa927 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:41:59,387 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:41:59,551 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:41:59,783 DEBUG awx.main.dispatch task 12de5e00-88cd-46f9-a47e-f1bcf72fa927 is finished
RESULT 2
OKREADY
2023-02-18 03:42:19,377 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(795c158c-5026-4f80-bc66-daee02c0f4a0, queue=awx_private_queue)
[2023-02-18 03:42:19,377: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(795c158c-5026-4f80-bc66-daee02c0f4a0, queue=awx_private_queue)
2023-02-18 03:42:19,393 DEBUG awx.main.dispatch delivered 795c158c-5026-4f80-bc66-daee02c0f4a0 to worker[192] qsize 0
2023-02-18 03:42:19,396 DEBUG awx.main.dispatch task 795c158c-5026-4f80-bc66-daee02c0f4a0 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:42:19,397 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:42:19,489 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:42:19,568 DEBUG awx.main.dispatch task 795c158c-5026-4f80-bc66-daee02c0f4a0 is finished
2023-02-18 03:42:22,074 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(6f71bbcd-cf6f-46de-b4ad-0e7d1607a51a, queue=awx_private_queue)
[2023-02-18 03:42:22,074: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(6f71bbcd-cf6f-46de-b4ad-0e7d1607a51a, queue=awx_private_queue)
2023-02-18 03:42:22,088 DEBUG awx.main.dispatch delivered 6f71bbcd-cf6f-46de-b4ad-0e7d1607a51a to worker[192] qsize 0
2023-02-18 03:42:22,090 DEBUG awx.main.dispatch task 6f71bbcd-cf6f-46de-b4ad-0e7d1607a51a starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:42:22,105 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:42:22,108 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:41:52.139580+00:00
2023-02-18 03:42:22,145 DEBUG awx.main.dispatch task 6f71bbcd-cf6f-46de-b4ad-0e7d1607a51a is finished
2023-02-18 03:42:39,385 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6c5daa78-7eb0-4b39-b8e7-a0a50e5ce7b3, queue=awx_private_queue)
[2023-02-18 03:42:39,385: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6c5daa78-7eb0-4b39-b8e7-a0a50e5ce7b3, queue=awx_private_queue)
2023-02-18 03:42:39,611 DEBUG awx.main.dispatch delivered 6c5daa78-7eb0-4b39-b8e7-a0a50e5ce7b3 to worker[197] qsize 0
2023-02-18 03:42:39,614 DEBUG awx.main.dispatch task 6c5daa78-7eb0-4b39-b8e7-a0a50e5ce7b3 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:42:39,617 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:42:39,666 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:42:39,760 DEBUG awx.main.dispatch task 6c5daa78-7eb0-4b39-b8e7-a0a50e5ce7b3 is finished
2023-02-18 03:42:51,648 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(7cc38fe1-8ad3-4665-8c2e-dbf9315b1787, queue=onap-awx-0)
[2023-02-18 03:42:51,648: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(7cc38fe1-8ad3-4665-8c2e-dbf9315b1787, queue=onap-awx-0)
2023-02-18 03:42:51,703 DEBUG awx.main.dispatch delivered 7cc38fe1-8ad3-4665-8c2e-dbf9315b1787 to worker[197] qsize 0
2023-02-18 03:42:51,706 DEBUG awx.main.dispatch task 7cc38fe1-8ad3-4665-8c2e-dbf9315b1787 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:42:51,707 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:42:51,753 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(9b3cd14b-080e-435a-abfc-5bbe94292d00, queue=onap-awx-0)
[2023-02-18 03:42:51,753: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(9b3cd14b-080e-435a-abfc-5bbe94292d00, queue=onap-awx-0)
2023-02-18 03:42:51,766 DEBUG awx.main.dispatch task 7cc38fe1-8ad3-4665-8c2e-dbf9315b1787 is finished
2023-02-18 03:42:51,769 DEBUG awx.main.dispatch delivered 9b3cd14b-080e-435a-abfc-5bbe94292d00 to worker[195] qsize 0
2023-02-18 03:42:51,771 DEBUG awx.main.dispatch task 9b3cd14b-080e-435a-abfc-5bbe94292d00 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:42:51,800 DEBUG awx.main.dispatch task 9b3cd14b-080e-435a-abfc-5bbe94292d00 is finished
2023-02-18 03:42:52,074 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d025780f-d710-403e-808c-613b866286c2, queue=awx_private_queue)
[2023-02-18 03:42:52,074: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d025780f-d710-403e-808c-613b866286c2, queue=awx_private_queue)
2023-02-18 03:42:52,089 DEBUG awx.main.dispatch delivered d025780f-d710-403e-808c-613b866286c2 to worker[183] qsize 0
2023-02-18 03:42:52,091 DEBUG awx.main.dispatch task d025780f-d710-403e-808c-613b866286c2 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:42:52,111 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:42:52,118 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:42:22.105131+00:00
2023-02-18 03:42:52,168 DEBUG awx.main.dispatch task d025780f-d710-403e-808c-613b866286c2 is finished
2023-02-18 03:42:59,386 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(9cd9d272-b6fb-419b-bba1-bec99f026e44, queue=awx_private_queue)
[2023-02-18 03:42:59,386: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(9cd9d272-b6fb-419b-bba1-bec99f026e44, queue=awx_private_queue)
2023-02-18 03:42:59,404 DEBUG awx.main.dispatch delivered 9cd9d272-b6fb-419b-bba1-bec99f026e44 to worker[192] qsize 0
2023-02-18 03:42:59,406 DEBUG awx.main.dispatch task 9cd9d272-b6fb-419b-bba1-bec99f026e44 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:42:59,408 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:42:59,511 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:42:59,595 DEBUG awx.main.dispatch task 9cd9d272-b6fb-419b-bba1-bec99f026e44 is finished
RESULT 2
OKREADY
2023-02-18 03:43:19,391 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(da510c79-6bc4-4a47-8473-5c9e30e9dac3, queue=awx_private_queue)
[2023-02-18 03:43:19,391: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(da510c79-6bc4-4a47-8473-5c9e30e9dac3, queue=awx_private_queue)
2023-02-18 03:43:19,408 DEBUG awx.main.dispatch delivered da510c79-6bc4-4a47-8473-5c9e30e9dac3 to worker[192] qsize 0
2023-02-18 03:43:19,410 DEBUG awx.main.dispatch task da510c79-6bc4-4a47-8473-5c9e30e9dac3 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:43:19,412 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:43:19,539 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:43:19,676 DEBUG awx.main.dispatch task da510c79-6bc4-4a47-8473-5c9e30e9dac3 is finished
2023-02-18 03:43:22,074 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(00bb9877-f766-4c9c-a9e5-87c463f59857, queue=awx_private_queue)
[2023-02-18 03:43:22,074: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(00bb9877-f766-4c9c-a9e5-87c463f59857, queue=awx_private_queue)
2023-02-18 03:43:22,090 DEBUG awx.main.dispatch delivered 00bb9877-f766-4c9c-a9e5-87c463f59857 to worker[183] qsize 0
2023-02-18 03:43:22,092 DEBUG awx.main.dispatch task 00bb9877-f766-4c9c-a9e5-87c463f59857 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:43:22,109 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:43:22,115 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:42:52.112020+00:00
2023-02-18 03:43:22,135 DEBUG awx.main.dispatch task 00bb9877-f766-4c9c-a9e5-87c463f59857 is finished
2023-02-18 03:43:39,397 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(05d82b28-fbc8-494b-bc1f-8449e59babf2, queue=awx_private_queue)
[2023-02-18 03:43:39,397: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(05d82b28-fbc8-494b-bc1f-8449e59babf2, queue=awx_private_queue)
2023-02-18 03:43:39,662 DEBUG awx.main.dispatch delivered 05d82b28-fbc8-494b-bc1f-8449e59babf2 to worker[192] qsize 0
2023-02-18 03:43:39,665 DEBUG awx.main.dispatch task 05d82b28-fbc8-494b-bc1f-8449e59babf2 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:43:39,667 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:43:39,748 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:43:39,811 DEBUG awx.main.dispatch task 05d82b28-fbc8-494b-bc1f-8449e59babf2 is finished
2023-02-18 03:43:51,648 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(bb10b720-1a5e-48a1-bf0f-be5c45a28d4b, queue=onap-awx-0)
[2023-02-18 03:43:51,648: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(bb10b720-1a5e-48a1-bf0f-be5c45a28d4b, queue=onap-awx-0)
2023-02-18 03:43:51,697 DEBUG awx.main.dispatch delivered bb10b720-1a5e-48a1-bf0f-be5c45a28d4b to worker[195] qsize 0
2023-02-18 03:43:51,699 DEBUG awx.main.dispatch task bb10b720-1a5e-48a1-bf0f-be5c45a28d4b starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:43:51,702 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:43:51,753 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(04e2babe-6bde-49a4-aab1-9c7d1b7b6215, queue=onap-awx-0)
[2023-02-18 03:43:51,753: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(04e2babe-6bde-49a4-aab1-9c7d1b7b6215, queue=onap-awx-0)
2023-02-18 03:43:51,767 DEBUG awx.main.dispatch delivered 04e2babe-6bde-49a4-aab1-9c7d1b7b6215 to worker[192] qsize 0
2023-02-18 03:43:51,770 DEBUG awx.main.dispatch task 04e2babe-6bde-49a4-aab1-9c7d1b7b6215 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:43:51,828 DEBUG awx.main.dispatch task 04e2babe-6bde-49a4-aab1-9c7d1b7b6215 is finished
2023-02-18 03:43:51,844 DEBUG awx.main.dispatch task bb10b720-1a5e-48a1-bf0f-be5c45a28d4b is finished
2023-02-18 03:43:52,074 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(a1a2abac-e7ab-42ce-a9db-450ee7e2ca5a, queue=awx_private_queue)
[2023-02-18 03:43:52,074: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(a1a2abac-e7ab-42ce-a9db-450ee7e2ca5a, queue=awx_private_queue)
2023-02-18 03:43:52,089 DEBUG awx.main.dispatch delivered a1a2abac-e7ab-42ce-a9db-450ee7e2ca5a to worker[197] qsize 0
2023-02-18 03:43:52,092 DEBUG awx.main.dispatch task a1a2abac-e7ab-42ce-a9db-450ee7e2ca5a starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:43:52,119 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:43:52,136 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:43:22.109714+00:00
2023-02-18 03:43:52,173 DEBUG awx.main.dispatch task a1a2abac-e7ab-42ce-a9db-450ee7e2ca5a is finished
2023-02-18 03:43:59,396 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(efcc84db-ea1d-44e7-812d-4fc8273aac31, queue=awx_private_queue)
[2023-02-18 03:43:59,396: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(efcc84db-ea1d-44e7-812d-4fc8273aac31, queue=awx_private_queue)
2023-02-18 03:43:59,413 DEBUG awx.main.dispatch delivered efcc84db-ea1d-44e7-812d-4fc8273aac31 to worker[183] qsize 0
2023-02-18 03:43:59,415 DEBUG awx.main.dispatch task efcc84db-ea1d-44e7-812d-4fc8273aac31 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:43:59,417 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:43:59,502 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:43:59,589 DEBUG awx.main.dispatch task efcc84db-ea1d-44e7-812d-4fc8273aac31 is finished
RESULT 2
OKREADY
2023-02-18 03:44:19,398 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f609b5f7-1db8-41ce-8ec8-f2dae01df0bb, queue=awx_private_queue)
[2023-02-18 03:44:19,398: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f609b5f7-1db8-41ce-8ec8-f2dae01df0bb, queue=awx_private_queue)
2023-02-18 03:44:19,416 DEBUG awx.main.dispatch delivered f609b5f7-1db8-41ce-8ec8-f2dae01df0bb to worker[183] qsize 0
2023-02-18 03:44:19,421 DEBUG awx.main.dispatch task f609b5f7-1db8-41ce-8ec8-f2dae01df0bb starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:44:19,424 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:44:19,487 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:44:19,603 DEBUG awx.main.dispatch task f609b5f7-1db8-41ce-8ec8-f2dae01df0bb is finished
2023-02-18 03:44:22,075 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(3ca2dc5f-d19e-4cba-8b7f-d7bf40a7bb0e, queue=awx_private_queue)
[2023-02-18 03:44:22,075: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(3ca2dc5f-d19e-4cba-8b7f-d7bf40a7bb0e, queue=awx_private_queue)
2023-02-18 03:44:22,094 DEBUG awx.main.dispatch delivered 3ca2dc5f-d19e-4cba-8b7f-d7bf40a7bb0e to worker[192] qsize 0
2023-02-18 03:44:22,099 DEBUG awx.main.dispatch task 3ca2dc5f-d19e-4cba-8b7f-d7bf40a7bb0e starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:44:22,116 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:44:22,121 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:43:52.119781+00:00
2023-02-18 03:44:22,153 DEBUG awx.main.dispatch task 3ca2dc5f-d19e-4cba-8b7f-d7bf40a7bb0e is finished
2023-02-18 03:44:39,409 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(fdd3b3fd-bb75-468e-a972-df2f82cd513d, queue=awx_private_queue)
[2023-02-18 03:44:39,409: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(fdd3b3fd-bb75-468e-a972-df2f82cd513d, queue=awx_private_queue)
2023-02-18 03:44:39,667 DEBUG awx.main.dispatch delivered fdd3b3fd-bb75-468e-a972-df2f82cd513d to worker[183] qsize 0
2023-02-18 03:44:39,670 DEBUG awx.main.dispatch task fdd3b3fd-bb75-468e-a972-df2f82cd513d starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:44:39,672 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:44:39,745 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:44:39,845 DEBUG awx.main.dispatch task fdd3b3fd-bb75-468e-a972-df2f82cd513d is finished
2023-02-18 03:44:51,479 DEBUG awx.main.dispatch publish awx.main.tasks.awx_isolated_heartbeat(b43d3a67-d3a3-4ded-8348-ab7289e65361, queue=onap-awx-0)
[2023-02-18 03:44:51,479: DEBUG/Process-1] publish awx.main.tasks.awx_isolated_heartbeat(b43d3a67-d3a3-4ded-8348-ab7289e65361, queue=onap-awx-0)
2023-02-18 03:44:51,495 DEBUG awx.main.dispatch delivered b43d3a67-d3a3-4ded-8348-ab7289e65361 to worker[192] qsize 0
2023-02-18 03:44:51,498 DEBUG awx.main.dispatch task b43d3a67-d3a3-4ded-8348-ab7289e65361 starting awx.main.tasks.awx_isolated_heartbeat(*[])
2023-02-18 03:44:51,500 DEBUG awx.main.tasks Controlling node checking for any isolated management tasks.
2023-02-18 03:44:51,556 DEBUG awx.main.dispatch task b43d3a67-d3a3-4ded-8348-ab7289e65361 is finished
2023-02-18 03:44:51,648 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(7e3f62bd-7611-4bc4-b311-18d48824095d, queue=onap-awx-0)
[2023-02-18 03:44:51,648: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(7e3f62bd-7611-4bc4-b311-18d48824095d, queue=onap-awx-0)
2023-02-18 03:44:51,683 DEBUG awx.main.dispatch delivered 7e3f62bd-7611-4bc4-b311-18d48824095d to worker[195] qsize 0
2023-02-18 03:44:51,686 DEBUG awx.main.dispatch task 7e3f62bd-7611-4bc4-b311-18d48824095d starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:44:51,690 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:44:51,753 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(16cba404-e275-451c-bfbe-012cf3dd9c8a, queue=onap-awx-0)
[2023-02-18 03:44:51,753: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(16cba404-e275-451c-bfbe-012cf3dd9c8a, queue=onap-awx-0)
2023-02-18 03:44:51,768 DEBUG awx.main.dispatch delivered 16cba404-e275-451c-bfbe-012cf3dd9c8a to worker[192] qsize 0
2023-02-18 03:44:51,771 DEBUG awx.main.dispatch task 16cba404-e275-451c-bfbe-012cf3dd9c8a starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:44:51,773 DEBUG awx.main.dispatch task 7e3f62bd-7611-4bc4-b311-18d48824095d is finished
2023-02-18 03:44:51,789 DEBUG awx.main.dispatch task 16cba404-e275-451c-bfbe-012cf3dd9c8a is finished
2023-02-18 03:44:52,074 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(8dc3aab7-db18-4cd2-96e4-11500e101c89, queue=awx_private_queue)
[2023-02-18 03:44:52,074: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(8dc3aab7-db18-4cd2-96e4-11500e101c89, queue=awx_private_queue)
2023-02-18 03:44:52,089 DEBUG awx.main.dispatch delivered 8dc3aab7-db18-4cd2-96e4-11500e101c89 to worker[195] qsize 0
2023-02-18 03:44:52,091 DEBUG awx.main.dispatch task 8dc3aab7-db18-4cd2-96e4-11500e101c89 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:44:52,154 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:44:52,159 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:44:22.116333+00:00
2023-02-18 03:44:52,201 DEBUG awx.main.dispatch task 8dc3aab7-db18-4cd2-96e4-11500e101c89 is finished
2023-02-18 03:44:59,408 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e64a41ff-2f38-4da4-aac4-04bf46372b9e, queue=awx_private_queue)
[2023-02-18 03:44:59,408: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e64a41ff-2f38-4da4-aac4-04bf46372b9e, queue=awx_private_queue)
2023-02-18 03:44:59,428 DEBUG awx.main.dispatch delivered e64a41ff-2f38-4da4-aac4-04bf46372b9e to worker[192] qsize 0
2023-02-18 03:44:59,431 DEBUG awx.main.dispatch task e64a41ff-2f38-4da4-aac4-04bf46372b9e starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:44:59,433 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:44:59,552 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:44:59,790 DEBUG awx.main.dispatch task e64a41ff-2f38-4da4-aac4-04bf46372b9e is finished
RESULT 2
OKREADY
2023-02-18 03:45:19,419 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6d347b58-568e-4bde-8004-1805311f6c95, queue=awx_private_queue)
[2023-02-18 03:45:19,419: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6d347b58-568e-4bde-8004-1805311f6c95, queue=awx_private_queue)
2023-02-18 03:45:19,436 DEBUG awx.main.dispatch delivered 6d347b58-568e-4bde-8004-1805311f6c95 to worker[197] qsize 0
2023-02-18 03:45:19,440 DEBUG awx.main.dispatch task 6d347b58-568e-4bde-8004-1805311f6c95 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:45:19,444 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:45:19,516 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:45:19,617 DEBUG awx.main.dispatch task 6d347b58-568e-4bde-8004-1805311f6c95 is finished
2023-02-18 03:45:22,074 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(99b099af-ba13-483f-abde-f7f6a2880264, queue=awx_private_queue)
[2023-02-18 03:45:22,074: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(99b099af-ba13-483f-abde-f7f6a2880264, queue=awx_private_queue)
2023-02-18 03:45:22,089 DEBUG awx.main.dispatch delivered 99b099af-ba13-483f-abde-f7f6a2880264 to worker[197] qsize 0
2023-02-18 03:45:22,093 DEBUG awx.main.dispatch task 99b099af-ba13-483f-abde-f7f6a2880264 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:45:22,113 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:45:22,117 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:44:52.154568+00:00
2023-02-18 03:45:22,161 DEBUG awx.main.dispatch task 99b099af-ba13-483f-abde-f7f6a2880264 is finished
2023-02-18 03:45:39,419 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(227b9dce-86ea-4048-8a81-3425d075f8bc, queue=awx_private_queue)
[2023-02-18 03:45:39,419: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(227b9dce-86ea-4048-8a81-3425d075f8bc, queue=awx_private_queue)
2023-02-18 03:45:39,836 DEBUG awx.main.dispatch delivered 227b9dce-86ea-4048-8a81-3425d075f8bc to worker[195] qsize 0
2023-02-18 03:45:39,840 DEBUG awx.main.dispatch task 227b9dce-86ea-4048-8a81-3425d075f8bc starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:45:39,842 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:45:39,942 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:45:40,126 DEBUG awx.main.dispatch task 227b9dce-86ea-4048-8a81-3425d075f8bc is finished
2023-02-18 03:45:51,649 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(135ec736-ea6f-4648-8e13-a7e539d8d28c, queue=onap-awx-0)
[2023-02-18 03:45:51,649: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(135ec736-ea6f-4648-8e13-a7e539d8d28c, queue=onap-awx-0)
2023-02-18 03:45:51,681 DEBUG awx.main.dispatch delivered 135ec736-ea6f-4648-8e13-a7e539d8d28c to worker[197] qsize 0
2023-02-18 03:45:51,683 DEBUG awx.main.dispatch task 135ec736-ea6f-4648-8e13-a7e539d8d28c starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:45:51,685 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:45:51,753 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(f30e1e46-7c62-49e3-a7f2-4dadd319af7d, queue=onap-awx-0)
[2023-02-18 03:45:51,753: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(f30e1e46-7c62-49e3-a7f2-4dadd319af7d, queue=onap-awx-0)
2023-02-18 03:45:51,763 DEBUG awx.main.dispatch task 135ec736-ea6f-4648-8e13-a7e539d8d28c is finished
2023-02-18 03:45:51,770 DEBUG awx.main.dispatch delivered f30e1e46-7c62-49e3-a7f2-4dadd319af7d to worker[192] qsize 0
2023-02-18 03:45:51,773 DEBUG awx.main.dispatch task f30e1e46-7c62-49e3-a7f2-4dadd319af7d starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:45:51,802 DEBUG awx.main.dispatch task f30e1e46-7c62-49e3-a7f2-4dadd319af7d is finished
2023-02-18 03:45:52,074 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(c1f58b34-f73c-4285-91f0-9a549faa4012, queue=awx_private_queue)
[2023-02-18 03:45:52,074: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(c1f58b34-f73c-4285-91f0-9a549faa4012, queue=awx_private_queue)
2023-02-18 03:45:52,089 DEBUG awx.main.dispatch delivered c1f58b34-f73c-4285-91f0-9a549faa4012 to worker[195] qsize 0
2023-02-18 03:45:52,092 DEBUG awx.main.dispatch task c1f58b34-f73c-4285-91f0-9a549faa4012 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:45:52,175 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:45:52,181 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:45:22.113705+00:00
2023-02-18 03:45:52,218 DEBUG awx.main.dispatch task c1f58b34-f73c-4285-91f0-9a549faa4012 is finished
2023-02-18 03:45:59,419 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(ac7c255c-b1c5-4d4c-91fa-00c37806b25f, queue=awx_private_queue)
[2023-02-18 03:45:59,419: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(ac7c255c-b1c5-4d4c-91fa-00c37806b25f, queue=awx_private_queue)
2023-02-18 03:45:59,436 DEBUG awx.main.dispatch delivered ac7c255c-b1c5-4d4c-91fa-00c37806b25f to worker[192] qsize 0
2023-02-18 03:45:59,438 DEBUG awx.main.dispatch task ac7c255c-b1c5-4d4c-91fa-00c37806b25f starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:45:59,440 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:45:59,543 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:45:59,787 DEBUG awx.main.dispatch task ac7c255c-b1c5-4d4c-91fa-00c37806b25f is finished
RESULT 2
OKREADY
2023-02-18 03:46:19,419 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(23c14a5c-9722-4697-a184-38f926ce88a6, queue=awx_private_queue)
[2023-02-18 03:46:19,419: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(23c14a5c-9722-4697-a184-38f926ce88a6, queue=awx_private_queue)
2023-02-18 03:46:19,436 DEBUG awx.main.dispatch delivered 23c14a5c-9722-4697-a184-38f926ce88a6 to worker[197] qsize 0
2023-02-18 03:46:19,439 DEBUG awx.main.dispatch task 23c14a5c-9722-4697-a184-38f926ce88a6 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:46:19,441 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:46:19,576 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:46:19,733 DEBUG awx.main.dispatch task 23c14a5c-9722-4697-a184-38f926ce88a6 is finished
2023-02-18 03:46:22,074 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(091cf0ef-2a68-4865-8f0c-ece0c91f7b42, queue=awx_private_queue)
[2023-02-18 03:46:22,074: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(091cf0ef-2a68-4865-8f0c-ece0c91f7b42, queue=awx_private_queue)
2023-02-18 03:46:22,090 DEBUG awx.main.dispatch delivered 091cf0ef-2a68-4865-8f0c-ece0c91f7b42 to worker[192] qsize 0
2023-02-18 03:46:22,092 DEBUG awx.main.dispatch task 091cf0ef-2a68-4865-8f0c-ece0c91f7b42 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:46:22,203 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:46:22,217 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:45:52.175617+00:00
2023-02-18 03:46:22,383 DEBUG awx.main.dispatch task 091cf0ef-2a68-4865-8f0c-ece0c91f7b42 is finished
2023-02-18 03:46:39,419 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0c79443e-2f97-4566-8877-733edd4c41a6, queue=awx_private_queue)
[2023-02-18 03:46:39,419: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0c79443e-2f97-4566-8877-733edd4c41a6, queue=awx_private_queue)
2023-02-18 03:46:39,485 DEBUG awx.main.dispatch delivered 0c79443e-2f97-4566-8877-733edd4c41a6 to worker[197] qsize 0
2023-02-18 03:46:39,487 DEBUG awx.main.dispatch task 0c79443e-2f97-4566-8877-733edd4c41a6 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:46:39,488 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:46:39,550 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:46:39,655 DEBUG awx.main.dispatch task 0c79443e-2f97-4566-8877-733edd4c41a6 is finished
2023-02-18 03:46:51,649 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(5c5aeba5-87de-4c71-97d4-94d2fedd21d1, queue=onap-awx-0)
[2023-02-18 03:46:51,649: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(5c5aeba5-87de-4c71-97d4-94d2fedd21d1, queue=onap-awx-0)
2023-02-18 03:46:51,943 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(65f63a4b-40f5-4d35-80e1-65f758094896, queue=onap-awx-0)
[2023-02-18 03:46:51,943: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(65f63a4b-40f5-4d35-80e1-65f758094896, queue=onap-awx-0)
2023-02-18 03:46:52,074 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(b97ad062-f217-4aa7-bc31-d0b2eabfd87c, queue=awx_private_queue)
[2023-02-18 03:46:52,074: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(b97ad062-f217-4aa7-bc31-d0b2eabfd87c, queue=awx_private_queue)
2023-02-18 03:46:52,131 DEBUG awx.main.dispatch delivered 5c5aeba5-87de-4c71-97d4-94d2fedd21d1 to worker[183] qsize 0
2023-02-18 03:46:52,136 DEBUG awx.main.dispatch delivered 65f63a4b-40f5-4d35-80e1-65f758094896 to worker[197] qsize 0
2023-02-18 03:46:52,136 DEBUG awx.main.dispatch task 5c5aeba5-87de-4c71-97d4-94d2fedd21d1 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:46:52,138 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:46:52,138 DEBUG awx.main.dispatch delivered b97ad062-f217-4aa7-bc31-d0b2eabfd87c to worker[195] qsize 0
2023-02-18 03:46:52,140 DEBUG awx.main.dispatch task b97ad062-f217-4aa7-bc31-d0b2eabfd87c starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:46:52,138 DEBUG awx.main.dispatch task 65f63a4b-40f5-4d35-80e1-65f758094896 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:46:52,201 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:46:52,207 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:46:22.203398+00:00
2023-02-18 03:46:52,221 DEBUG awx.main.dispatch task 65f63a4b-40f5-4d35-80e1-65f758094896 is finished
2023-02-18 03:46:52,352 DEBUG awx.main.dispatch task b97ad062-f217-4aa7-bc31-d0b2eabfd87c is finished
2023-02-18 03:46:52,378 DEBUG awx.main.dispatch task 5c5aeba5-87de-4c71-97d4-94d2fedd21d1 is finished
2023-02-18 03:46:59,419 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(36386f67-32ec-4ab1-86ae-13548336a409, queue=awx_private_queue)
[2023-02-18 03:46:59,419: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(36386f67-32ec-4ab1-86ae-13548336a409, queue=awx_private_queue)
2023-02-18 03:46:59,436 DEBUG awx.main.dispatch delivered 36386f67-32ec-4ab1-86ae-13548336a409 to worker[195] qsize 0
2023-02-18 03:46:59,438 DEBUG awx.main.dispatch task 36386f67-32ec-4ab1-86ae-13548336a409 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:46:59,440 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:46:59,553 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:46:59,729 DEBUG awx.main.dispatch task 36386f67-32ec-4ab1-86ae-13548336a409 is finished
RESULT 2
OKREADY
2023-02-18 03:47:19,426 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(fc6c9eff-0d26-49b0-ac45-49dbe7204384, queue=awx_private_queue)
[2023-02-18 03:47:19,426: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(fc6c9eff-0d26-49b0-ac45-49dbe7204384, queue=awx_private_queue)
2023-02-18 03:47:19,442 DEBUG awx.main.dispatch delivered fc6c9eff-0d26-49b0-ac45-49dbe7204384 to worker[197] qsize 0
2023-02-18 03:47:19,445 DEBUG awx.main.dispatch task fc6c9eff-0d26-49b0-ac45-49dbe7204384 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:47:19,446 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:47:19,592 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:47:19,803 DEBUG awx.main.dispatch task fc6c9eff-0d26-49b0-ac45-49dbe7204384 is finished
2023-02-18 03:47:22,074 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(21ed6dc8-d4ab-4878-8e77-e03a7468cc43, queue=awx_private_queue)
[2023-02-18 03:47:22,074: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(21ed6dc8-d4ab-4878-8e77-e03a7468cc43, queue=awx_private_queue)
2023-02-18 03:47:22,093 DEBUG awx.main.dispatch delivered 21ed6dc8-d4ab-4878-8e77-e03a7468cc43 to worker[195] qsize 0
2023-02-18 03:47:22,095 DEBUG awx.main.dispatch task 21ed6dc8-d4ab-4878-8e77-e03a7468cc43 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:47:22,161 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:47:22,176 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:46:52.202038+00:00
2023-02-18 03:47:22,277 DEBUG awx.main.dispatch task 21ed6dc8-d4ab-4878-8e77-e03a7468cc43 is finished
2023-02-18 03:47:39,434 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0559f4b4-1f85-4859-b016-86f933e51515, queue=awx_private_queue)
[2023-02-18 03:47:39,434: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0559f4b4-1f85-4859-b016-86f933e51515, queue=awx_private_queue)
2023-02-18 03:47:39,450 DEBUG awx.main.dispatch delivered 0559f4b4-1f85-4859-b016-86f933e51515 to worker[197] qsize 0
2023-02-18 03:47:39,453 DEBUG awx.main.dispatch task 0559f4b4-1f85-4859-b016-86f933e51515 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:47:39,455 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:47:39,522 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:47:39,631 DEBUG awx.main.dispatch task 0559f4b4-1f85-4859-b016-86f933e51515 is finished
2023-02-18 03:47:51,649 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(fe4f1b2e-abcc-4431-8d2b-ba1ff279d459, queue=onap-awx-0)
[2023-02-18 03:47:51,649: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(fe4f1b2e-abcc-4431-8d2b-ba1ff279d459, queue=onap-awx-0)
2023-02-18 03:47:51,734 DEBUG awx.main.dispatch delivered fe4f1b2e-abcc-4431-8d2b-ba1ff279d459 to worker[192] qsize 0
2023-02-18 03:47:51,736 DEBUG awx.main.dispatch task fe4f1b2e-abcc-4431-8d2b-ba1ff279d459 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:47:51,967 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:47:52,050 DEBUG awx.main.dispatch task fe4f1b2e-abcc-4431-8d2b-ba1ff279d459 is finished
2023-02-18 03:47:51,944 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(1a0749ef-c3df-4f24-b7e8-b0efff36b048, queue=onap-awx-0)
[2023-02-18 03:47:51,944: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(1a0749ef-c3df-4f24-b7e8-b0efff36b048, queue=onap-awx-0)
2023-02-18 03:47:52,210 DEBUG awx.main.dispatch delivered 1a0749ef-c3df-4f24-b7e8-b0efff36b048 to worker[197] qsize 0
2023-02-18 03:47:52,211 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(6a3d5d93-d271-41bf-b250-81b66507b125, queue=awx_private_queue)
[2023-02-18 03:47:52,211: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(6a3d5d93-d271-41bf-b250-81b66507b125, queue=awx_private_queue)
2023-02-18 03:47:52,213 DEBUG awx.main.dispatch task 1a0749ef-c3df-4f24-b7e8-b0efff36b048 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:47:52,226 DEBUG awx.main.dispatch delivered 6a3d5d93-d271-41bf-b250-81b66507b125 to worker[183] qsize 0
2023-02-18 03:47:52,228 DEBUG awx.main.dispatch task 6a3d5d93-d271-41bf-b250-81b66507b125 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:47:52,277 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:47:52,277 DEBUG awx.main.dispatch task 1a0749ef-c3df-4f24-b7e8-b0efff36b048 is finished
2023-02-18 03:47:52,285 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:47:22.161627+00:00
2023-02-18 03:47:52,379 DEBUG awx.main.dispatch task 6a3d5d93-d271-41bf-b250-81b66507b125 is finished
2023-02-18 03:47:59,434 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(25a6d590-fe5f-4e9f-b859-6ce5916bafc8, queue=awx_private_queue)
[2023-02-18 03:47:59,434: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(25a6d590-fe5f-4e9f-b859-6ce5916bafc8, queue=awx_private_queue)
2023-02-18 03:47:59,451 DEBUG awx.main.dispatch delivered 25a6d590-fe5f-4e9f-b859-6ce5916bafc8 to worker[192] qsize 0
2023-02-18 03:47:59,453 DEBUG awx.main.dispatch task 25a6d590-fe5f-4e9f-b859-6ce5916bafc8 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:47:59,454 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:47:59,588 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:47:59,686 DEBUG awx.main.dispatch task 25a6d590-fe5f-4e9f-b859-6ce5916bafc8 is finished
RESULT 2
OKREADY
2023-02-18 03:48:19,444 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e662fe6c-19e3-4604-b040-98df57f61caa, queue=awx_private_queue)
[2023-02-18 03:48:19,444: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e662fe6c-19e3-4604-b040-98df57f61caa, queue=awx_private_queue)
2023-02-18 03:48:19,460 DEBUG awx.main.dispatch delivered e662fe6c-19e3-4604-b040-98df57f61caa to worker[183] qsize 0
2023-02-18 03:48:19,463 DEBUG awx.main.dispatch task e662fe6c-19e3-4604-b040-98df57f61caa starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:48:19,465 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:48:19,554 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:48:19,623 DEBUG awx.main.dispatch task e662fe6c-19e3-4604-b040-98df57f61caa is finished
2023-02-18 03:48:22,211 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(1ae8ca2f-99e1-4366-a51b-819e6033a377, queue=awx_private_queue)
[2023-02-18 03:48:22,211: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(1ae8ca2f-99e1-4366-a51b-819e6033a377, queue=awx_private_queue)
2023-02-18 03:48:22,229 DEBUG awx.main.dispatch delivered 1ae8ca2f-99e1-4366-a51b-819e6033a377 to worker[183] qsize 0
2023-02-18 03:48:22,231 DEBUG awx.main.dispatch task 1ae8ca2f-99e1-4366-a51b-819e6033a377 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:48:22,251 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:48:22,255 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:47:52.277332+00:00
2023-02-18 03:48:22,308 DEBUG awx.main.dispatch task 1ae8ca2f-99e1-4366-a51b-819e6033a377 is finished
2023-02-18 03:48:39,452 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(005aaad8-036d-4a5d-baee-fbf754253f4b, queue=awx_private_queue)
[2023-02-18 03:48:39,452: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(005aaad8-036d-4a5d-baee-fbf754253f4b, queue=awx_private_queue)
2023-02-18 03:48:39,467 DEBUG awx.main.dispatch delivered 005aaad8-036d-4a5d-baee-fbf754253f4b to worker[192] qsize 0
2023-02-18 03:48:39,470 DEBUG awx.main.dispatch task 005aaad8-036d-4a5d-baee-fbf754253f4b starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:48:39,471 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:48:39,551 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:48:39,627 DEBUG awx.main.dispatch task 005aaad8-036d-4a5d-baee-fbf754253f4b is finished
2023-02-18 03:48:51,649 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(301682e4-7752-4ebc-a560-223dab25b358, queue=onap-awx-0)
[2023-02-18 03:48:51,649: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(301682e4-7752-4ebc-a560-223dab25b358, queue=onap-awx-0)
2023-02-18 03:48:51,762 DEBUG awx.main.dispatch delivered 301682e4-7752-4ebc-a560-223dab25b358 to worker[195] qsize 0
2023-02-18 03:48:51,765 DEBUG awx.main.dispatch task 301682e4-7752-4ebc-a560-223dab25b358 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:48:52,024 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:48:52,077 DEBUG awx.main.dispatch task 301682e4-7752-4ebc-a560-223dab25b358 is finished
2023-02-18 03:48:51,945 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(d8ae3c0d-e8cb-4446-b6cb-4760e71efbd5, queue=onap-awx-0)
[2023-02-18 03:48:51,945: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(d8ae3c0d-e8cb-4446-b6cb-4760e71efbd5, queue=onap-awx-0)
2023-02-18 03:48:52,219 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(83ac34d7-8374-452f-b041-80b1ac8e3ff8, queue=awx_private_queue)
[2023-02-18 03:48:52,219: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(83ac34d7-8374-452f-b041-80b1ac8e3ff8, queue=awx_private_queue)
2023-02-18 03:48:52,218 DEBUG awx.main.dispatch delivered d8ae3c0d-e8cb-4446-b6cb-4760e71efbd5 to worker[195] qsize 0
2023-02-18 03:48:52,222 DEBUG awx.main.dispatch task d8ae3c0d-e8cb-4446-b6cb-4760e71efbd5 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:48:52,233 DEBUG awx.main.dispatch delivered 83ac34d7-8374-452f-b041-80b1ac8e3ff8 to worker[192] qsize 0
2023-02-18 03:48:52,235 DEBUG awx.main.dispatch task 83ac34d7-8374-452f-b041-80b1ac8e3ff8 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:48:52,251 DEBUG awx.main.dispatch task d8ae3c0d-e8cb-4446-b6cb-4760e71efbd5 is finished
2023-02-18 03:48:52,258 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:48:52,264 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:48:22.251416+00:00
2023-02-18 03:48:52,290 DEBUG awx.main.dispatch task 83ac34d7-8374-452f-b041-80b1ac8e3ff8 is finished
2023-02-18 03:48:59,453 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(28e588d7-1d26-4cd9-9758-9812d01fcf22, queue=awx_private_queue)
[2023-02-18 03:48:59,453: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(28e588d7-1d26-4cd9-9758-9812d01fcf22, queue=awx_private_queue)
2023-02-18 03:48:59,472 DEBUG awx.main.dispatch delivered 28e588d7-1d26-4cd9-9758-9812d01fcf22 to worker[192] qsize 0
2023-02-18 03:48:59,476 DEBUG awx.main.dispatch task 28e588d7-1d26-4cd9-9758-9812d01fcf22 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:48:59,477 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:48:59,590 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:48:59,683 DEBUG awx.main.dispatch task 28e588d7-1d26-4cd9-9758-9812d01fcf22 is finished
RESULT 2
OKREADY
2023-02-18 03:49:19,470 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(1d6c2f9e-6ca6-4398-b3bf-ed47691b7727, queue=awx_private_queue)
[2023-02-18 03:49:19,470: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(1d6c2f9e-6ca6-4398-b3bf-ed47691b7727, queue=awx_private_queue)
2023-02-18 03:49:19,491 DEBUG awx.main.dispatch delivered 1d6c2f9e-6ca6-4398-b3bf-ed47691b7727 to worker[195] qsize 0
2023-02-18 03:49:19,496 DEBUG awx.main.dispatch task 1d6c2f9e-6ca6-4398-b3bf-ed47691b7727 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:49:19,499 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:49:19,604 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:49:19,695 DEBUG awx.main.dispatch task 1d6c2f9e-6ca6-4398-b3bf-ed47691b7727 is finished
2023-02-18 03:49:22,220 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(622f7d08-a691-4265-9d26-2a4419b7a4de, queue=awx_private_queue)
[2023-02-18 03:49:22,220: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(622f7d08-a691-4265-9d26-2a4419b7a4de, queue=awx_private_queue)
2023-02-18 03:49:22,236 DEBUG awx.main.dispatch delivered 622f7d08-a691-4265-9d26-2a4419b7a4de to worker[197] qsize 0
2023-02-18 03:49:22,239 DEBUG awx.main.dispatch task 622f7d08-a691-4265-9d26-2a4419b7a4de starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:49:22,258 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:49:22,267 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:48:52.258159+00:00
2023-02-18 03:49:22,301 DEBUG awx.main.dispatch task 622f7d08-a691-4265-9d26-2a4419b7a4de is finished
2023-02-18 03:49:39,476 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e51002fb-da87-4748-9647-741865877ce9, queue=awx_private_queue)
[2023-02-18 03:49:39,476: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e51002fb-da87-4748-9647-741865877ce9, queue=awx_private_queue)
2023-02-18 03:49:39,494 DEBUG awx.main.dispatch delivered e51002fb-da87-4748-9647-741865877ce9 to worker[183] qsize 0
2023-02-18 03:49:39,498 DEBUG awx.main.dispatch task e51002fb-da87-4748-9647-741865877ce9 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:49:39,503 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:49:39,609 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:49:39,683 DEBUG awx.main.dispatch task e51002fb-da87-4748-9647-741865877ce9 is finished
2023-02-18 03:49:51,649 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(7fc5de56-903b-416a-9f93-325e47550a56, queue=onap-awx-0)
[2023-02-18 03:49:51,649: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(7fc5de56-903b-416a-9f93-325e47550a56, queue=onap-awx-0)
2023-02-18 03:49:51,738 DEBUG awx.main.dispatch delivered 7fc5de56-903b-416a-9f93-325e47550a56 to worker[197] qsize 0
2023-02-18 03:49:51,741 DEBUG awx.main.dispatch task 7fc5de56-903b-416a-9f93-325e47550a56 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:49:51,743 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:49:51,789 DEBUG awx.main.dispatch task 7fc5de56-903b-416a-9f93-325e47550a56 is finished
2023-02-18 03:49:51,944 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(2d3ff4ae-f176-4aab-ba75-29291e6396eb, queue=onap-awx-0)
[2023-02-18 03:49:51,944: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(2d3ff4ae-f176-4aab-ba75-29291e6396eb, queue=onap-awx-0)
2023-02-18 03:49:51,975 DEBUG awx.main.dispatch delivered 2d3ff4ae-f176-4aab-ba75-29291e6396eb to worker[183] qsize 0
2023-02-18 03:49:51,978 DEBUG awx.main.dispatch task 2d3ff4ae-f176-4aab-ba75-29291e6396eb starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:49:51,999 DEBUG awx.main.dispatch task 2d3ff4ae-f176-4aab-ba75-29291e6396eb is finished
2023-02-18 03:49:52,220 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(5739ca4f-5f75-4d94-b8c2-07fec50e0061, queue=awx_private_queue)
[2023-02-18 03:49:52,220: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(5739ca4f-5f75-4d94-b8c2-07fec50e0061, queue=awx_private_queue)
2023-02-18 03:49:52,445 DEBUG awx.main.dispatch delivered 5739ca4f-5f75-4d94-b8c2-07fec50e0061 to worker[192] qsize 0
2023-02-18 03:49:52,449 DEBUG awx.main.dispatch task 5739ca4f-5f75-4d94-b8c2-07fec50e0061 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:49:52,464 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:49:52,470 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:49:22.258402+00:00
2023-02-18 03:49:52,521 DEBUG awx.main.dispatch task 5739ca4f-5f75-4d94-b8c2-07fec50e0061 is finished
2023-02-18 03:49:59,476 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(28ce5a3d-6cd1-422b-8f08-e4bcfc4eae2f, queue=awx_private_queue)
[2023-02-18 03:49:59,476: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(28ce5a3d-6cd1-422b-8f08-e4bcfc4eae2f, queue=awx_private_queue)
2023-02-18 03:49:59,492 DEBUG awx.main.dispatch delivered 28ce5a3d-6cd1-422b-8f08-e4bcfc4eae2f to worker[195] qsize 0
2023-02-18 03:49:59,494 DEBUG awx.main.dispatch task 28ce5a3d-6cd1-422b-8f08-e4bcfc4eae2f starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:49:59,497 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:49:59,598 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:49:59,692 DEBUG awx.main.dispatch task 28ce5a3d-6cd1-422b-8f08-e4bcfc4eae2f is finished
RESULT 2
OKREADY
2023-02-18 03:50:19,487 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7abad3e3-2c26-419a-aa64-87e2a41d4017, queue=awx_private_queue)
[2023-02-18 03:50:19,487: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7abad3e3-2c26-419a-aa64-87e2a41d4017, queue=awx_private_queue)
2023-02-18 03:50:19,512 DEBUG awx.main.dispatch delivered 7abad3e3-2c26-419a-aa64-87e2a41d4017 to worker[197] qsize 0
2023-02-18 03:50:19,516 DEBUG awx.main.dispatch task 7abad3e3-2c26-419a-aa64-87e2a41d4017 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:50:19,518 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:50:19,626 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:50:19,745 DEBUG awx.main.dispatch task 7abad3e3-2c26-419a-aa64-87e2a41d4017 is finished
2023-02-18 03:50:22,219 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(2fce44cf-cb86-4d98-b411-151ff1b95aa0, queue=awx_private_queue)
[2023-02-18 03:50:22,219: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(2fce44cf-cb86-4d98-b411-151ff1b95aa0, queue=awx_private_queue)
2023-02-18 03:50:22,235 DEBUG awx.main.dispatch delivered 2fce44cf-cb86-4d98-b411-151ff1b95aa0 to worker[197] qsize 0
2023-02-18 03:50:22,237 DEBUG awx.main.dispatch task 2fce44cf-cb86-4d98-b411-151ff1b95aa0 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:50:22,250 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:50:22,253 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:49:52.464286+00:00
2023-02-18 03:50:22,305 DEBUG awx.main.dispatch task 2fce44cf-cb86-4d98-b411-151ff1b95aa0 is finished
2023-02-18 03:50:39,494 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(016327be-747f-497c-b947-dfb534f858c3, queue=awx_private_queue)
[2023-02-18 03:50:39,494: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(016327be-747f-497c-b947-dfb534f858c3, queue=awx_private_queue)
2023-02-18 03:50:39,510 DEBUG awx.main.dispatch delivered 016327be-747f-497c-b947-dfb534f858c3 to worker[195] qsize 0
2023-02-18 03:50:39,514 DEBUG awx.main.dispatch task 016327be-747f-497c-b947-dfb534f858c3 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:50:39,516 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:50:39,564 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:50:39,619 DEBUG awx.main.dispatch task 016327be-747f-497c-b947-dfb534f858c3 is finished
2023-02-18 03:50:51,649 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(27e7cf93-5e2e-4efb-9147-c14100dbc0b0, queue=onap-awx-0)
[2023-02-18 03:50:51,649: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(27e7cf93-5e2e-4efb-9147-c14100dbc0b0, queue=onap-awx-0)
2023-02-18 03:50:51,763 DEBUG awx.main.dispatch delivered 27e7cf93-5e2e-4efb-9147-c14100dbc0b0 to worker[183] qsize 0
2023-02-18 03:50:51,766 DEBUG awx.main.dispatch task 27e7cf93-5e2e-4efb-9147-c14100dbc0b0 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:50:51,769 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:50:51,944 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(18757b19-c746-46ff-8cf4-93f78b249e4e, queue=onap-awx-0)
[2023-02-18 03:50:51,944: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(18757b19-c746-46ff-8cf4-93f78b249e4e, queue=onap-awx-0)
2023-02-18 03:50:51,961 DEBUG awx.main.dispatch delivered 18757b19-c746-46ff-8cf4-93f78b249e4e to worker[195] qsize 0
2023-02-18 03:50:51,964 DEBUG awx.main.dispatch task 18757b19-c746-46ff-8cf4-93f78b249e4e starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:50:51,981 DEBUG awx.main.dispatch task 27e7cf93-5e2e-4efb-9147-c14100dbc0b0 is finished
2023-02-18 03:50:52,059 DEBUG awx.main.dispatch task 18757b19-c746-46ff-8cf4-93f78b249e4e is finished
2023-02-18 03:50:52,220 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(3a23f50e-64c2-4005-98fd-a2698061aa0b, queue=awx_private_queue)
[2023-02-18 03:50:52,220: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(3a23f50e-64c2-4005-98fd-a2698061aa0b, queue=awx_private_queue)
2023-02-18 03:50:52,237 DEBUG awx.main.dispatch delivered 3a23f50e-64c2-4005-98fd-a2698061aa0b to worker[195] qsize 0
2023-02-18 03:50:52,240 DEBUG awx.main.dispatch task 3a23f50e-64c2-4005-98fd-a2698061aa0b starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:50:52,300 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:50:52,308 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:50:22.250665+00:00
2023-02-18 03:50:52,362 DEBUG awx.main.dispatch task 3a23f50e-64c2-4005-98fd-a2698061aa0b is finished
2023-02-18 03:50:59,494 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(8c6ece8d-7826-401e-b53f-d1b2964c1398, queue=awx_private_queue)
[2023-02-18 03:50:59,494: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(8c6ece8d-7826-401e-b53f-d1b2964c1398, queue=awx_private_queue)
2023-02-18 03:50:59,511 DEBUG awx.main.dispatch delivered 8c6ece8d-7826-401e-b53f-d1b2964c1398 to worker[195] qsize 0
2023-02-18 03:50:59,710 DEBUG awx.main.dispatch task 8c6ece8d-7826-401e-b53f-d1b2964c1398 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:50:59,712 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:50:59,798 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:50:59,939 DEBUG awx.main.dispatch task 8c6ece8d-7826-401e-b53f-d1b2964c1398 is finished
RESULT 2
OKREADY
2023-02-18 03:51:19,504 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(bbbb3302-7a7c-46d1-84d7-f72e2ebdde24, queue=awx_private_queue)
[2023-02-18 03:51:19,504: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(bbbb3302-7a7c-46d1-84d7-f72e2ebdde24, queue=awx_private_queue)
2023-02-18 03:51:19,523 DEBUG awx.main.dispatch delivered bbbb3302-7a7c-46d1-84d7-f72e2ebdde24 to worker[183] qsize 0
2023-02-18 03:51:19,526 DEBUG awx.main.dispatch task bbbb3302-7a7c-46d1-84d7-f72e2ebdde24 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:51:19,527 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:51:19,599 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:51:19,776 DEBUG awx.main.dispatch task bbbb3302-7a7c-46d1-84d7-f72e2ebdde24 is finished
2023-02-18 03:51:22,220 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(788e0a88-ae64-4f7a-bac5-0559514edb03, queue=awx_private_queue)
[2023-02-18 03:51:22,220: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(788e0a88-ae64-4f7a-bac5-0559514edb03, queue=awx_private_queue)
2023-02-18 03:51:22,237 DEBUG awx.main.dispatch delivered 788e0a88-ae64-4f7a-bac5-0559514edb03 to worker[192] qsize 0
2023-02-18 03:51:22,241 DEBUG awx.main.dispatch task 788e0a88-ae64-4f7a-bac5-0559514edb03 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:51:22,261 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:51:22,265 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:50:52.300766+00:00
2023-02-18 03:51:22,296 DEBUG awx.main.dispatch task 788e0a88-ae64-4f7a-bac5-0559514edb03 is finished
2023-02-18 03:51:39,511 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d2aff14f-84cf-4f98-aebd-187496ebe753, queue=awx_private_queue)
[2023-02-18 03:51:39,511: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d2aff14f-84cf-4f98-aebd-187496ebe753, queue=awx_private_queue)
2023-02-18 03:51:39,527 DEBUG awx.main.dispatch delivered d2aff14f-84cf-4f98-aebd-187496ebe753 to worker[195] qsize 0
2023-02-18 03:51:39,530 DEBUG awx.main.dispatch task d2aff14f-84cf-4f98-aebd-187496ebe753 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:51:39,531 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:51:39,635 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:51:39,777 DEBUG awx.main.dispatch task d2aff14f-84cf-4f98-aebd-187496ebe753 is finished
2023-02-18 03:51:51,649 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(b482c610-96f9-4a9d-a708-4e88551f369e, queue=onap-awx-0)
[2023-02-18 03:51:51,649: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(b482c610-96f9-4a9d-a708-4e88551f369e, queue=onap-awx-0)
2023-02-18 03:51:51,724 DEBUG awx.main.dispatch delivered b482c610-96f9-4a9d-a708-4e88551f369e to worker[197] qsize 0
2023-02-18 03:51:51,726 DEBUG awx.main.dispatch task b482c610-96f9-4a9d-a708-4e88551f369e starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:51:51,729 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:51:51,887 DEBUG awx.main.dispatch task b482c610-96f9-4a9d-a708-4e88551f369e is finished
2023-02-18 03:51:51,944 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(9bfc8212-de9d-4d3b-af55-5f2b682834f8, queue=onap-awx-0)
[2023-02-18 03:51:51,944: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(9bfc8212-de9d-4d3b-af55-5f2b682834f8, queue=onap-awx-0)
2023-02-18 03:51:51,962 DEBUG awx.main.dispatch delivered 9bfc8212-de9d-4d3b-af55-5f2b682834f8 to worker[183] qsize 0
2023-02-18 03:51:51,964 DEBUG awx.main.dispatch task 9bfc8212-de9d-4d3b-af55-5f2b682834f8 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:51:52,047 DEBUG awx.main.dispatch task 9bfc8212-de9d-4d3b-af55-5f2b682834f8 is finished
2023-02-18 03:51:52,220 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(f2e728f1-fc3a-46e3-89ea-35bd0a7b01e0, queue=awx_private_queue)
[2023-02-18 03:51:52,220: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(f2e728f1-fc3a-46e3-89ea-35bd0a7b01e0, queue=awx_private_queue)
2023-02-18 03:51:52,235 DEBUG awx.main.dispatch delivered f2e728f1-fc3a-46e3-89ea-35bd0a7b01e0 to worker[192] qsize 0
2023-02-18 03:51:52,238 DEBUG awx.main.dispatch task f2e728f1-fc3a-46e3-89ea-35bd0a7b01e0 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:51:52,300 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:51:52,311 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:51:22.261261+00:00
2023-02-18 03:51:52,397 DEBUG awx.main.dispatch task f2e728f1-fc3a-46e3-89ea-35bd0a7b01e0 is finished
2023-02-18 03:51:59,511 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(2164db51-4ecf-4bfa-aa42-d55eaad3f77d, queue=awx_private_queue)
[2023-02-18 03:51:59,511: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(2164db51-4ecf-4bfa-aa42-d55eaad3f77d, queue=awx_private_queue)
2023-02-18 03:51:59,527 DEBUG awx.main.dispatch delivered 2164db51-4ecf-4bfa-aa42-d55eaad3f77d to worker[197] qsize 0
2023-02-18 03:51:59,716 DEBUG awx.main.dispatch task 2164db51-4ecf-4bfa-aa42-d55eaad3f77d starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:51:59,717 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:51:59,831 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:51:59,933 DEBUG awx.main.dispatch task 2164db51-4ecf-4bfa-aa42-d55eaad3f77d is finished
RESULT 2
OKREADY
2023-02-18 03:52:19,514 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3c56a0d5-d854-42a0-b416-1f9520cbb4a6, queue=awx_private_queue)
[2023-02-18 03:52:19,514: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3c56a0d5-d854-42a0-b416-1f9520cbb4a6, queue=awx_private_queue)
2023-02-18 03:52:19,530 DEBUG awx.main.dispatch delivered 3c56a0d5-d854-42a0-b416-1f9520cbb4a6 to worker[195] qsize 0
2023-02-18 03:52:19,533 DEBUG awx.main.dispatch task 3c56a0d5-d854-42a0-b416-1f9520cbb4a6 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:52:19,536 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:52:19,654 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:52:19,780 DEBUG awx.main.dispatch task 3c56a0d5-d854-42a0-b416-1f9520cbb4a6 is finished
2023-02-18 03:52:22,220 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(813c920b-3745-4457-8942-58e334f6aaf6, queue=awx_private_queue)
[2023-02-18 03:52:22,220: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(813c920b-3745-4457-8942-58e334f6aaf6, queue=awx_private_queue)
2023-02-18 03:52:22,236 DEBUG awx.main.dispatch delivered 813c920b-3745-4457-8942-58e334f6aaf6 to worker[192] qsize 0
2023-02-18 03:52:22,238 DEBUG awx.main.dispatch task 813c920b-3745-4457-8942-58e334f6aaf6 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:52:22,287 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:52:22,295 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:51:52.301048+00:00
2023-02-18 03:52:22,336 DEBUG awx.main.dispatch task 813c920b-3745-4457-8942-58e334f6aaf6 is finished
2023-02-18 03:52:39,514 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(68300d77-c18d-4b88-810a-3a1e487b36e6, queue=awx_private_queue)
[2023-02-18 03:52:39,514: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(68300d77-c18d-4b88-810a-3a1e487b36e6, queue=awx_private_queue)
2023-02-18 03:52:39,529 DEBUG awx.main.dispatch delivered 68300d77-c18d-4b88-810a-3a1e487b36e6 to worker[183] qsize 0
2023-02-18 03:52:39,531 DEBUG awx.main.dispatch task 68300d77-c18d-4b88-810a-3a1e487b36e6 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:52:39,532 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:52:39,677 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:52:39,798 DEBUG awx.main.dispatch task 68300d77-c18d-4b88-810a-3a1e487b36e6 is finished
2023-02-18 03:52:51,652 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(4f95cc15-e18f-4206-b051-9fb76713a653, queue=onap-awx-0)
[2023-02-18 03:52:51,652: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(4f95cc15-e18f-4206-b051-9fb76713a653, queue=onap-awx-0)
2023-02-18 03:52:51,797 DEBUG awx.main.dispatch delivered 4f95cc15-e18f-4206-b051-9fb76713a653 to worker[195] qsize 0
2023-02-18 03:52:51,799 DEBUG awx.main.dispatch task 4f95cc15-e18f-4206-b051-9fb76713a653 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:52:51,801 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:52:51,944 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(4e435214-b3b4-45b7-bff4-53fcaf553460, queue=onap-awx-0)
[2023-02-18 03:52:51,944: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(4e435214-b3b4-45b7-bff4-53fcaf553460, queue=onap-awx-0)
2023-02-18 03:52:51,960 DEBUG awx.main.dispatch delivered 4e435214-b3b4-45b7-bff4-53fcaf553460 to worker[183] qsize 0
2023-02-18 03:52:51,963 DEBUG awx.main.dispatch task 4e435214-b3b4-45b7-bff4-53fcaf553460 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:52:52,066 DEBUG awx.main.dispatch task 4f95cc15-e18f-4206-b051-9fb76713a653 is finished
2023-02-18 03:52:52,075 DEBUG awx.main.dispatch task 4e435214-b3b4-45b7-bff4-53fcaf553460 is finished
2023-02-18 03:52:52,220 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(eb7d5eb4-7a15-4fcc-bdaf-c9a23f75e8ea, queue=awx_private_queue)
[2023-02-18 03:52:52,220: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(eb7d5eb4-7a15-4fcc-bdaf-c9a23f75e8ea, queue=awx_private_queue)
2023-02-18 03:52:52,238 DEBUG awx.main.dispatch delivered eb7d5eb4-7a15-4fcc-bdaf-c9a23f75e8ea to worker[183] qsize 0
2023-02-18 03:52:52,240 DEBUG awx.main.dispatch task eb7d5eb4-7a15-4fcc-bdaf-c9a23f75e8ea starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:52:52,295 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:52:52,304 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:52:22.287634+00:00
2023-02-18 03:52:52,436 DEBUG awx.main.dispatch task eb7d5eb4-7a15-4fcc-bdaf-c9a23f75e8ea is finished
2023-02-18 03:52:59,514 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(16dac122-a4f4-47b9-a0e9-62bcac9a5131, queue=awx_private_queue)
[2023-02-18 03:52:59,514: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(16dac122-a4f4-47b9-a0e9-62bcac9a5131, queue=awx_private_queue)
2023-02-18 03:52:59,530 DEBUG awx.main.dispatch delivered 16dac122-a4f4-47b9-a0e9-62bcac9a5131 to worker[197] qsize 0
2023-02-18 03:52:59,533 DEBUG awx.main.dispatch task 16dac122-a4f4-47b9-a0e9-62bcac9a5131 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:52:59,536 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:52:59,680 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:52:59,871 DEBUG awx.main.dispatch task 16dac122-a4f4-47b9-a0e9-62bcac9a5131 is finished
RESULT 2
OKREADY
2023-02-18 03:53:19,520 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(6f1b7282-48ca-450e-89e6-44f699aba6d9, queue=awx_private_queue)
[2023-02-18 03:53:19,520: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(6f1b7282-48ca-450e-89e6-44f699aba6d9, queue=awx_private_queue)
2023-02-18 03:53:19,538 DEBUG awx.main.dispatch delivered 6f1b7282-48ca-450e-89e6-44f699aba6d9 to worker[192] qsize 0
2023-02-18 03:53:19,541 DEBUG awx.main.dispatch task 6f1b7282-48ca-450e-89e6-44f699aba6d9 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:53:19,543 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:53:19,701 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:53:19,851 DEBUG awx.main.dispatch task 6f1b7282-48ca-450e-89e6-44f699aba6d9 is finished
2023-02-18 03:53:22,220 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(99cb0c65-8ae6-43bf-bd77-8716627f15d8, queue=awx_private_queue)
[2023-02-18 03:53:22,220: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(99cb0c65-8ae6-43bf-bd77-8716627f15d8, queue=awx_private_queue)
2023-02-18 03:53:22,236 DEBUG awx.main.dispatch delivered 99cb0c65-8ae6-43bf-bd77-8716627f15d8 to worker[195] qsize 0
2023-02-18 03:53:22,239 DEBUG awx.main.dispatch task 99cb0c65-8ae6-43bf-bd77-8716627f15d8 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:53:22,480 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:53:22,491 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:52:52.295769+00:00
2023-02-18 03:53:22,579 DEBUG awx.main.dispatch task 99cb0c65-8ae6-43bf-bd77-8716627f15d8 is finished
2023-02-18 03:53:39,520 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a0f18d7f-45c6-409b-bd6b-6f7f5ed18ce5, queue=awx_private_queue)
[2023-02-18 03:53:39,520: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a0f18d7f-45c6-409b-bd6b-6f7f5ed18ce5, queue=awx_private_queue)
2023-02-18 03:53:39,538 DEBUG awx.main.dispatch delivered a0f18d7f-45c6-409b-bd6b-6f7f5ed18ce5 to worker[197] qsize 0
2023-02-18 03:53:39,540 DEBUG awx.main.dispatch task a0f18d7f-45c6-409b-bd6b-6f7f5ed18ce5 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:53:39,542 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:53:39,708 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:53:39,784 DEBUG awx.main.dispatch task a0f18d7f-45c6-409b-bd6b-6f7f5ed18ce5 is finished
2023-02-18 03:53:51,654 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(90c08c66-38db-4ab2-8f2a-d3da1bf01b38, queue=onap-awx-0)
[2023-02-18 03:53:51,654: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(90c08c66-38db-4ab2-8f2a-d3da1bf01b38, queue=onap-awx-0)
2023-02-18 03:53:51,746 DEBUG awx.main.dispatch delivered 90c08c66-38db-4ab2-8f2a-d3da1bf01b38 to worker[195] qsize 0
2023-02-18 03:53:51,749 DEBUG awx.main.dispatch task 90c08c66-38db-4ab2-8f2a-d3da1bf01b38 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:53:51,750 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:53:51,886 DEBUG awx.main.dispatch task 90c08c66-38db-4ab2-8f2a-d3da1bf01b38 is finished
2023-02-18 03:53:51,944 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(d3b95a76-3fb0-4199-bbf2-83a4e4996e14, queue=onap-awx-0)
[2023-02-18 03:53:51,944: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(d3b95a76-3fb0-4199-bbf2-83a4e4996e14, queue=onap-awx-0)
2023-02-18 03:53:51,960 DEBUG awx.main.dispatch delivered d3b95a76-3fb0-4199-bbf2-83a4e4996e14 to worker[192] qsize 0
2023-02-18 03:53:51,962 DEBUG awx.main.dispatch task d3b95a76-3fb0-4199-bbf2-83a4e4996e14 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:53:52,003 DEBUG awx.main.dispatch task d3b95a76-3fb0-4199-bbf2-83a4e4996e14 is finished
2023-02-18 03:53:52,220 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(56b87f3b-d805-4f3d-93dc-a83d77fb0e8b, queue=awx_private_queue)
[2023-02-18 03:53:52,220: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(56b87f3b-d805-4f3d-93dc-a83d77fb0e8b, queue=awx_private_queue)
2023-02-18 03:53:52,236 DEBUG awx.main.dispatch delivered 56b87f3b-d805-4f3d-93dc-a83d77fb0e8b to worker[192] qsize 0
2023-02-18 03:53:52,238 DEBUG awx.main.dispatch task 56b87f3b-d805-4f3d-93dc-a83d77fb0e8b starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:53:52,292 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:53:52,302 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:53:22.480753+00:00
2023-02-18 03:53:52,348 DEBUG awx.main.dispatch task 56b87f3b-d805-4f3d-93dc-a83d77fb0e8b is finished
2023-02-18 03:53:59,521 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(3d918b18-bb9e-4390-a65b-dfedeeee7c02, queue=awx_private_queue)
[2023-02-18 03:53:59,521: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(3d918b18-bb9e-4390-a65b-dfedeeee7c02, queue=awx_private_queue)
2023-02-18 03:53:59,539 DEBUG awx.main.dispatch delivered 3d918b18-bb9e-4390-a65b-dfedeeee7c02 to worker[197] qsize 0
2023-02-18 03:53:59,544 DEBUG awx.main.dispatch task 3d918b18-bb9e-4390-a65b-dfedeeee7c02 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:53:59,548 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:53:59,741 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:53:59,920 DEBUG awx.main.dispatch task 3d918b18-bb9e-4390-a65b-dfedeeee7c02 is finished
RESULT 2
OKREADY
2023-02-18 03:54:19,535 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(087d4b0f-c01c-4fe5-8080-764e698b02b0, queue=awx_private_queue)
[2023-02-18 03:54:19,535: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(087d4b0f-c01c-4fe5-8080-764e698b02b0, queue=awx_private_queue)
2023-02-18 03:54:19,559 DEBUG awx.main.dispatch delivered 087d4b0f-c01c-4fe5-8080-764e698b02b0 to worker[183] qsize 0
2023-02-18 03:54:19,563 DEBUG awx.main.dispatch task 087d4b0f-c01c-4fe5-8080-764e698b02b0 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:54:19,568 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:54:19,676 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:54:19,783 DEBUG awx.main.dispatch task 087d4b0f-c01c-4fe5-8080-764e698b02b0 is finished
2023-02-18 03:54:22,220 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(2d7e6f79-ef4a-46ab-b84f-d8a0f1f83cc8, queue=awx_private_queue)
[2023-02-18 03:54:22,220: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(2d7e6f79-ef4a-46ab-b84f-d8a0f1f83cc8, queue=awx_private_queue)
2023-02-18 03:54:22,285 DEBUG awx.main.dispatch delivered 2d7e6f79-ef4a-46ab-b84f-d8a0f1f83cc8 to worker[183] qsize 0
2023-02-18 03:54:22,287 DEBUG awx.main.dispatch task 2d7e6f79-ef4a-46ab-b84f-d8a0f1f83cc8 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:54:22,302 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:54:22,307 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:53:52.293161+00:00
2023-02-18 03:54:22,341 DEBUG awx.main.dispatch task 2d7e6f79-ef4a-46ab-b84f-d8a0f1f83cc8 is finished
2023-02-18 03:54:39,533 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(894beb82-0672-449e-8b27-545123e9360e, queue=awx_private_queue)
[2023-02-18 03:54:39,533: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(894beb82-0672-449e-8b27-545123e9360e, queue=awx_private_queue)
2023-02-18 03:54:39,550 DEBUG awx.main.dispatch delivered 894beb82-0672-449e-8b27-545123e9360e to worker[183] qsize 0
2023-02-18 03:54:39,553 DEBUG awx.main.dispatch task 894beb82-0672-449e-8b27-545123e9360e starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:54:39,554 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:54:39,606 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:54:39,738 DEBUG awx.main.dispatch task 894beb82-0672-449e-8b27-545123e9360e is finished
2023-02-18 03:54:51,479 DEBUG awx.main.dispatch publish awx.main.tasks.awx_isolated_heartbeat(ce715e08-d156-44cb-b9db-13ced580b290, queue=onap-awx-0)
[2023-02-18 03:54:51,479: DEBUG/Process-1] publish awx.main.tasks.awx_isolated_heartbeat(ce715e08-d156-44cb-b9db-13ced580b290, queue=onap-awx-0)
2023-02-18 03:54:51,502 DEBUG awx.main.dispatch delivered ce715e08-d156-44cb-b9db-13ced580b290 to worker[197] qsize 0
2023-02-18 03:54:51,505 DEBUG awx.main.dispatch task ce715e08-d156-44cb-b9db-13ced580b290 starting awx.main.tasks.awx_isolated_heartbeat(*[])
2023-02-18 03:54:51,508 DEBUG awx.main.tasks Controlling node checking for any isolated management tasks.
2023-02-18 03:54:51,598 DEBUG awx.main.dispatch task ce715e08-d156-44cb-b9db-13ced580b290 is finished
2023-02-18 03:54:51,653 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(3d38790b-23de-4f31-a59d-61fc661a35bc, queue=onap-awx-0)
[2023-02-18 03:54:51,653: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(3d38790b-23de-4f31-a59d-61fc661a35bc, queue=onap-awx-0)
2023-02-18 03:54:51,715 DEBUG awx.main.dispatch delivered 3d38790b-23de-4f31-a59d-61fc661a35bc to worker[192] qsize 0
2023-02-18 03:54:51,718 DEBUG awx.main.dispatch task 3d38790b-23de-4f31-a59d-61fc661a35bc starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:54:51,721 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:54:51,793 DEBUG awx.main.dispatch task 3d38790b-23de-4f31-a59d-61fc661a35bc is finished
2023-02-18 03:54:51,944 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(154e845f-cc26-4db3-926d-38e650b5944c, queue=onap-awx-0)
[2023-02-18 03:54:51,944: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(154e845f-cc26-4db3-926d-38e650b5944c, queue=onap-awx-0)
2023-02-18 03:54:51,962 DEBUG awx.main.dispatch delivered 154e845f-cc26-4db3-926d-38e650b5944c to worker[183] qsize 0
2023-02-18 03:54:51,965 DEBUG awx.main.dispatch task 154e845f-cc26-4db3-926d-38e650b5944c starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:54:52,008 DEBUG awx.main.dispatch task 154e845f-cc26-4db3-926d-38e650b5944c is finished
2023-02-18 03:54:52,220 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(412d7e0d-f8bb-428d-8ad3-768fc881bde2, queue=awx_private_queue)
[2023-02-18 03:54:52,220: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(412d7e0d-f8bb-428d-8ad3-768fc881bde2, queue=awx_private_queue)
2023-02-18 03:54:52,470 DEBUG awx.main.dispatch delivered 412d7e0d-f8bb-428d-8ad3-768fc881bde2 to worker[195] qsize 0
2023-02-18 03:54:52,474 DEBUG awx.main.dispatch task 412d7e0d-f8bb-428d-8ad3-768fc881bde2 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:54:52,501 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:54:52,506 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:54:22.302230+00:00
2023-02-18 03:54:52,548 DEBUG awx.main.dispatch task 412d7e0d-f8bb-428d-8ad3-768fc881bde2 is finished
2023-02-18 03:54:59,533 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(d6f94293-79e9-4b54-8572-af6c43263eee, queue=awx_private_queue)
[2023-02-18 03:54:59,533: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(d6f94293-79e9-4b54-8572-af6c43263eee, queue=awx_private_queue)
2023-02-18 03:54:59,549 DEBUG awx.main.dispatch delivered d6f94293-79e9-4b54-8572-af6c43263eee to worker[192] qsize 0
2023-02-18 03:54:59,552 DEBUG awx.main.dispatch task d6f94293-79e9-4b54-8572-af6c43263eee starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:54:59,555 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:54:59,604 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:54:59,702 DEBUG awx.main.dispatch task d6f94293-79e9-4b54-8572-af6c43263eee is finished
RESULT 2
OKREADY
2023-02-18 03:55:19,546 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(712c0163-2ab9-4fb4-9ac4-5e837ae0077b, queue=awx_private_queue)
[2023-02-18 03:55:19,546: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(712c0163-2ab9-4fb4-9ac4-5e837ae0077b, queue=awx_private_queue)
2023-02-18 03:55:19,564 DEBUG awx.main.dispatch delivered 712c0163-2ab9-4fb4-9ac4-5e837ae0077b to worker[197] qsize 0
2023-02-18 03:55:19,568 DEBUG awx.main.dispatch task 712c0163-2ab9-4fb4-9ac4-5e837ae0077b starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:55:19,571 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:55:19,603 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:55:19,664 DEBUG awx.main.dispatch task 712c0163-2ab9-4fb4-9ac4-5e837ae0077b is finished
2023-02-18 03:55:22,220 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(d67bbfed-17af-43e3-8226-68d8e2d70bb8, queue=awx_private_queue)
[2023-02-18 03:55:22,220: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(d67bbfed-17af-43e3-8226-68d8e2d70bb8, queue=awx_private_queue)
2023-02-18 03:55:22,237 DEBUG awx.main.dispatch delivered d67bbfed-17af-43e3-8226-68d8e2d70bb8 to worker[195] qsize 0
2023-02-18 03:55:22,240 DEBUG awx.main.dispatch task d67bbfed-17af-43e3-8226-68d8e2d70bb8 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:55:22,275 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:55:22,280 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:54:52.501353+00:00
2023-02-18 03:55:22,307 DEBUG awx.main.dispatch task d67bbfed-17af-43e3-8226-68d8e2d70bb8 is finished
2023-02-18 03:55:39,554 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(c2d8d29f-50b1-472c-91c2-ee9b07cff412, queue=awx_private_queue)
[2023-02-18 03:55:39,554: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(c2d8d29f-50b1-472c-91c2-ee9b07cff412, queue=awx_private_queue)
2023-02-18 03:55:39,571 DEBUG awx.main.dispatch delivered c2d8d29f-50b1-472c-91c2-ee9b07cff412 to worker[183] qsize 0
2023-02-18 03:55:39,574 DEBUG awx.main.dispatch task c2d8d29f-50b1-472c-91c2-ee9b07cff412 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:55:39,576 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:55:39,687 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:55:39,813 DEBUG awx.main.dispatch task c2d8d29f-50b1-472c-91c2-ee9b07cff412 is finished
2023-02-18 03:55:51,653 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(49b457b7-f2ef-4413-9a6f-57637f9ea709, queue=onap-awx-0)
[2023-02-18 03:55:51,653: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(49b457b7-f2ef-4413-9a6f-57637f9ea709, queue=onap-awx-0)
2023-02-18 03:55:51,775 DEBUG awx.main.dispatch delivered 49b457b7-f2ef-4413-9a6f-57637f9ea709 to worker[195] qsize 0
2023-02-18 03:55:51,793 DEBUG awx.main.dispatch task 49b457b7-f2ef-4413-9a6f-57637f9ea709 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:55:51,795 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:55:51,924 DEBUG awx.main.dispatch task 49b457b7-f2ef-4413-9a6f-57637f9ea709 is finished
2023-02-18 03:55:51,945 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(e4ef9542-3e86-44f2-b5b6-99ea88513656, queue=onap-awx-0)
[2023-02-18 03:55:51,945: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(e4ef9542-3e86-44f2-b5b6-99ea88513656, queue=onap-awx-0)
2023-02-18 03:55:51,963 DEBUG awx.main.dispatch delivered e4ef9542-3e86-44f2-b5b6-99ea88513656 to worker[183] qsize 0
2023-02-18 03:55:51,965 DEBUG awx.main.dispatch task e4ef9542-3e86-44f2-b5b6-99ea88513656 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:55:52,034 DEBUG awx.main.dispatch task e4ef9542-3e86-44f2-b5b6-99ea88513656 is finished
2023-02-18 03:55:52,220 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(5c96157e-b7e4-4bfd-bbf2-bc6fe48806c3, queue=awx_private_queue)
[2023-02-18 03:55:52,220: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(5c96157e-b7e4-4bfd-bbf2-bc6fe48806c3, queue=awx_private_queue)
2023-02-18 03:55:52,252 DEBUG awx.main.dispatch delivered 5c96157e-b7e4-4bfd-bbf2-bc6fe48806c3 to worker[195] qsize 0
2023-02-18 03:55:52,255 DEBUG awx.main.dispatch task 5c96157e-b7e4-4bfd-bbf2-bc6fe48806c3 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:55:52,268 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:55:52,276 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:55:22.276145+00:00
2023-02-18 03:55:52,305 DEBUG awx.main.dispatch task 5c96157e-b7e4-4bfd-bbf2-bc6fe48806c3 is finished
2023-02-18 03:55:59,554 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(97a523f6-41be-4bb0-9e90-e1859a136507, queue=awx_private_queue)
[2023-02-18 03:55:59,554: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(97a523f6-41be-4bb0-9e90-e1859a136507, queue=awx_private_queue)
2023-02-18 03:55:59,779 DEBUG awx.main.dispatch delivered 97a523f6-41be-4bb0-9e90-e1859a136507 to worker[192] qsize 0
2023-02-18 03:55:59,783 DEBUG awx.main.dispatch task 97a523f6-41be-4bb0-9e90-e1859a136507 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:55:59,786 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:55:59,874 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:56:00,105 DEBUG awx.main.dispatch task 97a523f6-41be-4bb0-9e90-e1859a136507 is finished
RESULT 2
OKREADY
2023-02-18 03:56:19,561 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(b0cfba60-b510-4f31-8052-7b827bc33b08, queue=awx_private_queue)
[2023-02-18 03:56:19,561: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(b0cfba60-b510-4f31-8052-7b827bc33b08, queue=awx_private_queue)
2023-02-18 03:56:19,578 DEBUG awx.main.dispatch delivered b0cfba60-b510-4f31-8052-7b827bc33b08 to worker[183] qsize 0
2023-02-18 03:56:19,581 DEBUG awx.main.dispatch task b0cfba60-b510-4f31-8052-7b827bc33b08 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:56:19,582 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:56:19,656 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:56:19,755 DEBUG awx.main.dispatch task b0cfba60-b510-4f31-8052-7b827bc33b08 is finished
2023-02-18 03:56:22,221 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(b3a63113-d887-4dba-9b63-b371fc561f5a, queue=awx_private_queue)
[2023-02-18 03:56:22,221: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(b3a63113-d887-4dba-9b63-b371fc561f5a, queue=awx_private_queue)
2023-02-18 03:56:22,237 DEBUG awx.main.dispatch delivered b3a63113-d887-4dba-9b63-b371fc561f5a to worker[192] qsize 0
2023-02-18 03:56:22,239 DEBUG awx.main.dispatch task b3a63113-d887-4dba-9b63-b371fc561f5a starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:56:22,269 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:56:22,273 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:55:52.269021+00:00
2023-02-18 03:56:22,330 DEBUG awx.main.dispatch task b3a63113-d887-4dba-9b63-b371fc561f5a is finished
2023-02-18 03:56:39,568 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(1bf9599b-f7bb-4082-8a12-34216825aaea, queue=awx_private_queue)
[2023-02-18 03:56:39,568: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(1bf9599b-f7bb-4082-8a12-34216825aaea, queue=awx_private_queue)
2023-02-18 03:56:39,583 DEBUG awx.main.dispatch delivered 1bf9599b-f7bb-4082-8a12-34216825aaea to worker[192] qsize 0
2023-02-18 03:56:39,586 DEBUG awx.main.dispatch task 1bf9599b-f7bb-4082-8a12-34216825aaea starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:56:39,587 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:56:39,674 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:56:39,802 DEBUG awx.main.dispatch task 1bf9599b-f7bb-4082-8a12-34216825aaea is finished
2023-02-18 03:56:51,659 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(9d349296-8a97-4abd-8f7c-f90d94757ccf, queue=onap-awx-0)
[2023-02-18 03:56:51,659: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(9d349296-8a97-4abd-8f7c-f90d94757ccf, queue=onap-awx-0)
2023-02-18 03:56:51,720 DEBUG awx.main.dispatch delivered 9d349296-8a97-4abd-8f7c-f90d94757ccf to worker[192] qsize 0
2023-02-18 03:56:51,723 DEBUG awx.main.dispatch task 9d349296-8a97-4abd-8f7c-f90d94757ccf starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:56:51,724 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:56:51,817 DEBUG awx.main.dispatch task 9d349296-8a97-4abd-8f7c-f90d94757ccf is finished
2023-02-18 03:56:51,944 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(b0280ff9-8bf9-4d82-bcdd-de2a9e405366, queue=onap-awx-0)
[2023-02-18 03:56:51,944: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(b0280ff9-8bf9-4d82-bcdd-de2a9e405366, queue=onap-awx-0)
2023-02-18 03:56:51,960 DEBUG awx.main.dispatch delivered b0280ff9-8bf9-4d82-bcdd-de2a9e405366 to worker[197] qsize 0
2023-02-18 03:56:51,962 DEBUG awx.main.dispatch task b0280ff9-8bf9-4d82-bcdd-de2a9e405366 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:56:51,987 DEBUG awx.main.dispatch task b0280ff9-8bf9-4d82-bcdd-de2a9e405366 is finished
2023-02-18 03:56:52,220 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(0580818e-9d93-4389-8509-cf98fd5df7c9, queue=awx_private_queue)
[2023-02-18 03:56:52,220: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(0580818e-9d93-4389-8509-cf98fd5df7c9, queue=awx_private_queue)
2023-02-18 03:56:52,234 DEBUG awx.main.dispatch delivered 0580818e-9d93-4389-8509-cf98fd5df7c9 to worker[195] qsize 0
2023-02-18 03:56:52,237 DEBUG awx.main.dispatch task 0580818e-9d93-4389-8509-cf98fd5df7c9 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:56:52,303 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:56:52,313 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:56:22.269839+00:00
2023-02-18 03:56:52,367 DEBUG awx.main.dispatch task 0580818e-9d93-4389-8509-cf98fd5df7c9 is finished
2023-02-18 03:56:59,569 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(1ebb3156-9e3e-4925-a71f-1dc172b88d7b, queue=awx_private_queue)
[2023-02-18 03:56:59,569: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(1ebb3156-9e3e-4925-a71f-1dc172b88d7b, queue=awx_private_queue)
2023-02-18 03:56:59,627 DEBUG awx.main.dispatch delivered 1ebb3156-9e3e-4925-a71f-1dc172b88d7b to worker[197] qsize 0
2023-02-18 03:56:59,630 DEBUG awx.main.dispatch task 1ebb3156-9e3e-4925-a71f-1dc172b88d7b starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:56:59,632 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:56:59,673 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:56:59,740 DEBUG awx.main.dispatch task 1ebb3156-9e3e-4925-a71f-1dc172b88d7b is finished
RESULT 2
OKREADY
2023-02-18 03:57:19,572 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(2d4b36d8-70ed-4008-86b3-dc605c2f1b92, queue=awx_private_queue)
[2023-02-18 03:57:19,572: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(2d4b36d8-70ed-4008-86b3-dc605c2f1b92, queue=awx_private_queue)
2023-02-18 03:57:19,587 DEBUG awx.main.dispatch delivered 2d4b36d8-70ed-4008-86b3-dc605c2f1b92 to worker[192] qsize 0
2023-02-18 03:57:19,788 DEBUG awx.main.dispatch task 2d4b36d8-70ed-4008-86b3-dc605c2f1b92 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:57:19,790 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:57:19,827 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:57:19,879 DEBUG awx.main.dispatch task 2d4b36d8-70ed-4008-86b3-dc605c2f1b92 is finished
2023-02-18 03:57:22,221 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(13c50999-8bfe-4008-a78f-496f1e70954a, queue=awx_private_queue)
[2023-02-18 03:57:22,221: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(13c50999-8bfe-4008-a78f-496f1e70954a, queue=awx_private_queue)
2023-02-18 03:57:22,237 DEBUG awx.main.dispatch delivered 13c50999-8bfe-4008-a78f-496f1e70954a to worker[183] qsize 0
2023-02-18 03:57:22,239 DEBUG awx.main.dispatch task 13c50999-8bfe-4008-a78f-496f1e70954a starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:57:22,254 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:57:22,259 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:56:52.303936+00:00
2023-02-18 03:57:22,293 DEBUG awx.main.dispatch task 13c50999-8bfe-4008-a78f-496f1e70954a is finished
2023-02-18 03:57:39,574 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5cf64bbe-5c6b-4785-8dd8-68685abd8661, queue=awx_private_queue)
[2023-02-18 03:57:39,574: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5cf64bbe-5c6b-4785-8dd8-68685abd8661, queue=awx_private_queue)
2023-02-18 03:57:39,592 DEBUG awx.main.dispatch delivered 5cf64bbe-5c6b-4785-8dd8-68685abd8661 to worker[183] qsize 0
2023-02-18 03:57:39,594 DEBUG awx.main.dispatch task 5cf64bbe-5c6b-4785-8dd8-68685abd8661 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:57:39,595 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:57:39,682 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:57:39,758 DEBUG awx.main.dispatch task 5cf64bbe-5c6b-4785-8dd8-68685abd8661 is finished
2023-02-18 03:57:51,661 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(defac6bd-c0c2-4f9b-ac13-ec4545955fde, queue=onap-awx-0)
[2023-02-18 03:57:51,661: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(defac6bd-c0c2-4f9b-ac13-ec4545955fde, queue=onap-awx-0)
2023-02-18 03:57:51,740 DEBUG awx.main.dispatch delivered defac6bd-c0c2-4f9b-ac13-ec4545955fde to worker[183] qsize 0
2023-02-18 03:57:51,743 DEBUG awx.main.dispatch task defac6bd-c0c2-4f9b-ac13-ec4545955fde starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:57:51,744 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:57:51,945 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(c0e81b6c-35d9-45ef-a10a-d1f846d25a1d, queue=onap-awx-0)
[2023-02-18 03:57:51,945: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(c0e81b6c-35d9-45ef-a10a-d1f846d25a1d, queue=onap-awx-0)
2023-02-18 03:57:51,967 DEBUG awx.main.dispatch delivered c0e81b6c-35d9-45ef-a10a-d1f846d25a1d to worker[197] qsize 0
2023-02-18 03:57:51,970 DEBUG awx.main.dispatch task c0e81b6c-35d9-45ef-a10a-d1f846d25a1d starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:57:52,031 DEBUG awx.main.dispatch task defac6bd-c0c2-4f9b-ac13-ec4545955fde is finished
2023-02-18 03:57:52,108 DEBUG awx.main.dispatch task c0e81b6c-35d9-45ef-a10a-d1f846d25a1d is finished
2023-02-18 03:57:52,221 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(8dc36f35-e21e-4cf0-8327-846df2e30746, queue=awx_private_queue)
[2023-02-18 03:57:52,221: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(8dc36f35-e21e-4cf0-8327-846df2e30746, queue=awx_private_queue)
2023-02-18 03:57:52,236 DEBUG awx.main.dispatch delivered 8dc36f35-e21e-4cf0-8327-846df2e30746 to worker[195] qsize 0
2023-02-18 03:57:52,238 DEBUG awx.main.dispatch task 8dc36f35-e21e-4cf0-8327-846df2e30746 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:57:52,255 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:57:52,259 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:57:22.254762+00:00
2023-02-18 03:57:52,352 DEBUG awx.main.dispatch task 8dc36f35-e21e-4cf0-8327-846df2e30746 is finished
2023-02-18 03:57:59,574 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(8a201e37-a44d-4201-b7c1-77f905b941a3, queue=awx_private_queue)
[2023-02-18 03:57:59,574: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(8a201e37-a44d-4201-b7c1-77f905b941a3, queue=awx_private_queue)
2023-02-18 03:57:59,594 DEBUG awx.main.dispatch delivered 8a201e37-a44d-4201-b7c1-77f905b941a3 to worker[192] qsize 0
2023-02-18 03:57:59,596 DEBUG awx.main.dispatch task 8a201e37-a44d-4201-b7c1-77f905b941a3 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:57:59,597 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:57:59,661 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:57:59,779 DEBUG awx.main.dispatch task 8a201e37-a44d-4201-b7c1-77f905b941a3 is finished
RESULT 2
OKREADY
2023-02-18 03:58:19,576 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a27820ab-24b9-4b16-9510-fb3ac90032ec, queue=awx_private_queue)
[2023-02-18 03:58:19,576: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a27820ab-24b9-4b16-9510-fb3ac90032ec, queue=awx_private_queue)
2023-02-18 03:58:19,680 DEBUG awx.main.dispatch delivered a27820ab-24b9-4b16-9510-fb3ac90032ec to worker[183] qsize 0
2023-02-18 03:58:19,882 DEBUG awx.main.dispatch task a27820ab-24b9-4b16-9510-fb3ac90032ec starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:58:19,883 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:58:19,947 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:58:20,071 DEBUG awx.main.dispatch task a27820ab-24b9-4b16-9510-fb3ac90032ec is finished
2023-02-18 03:58:22,221 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(2a26be0a-d0f9-4194-b39c-565416651834, queue=awx_private_queue)
[2023-02-18 03:58:22,221: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(2a26be0a-d0f9-4194-b39c-565416651834, queue=awx_private_queue)
2023-02-18 03:58:22,237 DEBUG awx.main.dispatch delivered 2a26be0a-d0f9-4194-b39c-565416651834 to worker[183] qsize 0
2023-02-18 03:58:22,239 DEBUG awx.main.dispatch task 2a26be0a-d0f9-4194-b39c-565416651834 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:58:22,295 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:58:22,326 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:57:52.255993+00:00
2023-02-18 03:58:22,463 DEBUG awx.main.dispatch task 2a26be0a-d0f9-4194-b39c-565416651834 is finished
2023-02-18 03:58:39,584 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(7a0bee1e-c2c9-48e6-a033-08c3767750b4, queue=awx_private_queue)
[2023-02-18 03:58:39,584: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(7a0bee1e-c2c9-48e6-a033-08c3767750b4, queue=awx_private_queue)
2023-02-18 03:58:39,599 DEBUG awx.main.dispatch delivered 7a0bee1e-c2c9-48e6-a033-08c3767750b4 to worker[195] qsize 0
2023-02-18 03:58:39,601 DEBUG awx.main.dispatch task 7a0bee1e-c2c9-48e6-a033-08c3767750b4 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:58:39,602 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:58:39,675 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:58:39,853 DEBUG awx.main.dispatch task 7a0bee1e-c2c9-48e6-a033-08c3767750b4 is finished
2023-02-18 03:58:51,660 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(678b570c-e313-480c-8312-55149f13e905, queue=onap-awx-0)
[2023-02-18 03:58:51,660: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(678b570c-e313-480c-8312-55149f13e905, queue=onap-awx-0)
2023-02-18 03:58:51,805 DEBUG awx.main.dispatch delivered 678b570c-e313-480c-8312-55149f13e905 to worker[195] qsize 0
2023-02-18 03:58:51,808 DEBUG awx.main.dispatch task 678b570c-e313-480c-8312-55149f13e905 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:58:51,809 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:58:51,945 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(1dacb068-eee3-4d7b-8004-8825b8e70a86, queue=onap-awx-0)
[2023-02-18 03:58:51,945: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(1dacb068-eee3-4d7b-8004-8825b8e70a86, queue=onap-awx-0)
2023-02-18 03:58:51,960 DEBUG awx.main.dispatch delivered 1dacb068-eee3-4d7b-8004-8825b8e70a86 to worker[197] qsize 0
2023-02-18 03:58:51,962 DEBUG awx.main.dispatch task 1dacb068-eee3-4d7b-8004-8825b8e70a86 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:58:52,021 DEBUG awx.main.dispatch task 678b570c-e313-480c-8312-55149f13e905 is finished
2023-02-18 03:58:52,103 DEBUG awx.main.dispatch task 1dacb068-eee3-4d7b-8004-8825b8e70a86 is finished
2023-02-18 03:58:52,221 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(c525ce5a-ba02-4319-a905-b49c519e949f, queue=awx_private_queue)
[2023-02-18 03:58:52,221: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(c525ce5a-ba02-4319-a905-b49c519e949f, queue=awx_private_queue)
2023-02-18 03:58:52,237 DEBUG awx.main.dispatch delivered c525ce5a-ba02-4319-a905-b49c519e949f to worker[195] qsize 0
2023-02-18 03:58:52,239 DEBUG awx.main.dispatch task c525ce5a-ba02-4319-a905-b49c519e949f starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:58:52,329 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:58:52,355 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:58:22.295942+00:00
2023-02-18 03:58:52,478 DEBUG awx.main.dispatch task c525ce5a-ba02-4319-a905-b49c519e949f is finished
2023-02-18 03:58:59,585 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f2b5640c-f254-4211-85fb-73f03d28d557, queue=awx_private_queue)
[2023-02-18 03:58:59,585: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f2b5640c-f254-4211-85fb-73f03d28d557, queue=awx_private_queue)
2023-02-18 03:58:59,605 DEBUG awx.main.dispatch delivered f2b5640c-f254-4211-85fb-73f03d28d557 to worker[183] qsize 0
2023-02-18 03:58:59,611 DEBUG awx.main.dispatch task f2b5640c-f254-4211-85fb-73f03d28d557 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:58:59,613 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:58:59,686 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:58:59,776 DEBUG awx.main.dispatch task f2b5640c-f254-4211-85fb-73f03d28d557 is finished
RESULT 2
OKREADY
2023-02-18 03:59:19,588 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(af7e9c2c-fff7-4e1b-a6e3-4b78a40ee76f, queue=awx_private_queue)
[2023-02-18 03:59:19,588: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(af7e9c2c-fff7-4e1b-a6e3-4b78a40ee76f, queue=awx_private_queue)
2023-02-18 03:59:19,693 DEBUG awx.main.dispatch delivered af7e9c2c-fff7-4e1b-a6e3-4b78a40ee76f to worker[192] qsize 0
2023-02-18 03:59:19,938 DEBUG awx.main.dispatch task af7e9c2c-fff7-4e1b-a6e3-4b78a40ee76f starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:59:19,942 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:59:20,112 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:59:20,317 DEBUG awx.main.dispatch task af7e9c2c-fff7-4e1b-a6e3-4b78a40ee76f is finished
2023-02-18 03:59:22,221 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(2e0ff711-ef97-4c40-a936-809628551282, queue=awx_private_queue)
[2023-02-18 03:59:22,221: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(2e0ff711-ef97-4c40-a936-809628551282, queue=awx_private_queue)
2023-02-18 03:59:22,241 DEBUG awx.main.dispatch delivered 2e0ff711-ef97-4c40-a936-809628551282 to worker[183] qsize 0
2023-02-18 03:59:22,244 DEBUG awx.main.dispatch task 2e0ff711-ef97-4c40-a936-809628551282 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:59:22,284 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:59:22,299 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:58:52.330093+00:00
2023-02-18 03:59:22,399 DEBUG awx.main.dispatch task 2e0ff711-ef97-4c40-a936-809628551282 is finished
2023-02-18 03:59:39,585 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(f2971231-8ad4-4140-a47b-00ffe82ce0a4, queue=awx_private_queue)
[2023-02-18 03:59:39,585: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(f2971231-8ad4-4140-a47b-00ffe82ce0a4, queue=awx_private_queue)
2023-02-18 03:59:39,603 DEBUG awx.main.dispatch delivered f2971231-8ad4-4140-a47b-00ffe82ce0a4 to worker[192] qsize 0
2023-02-18 03:59:39,606 DEBUG awx.main.dispatch task f2971231-8ad4-4140-a47b-00ffe82ce0a4 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:59:39,607 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:59:39,822 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:59:39,991 DEBUG awx.main.dispatch task f2971231-8ad4-4140-a47b-00ffe82ce0a4 is finished
2023-02-18 03:59:51,662 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(89f73b91-49f6-4fa7-9f99-5d605d553635, queue=onap-awx-0)
[2023-02-18 03:59:51,662: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(89f73b91-49f6-4fa7-9f99-5d605d553635, queue=onap-awx-0)
2023-02-18 03:59:51,741 DEBUG awx.main.dispatch delivered 89f73b91-49f6-4fa7-9f99-5d605d553635 to worker[197] qsize 0
2023-02-18 03:59:51,745 DEBUG awx.main.dispatch task 89f73b91-49f6-4fa7-9f99-5d605d553635 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 03:59:51,749 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 03:59:51,944 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(86dd8697-06ae-4228-9e04-f5f23ff3ea74, queue=onap-awx-0)
[2023-02-18 03:59:51,944: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(86dd8697-06ae-4228-9e04-f5f23ff3ea74, queue=onap-awx-0)
2023-02-18 03:59:51,961 DEBUG awx.main.dispatch delivered 86dd8697-06ae-4228-9e04-f5f23ff3ea74 to worker[195] qsize 0
2023-02-18 03:59:51,965 DEBUG awx.main.dispatch task 86dd8697-06ae-4228-9e04-f5f23ff3ea74 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 03:59:52,139 DEBUG awx.main.dispatch task 86dd8697-06ae-4228-9e04-f5f23ff3ea74 is finished
2023-02-18 03:59:52,139 DEBUG awx.main.dispatch task 89f73b91-49f6-4fa7-9f99-5d605d553635 is finished
2023-02-18 03:59:52,221 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(2127e644-3aac-4cc3-a962-2c235674000c, queue=awx_private_queue)
[2023-02-18 03:59:52,221: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(2127e644-3aac-4cc3-a962-2c235674000c, queue=awx_private_queue)
2023-02-18 03:59:52,238 DEBUG awx.main.dispatch delivered 2127e644-3aac-4cc3-a962-2c235674000c to worker[192] qsize 0
2023-02-18 03:59:52,241 DEBUG awx.main.dispatch task 2127e644-3aac-4cc3-a962-2c235674000c starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 03:59:52,314 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 03:59:52,330 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:59:22.284238+00:00
2023-02-18 03:59:52,439 DEBUG awx.main.dispatch task 2127e644-3aac-4cc3-a962-2c235674000c is finished
2023-02-18 03:59:59,585 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(76c7f11b-9e35-4416-b3c7-30e3e64e402a, queue=awx_private_queue)
[2023-02-18 03:59:59,585: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(76c7f11b-9e35-4416-b3c7-30e3e64e402a, queue=awx_private_queue)
2023-02-18 03:59:59,603 DEBUG awx.main.dispatch delivered 76c7f11b-9e35-4416-b3c7-30e3e64e402a to worker[197] qsize 0
2023-02-18 03:59:59,605 DEBUG awx.main.dispatch task 76c7f11b-9e35-4416-b3c7-30e3e64e402a starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 03:59:59,607 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 03:59:59,770 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 03:59:59,901 DEBUG awx.main.dispatch task 76c7f11b-9e35-4416-b3c7-30e3e64e402a is finished
RESULT 2
OKREADY
2023-02-18 04:00:19,585 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(0e879df0-52d8-49fb-b75e-b5897f765b6e, queue=awx_private_queue)
[2023-02-18 04:00:19,585: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(0e879df0-52d8-49fb-b75e-b5897f765b6e, queue=awx_private_queue)
2023-02-18 04:00:19,888 DEBUG awx.main.dispatch delivered 0e879df0-52d8-49fb-b75e-b5897f765b6e to worker[195] qsize 0
2023-02-18 04:00:19,892 DEBUG awx.main.dispatch task 0e879df0-52d8-49fb-b75e-b5897f765b6e starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 04:00:19,895 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 04:00:20,086 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 04:00:20,392 DEBUG awx.main.dispatch task 0e879df0-52d8-49fb-b75e-b5897f765b6e is finished
2023-02-18 04:00:22,221 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(53cea95f-3fae-47b4-a5a4-45b5603a0b34, queue=awx_private_queue)
[2023-02-18 04:00:22,221: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(53cea95f-3fae-47b4-a5a4-45b5603a0b34, queue=awx_private_queue)
2023-02-18 04:00:22,237 DEBUG awx.main.dispatch delivered 53cea95f-3fae-47b4-a5a4-45b5603a0b34 to worker[195] qsize 0
2023-02-18 04:00:22,239 DEBUG awx.main.dispatch task 53cea95f-3fae-47b4-a5a4-45b5603a0b34 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 04:00:22,368 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 04:00:22,375 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 03:59:52.314781+00:00
2023-02-18 04:00:22,477 DEBUG awx.main.dispatch task 53cea95f-3fae-47b4-a5a4-45b5603a0b34 is finished
2023-02-18 04:00:39,587 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(535230fc-338e-40fc-9906-05e05bd29e8a, queue=awx_private_queue)
[2023-02-18 04:00:39,587: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(535230fc-338e-40fc-9906-05e05bd29e8a, queue=awx_private_queue)
2023-02-18 04:00:39,604 DEBUG awx.main.dispatch delivered 535230fc-338e-40fc-9906-05e05bd29e8a to worker[195] qsize 0
2023-02-18 04:00:39,606 DEBUG awx.main.dispatch task 535230fc-338e-40fc-9906-05e05bd29e8a starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 04:00:39,608 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 04:00:39,721 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 04:00:39,789 DEBUG awx.main.dispatch task 535230fc-338e-40fc-9906-05e05bd29e8a is finished
2023-02-18 04:00:51,662 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(8d888cd5-247a-4f4f-907a-37e4b3f0cb14, queue=onap-awx-0)
[2023-02-18 04:00:51,662: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(8d888cd5-247a-4f4f-907a-37e4b3f0cb14, queue=onap-awx-0)
2023-02-18 04:00:51,730 DEBUG awx.main.dispatch delivered 8d888cd5-247a-4f4f-907a-37e4b3f0cb14 to worker[183] qsize 0
2023-02-18 04:00:51,734 DEBUG awx.main.dispatch task 8d888cd5-247a-4f4f-907a-37e4b3f0cb14 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 04:00:51,737 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 04:00:51,894 DEBUG awx.main.dispatch task 8d888cd5-247a-4f4f-907a-37e4b3f0cb14 is finished
2023-02-18 04:00:51,944 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(9fdaa81f-896a-4719-8a1e-87788ce760dd, queue=onap-awx-0)
[2023-02-18 04:00:51,944: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(9fdaa81f-896a-4719-8a1e-87788ce760dd, queue=onap-awx-0)
2023-02-18 04:00:51,961 DEBUG awx.main.dispatch delivered 9fdaa81f-896a-4719-8a1e-87788ce760dd to worker[183] qsize 0
2023-02-18 04:00:51,963 DEBUG awx.main.dispatch task 9fdaa81f-896a-4719-8a1e-87788ce760dd starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 04:00:52,022 DEBUG awx.main.dispatch task 9fdaa81f-896a-4719-8a1e-87788ce760dd is finished
2023-02-18 04:00:52,221 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(a8b674de-bbe6-4b11-8421-27de6352125f, queue=awx_private_queue)
[2023-02-18 04:00:52,221: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(a8b674de-bbe6-4b11-8421-27de6352125f, queue=awx_private_queue)
2023-02-18 04:00:52,237 DEBUG awx.main.dispatch delivered a8b674de-bbe6-4b11-8421-27de6352125f to worker[195] qsize 0
2023-02-18 04:00:52,239 DEBUG awx.main.dispatch task a8b674de-bbe6-4b11-8421-27de6352125f starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 04:00:52,275 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 04:00:52,282 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 04:00:22.369219+00:00
2023-02-18 04:00:52,395 DEBUG awx.main.dispatch task a8b674de-bbe6-4b11-8421-27de6352125f is finished
2023-02-18 04:00:59,587 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(50570922-e26d-4c4c-acc9-ae3587d97ab4, queue=awx_private_queue)
[2023-02-18 04:00:59,587: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(50570922-e26d-4c4c-acc9-ae3587d97ab4, queue=awx_private_queue)
2023-02-18 04:00:59,603 DEBUG awx.main.dispatch delivered 50570922-e26d-4c4c-acc9-ae3587d97ab4 to worker[195] qsize 0
2023-02-18 04:00:59,606 DEBUG awx.main.dispatch task 50570922-e26d-4c4c-acc9-ae3587d97ab4 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 04:00:59,607 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 04:00:59,702 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 04:00:59,773 DEBUG awx.main.dispatch task 50570922-e26d-4c4c-acc9-ae3587d97ab4 is finished
RESULT 2
OKREADY
2023-02-18 04:01:19,600 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e1ade552-da38-4e47-93b9-66055aacf438, queue=awx_private_queue)
[2023-02-18 04:01:19,600: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e1ade552-da38-4e47-93b9-66055aacf438, queue=awx_private_queue)
2023-02-18 04:01:19,842 DEBUG awx.main.dispatch delivered e1ade552-da38-4e47-93b9-66055aacf438 to worker[183] qsize 0
2023-02-18 04:01:19,844 DEBUG awx.main.dispatch task e1ade552-da38-4e47-93b9-66055aacf438 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 04:01:19,846 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 04:01:19,886 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 04:01:19,989 DEBUG awx.main.dispatch task e1ade552-da38-4e47-93b9-66055aacf438 is finished
2023-02-18 04:01:22,222 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(e0b11e08-d06d-4c12-9e61-a1f2d0ccd893, queue=awx_private_queue)
[2023-02-18 04:01:22,222: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(e0b11e08-d06d-4c12-9e61-a1f2d0ccd893, queue=awx_private_queue)
2023-02-18 04:01:22,238 DEBUG awx.main.dispatch delivered e0b11e08-d06d-4c12-9e61-a1f2d0ccd893 to worker[192] qsize 0
2023-02-18 04:01:22,243 DEBUG awx.main.dispatch task e0b11e08-d06d-4c12-9e61-a1f2d0ccd893 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 04:01:22,265 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 04:01:22,270 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 04:00:52.275856+00:00
2023-02-18 04:01:22,298 DEBUG awx.main.dispatch task e0b11e08-d06d-4c12-9e61-a1f2d0ccd893 is finished
2023-02-18 04:01:39,607 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(5ee99d15-1ed0-4ef6-b839-d25586e2555e, queue=awx_private_queue)
[2023-02-18 04:01:39,607: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(5ee99d15-1ed0-4ef6-b839-d25586e2555e, queue=awx_private_queue)
2023-02-18 04:01:39,636 DEBUG awx.main.dispatch delivered 5ee99d15-1ed0-4ef6-b839-d25586e2555e to worker[192] qsize 0
2023-02-18 04:01:39,638 DEBUG awx.main.dispatch task 5ee99d15-1ed0-4ef6-b839-d25586e2555e starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 04:01:39,639 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 04:01:39,710 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 04:01:39,830 DEBUG awx.main.dispatch task 5ee99d15-1ed0-4ef6-b839-d25586e2555e is finished
2023-02-18 04:01:51,665 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(7a345fdd-ba1e-4b44-9715-faf91127e15c, queue=onap-awx-0)
[2023-02-18 04:01:51,665: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(7a345fdd-ba1e-4b44-9715-faf91127e15c, queue=onap-awx-0)
2023-02-18 04:01:51,752 DEBUG awx.main.dispatch delivered 7a345fdd-ba1e-4b44-9715-faf91127e15c to worker[183] qsize 0
2023-02-18 04:01:51,754 DEBUG awx.main.dispatch task 7a345fdd-ba1e-4b44-9715-faf91127e15c starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 04:01:51,756 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 04:01:51,847 DEBUG awx.main.dispatch task 7a345fdd-ba1e-4b44-9715-faf91127e15c is finished
2023-02-18 04:01:51,945 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(bc24cde0-858f-4fe6-bbd2-0f829693095b, queue=onap-awx-0)
[2023-02-18 04:01:51,945: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(bc24cde0-858f-4fe6-bbd2-0f829693095b, queue=onap-awx-0)
2023-02-18 04:01:51,966 DEBUG awx.main.dispatch delivered bc24cde0-858f-4fe6-bbd2-0f829693095b to worker[183] qsize 0
2023-02-18 04:01:51,968 DEBUG awx.main.dispatch task bc24cde0-858f-4fe6-bbd2-0f829693095b starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 04:01:51,995 DEBUG awx.main.dispatch task bc24cde0-858f-4fe6-bbd2-0f829693095b is finished
2023-02-18 04:01:52,221 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(9ccb1ba7-8e7d-41e9-ba15-e072a6b53f14, queue=awx_private_queue)
[2023-02-18 04:01:52,221: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(9ccb1ba7-8e7d-41e9-ba15-e072a6b53f14, queue=awx_private_queue)
2023-02-18 04:01:52,238 DEBUG awx.main.dispatch delivered 9ccb1ba7-8e7d-41e9-ba15-e072a6b53f14 to worker[183] qsize 0
2023-02-18 04:01:52,240 DEBUG awx.main.dispatch task 9ccb1ba7-8e7d-41e9-ba15-e072a6b53f14 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 04:01:52,278 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 04:01:52,281 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 04:01:22.266029+00:00
2023-02-18 04:01:52,305 DEBUG awx.main.dispatch task 9ccb1ba7-8e7d-41e9-ba15-e072a6b53f14 is finished
2023-02-18 04:01:59,607 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(029963d6-91fc-43d4-947d-32bf78eb89a6, queue=awx_private_queue)
[2023-02-18 04:01:59,607: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(029963d6-91fc-43d4-947d-32bf78eb89a6, queue=awx_private_queue)
2023-02-18 04:01:59,624 DEBUG awx.main.dispatch delivered 029963d6-91fc-43d4-947d-32bf78eb89a6 to worker[197] qsize 0
2023-02-18 04:01:59,626 DEBUG awx.main.dispatch task 029963d6-91fc-43d4-947d-32bf78eb89a6 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 04:01:59,629 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 04:01:59,711 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 04:01:59,811 DEBUG awx.main.dispatch task 029963d6-91fc-43d4-947d-32bf78eb89a6 is finished
RESULT 2
OKREADY
2023-02-18 04:02:19,618 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(a60e0241-23ff-48a7-bd4b-66d8d832fd46, queue=awx_private_queue)
[2023-02-18 04:02:19,618: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(a60e0241-23ff-48a7-bd4b-66d8d832fd46, queue=awx_private_queue)
2023-02-18 04:02:19,851 DEBUG awx.main.dispatch delivered a60e0241-23ff-48a7-bd4b-66d8d832fd46 to worker[183] qsize 0
2023-02-18 04:02:19,853 DEBUG awx.main.dispatch task a60e0241-23ff-48a7-bd4b-66d8d832fd46 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 04:02:19,855 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 04:02:19,898 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 04:02:19,964 DEBUG awx.main.dispatch task a60e0241-23ff-48a7-bd4b-66d8d832fd46 is finished
2023-02-18 04:02:22,221 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(5b9ab414-292a-4517-a2ea-97d792196be0, queue=awx_private_queue)
[2023-02-18 04:02:22,221: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(5b9ab414-292a-4517-a2ea-97d792196be0, queue=awx_private_queue)
2023-02-18 04:02:22,239 DEBUG awx.main.dispatch delivered 5b9ab414-292a-4517-a2ea-97d792196be0 to worker[192] qsize 0
2023-02-18 04:02:22,242 DEBUG awx.main.dispatch task 5b9ab414-292a-4517-a2ea-97d792196be0 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 04:02:22,261 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 04:02:22,265 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 04:01:52.278190+00:00
2023-02-18 04:02:22,289 DEBUG awx.main.dispatch task 5b9ab414-292a-4517-a2ea-97d792196be0 is finished
2023-02-18 04:02:39,625 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(8439668c-14e9-4499-b547-718e0e4bfe41, queue=awx_private_queue)
[2023-02-18 04:02:39,625: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(8439668c-14e9-4499-b547-718e0e4bfe41, queue=awx_private_queue)
2023-02-18 04:02:39,641 DEBUG awx.main.dispatch delivered 8439668c-14e9-4499-b547-718e0e4bfe41 to worker[195] qsize 0
2023-02-18 04:02:39,644 DEBUG awx.main.dispatch task 8439668c-14e9-4499-b547-718e0e4bfe41 starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 04:02:39,646 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 04:02:39,690 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 04:02:39,802 DEBUG awx.main.dispatch task 8439668c-14e9-4499-b547-718e0e4bfe41 is finished
2023-02-18 04:02:51,667 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(2c943205-0d0b-42ad-a9d5-7ad379283829, queue=onap-awx-0)
[2023-02-18 04:02:51,667: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(2c943205-0d0b-42ad-a9d5-7ad379283829, queue=onap-awx-0)
2023-02-18 04:02:51,703 DEBUG awx.main.dispatch delivered 2c943205-0d0b-42ad-a9d5-7ad379283829 to worker[197] qsize 0
2023-02-18 04:02:51,705 DEBUG awx.main.dispatch task 2c943205-0d0b-42ad-a9d5-7ad379283829 starting awx.main.tasks.cluster_node_heartbeat(*[])
2023-02-18 04:02:51,707 DEBUG awx.main.tasks Cluster node heartbeat task.
2023-02-18 04:02:51,776 DEBUG awx.main.dispatch task 2c943205-0d0b-42ad-a9d5-7ad379283829 is finished
2023-02-18 04:02:51,945 DEBUG awx.main.dispatch publish awx.main.tasks.awx_k8s_reaper(4497c456-c49a-4d85-9b6c-6db96fa00fe2, queue=onap-awx-0)
[2023-02-18 04:02:51,945: DEBUG/Process-1] publish awx.main.tasks.awx_k8s_reaper(4497c456-c49a-4d85-9b6c-6db96fa00fe2, queue=onap-awx-0)
2023-02-18 04:02:51,960 DEBUG awx.main.dispatch delivered 4497c456-c49a-4d85-9b6c-6db96fa00fe2 to worker[195] qsize 0
2023-02-18 04:02:51,963 DEBUG awx.main.dispatch task 4497c456-c49a-4d85-9b6c-6db96fa00fe2 starting awx.main.tasks.awx_k8s_reaper(*[])
2023-02-18 04:02:51,987 DEBUG awx.main.dispatch task 4497c456-c49a-4d85-9b6c-6db96fa00fe2 is finished
2023-02-18 04:02:52,221 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(a0afd6e7-bb01-4083-a9e6-6b681cc9049a, queue=awx_private_queue)
[2023-02-18 04:02:52,221: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(a0afd6e7-bb01-4083-a9e6-6b681cc9049a, queue=awx_private_queue)
2023-02-18 04:02:52,237 DEBUG awx.main.dispatch delivered a0afd6e7-bb01-4083-a9e6-6b681cc9049a to worker[192] qsize 0
2023-02-18 04:02:52,239 DEBUG awx.main.dispatch task a0afd6e7-bb01-4083-a9e6-6b681cc9049a starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 04:02:52,253 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 04:02:52,260 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 04:02:22.261877+00:00
2023-02-18 04:02:52,280 DEBUG awx.main.dispatch task a0afd6e7-bb01-4083-a9e6-6b681cc9049a is finished
2023-02-18 04:02:59,626 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e1e3825b-5c74-4af0-92b0-4540f897b95d, queue=awx_private_queue)
[2023-02-18 04:02:59,626: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e1e3825b-5c74-4af0-92b0-4540f897b95d, queue=awx_private_queue)
2023-02-18 04:02:59,642 DEBUG awx.main.dispatch delivered e1e3825b-5c74-4af0-92b0-4540f897b95d to worker[192] qsize 0
2023-02-18 04:02:59,644 DEBUG awx.main.dispatch task e1e3825b-5c74-4af0-92b0-4540f897b95d starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 04:02:59,646 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 04:02:59,707 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 04:02:59,807 DEBUG awx.main.dispatch task e1e3825b-5c74-4af0-92b0-4540f897b95d is finished
RESULT 2
OKREADY
2023-02-18 04:03:19,633 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(e590f171-2de2-464d-9dce-43603092a93e, queue=awx_private_queue)
[2023-02-18 04:03:19,633: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(e590f171-2de2-464d-9dce-43603092a93e, queue=awx_private_queue)
2023-02-18 04:03:19,877 DEBUG awx.main.dispatch delivered e590f171-2de2-464d-9dce-43603092a93e to worker[197] qsize 0
2023-02-18 04:03:19,880 DEBUG awx.main.dispatch task e590f171-2de2-464d-9dce-43603092a93e starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 04:03:19,882 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 04:03:19,982 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 04:03:20,059 DEBUG awx.main.dispatch task e590f171-2de2-464d-9dce-43603092a93e is finished
2023-02-18 04:03:22,222 DEBUG awx.main.dispatch publish awx.main.tasks.awx_periodic_scheduler(9abea2d0-8165-4690-9901-b78eb62bbbd6, queue=awx_private_queue)
[2023-02-18 04:03:22,222: DEBUG/Process-1] publish awx.main.tasks.awx_periodic_scheduler(9abea2d0-8165-4690-9901-b78eb62bbbd6, queue=awx_private_queue)
2023-02-18 04:03:22,241 DEBUG awx.main.dispatch delivered 9abea2d0-8165-4690-9901-b78eb62bbbd6 to worker[192] qsize 0
2023-02-18 04:03:22,245 DEBUG awx.main.dispatch task 9abea2d0-8165-4690-9901-b78eb62bbbd6 starting awx.main.tasks.awx_periodic_scheduler(*[])
2023-02-18 04:03:22,259 DEBUG awx.main.tasks Starting periodic scheduler
2023-02-18 04:03:22,264 DEBUG awx.main.tasks Last scheduler run was: 2023-02-18 04:02:52.253932+00:00
2023-02-18 04:03:22,302 DEBUG awx.main.dispatch task 9abea2d0-8165-4690-9901-b78eb62bbbd6 is finished
2023-02-18 04:03:39,642 DEBUG awx.main.dispatch publish awx.main.scheduler.tasks.run_task_manager(8195d1eb-45e2-40ac-8cd6-dbdfd457150c, queue=awx_private_queue)
[2023-02-18 04:03:39,642: DEBUG/Process-1] publish awx.main.scheduler.tasks.run_task_manager(8195d1eb-45e2-40ac-8cd6-dbdfd457150c, queue=awx_private_queue)
2023-02-18 04:03:39,666 DEBUG awx.main.dispatch delivered 8195d1eb-45e2-40ac-8cd6-dbdfd457150c to worker[195] qsize 0
2023-02-18 04:03:39,672 DEBUG awx.main.dispatch task 8195d1eb-45e2-40ac-8cd6-dbdfd457150c starting awx.main.scheduler.tasks.run_task_manager(*[])
2023-02-18 04:03:39,678 DEBUG awx.main.scheduler Running Tower task manager.
2023-02-18 04:03:39,754 DEBUG awx.main.scheduler Starting Scheduler
2023-02-18 04:03:39,825 DEBUG awx.main.dispatch task 8195d1eb-45e2-40ac-8cd6-dbdfd457150c is finished
2023-02-18 04:03:51,671 DEBUG awx.main.dispatch publish awx.main.tasks.cluster_node_heartbeat(46f8976c-3fd6-4850-aed3-da75208bcda2, queue=onap-awx-0)
[2023-02-18 04:03:51,671: DEBUG/Process-1] publish awx.main.tasks.cluster_node_heartbeat(46f8976c-3fd6-4850-aed3-da75208bcda2, queue=onap-awx-0)
2023-02-18 04:03:51,793 DEBUG awx.main.dispatch delivered 46