By type
2022-04-10 03:01:16,652||139847850117920|INFO|component|conductor.common.music.messaging.component: [-] Message 8aa5f9ca-6adb-438c-b1d7-18ff6d246930 method plans_get received 2022-04-10 03:01:29,444||139847850117920|INFO|component|conductor.common.music.messaging.component: [-] Message 8aa5f9ca-6adb-438c-b1d7-18ff6d246930 method plans_get, status: completed 2022-04-10 03:01:43,902||139847850117920|INFO|component|conductor.common.music.messaging.component: [-] updating the message status from working to completed, atomic update response from MUSIC SUCCESS 2022-04-10 03:03:10,510||139847917214496|INFO|component|conductor.common.music.messaging.component: [-] Message d8a0d401-3e60-48ae-a244-bb7a61ec4084 method plans_get received 2022-04-10 03:03:18,843||139847917214496|INFO|component|conductor.common.music.messaging.component: [-] Message d8a0d401-3e60-48ae-a244-bb7a61ec4084 method plans_get, status: completed 2022-04-10 03:03:28,943||139847917214496|INFO|component|conductor.common.music.messaging.component: [-] updating the message status from working to completed, atomic update response from MUSIC SUCCESS 2022-04-10 03:05:07,849||139847915092768|INFO|component|conductor.common.music.messaging.component: [-] Message 1f0573e0-90e8-4eb5-9f92-0d13fdc08e8e method plans_get received 2022-04-10 03:05:17,843||139847915092768|INFO|component|conductor.common.music.messaging.component: [-] Message 1f0573e0-90e8-4eb5-9f92-0d13fdc08e8e method plans_get, status: completed 2022-04-10 03:05:33,410||139847915092768|INFO|component|conductor.common.music.messaging.component: [-] updating the message status from working to completed, atomic update response from MUSIC SUCCESS 2022-04-10 03:05:47,416||139847915092768|INFO|component|conductor.common.music.messaging.component: [-] Message 58070330-db99-4d83-860e-b096e7a9e575 method plans_get received 2022-04-10 03:05:58,004||139847915092768|INFO|component|conductor.common.music.messaging.component: [-] Message 58070330-db99-4d83-860e-b096e7a9e575 method plans_get, status: completed 2022-04-10 03:06:03,877||139847915092768|INFO|component|conductor.common.music.messaging.component: [-] updating the message status from working to completed, atomic update response from MUSIC SUCCESS 2022-04-10 03:06:47,903||139847878761248|INFO|component|conductor.common.music.messaging.component: [-] Message b5d0506a-05b5-4825-a683-8220cd5b18c3 method plans_get received 2022-04-10 03:06:55,580||139847878761248|INFO|component|conductor.common.music.messaging.component: [-] Message b5d0506a-05b5-4825-a683-8220cd5b18c3 method plans_get, status: completed 2022-04-10 03:07:08,547||139847878761248|INFO|component|conductor.common.music.messaging.component: [-] updating the message status from working to completed, atomic update response from MUSIC SUCCESS 2022-04-10 03:08:43,044||139847860726560|INFO|component|conductor.common.music.messaging.component: [-] Message 1bd2878b-2fc8-40bf-97f5-77ae9b9e1069 method plans_get received 2022-04-10 03:08:56,802||139847860726560|INFO|component|conductor.common.music.messaging.component: [-] Message 1bd2878b-2fc8-40bf-97f5-77ae9b9e1069 method plans_get, status: completed 2022-04-10 03:09:05,745||139847860726560|INFO|component|conductor.common.music.messaging.component: [-] updating the message status from working to completed, atomic update response from MUSIC SUCCESS 2022-04-10 03:10:45,002||139847878761248|INFO|component|conductor.common.music.messaging.component: [-] Message 446be5a0-d4f6-455b-a773-2169aff2d1f2 method plans_get received 2022-04-10 03:10:57,202||139847878761248|INFO|component|conductor.common.music.messaging.component: [-] Message 446be5a0-d4f6-455b-a773-2169aff2d1f2 method plans_get, status: completed 2022-04-10 03:11:01,144||139847878761248|INFO|component|conductor.common.music.messaging.component: [-] updating the message status from working to completed, atomic update response from MUSIC SUCCESS 2022-04-10 03:11:54,246||139847836064544|INFO|component|conductor.common.music.messaging.component: [-] Message 4a2eb437-95c0-442f-b263-431ff7b90fda method plans_get received 2022-04-10 03:12:06,543||139847836064544|INFO|component|conductor.common.music.messaging.component: [-] Message 4a2eb437-95c0-442f-b263-431ff7b90fda method plans_get, status: completed 2022-04-10 03:12:12,182||139847836064544|INFO|component|conductor.common.music.messaging.component: [-] updating the message status from working to completed, atomic update response from MUSIC SUCCESS 2022-04-10 03:14:41,791||139847855422240|INFO|component|conductor.common.music.messaging.component: [-] Message cfdbf274-5943-4b66-952a-944d8de6f389 method plans_get received 2022-04-10 03:14:53,343||139847855422240|INFO|component|conductor.common.music.messaging.component: [-] Message cfdbf274-5943-4b66-952a-944d8de6f389 method plans_get, status: completed 2022-04-10 03:15:11,242||139847855422240|INFO|component|conductor.common.music.messaging.component: [-] updating the message status from working to completed, atomic update response from MUSIC SUCCESS 2022-04-10 03:20:00,103||139847839247136|INFO|component|conductor.common.music.messaging.component: [-] Message df8fa5cd-387e-418e-aa83-86be46bb2c2b method plans_get received 2022-04-10 03:20:06,882||139847839247136|INFO|component|conductor.common.music.messaging.component: [-] Message df8fa5cd-387e-418e-aa83-86be46bb2c2b method plans_get, status: completed 2022-04-10 03:20:15,842||139847839247136|INFO|component|conductor.common.music.messaging.component: [-] updating the message status from working to completed, atomic update response from MUSIC SUCCESS 2022-04-10 03:50:02,303||139847919336224|ERROR|_utils|cotyledon._utils: [-] Unhandled exception Traceback (most recent call last): File "/opt/has/conductor/conductor/common/etcd/api.py", line 60, in get_client return etcd3.client(host=self.host, port=self.port, File "/usr/local/lib/python3.9/site-packages/etcd3/client.py", line 1178, in client return Etcd3Client(host=host, File "/usr/local/lib/python3.9/site-packages/etcd3/client.py", line 148, in __init__ resp = self.auth_stub.Authenticate(auth_request, self.timeout) File "/usr/local/lib/python3.9/site-packages/grpc/_channel.py", line 946, in __call__ return _end_unary_response_blocking(state, call, False, None) File "/usr/local/lib/python3.9/site-packages/grpc/_channel.py", line 849, in _end_unary_response_blocking raise _InactiveRpcError(state) grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with: status = StatusCode.UNAVAILABLE details = "etcdserver: request timed out" debug_error_string = "{"created":"@1649562602.302385954","description":"Error received from peer ipv4:10.233.67.100:2379","file":"src/core/lib/surface/call.cc","file_line":1069,"grpc_message":"etcdserver: request timed out","grpc_status":14}" > During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/cotyledon/_utils.py", line 95, in exit_on_exception yield File "/usr/local/lib/python3.9/site-packages/cotyledon/_service.py", line 139, in _run self.run() File "/opt/has/conductor/conductor/controller/translator_svc.py", line 256, in run fut.result() File "/usr/local/lib/python3.9/concurrent/futures/_base.py", line 440, in result return self.__get_result() File "/usr/local/lib/python3.9/concurrent/futures/_base.py", line 389, in __get_result raise self._exception File "/usr/local/lib/python3.9/site-packages/futurist/_utils.py", line 49, in run result = self.fn(*self.args, **self.kwargs) File "/opt/has/conductor/conductor/controller/translator_svc.py", line 202, in __check_for_templates translating_plans = self.Plan.query.get_plan_by_col("status", self.Plan.TRANSLATING) File "/opt/has/conductor/conductor/common/music/model/search.py", line 87, in get_plan_by_col rows = db_backend.DB_API.row_read( File "/opt/has/conductor/conductor/common/etcd/api.py", line 130, in row_read schema = self.get_value(f'{keyspace}/{table}') File "/opt/has/conductor/conductor/common/etcd/api.py", line 75, in get_value raw_value = self.get_raw_value(key) File "/opt/has/conductor/conductor/common/etcd/api.py", line 72, in get_raw_value return self.get_client().get(key)[0] File "/opt/has/conductor/conductor/common/etcd/api.py", line 69, in get_client raise EtcdClientException("Failed to establish connection with ETCD. GRPC {}".format(rpc_error.code())) conductor.common.etcd.utils.EtcdClientException: Failed to establish connection with ETCD. GRPC StatusCode.UNAVAILABLE 2022-04-10 03:50:02,314||139847921457952|INFO|_service_manager|cotyledon._service_manager: [-] Child 190 exited with status 2