Results

          2021-06-13 22:47:29,015|None|140419391355680|INFO|service|conductor.reservation.service:  [-] plan id: healthcheck [-] Reservation starts, changing the template status from solved to reserving, atomic update response from MUSIC SUCCESS
2021-06-13 22:47:29,016|None|140419391355680|INFO|service|conductor.reservation.service:  [-] plan id: healthcheck [-] Plan healthcheck with request id foo is reserving by machine dev-oof-has-reservation-6b565b6d7c-45v6t. Tried to reserve it for 1 times.
2021-06-13 22:47:29,016|None|140419391355680|ERROR|service|conductor.reservation.service:  [-] plan id: healthcheck [-] no conductor_solver in translation for Plan healthcheck
2021-06-13 22:47:29,017|None|140419391355680|INFO|service|conductor.reservation.service:  [-] plan id: healthcheck [-] Plan healthcheck with request id foo Reservation complete
2021-06-13 22:47:29,258|None|140419391355680|INFO|service|conductor.reservation.service:  [-] plan id: healthcheck [-] Reservation is complete, changing the template status from reserving to done, atomic update response from MUSIC SUCCESS
2021-06-14 00:00:10,012|None|140419391355680|ERROR|_utils|cotyledon._utils:  [-] plan id: healthcheck [-] Unhandled exception
Traceback (most recent call last):
  File "/opt/has/conductor/conductor/common/etcd/api.py", line 60, in get_client
    return etcd3.client(host=self.host, port=self.port,
  File "/usr/local/lib/python3.9/site-packages/etcd3/client.py", line 1178, in client
    return Etcd3Client(host=host,
  File "/usr/local/lib/python3.9/site-packages/etcd3/client.py", line 148, in __init__
    resp = self.auth_stub.Authenticate(auth_request, self.timeout)
  File "/usr/local/lib/python3.9/site-packages/grpc/_channel.py", line 946, in __call__
    return _end_unary_response_blocking(state, call, False, None)
  File "/usr/local/lib/python3.9/site-packages/grpc/_channel.py", line 849, in _end_unary_response_blocking
    raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "etcdserver: request timed out"
	debug_error_string = "{"created":"@1623628810.010298395","description":"Error received from peer ipv4:10.242.105.10:2379","file":"src/core/lib/surface/call.cc","file_line":1067,"grpc_message":"etcdserver: request timed out","grpc_status":14}"
>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/cotyledon/_utils.py", line 95, in exit_on_exception
    yield
  File "/usr/local/lib/python3.9/site-packages/cotyledon/_service.py", line 139, in _run
    self.run()
  File "/opt/has/conductor/conductor/reservation/service.py", line 264, in run
    solved_plans = self.Plan.query.get_plan_by_col("status", self.Plan.SOLVED)
  File "/opt/has/conductor/conductor/common/music/model/search.py", line 87, in get_plan_by_col
    rows = db_backend.DB_API.row_read(
  File "/opt/has/conductor/conductor/common/etcd/api.py", line 134, in row_read
    return self.get_values_prefix(key_prefix, pk_name, pk_value)
  File "/opt/has/conductor/conductor/common/etcd/api.py", line 80, in get_values_prefix
    for kv in self.get_client().get_prefix(key_prefix)}
  File "/opt/has/conductor/conductor/common/etcd/api.py", line 67, in get_client
    raise EtcdClientException("Failed to establish connection with ETCD. GRPC {}".format(rpc_error.code()))
conductor.common.etcd.utils.EtcdClientException: Failed to establish connection with ETCD. GRPC StatusCode.UNAVAILABLE
2021-06-14 00:00:10,400||140419393477408|INFO|_service_manager|cotyledon._service_manager: [-] Child 151 exited with status 2